Loading...
Please wait, while we are loading the content...
Similar Documents
MPI and OpenMP paradigms on cluster of SMP architectures: the vacancy tracking algorithm for multi-dimensional array transposition (2002)
| Content Provider | CiteSeerX |
|---|---|
| Author | Ding, Chris H. Q. He, Yun |
| Description | In Proceedings of the 2002 ACM/IEEE conference on Supercomputing in Proceedings of the 2002 ACM/IEEE conference on Supercomputing |
| Abstract | Abstract. We evaluate remapping multi-dimensional arrays on cluster of SMP architectures under OpenMP, MPI, and hybrid paradigms. Traditional method of multi-dimensional array transpose needs an auxiliary array of the same size and a copy back stage. We recently developed an in-place method using vacancy tracking cycles. The vacancy tracking algorithm outperforms the traditional 2-array method as demonstrated by extensive comparisons. Performance of multi-threaded parallelism using OpenMP are first tested with different scheduling methods and different number of threads. Both methods are then parallelized using several parallel paradigms. At node level, pure OpenMP outperforms pure MPI by a factor of 2.76 for vacancy tracking method. Across entire cluster of SMP nodes, by carefully choosing thread numbers, the hybrid MPI/OpenMP implementation outperforms pure MPI by a factor of 3.79 for traditional method and 4.44 for vacancy tracking method, demonstrating the validity of the parallel paradigm of mixing MPI with OpenMP. |
| File Format | |
| Publisher Date | 2002-01-01 |
| Access Restriction | Open |
| Subject Keyword | Pure Mpi Multi-threaded Parallelism Multi-dimensional Array Transpose Smp Node Traditional 2-array Method Extensive Comparison Entire Cluster Smp Architecture Multi-dimensional Array Transposition Hybrid Paradigm In-place Method Multi-dimensional Array Several Parallel Paradigm Hybrid Mpi Openmp Implementation Node Level Parallel Paradigm Thread Number Pure Openmp Auxiliary Array |
| Content Type | Text |
| Resource Type | Proceeding Conference Proceedings Article |