Simulator test suite for evaluating performance of multithreaded Message passing interface execution on SUN cluster

Authors

  • Samera Hamad Mahmud University Omar Al-Mukhtar

DOI:

https://doi.org/10.37376/1571-000-040-008

Keywords:

Message passing interface (MPI), Performance measurement, Multithreading

Abstract

The Message Passing Interface Standard (MPI) is a message passing library standard based on the consensus of the MPI Forum, which has over 40 participating organizations, including vendors, researchers, software library developers, and users. The goal of the Message Passing Interface is to establish a portable, efficient, and flexible standard for message passing that will be widely used for writing message passing programs. As such, MPI is the first standardized, vendor independent, message-passing library. The advantages of developing message passing software using MPI closely match the design goals of portability, efficiency, and flexibility. MPI is not an IEEE or ISO standard, but has, in fact, become the "industry standard" for writing message passing programs on HPC platforms. As parallel systems are commonly being built out of increasingly large multicore chips, Application programmers are exploring the use of hybrid programming models combining MPI  across nodes and multithreading within a node. Many MPI implementations, however, are just starting to support, multithreaded MPI communication, often focusing on correctness First and performance later. The MPI implementation defines functions that can be used for initializing the thread environment. It is not required that all MPI implementations fulfill all the requirements which are All MPI calls are thread-safe and Blocking MPI calls. MPI process is a process that may be multi-threaded. Each thread can issue MPI calls. The MPI Standard, however, requires only that no MPI call in one thread block MPI calls in other threads; it makes no performance guarantees. In this paper propose a test suite to measure the performance. The test has seven benchmarks which are overhead of MPI_thread_multiple level for thread safety, concurrent bandwidth, concurrent latency, concurrent short-long messages, communication/computation overlap, concurrent collective and concurrent collective and computation.

Downloads

Download data is not yet available.

References

Sadik G. Caglar, Gregory D. Benson, Qing Huang, Cho-Wai Chu, USFMPI: a multi-threaded implementation of MPI for Linux clusters, in: Proceedings of the IASTED Conference on Parallel and Distributed Computing and Systems, 2003.

Erik D. Demaine, A threads-only MPI implementatin for the development of parallel programs, in: Proceedings of the 11th International Symposium on High Performance Computing Systems, July 1997, pp. 153–163.

Francisco Garcı´ a, Alejandro Calderon, Jesus Carretero, MiMPI: a multithread-safe implementation of MPI, in: Recent Advances in Parallel Virtual Machine and Message Passing Interface, Sixth European PVM/MPI Users’ Group Meeting, Lecture Notes in Computer Science, vol. 1697, Springer, September 1999, pp. 207–214.

William Gropp, Rajeev Thakur, Thread safety in an MPI implementation: requirements and analysis, Parallel Computing 33 (9) (2007) 595–604.

IEEE/ANSI Std, 1003.1. Portable Operating System Interface (POSIX)–Part 1: System Application Program Interface (API) [C Language], 1996 edition.

Intel MPI benchmarks. http://www.intel.com.

Edward A. Lee, The problem with threads, Computer 39 (5) (2006) 33–42.

Message Passing Interface Forum, MPI-2: Extensions to the Message-Passing Interface, July 1997. http://www.mpi-forum.org/docs/docs.html.

OpenMP. http://www.openmp.org.

OSU MPI benchmarks. http://mvapich.cse.ohio-state.edu/benchmarks.

Tomas Plachetka. (Quasi-) thread-safe PVM and (quasi-) thread-safe MPI without active polling, in: Recent Advances in Parallel Virtual Machine and Message Passing Interface, Ninth European PVM/MPI Users’ Group Meeting, Lecture Notes in Computer Science, vol. 2474, Springer, September 2002, pp. 296–305.

Boris V. Protopopov, Anthony Skjellum, A multithreaded message passing interface (MPI) architecture: performance and program issues, Journal of Parallel and Distributed Computing 61 (4) (2001) 449–466.

Ralf Reussner, Peter Sanders, Jesper Larsson Traff, SKaMPI: a comprehensive benchmark for public benchmarking of MPI, Scientific Programming 10 (1) (2002) 55–65.

Anthony Skjellum, Boris Protopopov, Shane Hebert, A thread taxonomy for MPI, in: Proceedings of the Second MPI Developers Conference, June 1996, p. 50–57.

] Hong Tang, Tao Yang, Optimizing threaded MPI execution on SMP clusters, in: Proceedings of the 15th ACM International Conference on Supercomputing, June 2001, pp. 381–392.

https://computing.llnl.gov/tutorials/mpi/.

http://www.redbooks.ibm.com.

http://www.ssh.com/products/ssh_secure_shell/

Downloads

Published

2024-05-13

How to Cite

Hamad Mahmud, S. . (2024). Simulator test suite for evaluating performance of multithreaded Message passing interface execution on SUN cluster. Journal of Science and Humanities- Faculty of Arts and Science Al – Marj, (40), 1–16. https://doi.org/10.37376/1571-000-040-008

Issue

Section

Articles