Containerizing Parallel MPI-based HPC Applications
A. Bukhamsin and A. Schonewille
Event name: Third EAGE Workshop on High Performance Computing for Upstream
Session: Containers and Clouds
Publication date: 01 October 2017
Info: Extended abstract, PDF ( 481.73Kb )
Price: € 20
Software container technology based on Docker is a lightweight packaging and virtualization technology. These containers are used to package and run the application with all its dependencies in a portable image with minimum requirements. Because of the complexity and dependencies of HPC (High performance computing) applications, this concept can be used to pre-package HPC applications. Although Docker is already used in cloud computing, HPC implementations are lagging due to, what we believe, the nature of most HPC applications: inter-process communications and the shortcomings of spawning containerized MPI-based applications on compute resources. This paper shows our solution for containerizing HPC MPI applications and running them across multiple hosts connected with Infiniband interconnect.