Running MPI Software on Sol
Depending on the MPI stack used to build the application, the process of running MPI software will differ. Below is a concise guide outlining the various MPI stacks along with the corresponding module and run commands to employ.
openmpi 4.1.5 / hpcx 2.13.1
Load with: module load openmpi/4.1.5
or module load hpcx/2.13.1
Run with: srun --export=ALL --mpi=pmix "./my-simulation"
Built with gcc11.2.0
Provides: OpenMPI 4.1.5 compilers
Example script: /packages/public/sol-sbatch-templates/template/example-mpi-with-hpcx-job/main.sh
mpich 4.1.2
Load with: module load mpich/4.2.2
Run with: mpirun -launcher slurm "./my-simulation"
Built with: gcc8.5.0
Provides: MPICH 4.1.2 compilers
Example script: /packages/public/sol-sbatch-templates/template/example-mpi-with-mpich-job/main.sh
mvapich 3.0b
Load with: module load mvapich/3.0b
Run with: mpirun -launcher slurm "./my-simulation"
Built with: gcc8.5.0
Provides: MVAPICH 3.0b compilers
Example script: /packages/public/sol-sbatch-templates/template/example-mpi-with-mvapich-job/main.sh
intel parallel studio 2020.4
Load with: module load intel/parallel-studio-2020.4
Run with: mpiexec.hydra -genvall "./my-simulation"
Packaged with: icc
Provides: Intel MPI Library for Linux, V. 2019 Update 9 Build 20200923
Example script: /packages/public/sol-sbatch-templates/template/example-mpi-with-intel-job/main.sh
intel oneapi 2022.1.0
Load with: module load intel/intel-oneapi-2022.1.0
Run with: mpiexec.hydra -genvall "./my-simulation"
Packaged with: icc
Provides: Intel MPI Library for Linux, V. Version 2021.10 Build 20230619
No example script provided
Â