PSI OpenMPI modules not loading correctly
The following issues are observed for Pmodules/1.1.22
- Loading both gcc and openmpi, only load gcc (see example below). Loading openmpi after gcc, works.
- Cray modules are loaded again when loading PSI modules (which do not rely on any Cray module, at least for that compilation). The environment should be clean.
🔥 [caubet_m@cn080:~/git/buildblocks(openmpi_merlin7)]# module search openmpi
Module Rel.stage Group Overlay Requires
--------------------------------------------------------------------------------
openmpi/4.1.6_slurm unstable Compiler Alps gcc/12.3.0
openmpi/5.0.5_slurm unstable Compiler Alps gcc/12.3.0
🔥 [caubet_m@cn080:~/git/buildblocks(openmpi_merlin7)]#
🔥 [caubet_m@cn080:~/git/buildblocks(openmpi_merlin7)]# # module load gcc/12.3.0 openmpi/5.0.5_slurm
🔥 [caubet_m@cn080:~/git/buildblocks(openmpi_merlin7)]# module list
Currently Loaded Modules:
1) craype-x86-rome 2) libfabric/1.15.2.0
3) craype-network-ofi
4) xpmem/2.8.2-1.0_5.1__g84a27a5.shasta 5) PrgEnv-cray/8.5.0
6) cce/17.0.0 7) cray-dsmml/0.2.2
8) cray-libsci/23.12.5 9) cray-mpich/8.1.28
10) craype/2.7.30 11) perftools-base/23.12.0
12) cpe/23.12 13) cray/23.12
14) libevent/2.1.12
🔥 [caubet_m@cn080:~/git/buildblocks(openmpi_merlin7)]# module purge
Unloading the cpe module is insufficient to restore the system defaults.
Please run 'source /opt/cray/pe/cpe/23.12/restore_lmod_system_defaults.[csh|sh]'.
Inactive Modules:
1) cce/17.0.0
🔥 [caubet_m@cn080:~/git/buildblocks(openmpi_merlin7)]# module load gcc/12.3.0 openmpi/5.0.5_slurm
Activating Modules:
1) cce/17.0.0
Lmod is automatically replacing "cce/17.0.0" with "gcc-native/12.3".
Lmod is automatically replacing "PrgEnv-cray/8.5.0" with "PrgEnv-gnu/8.5.0".
Due to MODULEPATH changes, the following have been reloaded:
1) cray-libsci/23.12.5 2) cray-mpich/8.1.28
module list
Unloading the cpe module is insufficient to restore the system defaults.
Please run 'source /opt/cray/pe/cpe/23.12/restore_lmod_system_defaults.[csh|sh]'.
Lmod is automatically replacing "PrgEnv-cray/8.5.0" with "PrgEnv-gnu/8.5.0".
Lmod is automatically replacing "cce/17.0.0" with "gcc-native/12.3".
which
Lmod is automatically replacing "gcc-native/12.3" with "cce/17.0.0".
Lmod is automatically replacing "cce/17.0.0" with "gcc-native/12.3".
Lmod is automatically replacing "PrgEnv-cray/8.5.0" with "PrgEnv-gnu/8.5.0".
module load: module conflicts with already loaded modules -- gcc/12.3.0
🔥 [caubet_m@cn080:~/git/buildblocks(openmpi_merlin7)]# module list
Currently Loaded Modules:
1) craype-x86-rome 2) libfabric/1.15.2.0
3) craype-network-ofi
4) xpmem/2.8.2-1.0_5.1__g84a27a5.shasta 5) perftools-base/23.12.0
6) cpe/23.12 7) cray/23.12
8) gcc-native/12.3 9) craype/2.7.30
10) cray-dsmml/0.2.2 11) cray-mpich/8.1.28
12) cray-libsci/23.12.5 13) PrgEnv-gnu/8.5.0
14) gcc/12.3.0
🔥 [caubet_m@cn080:~/git/buildblocks(openmpi_merlin7)]# which mpirun
which: no mpirun in (/opt/cray/pe/mpich/8.1.28/ofi/gnu/12.3/bin:/opt/cray/pe/mpich/8.1.28/bin:/opt/cray/pe/craype/2.7.30/bin:/opt/cray/pe/perftools/23.12.0/bin:/opt/cray/pe/papi/7.0.1.2/bin:/opt/cray/libfabric/1.15.2.0/bin:/opt/psi/Programming/gcc/12.3.0/bin:/data/user/caubet_m/software/ior_latest/bin:/data/user/caubet_m/.krew/bin:/data/user/caubet_m/Documents/Git/hub.com/mcaubet/tmux:/home/caubet_m/GIT/GITHUB/dcache-shellutils/bin:/data/user/caubet_m/Software/emacs/current/bin
:/data/user/caubet_m/Software/general/bin:/usr/local/bin:/usr/bin:/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin:/opt/cray/pe/bin)
🔥 [caubet_m@cn080:~/git/buildblocks(openmpi_merlin7)]# module load openmpi/5.0.5_slurm
module load: unstable module has been loaded -- cuda/12.2.0
module load: unstable module has been loaded -- openmpi/5.0.5_slurm