Add prgenv-gnu-openmpi with OpenMPI #263

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Draft

msimberg wants to merge 48 commits into eth-cscs:main from msimberg:prgenv-gnu-ompi

Collaborator

msimberg commented Oct 29, 2025 •

edited

Loading

No description provided.

msimberg added 15 commits

October 3, 2025 14:16


          Add test recipe for next version of prgenv-gnu with upsteam libfabric…

a8ccde1

… and xpmem


          Add prgenv-gnu/next to config

466a169


          No zen for prgenv-gnu/next

0ea7a0e


          Use special branch of alps-cluster-config

ab2e9bb


          Disable xpmem kernel-module

1ae291c


          Use GCC 14.2 again

f2b9f01


          Use libfabric 2.3

e80770d


          Add +gdrcopy variant to libfabric in prgenv-gnu/next

7cfa922


          Don't exclude gcc module

7ae62d1


          Don't use custom alps-cluster-config

04027f8


          Move prgenv-gnu/next to prgenv-gnu/25.11

e42a796


          Remove custom xpmem from prgenv-gnu

fb5a928


          Add prgenv-gnu/25.11 mc recipe

25124f1


          Try gcc 14.3 again for prgenv-gnu/25.11

c649e60


          Add openmpi view to prgenv-gnu/25.11

46675fb

Collaborator Author

msimberg commented Oct 29, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu:25.6

msimberg added 2 commits

October 29, 2025 12:23


          Use gcc 14.2 again in prgenv-gnu/25.11

c769617


          Merge branch 'prgenv-gnu-next' into prgenv-gnu-ompi

ee2d15e

Collaborator Author

msimberg commented Oct 29, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu:25.11

Collaborator Author

msimberg commented Oct 29, 2025

Hmm, I think https://gitlab.com/cscs-ci/ci-testing/webhook-ci/mirrors/551234120955960/1440398897047560/-/jobs/11893599733#L3276 means that we can't (don't want?) two environments in the same uenv:

==> Error: Name clashes detected in module files:

Unless we can or want to disambiguate the modules with custom module names. I'll make a separate uenv for now.


          Move openmpi environment to separate uenv

d1b83c6

Collaborator Author

msimberg commented Oct 29, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu:25.11

Collaborator Author

msimberg commented Oct 29, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.11


          Fix config.yaml

f84670a

Collaborator Author

msimberg commented Oct 29, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.11


          No openmpi on eiger, for now...

d9ea85b

Collaborator Author

msimberg commented Oct 29, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.11


          Rename openmpi view

e3647d7

Collaborator Author

msimberg commented Oct 29, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.11

Member

bcumming commented Oct 29, 2025

Hmm, I think https://gitlab.com/cscs-ci/ci-testing/webhook-ci/mirrors/551234120955960/1440398897047560/-/jobs/11893599733#L3276 means that we can't (don't want?) two environments in the same uenv:
==> Error: Name clashes detected in module files:
Unless we can or want to disambiguate the modules with custom module names. I'll make a separate uenv for now.

The alternative is to not provide modules? That would probably be quite disruptive to existing users trying to upgrade, so separate uenv is probably the way to go for now.

msimberg commented

View reviewed changes

recipes/prgenv-gnu-openmpi/25.11/gh200/environments.yaml Outdated Show resolved Hide resolved


          Merge remote-tracking branch 'origin/main' into prgenv-gnu-ompi

b3bba95

msimberg commented

View reviewed changes

recipes/prgenv-gnu-openmpi/25.11/repo/packages/libfabric/package.py Outdated Show resolved Hide resolved

msimberg and others added 3 commits

November 25, 2025 09:37


          Remove extra prgenv-gnu config entry

0f39f0a


          Merge remote-tracking branch 'origin/main' into prgenv-gnu-ompi

5f720c2


          Remove custom repo for openmpi recipe

637aaa9

bcumming pushed a commit to eth-cscs/alps-cluster-config that referenced this pull request


          Update OpenMPI and libfabric preferences (#68)

17411bf

This PR:
- Makes libfabric version >= 2.2 the preferred choice, from upstream
source. I've set no upper bound since we really do want to be testing
the latest versions as they drop in. If anything we could set a
constraint not to use libfabric 3 if/when that release happens as that
is likely to need more testing.
- Removes the custom openmpi package, all changes are upstream and e.g.
in eth-cscs/alps-uenv#263 I anyway want to use a
very recent spack-packages commit

msimberg added 8 commits

December 2, 2025 09:26


          Fix name of openmpi uenv

ca98862


          Use simpler network spec for openmpi recipe

9639f29


          Add mc recipe for openmpi

5a8fcb2


          Bump spack-packages for openmpi recipe

c946017


          Try lifting compiler restriction in gh200 recipe

f9b9466


          Move openmpi recipe to 25.12

6535c10


          Enable openmpi recipe for eiger

3f5cfcd


          Remove repo link in openmpi recipe

e3ad543

Collaborator Author

msimberg commented Dec 2, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.12

Collaborator Author

msimberg commented Dec 2, 2025

cscs-ci run alps;system=eiger;uarch=zen2;uenv=prgenv-gnu-openmpi:25.12


          Fix config paths

f847ed6

Collaborator Author

msimberg commented Dec 2, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.12

Collaborator Author

msimberg commented Dec 2, 2025

cscs-ci run alps;system=eiger;uarch=zen2;uenv=prgenv-gnu-openmpi:25.12

Collaborator Author

msimberg commented Dec 2, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.12

Collaborator Author

msimberg commented Dec 2, 2025

cscs-ci run alps;system=eiger;uarch=zen2;uenv=prgenv-gnu-openmpi:25.12

Collaborator Author

msimberg commented Dec 2, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.12

msimberg force-pushed the prgenv-gnu-ompi branch from 9d4ec25 to 926b1e6 Compare

December 2, 2025 16:47

Collaborator Author

msimberg commented Dec 2, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.12

msimberg force-pushed the prgenv-gnu-ompi branch from 926b1e6 to f847ed6 Compare

December 3, 2025 08:58

Collaborator Author

msimberg commented Dec 3, 2025

cscs-ci run alps;system=daint;uarch=gh200;uenv=prgenv-gnu-openmpi:25.12

Collaborator Author

msimberg commented Dec 3, 2025

cscs-ci run alps;system=eiger;uarch=zen2;uenv=prgenv-gnu-openmpi:25.12

Collaborator Author

msimberg commented Dec 3, 2025

cscs-ci run alps;system=clariden;uarch=gh200;uenv=prgenv-gnu-openmpi:25.12

Collaborator Author

msimberg commented Dec 3, 2025

cscs-ci run alps;system=santis;uarch=gh200;uenv=prgenv-gnu-openmpi:25.12

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet