Skip to content

Distributed standalone driver#1102

Merged
jcanton merged 665 commits intomainfrom
distributed_standalone_driver
Apr 28, 2026
Merged

Distributed standalone driver#1102
jcanton merged 665 commits intomainfrom
distributed_standalone_driver

Conversation

@jcanton
Copy link
Copy Markdown
Contributor

@jcanton jcanton commented Mar 10, 2026 •
edited
Loading

add distributed standalone driver

msimberg and others added 30 commits March 4, 2026 15:18
@msimberg
Add specialized mask_prog_halo_c test
a397e0a
@msimberg
Merge remote-tracking branch 'origin/halo_construction' into halo_con…
d0acad4 
…struction
@msimberg
Merge remote-tracking branch 'origin/main' into halo_construction
d949e44
@msimberg
Update array_ns_from_array after merge
d2d8faf
@msimberg
Update tested fields in test_parallel_grid_manager.py after merge
95a676f
@nfarabullini
Merge branch 'main' into distributed-tests-dace-gpu
47d0e63
@nfarabullini
modified np strict references with broader array_ns
ce21e8f
@msimberg
Simplify test_halo.py
214fbe9
@msimberg
Remove empty pytest file
0d33ee4
@msimberg
Disable r01b01 grid for testing for now
1f632ab
@msimberg
Fix formatting
a62e6e3
@msimberg
Ignore commented out code
c367428
@msimberg
Small cleanup refactoring in halo construction
1975443
@msimberg
Update decomposition info with_dimension call to set_dimension
19abd25
@nfarabullini
Merge branch 'main' into ci_for_standalone_driver
4bf0618
@msimberg
Explicitly convert np.bool_ to bool
0d10792
@nfarabullini
adjusted tolerances
cecea11
@nfarabullini
Merge branch 'ci_for_standalone_driver' of https://github.com/C2SM/ic…
3013e78 
…on4py into ci_for_standalone_driver
@nfarabullini
Merge branch 'main' into distributed-tests-dace-gpu
74938f3
@msimberg
Remove unnecessary test
f6fd95f
@nfarabullini
replaced a few more np with array_ns
03fb537
@nfarabullini
Update interpolation_fields.py
878db70
@nfarabullini
ran pre-commit
c449030
@nfarabullini
removed additional but unused return val
9460369
@nfarabullini
edit for scipy func to flexible gpu/cpu func
d96956a
@msimberg
Constrain xfail a bit more
c343334
@nfarabullini
Update interpolation_fields.py
c3606ae
@nfarabullini
replaced gt4py field operator within regular function to regular pyth…
890166a 
…on code
@nfarabullini
ran pre-commit
81375ca
@msimberg
Add domain sizes
da60b19
@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 24, 2026

cscs-ci run default

@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 24, 2026

cscs-ci run distributed

nfarabullini
nfarabullini reviewed Apr 24, 2026
View reviewed changes
Comment thread model/common/src/icon4py/model/common/decomposition/definitions.py
Comment thread model/common/src/icon4py/model/common/decomposition/mpi_decomposition.py Outdated
Comment thread model/common/src/icon4py/model/common/decomposition/mpi_decomposition.py
Comment thread model/common/src/icon4py/model/common/utils/env.py Outdated
Comment thread model/common/src/icon4py/model/common/utils/env.py Outdated
@msimberg msimberg mentioned this pull request Apr 27, 2026
Open
jcanton and others added 2 commits April 27, 2026 16:00
@jcanton @nfarabullini
Update model/common/src/icon4py/model/common/decomposition/definition…
265fbad 
…s.py

Co-authored-by: Nicoletta Farabullini <41536517+nfarabullini@users.noreply.github.com>
@jcanton @nfarabullini
Update model/common/src/icon4py/model/common/decomposition/mpi_decomp…
86251cd 
…osition.py

Co-authored-by: Nicoletta Farabullini <41536517+nfarabullini@users.noreply.github.com>
@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 27, 2026

cscs-ci run default

@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 27, 2026

cscs-ci run distributed

@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 27, 2026

cscs-ci run default

@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 27, 2026

cscs-ci run distributed

@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 28, 2026

cscs-ci run default

@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 28, 2026

cscs-ci run distributed

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 28, 2026

Mandatory Tests

Please make sure you run these tests via comment before you merge!

  • cscs-ci run default
  • cscs-ci run distributed

Optional Tests

To run benchmarks you can use:

  • cscs-ci run benchmark-bencher

To run tests and benchmarks with the DaCe backend you can use:

  • cscs-ci run dace

To run test levels ignored by the default test suite (mostly simple datatest for static fields computations) you can use:

  • cscs-ci run extra

For more detailed information please look at CI in the EXCLAIM universe.

@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 28, 2026

cscs-ci run default

@jcanton
Copy link
Copy Markdown
Contributor Author

jcanton commented Apr 28, 2026

cscs-ci run distributed

@msimberg msimberg mentioned this pull request Apr 28, 2026
Open
@jcanton jcanton merged commit 19dbbd0 into main Apr 28, 2026
54 checks passed
@msimberg msimberg deleted the distributed_standalone_driver branch April 28, 2026 11:01
jcanton added a commit to msimberg/icon4py that referenced this pull request Apr 28, 2026
@jcanton
Merge branch 'main' into rgw-test-data
2a2489b 
* main:
  Distributed standalone driver (C2SM#1102)
  Added smagorinsky coefficients, iforcing, turbulence coeffs and extra_diffu to interface (C2SM#1192)
  Fix cupy/numpy usage in metis decomposition (C2SM#1212)
  py2fgen: expose main for module use (C2SM#1216)
  Fix plot script for blueline perf (C2SM#1209)
jcanton added a commit that referenced this pull request May 4, 2026
@jcanton
Merge branch 'main' into copilot/make-variable-names-consistent
53a475e 
* main: (21 commits)
  Add persistent gt4py cache for github workflows (#1220)
  Fix typo in EDGE_TANGENT_Z definition (#1230)
  Update MPI test initialization (#1223)
  Vectorize static field computations (#1198)
  Add notes on common issues with ghex and mpi4py on alps (#1221)
  Add AGENTS.md (#1204)
  fix d2dexdz2_fac2_mc bug in `driver_utils.py` (#1225)
  Remove dace orchestration functionality (#1227)
  Remove FrozenNameSpace in graupel and dycore (#1201)
  Pull test data from CSCS object store (#1191)
  Fix typo in field names in driver_utils.py (#1226)
  Fix unnecessary use of `xp.ones` (#1222)
  Distributed standalone driver (#1102)
  Added smagorinsky coefficients, iforcing, turbulence coeffs and extra_diffu to interface (#1192)
  Fix cupy/numpy usage in metis decomposition (#1212)
  py2fgen: expose main for module use (#1216)
  Fix plot script for blueline perf (#1209)
  Rewrite download infrastructure with pooch (#1182)
  Muphys: remove frozen namespaces (#1202)
  Rename ProcessProperties variables to consistent `process_props` naming (#1175)
  ...
jcanton added a commit that referenced this pull request May 4, 2026
@jcanton
Merge branch 'main' into copilot/clean-up-math-module
1d00a72 
* main:
  Add persistent gt4py cache for github workflows (#1220)
  Fix typo in EDGE_TANGENT_Z definition (#1230)
  Update MPI test initialization (#1223)
  Vectorize static field computations (#1198)
  Add notes on common issues with ghex and mpi4py on alps (#1221)
  Add AGENTS.md (#1204)
  fix d2dexdz2_fac2_mc bug in `driver_utils.py` (#1225)
  Remove dace orchestration functionality (#1227)
  Remove FrozenNameSpace in graupel and dycore (#1201)
  Pull test data from CSCS object store (#1191)
  Fix typo in field names in driver_utils.py (#1226)
  Fix unnecessary use of `xp.ones` (#1222)
  Distributed standalone driver (#1102)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@havogt havogt havogt left review comments

@OngChia OngChia OngChia left review comments

Copilot code review Copilot Copilot left review comments

@msimberg msimberg msimberg approved these changes

@nfarabullini nfarabullini nfarabullini approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@jcanton @nfarabullini @msimberg @havogt @OngChia