Skip to content

Conversation

@pentschev
Copy link
Member

Expose functions to create UCXX communicators when launching with rrun to Python and support it with bulk_mpi_shuffle benchmark. Tests are not added in this PR because the existing pytest structure depends heavily on MPI, this will need to be done in a follow-up PR. Additionally, add a check for rrun and raise an exception in streaming_benchmark since it depends on allreduce that is currently implemented by MPI and we still don't have allreduce that's independent of MPI.

Depends on #679 .

@pentschev pentschev self-assigned this Nov 20, 2025
@pentschev pentschev requested a review from a team as a code owner November 20, 2025 11:46
@pentschev pentschev added the DO NOT MERGE Hold off on merging; see PR for details label Nov 20, 2025
@pentschev pentschev requested review from a team as code owners November 20, 2025 11:46
@pentschev pentschev added the feature request New feature or request label Nov 20, 2025
@pentschev pentschev requested a review from gforsyth November 20, 2025 11:46
@pentschev pentschev added the non-breaking Introduces a non-breaking change label Nov 20, 2025
@pentschev pentschev removed the DO NOT MERGE Hold off on merging; see PR for details label Nov 20, 2025
@quasiben
Copy link
Member

When this goes in I'll include the bulk_mpi_shuffle as part of our nightly measurement

@pentschev
Copy link
Member Author

When this goes in I'll include the bulk_mpi_shuffle as part of our nightly measurement

Only missing a review from @rapidsai/rapidsmpf-cmake-codeowners @rapidsai/rapidsmpf-cpp-codeowners @rapidsai/rapidsmpf-python-codeowners . From my end, this is good to go.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature request New feature or request non-breaking Introduces a non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants