Skip to content

[cudf_polars] [MINOR] Configurable dask worker memory in benchmarks #21972

Open
nirandaperera wants to merge 2 commits intorapidsai:mainfrom
nirandaperera:cudf_polars_bench_limit_dask_mem
Open

[cudf_polars] [MINOR] Configurable dask worker memory in benchmarks #21972
nirandaperera wants to merge 2 commits intorapidsai:mainfrom
nirandaperera:cudf_polars_bench_limit_dask_mem

Conversation

@nirandaperera
Copy link
Copy Markdown
Contributor

Description

This PR allows configuring dask worker memory in pdsh benchmarks. Only affects --cluster distributed without using --scheduler-address or --scheduler-file args (ie. when creating a LocalCUDACluster).

Discussion

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

Signed-off-by: niranda perera <niranda.perera@gmail.com>
@nirandaperera nirandaperera requested a review from a team as a code owner March 31, 2026 23:16
@nirandaperera nirandaperera requested review from bdice and rjzamora March 31, 2026 23:16
@nirandaperera nirandaperera added the improvement Improvement / enhancement to an existing function label Mar 31, 2026
@github-actions github-actions bot added Python Affects Python cuDF API. cudf-polars Issues specific to cudf-polars labels Mar 31, 2026
@GPUtester GPUtester moved this to In Progress in cuDF Python Mar 31, 2026
@nirandaperera nirandaperera added the non-breaking Non-breaking change label Mar 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cudf-polars Issues specific to cudf-polars improvement Improvement / enhancement to an existing function non-breaking Non-breaking change Python Affects Python cuDF API.

Projects

Status: In Progress

Development

Successfully merging this pull request may close these issues.

2 participants