Skip to content

Conversation

@MagellaX
Copy link
Contributor

@MagellaX MagellaX commented Feb 2, 2026

Adds run_dataset_async to fan out run_single_task calls with an asyncio concurrency cap.
Supports group_size runs per task and returns a flat list of Trace results.
Includes focused tests for the async runner’s behavior and grouping.


Note

Medium Risk
Introduces new concurrency and error-handling behavior around task execution; failures are now captured per-task and returned as error Traces, so ordering/throughput and partial-failure semantics should be validated.

Overview
Adds run_dataset_async as a new public API to execute datasets by concurrently fanning out run_single_task calls with an asyncio semaphore cap, optional group_size repeats, and deterministic result ordering.

Updates the datasets package exports to include run_dataset_async, and adds tests covering empty input validation and group_size repetition/trace naming.

Written by Cursor Bugbot for commit f6ff476. This will update automatically on new commits. Configure here.

Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 579b4f0df5

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@MagellaX MagellaX force-pushed the feature/async-dataset-runner branch from 579b4f0 to 0438be6 Compare February 2, 2026 08:22
Copy link

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.

@MagellaX MagellaX force-pushed the feature/async-dataset-runner branch from e0e9463 to f6ff476 Compare February 2, 2026 09:08
@MagellaX
Copy link
Contributor Author

MagellaX commented Feb 4, 2026

any thoughts bro?? @lorenss-m

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant