Skip to content

Conversation

@sjawhar
Copy link
Contributor

@sjawhar sjawhar commented Dec 7, 2025

Thank you for the contribution - we'll try to review it as soon as possible. πŸ™

TODO

  • Tests
  • Add --jobs argument to CLI

OTHER THOUGHTS

Obviously, when adding a feature like parallel execution, one of the first objections will be something like "but what if two stages can't run in parallel?". The quick answer is: then don't run in parallel!

But I think it would also be pretty easy to accommodate this in a fairly generic way. For example:

stages:
  foo:
    cmd: python blah.py
    mutex: [foobar]
    # other stage properties

  bar:
    cmd: python other_thing.py
    mutex: [foobar, also_another_one]

Probably self-explanatory, but the idea behind this is:

  • No two stages that belong to the same mutex group should be run concurrently
  • A stage can belong to arbitrarily many mutex groups
  • You can call the mutex groups whatever you want, so that they make sense to you

I'd be happy to contribute a follow-up PR with the mutex feature, if you like the idea

@github-project-automation github-project-automation bot moved this to Backlog in DVC Dec 7, 2025
@codecov
Copy link

codecov bot commented Dec 7, 2025

Codecov Report

❌ Patch coverage is 97.90210% with 3 lines in your changes missing coverage. Please review.
βœ… Project coverage is 91.02%. Comparing base (2431ec6) to head (10383e1).
⚠️ Report is 165 commits behind head on main.

Files with missing lines Patch % Lines
dvc/repo/reproduce.py 95.89% 1 Missing and 2 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #10922      +/-   ##
==========================================
+ Coverage   90.68%   91.02%   +0.34%     
==========================================
  Files         504      504              
  Lines       39795    41057    +1262     
  Branches     3141     3254     +113     
==========================================
+ Hits        36087    37372    +1285     
- Misses       3042     3048       +6     
+ Partials      666      637      -29     

β˜” View full report in Codecov by Sentry.
πŸ“’ Have feedback on the report? Share it here.

πŸš€ New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@sjawhar sjawhar force-pushed the feature/parallel-repro branch 7 times, most recently from 3edc745 to ed33d83 Compare December 14, 2025 02:27
@sjawhar sjawhar force-pushed the feature/parallel-repro branch from ed33d83 to 10383e1 Compare December 14, 2025 02:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant