feat(ingest): improve CI batches #14239
Conversation
github-actions
bot
added
ingestion
Codecov Report✅ All modified and coverable lines are covered by tests. 📢 Thoughts on this report? Let us know! |
datahub-cyborg
bot
added
the
needs-review
| @@ -63,6 +63,9 @@ markers = | |||
| integration_batch_0: mark tests to run in batch 0 of integration tests. This is done mainly for parallelization in CI. Batch 0 is the default batch. | |||
| integration_batch_1: mark tests to run in batch 1 of integration tests | |||
| integration_batch_2: mark tests to run in batch 2 of integration tests | |||
| integration_batch_3: mark tests to run in batch 3 of integration tests (mostly powerbi) | |||
There was a problem hiding this comment.
Is it true there are two mostly powerbi batches?
There was a problem hiding this comment.
yeah. somehow the m query parser is extremely slow, so the powerbi tests alone take ~24 minutes. so I split them into two batches
datahub-cyborg
bot
added
pending-submitter-merge
and removed
needs-review
🤖 PR Nanny Status: ✅ All Checks PassingLast updated: 2025-07-28 17:37:44 UTC / 2025-07-28 10:37:44 PDT I'm monitoring this PR and all critical checks are currently passing. I'll automatically retry any critical checks that fail in the future. 🧠 Can't debug failures? Get instant AI insights - Get PR Nanny |
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
🚫 [actionlint] reported by reviewdog 🐶
property "extra_pip_extras" is not defined in object type {extra_pip_constraints: string; extra_pip_requirements: string; python-version: number} [expression]
|
Airflow tests broke due to an unrelated PR, reverting to fix that here #14248 |
Uh oh!
There was an error while loading. Please reload this page.