Add Advance Auto Parts and speed Workday pagination - #6430
Merged
Conversation
This was referenced Aug 9, 2026
Closed
viktor-shcherb
force-pushed
the
fix-crawler/workday-large-board-timeout
branch
from
August 10, 2026 15:19
3861a9e to
3eb7bfa
Compare
Member
Author
|
Maintainer review resolution:
|
viktor-shcherb
marked this pull request as ready for review
August 10, 2026 15:20
viktor-shcherb
added a commit
that referenced
this pull request
Aug 10, 2026
* Fix company configuration runner audit findings (#6500) * Fix company runner audit findings * Tighten API inventory completeness checks * Support nested Workday facets for TJX (#6433) * Support nested Workday facets for TJX * Complete Workday inventories safely * Bump crawler version --------- Co-authored-by: Codex <codex@openai.com> * Bump grafana/alloy from v1.18.0 to v1.18.1 in /apps/crawler (#6479) * Bump grafana/alloy from v1.18.0 to v1.18.1 in /apps/crawler Bumps grafana/alloy from v1.18.0 to v1.18.1. --- updated-dependencies: - dependency-name: grafana/alloy dependency-version: v1.18.1 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Update Alloy deployment pins * Bump crawler version --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Viktor Shcherbakov <viktoroo.sch@gmail.com> * Add Advance Auto Parts and speed Workday pagination (#6430) * Add Advance Auto Parts and speed Workday pagination * Polish Advance Auto Parts configuration * Bump crawler version to 0.13.289 --------- Co-authored-by: Codex <codex@openai.com> * Add Dollar Tree and support nested Workday facets (#6373) * Add Dollar Tree and fix Workday pagination * Upload images to R2 * Polish Dollar Tree configuration * Bump crawler version to 0.13.290 --------- Co-authored-by: Codex <codex@openai.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Fix Workday pagination for large tenants (#6424) * Fix Workday pagination for large tenants * Polish CVS Health configuration and assets * Bump crawler version to 0.13.291 * Upload images to R2 --------- Co-authored-by: Codex <codex@openai.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Fix Workday nested facets and add O'Reilly Auto Parts (#6375) * Fix Workday nested facet partitioning * Upload images to R2 * Polish O'Reilly Auto Parts configuration * Bump crawler version to 0.13.292 --------- Co-authored-by: Codex <codex@openai.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Add REWE Group crawler support (#6377) * Add REWE Group crawler support * Upload images to R2 * Harden REWE pagination and minified asset * Bump crawler version to 0.13.293 * Upload images to R2 --------- Co-authored-by: Codex <codex@openai.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Add AutoZone (#6422) * Fix Oracle HCM pagination and add AutoZone * Tighten AutoZone crawler integration * Bump crawler version to 0.13.294 * Upload images to R2 --------- Co-authored-by: Codex <codex@openai.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Add Circle K and fix Talent.vn extraction (#6432) * Add Circle K crawler support * Harden Circle K data quality and assets * Bump crawler version to 0.13.295 * Upload images to R2 --------- Co-authored-by: Codex <codex@openai.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Reconfigure DHL (#6436) * Configure DHL Closes #6389 * Upload images to R2 * Fix DHL board completeness and detail quality --------- Co-authored-by: Codex <codex@openai.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Add Trinity Health with PracticeMatch support (#6437) * Add Trinity Health with PracticeMatch support * Fix PracticeMatch request protocol and Trinity metadata * Upload images to R2 * Allow PracticeMatch company PR checks --------- Co-authored-by: Codex <codex@openai.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Add Checkers & Rally's (#6438) * Configure Checkers & Rally's Closes #6391 * Upload images to R2 * Add Checkers corporate identity metadata --------- Co-authored-by: Codex <codex@openai.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Add Accor with WTTJ monitor * Harden Accor data and asset quality * Upload images to R2 * Allow Welcome to the Jungle PR checks --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Codex <codex@openai.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Guided-workflow evidence
The validated inventory seed matched the official Advance Auto Parts tenant. The normal probe reported 16,495 live jobs, consistent with the issue's 16,420-job inventory estimate. A full
ws run monitorreached Workday's 2,000-result cap, split into 55 location facets, and was terminated before completion because those facet partitions were paginated sequentially.Official careers research found one centralized board covering the company's regions and employing entities; localized Phenom pages are presentation mirrors of the same Workday source.
Root cause and fix
Large Workday boards require hundreds of 20-item list requests after facet splitting. The monitor streamed results per facet but awaited each complete facet serially. This change runs facet partitions concurrently behind a five-query semaphore and shares that bound across multi-site discovery. Outstanding tasks are cancelled cleanly if the global job cap is reached or the generator exits.
Validation
uv run pytest tests/test_workday.py— 78 passeduv run ruff check src/core/monitors/workday.py tests/test_workday.pyuv run ws validateCloses #6368