Skip to content

Add Advance Auto Parts and speed Workday pagination - #6430

Merged
viktor-shcherb merged 3 commits into
mainfrom
fix-crawler/workday-large-board-timeout
Aug 10, 2026
Merged

Add Advance Auto Parts and speed Workday pagination#6430
viktor-shcherb merged 3 commits into
mainfrom
fix-crawler/workday-large-board-timeout

Conversation

@viktor-shcherb

Copy link
Copy Markdown
Member

Summary

  • add Advance Auto Parts with its centralized Workday board, localized descriptions, metadata, and verified logo/icon assets
  • paginate capped Workday facet partitions with bounded concurrency
  • share the query semaphore across multi-site runs so tenant-level request concurrency remains bounded
  • add regression coverage for concurrent facet pagination

Guided-workflow evidence

The validated inventory seed matched the official Advance Auto Parts tenant. The normal probe reported 16,495 live jobs, consistent with the issue's 16,420-job inventory estimate. A full ws run monitor reached Workday's 2,000-result cap, split into 55 location facets, and was terminated before completion because those facet partitions were paginated sequentially.

Official careers research found one centralized board covering the company's regions and employing entities; localized Phenom pages are presentation mirrors of the same Workday source.

Root cause and fix

Large Workday boards require hundreds of 20-item list requests after facet splitting. The monitor streamed results per facet but awaited each complete facet serially. This change runs facet partitions concurrently behind a five-query semaphore and shares that bound across multi-site discovery. Outstanding tasks are cancelled cleanly if the global job cap is reached or the generator exits.

Validation

  • uv run pytest tests/test_workday.py — 78 passed
  • uv run ruff check src/core/monitors/workday.py tests/test_workday.py
  • uv run ws validate
  • live Advance Auto Parts monitor — 16,517 jobs, 111.7s, untruncated

Closes #6368

@viktor-shcherb
viktor-shcherb force-pushed the fix-crawler/workday-large-board-timeout branch from 3861a9e to 3eb7bfa Compare August 10, 2026 15:19
@viktor-shcherb

Copy link
Copy Markdown
Member Author

Maintainer review resolution:

  • Rebased onto current main; the Workday runtime changes are no longer duplicated here because Support nested Workday facets for TJX #6433 now provides the stricter shared implementation (nested facets, 100-value request bounds, shared five-query concurrency, direct-pagination fallback, and unique-inventory completeness checks).
  • Reused the cleaner already-uploaded cropped wordmark and icon; removed duplicate raw assets from this branch.
  • Verified company identity/metadata and corrected the canonical website and ticker/Wikidata links.
  • Fresh bounded detail sample: 10/10 clean titles and substantive descriptions (4.2–9.2 KB), 10/10 employment types and posting dates, 9/10 full-address locations. One current posting exposes only store identifier 6069; the raw Workday detail API has no richer location, so that is an upstream limitation.
  • The original full run enumerated 16,517 untruncated jobs. A repeat full run today stalled in five tenant-side requests for over 80 minutes and was stopped; it was not counted as a successful validation.
  • ws validate, 88 Workday tests, and Ruff pass. Version is 0.13.289.

@viktor-shcherb
viktor-shcherb marked this pull request as ready for review August 10, 2026 15:20
@viktor-shcherb
viktor-shcherb merged commit d6d8022 into main Aug 10, 2026
28 checks passed
viktor-shcherb added a commit that referenced this pull request Aug 10, 2026
* Fix company configuration runner audit findings (#6500)

* Fix company runner audit findings

* Tighten API inventory completeness checks

* Support nested Workday facets for TJX (#6433)

* Support nested Workday facets for TJX

* Complete Workday inventories safely

* Bump crawler version

---------

Co-authored-by: Codex <codex@openai.com>

* Bump grafana/alloy from v1.18.0 to v1.18.1 in /apps/crawler (#6479)

* Bump grafana/alloy from v1.18.0 to v1.18.1 in /apps/crawler

Bumps grafana/alloy from v1.18.0 to v1.18.1.

---
updated-dependencies:
- dependency-name: grafana/alloy
  dependency-version: v1.18.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update Alloy deployment pins

* Bump crawler version

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Viktor Shcherbakov <viktoroo.sch@gmail.com>

* Add Advance Auto Parts and speed Workday pagination (#6430)

* Add Advance Auto Parts and speed Workday pagination

* Polish Advance Auto Parts configuration

* Bump crawler version to 0.13.289

---------

Co-authored-by: Codex <codex@openai.com>

* Add Dollar Tree and support nested Workday facets (#6373)

* Add Dollar Tree and fix Workday pagination

* Upload images to R2

* Polish Dollar Tree configuration

* Bump crawler version to 0.13.290

---------

Co-authored-by: Codex <codex@openai.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fix Workday pagination for large tenants (#6424)

* Fix Workday pagination for large tenants

* Polish CVS Health configuration and assets

* Bump crawler version to 0.13.291

* Upload images to R2

---------

Co-authored-by: Codex <codex@openai.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fix Workday nested facets and add O'Reilly Auto Parts (#6375)

* Fix Workday nested facet partitioning

* Upload images to R2

* Polish O'Reilly Auto Parts configuration

* Bump crawler version to 0.13.292

---------

Co-authored-by: Codex <codex@openai.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Add REWE Group crawler support (#6377)

* Add REWE Group crawler support

* Upload images to R2

* Harden REWE pagination and minified asset

* Bump crawler version to 0.13.293

* Upload images to R2

---------

Co-authored-by: Codex <codex@openai.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Add AutoZone (#6422)

* Fix Oracle HCM pagination and add AutoZone

* Tighten AutoZone crawler integration

* Bump crawler version to 0.13.294

* Upload images to R2

---------

Co-authored-by: Codex <codex@openai.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Add Circle K and fix Talent.vn extraction (#6432)

* Add Circle K crawler support

* Harden Circle K data quality and assets

* Bump crawler version to 0.13.295

* Upload images to R2

---------

Co-authored-by: Codex <codex@openai.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Reconfigure DHL (#6436)

* Configure DHL

Closes #6389

* Upload images to R2

* Fix DHL board completeness and detail quality

---------

Co-authored-by: Codex <codex@openai.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Add Trinity Health with PracticeMatch support (#6437)

* Add Trinity Health with PracticeMatch support

* Fix PracticeMatch request protocol and Trinity metadata

* Upload images to R2

* Allow PracticeMatch company PR checks

---------

Co-authored-by: Codex <codex@openai.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Add Checkers & Rally's (#6438)

* Configure Checkers & Rally's

Closes #6391

* Upload images to R2

* Add Checkers corporate identity metadata

---------

Co-authored-by: Codex <codex@openai.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Add Accor with WTTJ monitor

* Harden Accor data and asset quality

* Upload images to R2

* Allow Welcome to the Jungle PR checks

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add company: Advance Auto Parts, Inc

2 participants