Benchmark scikit-learn PR #34793 (Ridge only) - #31
Open
cakedev0 wants to merge 16 commits into
Open
Conversation
Contributor
|
Comparing |
Contributor
|
intel-gnr: scikit-learn Dashboard: https://pr-31-compare-intel-gnr.sklbench-pr-comparison.pages.dev/pr_comparison Full run: https://github.com/probabl-ai/scikit-learn-benchmarks/actions/runs/32993244861 |
Contributor
|
intel-laptop: scikit-learn Dashboard: https://pr-31-compare-intel-laptop.sklbench-pr-comparison.pages.dev/pr_comparison Full run: https://github.com/probabl-ai/scikit-learn-benchmarks/actions/runs/32993244861 |
cakedev0
added a commit
that referenced
this pull request
Aug 21, 2026
Confirmed live on PR #31: the "Validate config" step used -e reporting (and run.sh's own preflight used -e default), but implementations_for_pixi_env() rejects any PIXI_ENVIRONMENT_NAME outside its real-env allowlist - so this preflight was broken for any config calling it (all_models.py and anything derived from it, e.g. this PR's own all_models_ridge_only.py), unconditionally, regardless of which real environment would go on to run. - run.sh: drop the recently-added --validate-only preflight block and its now-unused extract_configs helper. - scripts/classify_bench_session.py: drop the now-dead special-case for run.sh's removed --validate-only header line. - .github/workflows/pr-comparison.yml: reuse run.sh directly (one invocation with two env@owner:ref entries) instead of duplicating setup_sklearn_ref.sh + sklbench calls per side - matches CONTRIBUTING.md's documented PR-vs-base comparison pattern exactly, and collapses two log files/classify calls into one. Keep a config preflight, but scoped to this workflow with a real, always-installable env (sklearn-pypi) instead of a broken one - still worth catching a typo'd config before a many-minutes sklearn-dev clone+build. - scripts/resolve_sklearn_pr.py: output the fork's `owner` (matching run.sh's env@owner:ref shorthand) instead of a full clone_url, and validate the fork's repo is actually named "scikit-learn" (what that shorthand assumes) rather than silently mishandling a differently-named fork. - tests/test_config_loading.py: register all_models_ridge_only.py in ENV_SENSITIVE_CONFIGS alongside the other all_models.py-derived configs. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
cakedev0
force-pushed
the
ridge-only-pr-34793
branch
from
August 21, 2026 20:57
c00a46d to
65ba120
Compare
cakedev0
added a commit
that referenced
this pull request
Aug 21, 2026
…ght (#32) Confirmed live on PR #31: the "Validate config" step used -e reporting (and run.sh's own preflight used -e default), but implementations_for_pixi_env() rejects any PIXI_ENVIRONMENT_NAME outside its real-env allowlist - so this preflight was broken for any config calling it (all_models.py and anything derived from it, e.g. this PR's own all_models_ridge_only.py), unconditionally, regardless of which real environment would go on to run. - run.sh: drop the recently-added --validate-only preflight block and its now-unused extract_configs helper. - scripts/classify_bench_session.py: drop the now-dead special-case for run.sh's removed --validate-only header line. - .github/workflows/pr-comparison.yml: reuse run.sh directly (one invocation with two env@owner:ref entries) instead of duplicating setup_sklearn_ref.sh + sklbench calls per side - matches CONTRIBUTING.md's documented PR-vs-base comparison pattern exactly, and collapses two log files/classify calls into one. Keep a config preflight, but scoped to this workflow with a real, always-installable env (sklearn-pypi) instead of a broken one - still worth catching a typo'd config before a many-minutes sklearn-dev clone+build. - scripts/resolve_sklearn_pr.py: output the fork's `owner` (matching run.sh's env@owner:ref shorthand) instead of a full clone_url, and validate the fork's repo is actually named "scikit-learn" (what that shorthand assumes) rather than silently mishandling a differently-named fork. - tests/test_config_loading.py: register all_models_ridge_only.py in ENV_SENSITIVE_CONFIGS alongside the other all_models.py-derived configs. Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
For benchmarking scikit-learn PR #34793 (ridge/optim_cholesky) via the sklbench-compare flow. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
cakedev0
force-pushed
the
ridge-only-pr-34793
branch
from
August 21, 2026 20:59
65ba120 to
28022ea
Compare
Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
The site has no index.html (only pr_comparison.html), so the bare Cloudflare Pages domain 404s - confirmed live on PR #31's intel-laptop dashboard link. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
cakedev0
added a commit
that referenced
this pull request
Aug 21, 2026
The site has no index.html (only pr_comparison.html), so the bare Cloudflare Pages domain 404s - confirmed live on PR #31's intel-laptop dashboard link. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Contributor
|
Dashboard preview: https://pr-31.sklbench-dashboard-preview.pages.dev Built from |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Benchmarks for PR scikit-learn/scikit-learn#34793
The PR doesn't touch the prediction path, but the table/benchmarks still show speed-ups/slow-downs; seems this is really noisy, to be investigated/fixed later.
For this PR, only the fit time is relevant.