feat: CI evals on Ubicloud — 12 parallel runners + Docker image (v0.11.10.0)#360

Merged

garrytan merged 25 commits intomainfrom

garrytan/fast-ci-e2e-eval

Mar 23, 2026

Commits on Mar 23, 2026

feat: enable within-file E2E test concurrency for 3x faster runs

garrytan
and
claude
committed
feat: add CI eval workflow on Ubicloud runners

garrytan
and
claude
committed
chore: bump version and changelog (v0.11.6.0)

garrytan
and
claude
committed
chore: optimize CI eval PR comment — aggregate all suites, update-not-duplicate

garrytan
and
claude
committed
feat: parallelize CI evals — 12 runners (1 per suite) for ~3min wall clock

garrytan
and
claude
committed
feat: add Docker CI image with pre-baked toolchain + deps

garrytan
and
claude
committed
feat: parallelize CI evals — 12 runners (1 per suite) for ~3min wall clock

garrytan
and
claude
committed
chore: self-bootstrapping CI — build Docker image inline, cache by content hash

garrytan
and
claude
committed
fix: bun.lockb → bun.lock + auth before manifest check

garrytan
and
claude
committed
fix: bun.lock is gitignored — use package.json only for Docker cache

garrytan
and
claude
committed
fix: symlink node_modules instead of hardlink (cross-device)

garrytan
and
claude
committed
debug: add claude CLI smoke test step to diagnose exit_code_1

garrytan
and
claude
committed
ci: retrigger eval workflow
garrytan
committed
ci: add workflow_dispatch trigger for manual runs
garrytan
committed
debug: more verbose claude CLI diagnostics
garrytan
committed
fix: run eval container as non-root — claude CLI rejects --dangerously-skip-permissions as root

garrytan
and
claude
committed
fix: install bun to /usr/local so non-root runner user can access it

garrytan
and
claude
committed
fix: unset CI/GITHUB_ACTIONS env vars for eval runs

garrytan
and
claude
committed
revert: remove CI env unset — didn't fix routing

garrytan
and
claude
committed
fix: copy CLAUDE.md into routing test tmpDirs for skill context

garrytan
and
claude
committed
fix: routing tests use createRoutingWorkDir with full project context

garrytan
and
claude
committed
fix: install skills at top-level .claude/skills/ for CI discovery

garrytan
and
claude
committed
chore: merge origin/main (resolve CHANGELOG/VERSION/SKILL.md conflicts)
garrytan
committed
chore: bump version and changelog (v0.11.10.0)

garrytan
and
claude
committed
fix: CI report needs checkout + routing needs user-level skill install

garrytan
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: CI evals on Ubicloud — 12 parallel runners + Docker image (v0.11.10.0)#360

feat: CI evals on Ubicloud — 12 parallel runners + Docker image (v0.11.10.0)#360
garrytan merged 25 commits intomainfrom
garrytan/fast-ci-e2e-eval

Commits on Mar 23, 2026

feat: enable within-file E2E test concurrency for 3x faster runs

feat: add CI eval workflow on Ubicloud runners

chore: bump version and changelog (v0.11.6.0)

chore: optimize CI eval PR comment — aggregate all suites, update-not-duplicate

feat: parallelize CI evals — 12 runners (1 per suite) for ~3min wall clock

feat: add Docker CI image with pre-baked toolchain + deps

feat: parallelize CI evals — 12 runners (1 per suite) for ~3min wall clock

chore: self-bootstrapping CI — build Docker image inline, cache by content hash

fix: bun.lockb → bun.lock + auth before manifest check

fix: bun.lock is gitignored — use package.json only for Docker cache

fix: symlink node_modules instead of hardlink (cross-device)

debug: add claude CLI smoke test step to diagnose exit_code_1

ci: retrigger eval workflow

ci: add workflow_dispatch trigger for manual runs

debug: more verbose claude CLI diagnostics

fix: run eval container as non-root — claude CLI rejects --dangerously-skip-permissions as root

fix: install bun to /usr/local so non-root runner user can access it

fix: unset CI/GITHUB_ACTIONS env vars for eval runs

revert: remove CI env unset — didn't fix routing

fix: copy CLAUDE.md into routing test tmpDirs for skill context

fix: routing tests use createRoutingWorkDir with full project context

fix: install skills at top-level .claude/skills/ for CI discovery

chore: merge origin/main (resolve CHANGELOG/VERSION/SKILL.md conflicts)

chore: bump version and changelog (v0.11.10.0)

fix: CI report needs checkout + routing needs user-level skill install