Epic: Bulletproof Optimizer

[prashsub]

Status (PR #202): 2/6 children shipped — Optimizer regression test harness (#86) and Fix leakage risk in GSO (#189). Plus large adjacent reliability work not tied to a specific child: MLflow eval hang defense (eval_watchdog.py + adaptive concurrency tier ladder + per-request OpenAI timeout, mlflow bumped past PR #22060), Cycle 11 invariant suite I1–I8, Phase B–H decision trace + run-output-bundle observability, structural AST-audit lint closing harness Bugs B/C/D/E. Children #82, #83, #84, #85 still open.

Make the optimizer reliable and trustworthy. Product team is not focused
on this area, so it is the team's primary investment.

Source: Apr 14 2026 sync (Prashanth/David), Apr 17 2026 team check-in.

Children

• Harden MLflow prompt registry switch (Harden MLflow prompt registry switch #81 — closed via PR Fix MLflow Prompt Registry probe and baseline-eval count mismatch #79)
• Improve excluded-query explanation UI (baseline 85.7% / 12-of-14) (Improve excluded-query explanation UI (baseline 85.7% / 12-of-14) #82)
• Add details drawer for excluded items; keep main screen simple (Add details drawer for excluded items; keep main screen simple #83)
• Handle SQL-not-run case explicitly (exclude vs score) (Handle SQL-not-run case explicitly (exclude vs score) #84)
• Detect too-easy synthetic datasets that produce 100% scores (Detect too-easy synthetic datasets that produce 100% scores #85)
• Optimizer regression test harness (Optimizer regression test harness #86 — addressed in PR feat(gso): Genie Space Optimizer — complete optimizer engine (lossless contract, process spine, decision trace, observability) #202)
• Fix leakage risk in GSO (Fix leakage risk in GSO #189 — addressed in PR feat(gso): Genie Space Optimizer — complete optimizer engine (lossless contract, process spine, decision trace, observability) #202)

---

(.roadmap/sync-roadmap.sh infrastructure has been removed; this body is now hand-maintained.)

[hiydavid]

Also include #205 as part of the epic.