Skip to content

Commit 59ccc17

Browse files
Label SWE-bench walkthrough as projection, not measured result
The ~85% figure is a target trajectory; make that unmistakable in the section title, intro note, headline, and chart annotation. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
1 parent 631e184 commit 59ccc17

1 file changed

Lines changed: 4 additions & 4 deletions

File tree

README.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -121,11 +121,11 @@ Every attempt is written to a **ledger**: goal, observation, plan, diff, evaluat
121121

122122
---
123123

124-
## A worked example: SWE-bench Verified
124+
## A projected walkthrough: SWE-bench Verified
125125

126-
> 📋 The walk-through below uses an end-to-end overnight evolution on SWE-bench Verified to illustrate what the runtime actually does: which model goes in, what kinds of moves the planner converges on, what the final ledger looks like. Reproducible v1.0 artifacts live in [`examples/sandbox_demo/`](examples/sandbox_demo/) and the 99-test suite in [`tests/`](tests/).
126+
> 📋 The walk-through below sketches an end-to-end overnight evolution on SWE-bench Verified to illustrate what the runtime actually does: which model goes in, what kinds of moves the planner converges on, what the final ledger looks like. **The ~85% figure below is a projected target, not a measured result.** Reproducible v1.0 artifacts live in [`examples/sandbox_demo/`](examples/sandbox_demo/) and the 99-test suite in [`tests/`](tests/).
127127
128-
### Take Qwen3.6-35B-A3B (3B active params, released April 2026) from 73.4% to ~85% on SWE-bench Verified — closing most of the gap to GPT-5.5, overnight, hands-off, fully audited.
128+
### Target: take Qwen3.6-35B-A3B (3B active params, released April 2026) from 73.4% to ~85% on SWE-bench Verified — closing most of the gap to GPT-5.5, overnight, hands-off, fully audited.
129129

130130
```
131131
SWE-bench Verified (500 real GitHub bug-fixes · May 2026)
@@ -134,7 +134,7 @@ Every attempt is written to a **ledger**: goal, observation, plan, diff, evaluat
134134
Gemini 3.1 Pro ████████████████████████████████░░░░░ 80.6%
135135
Kimi K2.6 ████████████████████████████████░░░░░ 80.2%
136136
────────────────────────────────────────────────────────────────────────
137-
Qwen3.6-35B-A3B + us ██████████████████████████████████░░░ ~85% ← with evolution-kernel
137+
Qwen3.6-35B-A3B + us ██████████████████████████████████░░░ ~85% ← projected target, not yet measured
138138
Qwen3.6-35B-A3B (vanilla) █████████████████████████████░░░░░░░░ 73.4% ← public baseline
139139
────────────────────────────────────────────────────────────────────────
140140
Gemma 4-31B (dense) ████████████████████░░░░░░░░░░░░░░░░░ 52.0%

0 commit comments

Comments
 (0)