Fix benchmark bugs across multiple benchmarks#475

Merged

simonrosenberg merged 8 commits intomainfrom

fix/benchmark-bug-fixes

Mar 3, 2026

Commits on Mar 3, 2026

Fix benchmark bugs: error handling, image naming, lazy imports, and more

simonrosenberg
and
claude
committed
Update benchmarks/swtbench/run_infer.py

simonrosenberg
and
all-hands-bot
authored
Update benchmarks/multiswebench/build_images.py

simonrosenberg
and
all-hands-bot
authored
Address PR review: cleaner pd.isna guard, document heredoc tradeoff

simonrosenberg
and
claude
committed
Fix generate_report resolved/unresolved logic, add tests

simonrosenberg
and
claude
committed
Revert redundant argparse default for --timeout in swebench eval

simonrosenberg
and
claude
committed
Revert unnecessary eval_note style change in swtbench

simonrosenberg
and
claude
committed
Fix pre-commit: rename ambiguous variable, fix ruff formatting

simonrosenberg
and
claude
committed