Skip to content

Pull requests: OpenHands/benchmarks

New pull request New
22 Open 306 Closed
22 Open 306 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix(commit0): evaluation harness fails to score cachetools and parsel due to test command issues
#539 opened Mar 19, 2026 by VascoSch92 Loading…
11
feat: add cache-mode input to image build workflows
#536 opened Mar 18, 2026 by simonrosenberg Loading…
2 tasks
2
fix(ci): restore SWT-Bench build parallelism and disable cache export
#525 opened Mar 17, 2026 by simonrosenberg Loading…
3 tasks
1
@simonrosenberg
11
swefficiency benchmark updated
#522 opened Mar 16, 2026 by 18jeffreyma Loading…
16
build(deps): bump the version-all group across 1 directory with 18 updates dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code
#519 opened Mar 16, 2026 by dependabot bot Loading…
Add benchmark-side Apptainer workspace support
#509 opened Mar 12, 2026 by neubig • Draft
1
Revert "feat: auto-detect pre-built Docker images across all benchmarks (#456)"
#503 opened Mar 11, 2026 by juanmichelini Loading…
1
6
fix: Reuse pre-built SDK sdist to speed up image builds
#499 opened Mar 10, 2026 by juanmichelini • Draft
14
build(deps): bump the version-all group across 1 directory with 5 updates dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#492 opened Mar 9, 2026 by dependabot bot Loading…
Enable terminalbench CI smoke runs
#491 opened Mar 8, 2026 by neubig Loading…
5 of 6 tasks
Add background BuildKit pruning for completed batches
#489 opened Mar 8, 2026 by neubig • Draft
6 tasks done
7
Disable rich logging by default to fix multiprocessing deadlock
#487 opened Mar 5, 2026 by juanmichelini • Draft
1
22
Fix fork+threading deadlock in SWE-Bench image builds
#486 opened Mar 5, 2026 by juanmichelini • Draft
1
Add deadlock detection with no-progress timeout
#458 opened Feb 26, 2026 by neubig • Draft
53
NeMo Evaluator Integration
#455 opened Feb 26, 2026 by simonrosenberg Loading…
1
@simonrosenberg
27
refactor: Replace ProcessPoolExecutor with asyncio for evaluation
#446 opened Feb 25, 2026 by simonrosenberg Loading…
1
@simonrosenberg
28
Recycle worker processes to prevent OOM from heap fragmentation
#442 opened Feb 24, 2026 by simonrosenberg Loading…
3 tasks
1
feat(swesmith): add SWE-Smith benchmark evaluation scaffold
#428 opened Feb 18, 2026 by mkaramuk • Draft
Fix: laminar trace timeline to account for idle wait time
#415 opened Feb 13, 2026 by Rainhunter13 Loading…
7
Add security benchmark with ASTRA
#361 opened Jan 26, 2026 by XZ-X • Draft
1
BREAKING: Rename --max-attempts to --n-critic-runs
#325 opened Jan 16, 2026 by juanmichelini • Draft
12
Agentic code search
#141 opened Dec 8, 2025 by adityasoni9998 Loading…
5
ProTip! Filter pull requests by the default branch with base:main.