-
Notifications
You must be signed in to change notification settings - Fork 652
Pull requests: EvolvingLMMs-Lab/lmms-eval
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
feat: add Atlas Cloud LLM judge provider
#1516
opened Sep 7, 2026 by
binyangzhu000-sudo
Loading…
3 of 7 tasks
feat(mmmu): support local evaluation of the public test split
#1515
opened Sep 7, 2026 by
MingheShen
Loading…
2 of 7 tasks
fix(cache): rebuild live requests from cached contexts
#1514
opened Sep 5, 2026 by
Luodian
Contributor
Loading…
fix(mathvision): extract the last \\boxed{...} with balanced braces
#1512
opened Sep 4, 2026 by
feiiiiii5
Contributor
Loading…
1 task done
fix(mathvision): unwrap \\text{...}/\\mbox{...} instead of leaving braces behind
#1510
opened Sep 4, 2026 by
feiiiiii5
Contributor
Loading…
1 task done
fix(mathvision): call _fix_fracs unconditionally in _strip_string
#1508
opened Sep 4, 2026 by
feiiiiii5
Contributor
Loading…
1 task done
fix(mathvision): preserve optional root indices in _fix_sqrt
#1506
opened Sep 4, 2026 by
feiiiiii5
Contributor
Loading…
1 task done
feat: add group-level postprocess hook for custom result aggregation
#1499
opened Aug 31, 2026 by
lorenzozanee
Contributor
Loading…
7 tasks
feat: add EgoLifeQA benchmark
#1498
opened Aug 31, 2026 by
lorenzozanee
Contributor
Loading…
1 task done
fix(llava): handle transformers compat for apply_chunking_to_forward import
#1497
opened Aug 31, 2026 by
lorenzozanee
Contributor
Loading…
1 task done
fix(mmvp): apply ground truth corrections in code for robust evaluation
#1495
opened Aug 31, 2026 by
lorenzozanee
Contributor
Loading…
7 tasks
fix: make opencv optional on linux ppc64le to allow uv sync
#1494
opened Aug 31, 2026 by
lorenzozanee
Contributor
Loading…
1 of 7 tasks
fix(qwen2_5_vl): propagate sampled fps to processor for correct second_per_grid_ts
#1491
opened Aug 30, 2026 by
lorenzozanee
Contributor
Loading…
1 task done
Previous Next
ProTip!
Updated in the last three days: updated:>2026-09-07.