Skip to content

Pull requests: AISBench/benchmark

New pull request New
23 Open 234 Closed
23 Open 234 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

0729 fixprefill disp bugfix
#427 opened Jul 30, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
1
2
feat: add aa_lcr unit test
#420 opened Jul 24, 2026 by jschen069 Collaborator Loading…
15 tasks
1
fix: add cross-platform file locking and background progress thread bugfix
#414 opened Jul 23, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
9
feat: add ifbench unit test test-cases
#413 opened Jul 23, 2026 by jschen069 Collaborator Loading…
1 of 15 tasks
1
[Feature][CI/CD] Support agent runtime env auto deploy feature
#410 opened Jul 23, 2026 by SJTUyh Collaborator Loading…
2 of 15 tasks
1
1
【WIP】 control Prefill con in aisbench
#396 opened Jul 14, 2026 by vasede Loading…
15 tasks
5
bugfix: Support for extracting answers expressed in thousand separato… bugfix
#360 opened Jun 24, 2026 by yejj710 Collaborator Loading…
1 of 9 tasks
2
test ai
#352 opened Jun 23, 2026 by wenba0 Collaborator Loading…
15 tasks
3
[Docs] Add recommand instruction for custom configs docs
#349 opened Jun 22, 2026 by SJTUyh Collaborator Loading…
1 of 15 tasks
1
4
Update answer pattern for COT chat prompt
#347 opened Jun 18, 2026 by F0undLinks Loading…
7 tasks
4
Update cmmlu_gen_5_shot_cot_chat_prompt.py
#346 opened Jun 18, 2026 by F0undLinks Loading…
7 tasks
4
增加用户自定义mcq数据0-shot&5-shot的语言模型精度评测功能，增加README
#345 opened Jun 16, 2026 by F0undLinks Loading…
14 tasks
8
【Feature】Supports rerunning specified use cases on SWE dataset
#331 opened Jun 8, 2026 by yejj710 Collaborator Loading…
6 tasks
4
[bugfix]: fix answer extraction regex and evaluator bugs in MMLU-Pro bugfix
#269 opened May 2, 2026 by lvhua6352 Loading…
1 of 15 tasks
1
3
[Bugfix] Add pred and choices parsing to fix the issue of score=0 for… bugfix
#258 opened Apr 20, 2026 by Yanguan619 Loading…
1 of 15 tasks
1
12
Fix max_out_len handling for multi-turn ShareGPT conversations bugfix
#243 opened Apr 12, 2026 by Shadowless-ly Loading…
6 of 15 tasks
1
10
Fix the issue where TTFT and TPOT have no data when running Kimi2.5 i…
#210 opened Mar 21, 2026 by GaoHuaZhang Collaborator Loading…
15 tasks
4
update fix on textvqa, mmmu, mmstar, add patch for glm4.6v bugfix
#188 opened Mar 13, 2026 by Shane120283483 Loading…
1 of 15 tasks
8
[UT] Add new UT for Gedit feature test-cases
#163 opened Mar 5, 2026 by SJTUyh Collaborator Loading…
1 of 15 tasks
6
[feature] [sub feature 2] Dependency for qwen image edit run feature
#151 opened Feb 13, 2026 by SJTUyh Collaborator Loading…
1 of 15 tasks
12
[feature] [sub feature 3] Support qwen Image edit infer with gedit dataset feature
#150 opened Feb 13, 2026 by SJTUyh Collaborator Loading…
1 of 15 tasks
1
【TEST】补充math和agieval数据集的冒烟用例 test-cases
#145 opened Feb 11, 2026 by GaoHuaZhang Collaborator Loading…
1 of 15 tasks
8
local eval add mindformers model
#110 opened Jan 15, 2026 by muqing-li Loading…
1 of 15 tasks
81
ProTip! Add no:assignee to see everything that’s not assigned.