Skip to content

Actions: open-compass/VLMEvalKit

Actions

lint

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
lint.yml
1,039 workflow runs
1,039 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Add MVH-Bench benchmark support lint #4263: Pull request #1713 opened by Leeinsu1
Action required Leeinsu1:add-mvh-bench
Leeinsu1:add-mvh-bench
Action required
Add E3VQA benchmark support lint #4262: Pull request #1712 opened by Leeinsu1
Action required Leeinsu1:add-e3vqa
Leeinsu1:add-e3vqa
Action required
[Fix] do not score an unparseable MCQ item as correct lint #4261: Pull request #1711 synchronize by li-lizhe
Action required li-lizhe:fix/mcq-unparseable-not-correct
li-lizhe:fix/mcq-unparseable-not-correct
Action required
[Fix] do not score an unparseable MCQ item as correct lint #4260: Pull request #1711 opened by li-lizhe
Action required li-lizhe:fix/mcq-unparseable-not-correct
li-lizhe:fix/mcq-unparseable-not-correct
Action required
fix: return evaluation summaries from dataset.evaluate() so scores reach status.json lint #4259: Pull request #1709 opened by li-lizhe
Action required li-lizhe:fix/evaluate-returns-summary
li-lizhe:fix/evaluate-returns-summary
Action required
[Benchmark] Add support for CAPEval lint #4258: Pull request #1633 synchronize by ssiq
Action required liuzhipenggg:add-capeval-v2
liuzhipenggg:add-capeval-v2
Action required
[Benchmark] Add support for CAPEval lint #4257: Pull request #1633 synchronize by ssiq
Action required liuzhipenggg:add-capeval-v2
liuzhipenggg:add-capeval-v2
Action required
[Fix] fix tqdm import in spatial457 (#1619) lint #4256: Commit 54a063c pushed by github-merge-queue Bot
2m 9s main
main
2m 9s
[Fix] fix tqdm import in spatial457 (#1619) lint #4255: Commit 54a063c pushed by github-merge-queue Bot
2m 22s gh-readonly-queue/main/pr-1619-13497fcfe0350499bd255227ce9cb4c40c77fc86
gh-readonly-queue/main/pr-1619-13497fcfe0350499bd255227ce9cb4c40c77fc86
2m 22s
[Fix] Accept numeric LogicVista judge answers (#1641) lint #4254: Commit 13497fc pushed by github-merge-queue Bot
2m 11s gh-readonly-queue/main/pr-1641-3e3c15bb8019a0abeac231021d699a9e2863c5c5
gh-readonly-queue/main/pr-1641-3e3c15bb8019a0abeac231021d699a9e2863c5c5
2m 11s
[Fix] Accept numeric LogicVista judge answers (#1641) lint #4253: Commit 13497fc pushed by github-merge-queue Bot
3m 8s main
main
3m 8s
[Fix] add missing case for answer regex in spatial457 (#1620) lint #4252: Commit 3e3c15b pushed by github-merge-queue Bot
2m 13s gh-readonly-queue/main/pr-1620-c085e65540fd896ac8cc2b97538eec7d07bc7790
gh-readonly-queue/main/pr-1620-c085e65540fd896ac8cc2b97538eec7d07bc7790
2m 13s
[Fix] add missing case for answer regex in spatial457 (#1620) lint #4251: Commit 3e3c15b pushed by github-merge-queue Bot
2m 22s main
main
2m 22s
[Fix] fix tqdm import in spatial457 lint #4250: Pull request #1619 synchronize by ssiq
1m 53s JackLangerman:patch-2
JackLangerman:patch-2
1m 53s
[Fix] Strip use_vllm/use_verifier eval flags from judge kwargs (OpenA… lint #4249: Commit c085e65 pushed by github-merge-queue Bot
1m 51s gh-readonly-queue/main/pr-1611-88ba5e79daf1a4be1b9df748a593adfc903a6557
gh-readonly-queue/main/pr-1611-88ba5e79daf1a4be1b9df748a593adfc903a6557
1m 51s
[Fix] Strip use_vllm/use_verifier eval flags from judge kwargs (OpenA… lint #4248: Commit c085e65 pushed by github-merge-queue Bot
1m 36s main
main
1m 36s
[Fix] Strip use_vllm/use_verifier eval flags from judge kwargs (OpenAI 400) lint #4247: Pull request #1611 synchronize by ssiq
2m 5s cdpark92:fix-judge-kwargs-leak
cdpark92:fix-judge-kwargs-leak
2m 5s
[Fix] add missing case for answer regex in spatial457 lint #4246: Pull request #1620 synchronize by ssiq
2m 7s JackLangerman:patch-3
JackLangerman:patch-3
2m 7s
[Fix] Accept numeric LogicVista judge answers lint #4245: Pull request #1641 synchronize by ssiq
2m 44s reacher-z:fix/logicvista-numeric-answers
reacher-z:fix/logicvista-numeric-answers
2m 44s
[Benchmark] Update SciDocBench official release and evaluation lint #4244: Pull request #1688 synchronize by ssiq
1m 44s Henryexcellentw:feat/scidocbench-release
Henryexcellentw:feat/scidocbench-release
1m 44s
[Fix] Detect MIME types for extensionless images (#1643) lint #4243: Commit 88ba5e7 pushed by github-merge-queue Bot
2m 30s gh-readonly-queue/main/pr-1643-2a7732ce277dcee7017cda56e372bc267754e4f8
gh-readonly-queue/main/pr-1643-2a7732ce277dcee7017cda56e372bc267754e4f8
2m 30s
[Fix] Detect MIME types for extensionless images (#1643) lint #4242: Commit 88ba5e7 pushed by github-merge-queue Bot
1m 25s main
main
1m 25s
Fix DUDE_acc crash on an empty prediction (#1708) lint #4241: Commit 2a7732c pushed by github-merge-queue Bot
2m 5s main
main
2m 5s
Fix DUDE_acc crash on an empty prediction (#1708) lint #4240: Commit 2a7732c pushed by github-merge-queue Bot
2m 7s gh-readonly-queue/main/pr-1708-6f0370704932cec0d9aa1e73f01954cd786c57ea
gh-readonly-queue/main/pr-1708-6f0370704932cec0d9aa1e73f01954cd786c57ea
2m 7s
Fix DUDE_acc crash on an empty prediction lint #4239: Pull request #1708 opened by plox-sumit
2m 9s plox-sumit:fix/dude-nan-pred
plox-sumit:fix/dude-nan-pred
2m 9s