Search results

huggingface Leaderboard not working

Status: Open.

#31 In AILab-CVC/SEED-Bench;

· LindiaC opened on Nov 4, 2024

Data source for "Transit Maps" model: not listed in this repository? also not listed on Huggingface?

Status: Open.

#29 In AILab-CVC/SEED-Bench;

· miku2000 opened on Jun 27, 2024

Wrong Question Types in SEED-Bench1

Status: Open.

#28 In AILab-CVC/SEED-Bench;

· littlepenguin89106 opened on May 17, 2024

Question about evaluation input format

Status: Open.

#27 In AILab-CVC/SEED-Bench;

· yellow-binary-tree opened on May 11, 2024

any plan to release the original images for SEED-Bench-2-Plus?

Status: Open.

#25 In AILab-CVC/SEED-Bench;

· hyunjun-eun opened on May 3, 2024

Question on multi-image input

Status: Open.

#24 In AILab-CVC/SEED-Bench;

· auhowielau opened on Mar 18, 2024

[bugs] LLaVA-Evaluation : RuntimeError: Expected all tensors to be on the same device

Status: Open.

#21 In AILab-CVC/SEED-Bench;

· JJJYmmm opened on Jan 31, 2024

Muti-GPUs Evaluation

Status: Open.

#20 In AILab-CVC/SEED-Bench;

· JJJYmmm opened on Jan 31, 2024

Question on how task27 generates images

Status: Open.

#19 In AILab-CVC/SEED-Bench;

· JunZhan2000 opened on Jan 16, 2024

a lot of data with more questions than pictures in SEED-Bench-2 level L2, is this reasonable?

Status: Open.

#15 In AILab-CVC/SEED-Bench;

· nemonameless opened on Dec 12, 2023

In-Context Example Selection Process

Status: Open.

#14 In AILab-CVC/SEED-Bench;

· mustafaadogan opened on Dec 2, 2023

VLMs vs LLMs evaluation

Status: Open.

#12 In AILab-CVC/SEED-Bench;

· idan-tankel opened on Oct 22, 2023