Skip to content

Add Gemma 4 support#1530

Open
jethac wants to merge 1 commit intoopen-compass:mainfrom
jethac:main
Open

Add Gemma 4 support#1530
jethac wants to merge 1 commit intoopen-compass:mainfrom
jethac:main

Conversation

@jethac
Copy link
Copy Markdown

@jethac jethac commented Apr 29, 2026

Summary

  • Add a Gemma4 model adapter with transformers and vLLM inference paths
  • Register Gemma 4 instruction-tuned model variants in the Gemma model group
  • Normalize local images as RGB PIL images and strip thinking blocks from returned responses for evaluation

Tests

  • python -m py_compile vlmeval/config.py vlmeval/vlm/gemma.py
  • python -m pre_commit run --files vlmeval/config.py vlmeval/vlm/gemma.py vlmeval/vlm/init.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant