-
Notifications
You must be signed in to change notification settings - Fork 18
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem? Please describe:
Currently matrix inference only support text.
Describe the solution you would like:
- Find huggingface dataset contains images (eg cais/hle) and videos
- Convert the row into Chat message
- Deploy maverick-fp8 on h100 and test it on images, which should work.
- Explore video input and model, eg gemma
Additional Context:
We currently integrated vllm v0.8.3, please see if it support video models.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request