Skip to content

llm-scaler-vllm beta release 0.10.0-b3

Pre-release
Pre-release

Choose a tag to compare

View all tags
@liu-shaojun liu-shaojun released this 23 Sep 07:06
vllm-0.10.0-b3
927de0e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Highlights

Resources

What’s new

  • vLLM:

    • Support Seed-oss model
    • Adding miner-U
    • Enable MiniCPM-V-4_5
    • Fix internvl_3_5 and deepseek-v2-lite error
Assets 2
Loading