[DO NOT MERGE] Support Piecewise CUDA Graph for Qwen2.5-VL - #17

Draft

yuan-luo wants to merge 11 commits into

mainfrom

support_vl_pcg_qwen25_vl

Commits on Nov 19, 2025

Support vlm piecewise cuda graph - fix empty positions in rotary_embedding
luoyuan.luo
committed
0c334a2
Support processing mm outside model
luoyuan.luo
committed
471a51f
support input_deepstack_embeds outside model

committed
fd1cd1a
Support qwen2_5_vl piecewise cuda graph
luoyuan.luo
committed
db5c290
Support piecewise CUDA graph interact with PP in VLM

luoyuan.luo
and
yuan-luo
committed
4e1a121
Revise piecewise cuda graph framework for vlm

luoyuan.luo
and
yuan-luo
committed
79a2da2
Resolve llava and VideoOpenAI model due to different ViT archtecture

luoyuan.luo
and
yuan-luo
committed
b0b5ea4
Add unit test for pcg vlm
luoyuan.luo
committed
4ffe08a
Revert and add back qwen3_vl change

committed
7702eb0
Add lmms_eval unit test for pcg

committed
bc54e4c
Address review comments and fix ci

committed
1184918