Skip to content

Commit 6927f88

Browse files
Fix cache miss for InternVL
--------- Signed-off-by: Jianhong Zhang <[email protected]>
1 parent c17c7b0 commit 6927f88

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/model_executor/models/internvl.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1491,6 +1491,7 @@ def extract_feature(self, pixel_values: torch.Tensor) -> torch.Tensor:
14911491
end_idx = start_idx + i
14921492
batch_sliced_pixel_values = \
14931493
pixel_values[start_idx:end_idx, ...]
1494+
batch_sliced_pixel_values = batch_sliced_pixel_values.contiguous().clone()
14941495
if is_lazy:
14951496
vit_embeds_minibatch = \
14961497
self.vision_model(

0 commit comments

Comments
 (0)