Skip to content

Commit 5eae365

Browse files
authored
[None][fix] Pass checkpoint_format to create_input_processor (#9521)
Signed-off-by: Robin Kobus <[email protected]>
1 parent 2d7421b commit 5eae365

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

tensorrt_llm/_torch/pyexecutor/model_engine.py

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -181,7 +181,11 @@ def __init__(
181181

182182
self.attn_runtime_features = attn_runtime_features or AttentionRuntimeFeatures(
183183
)
184-
self.input_processor = create_input_processor(model_path, None)
184+
185+
self.input_processor = create_input_processor(
186+
model_path,
187+
tokenizer=None,
188+
checkpoint_format=llm_args.checkpoint_format)
185189
self.input_processor_with_hash = create_input_processor_with_hash(
186190
self.input_processor)
187191
if model is None:

0 commit comments

Comments
 (0)