We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 57b9db1 commit fdfacbcCopy full SHA for fdfacbc
tensorrt_llm/_torch/pyexecutor/model_engine.py
@@ -2027,7 +2027,7 @@ def forward(
2027
self.iter_counter += 1
2028
2029
# 3. Ask the manager to execute the graph
2030
- graph_output = self.cuda_graph_manager.execute(
+ graph_output = self.cuda_graph_model_engine.execute(
2031
batch=padded_requests,
2032
inputs=inputs,
2033
forward_fn=self._forward_step)
0 commit comments