Skip to content

Commit 8248034

Browse files
authored
[https://nvbugs/5652552][fix] add printing for llm args (#9205)
Signed-off-by: Ruodi Lu <[email protected]> Co-authored-by: Ruodi Lu <[email protected]>
1 parent 43896af commit 8248034

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

tensorrt_llm/_torch/pyexecutor/py_executor_creator.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -707,7 +707,8 @@ def drafting_loop_wrapper(model):
707707

708708
_adjust_torch_mem_fraction()
709709

710-
logger.info(f"{llm_args}")
710+
if mapping.rank == 0:
711+
logger.info(f"LLM Args:\n{llm_args}")
711712

712713
py_executor.start_worker()
713714
return py_executor

0 commit comments

Comments
 (0)