Skip to content

Commit da074be

Browse files
authored
[None][fix] Fix #8383 introduced TRTLLM backend python error (#9804)
Signed-off-by: Jhao-Ting Chen <[email protected]>
1 parent 23cf72b commit da074be

File tree

1 file changed

+3
-0
lines changed
  • tensorrt_llm/_torch/attention_backend

1 file changed

+3
-0
lines changed

tensorrt_llm/_torch/attention_backend/trtllm.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -604,6 +604,9 @@ def is_nvfp4_output_kernel_available(
604604
is_mla_enable,
605605
)
606606

607+
def is_sm_version_trtllm_gen_kernel(self, sm):
608+
return not (sm < 100 or sm in [120, 121])
609+
607610

608611
@dataclass(kw_only=True)
609612
class TrtllmAttentionMetadata(AttentionMetadata):

0 commit comments

Comments
 (0)