[TRTLLM-6756][feat] Add Beam Search to TorchSampler#8509

Open

stnie wants to merge 17 commits intoNVIDIA:mainfrom

stnie:develop/sampler/beam_search_torch

Commits on Nov 26, 2025

[TRTLLM-6756][feat] Enhance TorchSampler to support beam search sampling.
stnie
committed
[TRTLLM-6756][chore] Update Beam Search after code refactoring.
stnie
committed
[TRTLLM-6756][chore] Fixed wrong shape, when not using beam search
stnie
committed
[TRTLLM-6756][feat] Update beam search in TorchSampler to cover more features
stnie
committed
[TRTLLM-6756][chore] Update TorchSampler to cleanup code
stnie
committed
[TRTLLM-6756][test] Update unit tests for beam search sampling functionality
stnie
committed
[TRTLLM-6756][feat] Make beam search sampling asynchronous
stnie
committed
[TRTLLM-6756][chore] Updated beam search code to run with async sample_async
stnie
committed
[TRTLLM-6756][test] Updated test_beam_search.py to correctly test for the updated beam search in TorchSampler
stnie
committed
[TRTLLM-6756][chore] Fixed formatting after merge
stnie
committed
[TRTLLM-6756][chore] Fixed bugs to pass tests and improved beam search sampling
stnie
committed
[TRTLLM-6756][chore] Update formatting after rebase + merge
stnie
committed
[TRTLLM-6756][refactor] Refactor RequestGroupKey to use dataclass
stnie
committed
[TRTLLM-6756][refactor] Update _handle_finish_reasons method in TorchSampler
stnie
committed
[TRTLLM-6756][chore] Enhance TorchSampler with new setup_sampler_step method and fix bugs
stnie
committed
[TRTLLM-6756][refactor] Enhance beam search handling in TorchSampler and sampling utilities
stnie
committed
[TRTLLM-6756][chore] Update test cases for beam search sampling after merge
stnie
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[TRTLLM-6756][feat] Add Beam Search to TorchSampler#8509

[TRTLLM-6756][feat] Add Beam Search to TorchSampler#8509
stnie wants to merge 17 commits intoNVIDIA:mainfrom
stnie:develop/sampler/beam_search_torch

Commits on Nov 26, 2025

[TRTLLM-6756][feat] Enhance TorchSampler to support beam search sampling.

[TRTLLM-6756][chore] Update Beam Search after code refactoring.

[TRTLLM-6756][chore] Fixed wrong shape, when not using beam search

[TRTLLM-6756][feat] Update beam search in TorchSampler to cover more features

[TRTLLM-6756][chore] Update TorchSampler to cleanup code

[TRTLLM-6756][test] Update unit tests for beam search sampling functionality

[TRTLLM-6756][feat] Make beam search sampling asynchronous

[TRTLLM-6756][chore] Updated beam search code to run with async sample_async

[TRTLLM-6756][test] Updated test_beam_search.py to correctly test for the updated beam search in TorchSampler

[TRTLLM-6756][chore] Fixed formatting after merge

[TRTLLM-6756][chore] Fixed bugs to pass tests and improved beam search sampling

[TRTLLM-6756][chore] Update formatting after rebase + merge

[TRTLLM-6756][refactor] Refactor RequestGroupKey to use dataclass

[TRTLLM-6756][refactor] Update _handle_finish_reasons method in TorchSampler

[TRTLLM-6756][chore] Enhance TorchSampler with new setup_sampler_step method and fix bugs

[TRTLLM-6756][refactor] Enhance beam search handling in TorchSampler and sampling utilities

[TRTLLM-6756][chore] Update test cases for beam search sampling after merge

[TRTLLM-6756][feat] Add Beam Search to TorchSampler#8509stnie wants to merge 17 commits intoNVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom stnie:develop/sampler/beam_search_torchstnie/TensorRT-LLM:develop/sampler/beam_search_torchCopy head branch name to clipboard

Commits

Commits on Nov 26, 2025

[TRTLLM-6756][feat] Add Beam Search to TorchSampler#8509
stnie wants to merge 17 commits intoNVIDIA:mainfrom
stnie:develop/sampler/beam_search_torch