Skip to content

Add new backend support for TensorRT-LLM #1

@wtlow003

Description

@wtlow003

Seen from the benchmark here: https://github.com/shashikg/WhisperS2T?tab=readme-ov-file

We observed that WhisperS2T provides impressive performance when using the backend of TensorRT-LLM.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions