Skip to content
Discussion options

You must be logged in to vote

According to the Whisper API Docs, the "best_of" parameter is used with beam search.

It's poorly worded or outdated. They probably meant "used together" in a general sense, but in practice the two parameters don’t interact directly because they control two different decoding modes. Model can restart decoding segments with "best_of" mode if a segment fails or produces low-quality text.

BTW, another thing I noticed in those docs: "The default beam size is 5". As I remember it's true only to cli, but when used directly in Python then by default it's using the greedy search (aka beam_size=1).

So, did faster-whisper-xxl change the use of best_of to work with temperature instead of beam size?

Replies: 2 comments 1 reply

Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
1 reply
@Purfview
Comment options

Answer selected by Purfview
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants