File tree Expand file tree Collapse file tree 2 files changed +4
-1
lines changed
tests/unittest/api_stability/references Expand file tree Collapse file tree 2 files changed +4
-1
lines changed Original file line number Diff line number Diff line change @@ -181,7 +181,7 @@ class SamplingParams:
181181
182182 logprobs (int, optional): Number of log probabilities to return per output token. Defaults to None.
183183 prompt_logprobs (int, optional): Number of log probabilities to return per prompt token. Defaults to None.
184- logprobs_mode (str ): Controls return logprobs after sampling modifications. Defaults to "processed_logprobs".
184+ logprobs_mode (Literal['processed_logprobs'] ): Controls return logprobs after sampling modifications. Defaults to "processed_logprobs".
185185 Options:
186186 - "processed_logprobs": Return log-softmax of processed logits
187187 return_context_logits (bool): Controls if Result should contain the context logits. Defaults to False.
Original file line number Diff line number Diff line change @@ -15,5 +15,8 @@ methods:
1515 prompt_ignore_length :
1616 annotation : Optional[int]
1717 default : null
18+ logprobs_mode :
19+ annotation : Literal['processed_logprobs']
20+ default : processed_logprobs
1821 return_annotation : None
1922properties : {}
You can’t perform that action at this time.
0 commit comments