Add support for Chat Completion Service Tier #1023
Merged
+12
−0
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Describe the change
This adds support for specifying the Service Tier in a chat completion request.
Provide OpenAI documentation link
https://platform.openai.com/docs/api-reference/chat/create#chat-create-service_tier
Describe your solution
service_tier
to the chat completion request and responseservice_tier
values, based on the documentationpriority
value is only available to enterprise customers and isn't in the API Reference. It is documented here: https://openai.com/api-priority-processing/Tests
service_tier
toflex
.service_tier
set.Additional Context
The
service_tier
property is needed to use flex and priority processing: