Skip to content

Commit 4ca8b78

Browse files
authored
add repetition_penalty for openai chat api (#932)
1 parent b609b5f commit 4ca8b78

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

lightllm/server/api_openai.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -114,6 +114,7 @@ async def chat_completions_impl(request: ChatCompletionRequest, raw_request: Req
114114
"do_sample": True,
115115
"presence_penalty": request.presence_penalty,
116116
"frequency_penalty": request.frequency_penalty,
117+
"repetition_penalty": request.repetition_penalty,
117118
"temperature": request.temperature,
118119
"top_p": request.top_p,
119120
"top_k": request.top_k,

0 commit comments

Comments
 (0)