theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

OAI: Fix chat completion validation

Browse Source 
Validation wasn't properly run on older pydantic, so ChatCompletionRespChoice
was being sent instead of a ChatCompletionMessage when streaming
responses.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2023-12-17 16:00:22 -05:00
committed by Brian Dashore
parent 7cbc08fc72
commit a87e474660
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
OAI/types/chat_completion.py
View File

@@ -18,7 +18,7 @@ class ChatCompletionStreamChoice(BaseModel):
# Index is 0 since we aren't using multiple choices
index: int = 0
finish_reason: Optional[str]
delta: Union[ChatCompletionRespChoice, dict] = {}
delta: Union[ChatCompletionMessage, dict] = {}
# Inherited from common request
class ChatCompletionRequest(CommonCompletionRequest):