theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-20 14:28:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

Sampling: Cleanup and update

Browse Source 
Cleanup how overrides are handled, class naming, and adopt exllamav2's
model class to enforce latest stable version methods rather than
adding multiple backwards compatability checks.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-02-01 12:58:55 -05:00
parent 2ea063cea9
commit b827bcbb44
4 changed files with 34 additions and 86 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
OAI/types/common.py
View File

@@ -2,7 +2,7 @@
from pydantic import BaseModel, Field
from typing import List, Dict, Optional
from common.sampling import CommonSamplerRequest
from common.sampling import BaseSamplerRequest
class LogProbs(BaseModel):
@@ -49,5 +49,5 @@ class CommonCompletionRequest(BaseSamplerRequest):
description="Not parsed. Only used for OAI compliance.", default=None
)
# Generation info (remainder is in CommonSamplerRequest superclass)
# Generation info (remainder is in BaseSamplerRequest superclass)
stream: Optional[bool] = False