theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-30 11:11:35 +00:00
Code Issues Packages Projects Releases Wiki Activity

Embeddings: Handle case if embedding input is passed as a string

Browse Source 
Infinity expects a list when embedding, so convert to a list if the
input is a string.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
This commit is contained in:
kingbri
2025-02-23 00:39:21 -05:00
parent c580893054
commit 35fe372f2b
1 changed files with 4 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
endpoints/OAI/utils/embeddings.py
View File

@@ -39,6 +39,10 @@ async def get_embeddings(data: EmbeddingsRequest, request: Request) -> dict:
model_path = model.embeddings_container.model_dir model_path = model.embeddings_container.model_dir
logger.info(f"Recieved embeddings request {request.state.id}") logger.info(f"Recieved embeddings request {request.state.id}")
if not isinstance(data.input, list):
data.input = [data.input]
embedding_data = await model.embeddings_container.generate(data.input) embedding_data = await model.embeddings_container.generate(data.input)
# OAI expects a return of base64 if the input is base64 # OAI expects a return of base64 if the input is base64