theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity

Embeddings: Add model management

Browse Source 
Embedding models are managed on a separate backend, but are run
in parallel with the model itself. Therefore, manage this in a separate
container with separate routes.

Signed-off-by: kingbri <bdashore3@proton.me>
This commit is contained in:
kingbri
2024-07-30 15:19:27 -04:00
parent f13d0fb8b3
commit bfa011e0ce
6 changed files with 135 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
config_sample.yml
View File

@@ -73,9 +73,9 @@ developer:
#realtime_process_priority: False
embeddings:
embeddings_model_dir: models
embedding_model_dir: models
embeddings_model_name:
embedding_model_name:
embeddings_device: cpu