theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-15 00:07:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
29 Commits 4 Branches 0 Tags
5e8419ec0c48ce8413b07bb1f0fc3ffa536305fb
Commit Graph

2 Commits

Author SHA1 Message Date
kingbri
5e8419ec0c OAI: Add chat completions endpoint 
Chat completions is the endpoint that will be used by OAI in the
future. Makes sense to support it even though the completions
endpoint will be used more often.

Also unify common parameters between the chat completion and completion
requests since they're very similar.

Signed-off-by: kingbri <bdashore3@proton.me>
 2023-11-16 01:06:07 -05:00
kingbri
b625bface9 OAI: Add API-based model loading/unloading and auth routes 
Models can be loaded and unloaded via the API. Also add authentication
to use the API and for administrator tasks.

Both types of authorization use different keys.

Also fix the unload function to properly free all used vram.

Signed-off-by: kingbri <bdashore3@proton.me>
 2023-11-14 01:17:19 -05:00