theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
14 Commits 4 Branches 0 Tags
47343e2f1adb70a697a7fd4638808de721ae25d4
Commit Graph

2 Commits

Author SHA1 Message Date
kingbri
47343e2f1a OAI: Add models support 
The models endpoint fetches all the models that OAI has to offer.
However, since this is an OAI clone, just list the models inside
the user's configured model directory instead.

Signed-off-by: kingbri <bdashore3@proton.me>
 2023-11-13 21:38:34 -05:00
kingbri
eee8b642bd OAI: Implement completion API endpoint 
Add support for /v1/completions with the option to use streaming
if needed. Also rewrite API endpoints to use async when possible
since that improves request performance.

Model container parameter names also needed rewrites as well and
set fallback cases to their disabled values.

Signed-off-by: kingbri <bdashore3@proton.me>
 2023-11-13 18:31:26 -05:00