theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-15 00:07:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
277 Commits 4 Branches 0 Tags
c02fe4d1db6e6c11940004dca1f75557bf7fd2c1
Commit Graph

3 Commits

Author SHA1 Message Date
kingbri
c02fe4d1db API: Fix response creation 
Change chat completion and text completion responses to be more
flexible.

Signed-off-by: kingbri <bdashore3@proton.me>
 2024-02-08 21:26:53 -05:00
kingbri
0af6a38af3 Model: Add logprobs support 
Returns token offsets, selected tokens, probabilities of tokens
post-sampling, and normalized probability of selecting a token
pre-sampling (for efficiency purposes).

Only for text completions. Chat completions in a later commit.

Signed-off-by: kingbri <bdashore3@proton.me>
 2024-02-08 21:26:53 -05:00
kingbri
d3781920b3 OAI: Split up utility functions 
Just like types, put utility functions in their own separate module
based on the route.

Signed-off-by: kingbri <bdashore3@proton.me>
 2024-02-02 23:36:17 -05:00