theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-04-20 14:28:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,045 Commits 4 Branches 0 Tags
e77fa0b7a86d1c8f7ae3d70bb09f5ce9f884069e
Commit Graph

303 Commits

Author SHA1 Message Date
kingbri
740b0215dd Model: Dynamically scale generate_window 
Allows for adjustment of reservation space at the end of the context
before rolling it. This should be scaled as a model's max_seq_len
goes up.

Signed-off-by: kingbri <bdashore3@proton.me>
 2024-01-25 00:15:40 -05:00
kingbri
de0ba7214c API: Add template switching and unload endpoints 
Templates can be switched and unloaded without reloading the entire
model.

Signed-off-by: kingbri <bdashore3@proton.me>
 2024-01-25 00:15:40 -05:00
kingbri
78f920eeda Tree: Refactor code organization 
Move common functions into their own folder and refactor the backends
to use their own folder as well.

Also cleanup imports and alphabetize import statments themselves.

Finally, move colab and docker into their own folders as well.

Signed-off-by: kingbri <bdashore3@proton.me>
 2024-01-25 00:15:40 -05:00