theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
0c1d794390be3a15b582374a7404d6ca599c6615
tabbyAPI/backends/exllamav2
History
kingbri 0c1d794390 Model: Add exl3 and associated load functions 
Initial exl3 compat and loading functionality.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-05-02 21:32:39 -04:00
..
grammar.py
Grammar: Cache the engine vocabulary
2024-12-05 21:36:37 -08:00
model.py
Model: Add exl3 and associated load functions
2025-05-02 21:32:39 -04:00
utils.py
Dependencies: Update torch, exllamav2, and flash-attn
2025-02-09 01:27:48 -05:00
version.py
Dependencies: Update torch, exllamav2, and flash-attn
2025-02-09 01:27:48 -05:00
vision.py
Dependencies: Fix OpenAPI generation
2024-11-22 17:59:20 -05:00