kingbri b827bcbb44 Sampling: Cleanup and update ...

Cleanup how overrides are handled, class naming, and adopt exllamav2's
model class to enforce latest stable version methods rather than
adding multiple backwards compatability checks.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-02-02 23:36:17 -05:00

..

chat_completion.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

common.py

Sampling: Cleanup and update

2024-02-02 23:36:17 -05:00

completion.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

lora.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

model.py

OAI: Add fasttensors to model load endpoint

2024-01-25 01:08:02 -05:00

sampler_overrides.py

API: Add sampler override switching

2024-01-25 00:15:40 -05:00

template.py

API: Add template switching and unload endpoints

2024-01-25 00:15:40 -05:00

token.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00