kingbri b373b25235 API: Move to ModelManager ...

This is a shared module  which manages the model container and provides
extra utility functions around it to help slim down the API.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-03-12 23:59:30 -04:00

..

chat_completion.py

API: Add logprobs for chat completions

2024-02-08 21:26:53 -05:00

common.py

Model: Add logprobs support

2024-02-08 21:26:53 -05:00

completion.py

Model: Add logprobs support

2024-02-08 21:26:53 -05:00

lora.py

API: Add more methods to semaphore

2024-03-04 23:21:40 -05:00

model.py

API: Move to ModelManager

2024-03-12 23:59:30 -04:00

sampler_overrides.py

Tree: Format

2024-03-08 01:00:48 -05:00

template.py

API: Add template switching and unload endpoints

2024-01-25 00:15:40 -05:00

token.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00