kingbri 2642ef7156 OAI: Update logprobs type ...

Some logprobs cannot exist, so make the type optional

Signed-off-by: kingbri <bdashore3@proton.me>

2024-02-08 21:26:53 -05:00

..

chat_completion.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

common.py

OAI: Update logprobs type

2024-02-08 21:26:53 -05:00

completion.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

lora.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00

model.py

Model: Auto-detect a one GPU setup and fix gpu_split_auto

2024-02-06 23:08:57 -05:00

sampler_overrides.py

API: Add sampler override switching

2024-01-25 00:15:40 -05:00

template.py

API: Add template switching and unload endpoints

2024-01-25 00:15:40 -05:00

token.py

Tree: Refactor code organization

2024-01-25 00:15:40 -05:00