kingbri b944f8d756 OAI: Add "n" for non-streaming generations ...

This adds the ability to add multiple choices to a generation. This
is only available for non-streaming gens for now, it requires some
more work to port over to streaming.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-05-28 00:52:30 -04:00

..

auth.py

Endpoints: Add key permission checker

2024-03-18 00:53:27 -04:00

chat_completion.py

Revert "API: Remove unncessary Optional signatures"

2024-05-02 21:23:48 -04:00

common.py

OAI: Add "n" for non-streaming generations

2024-05-28 00:52:30 -04:00

completion.py

API: Fix finish_reason returns

2024-03-18 15:59:28 -04:00

download.py

Downloader: Fix handling of include pattern

2024-04-30 01:13:06 -04:00

lora.py

Revert "API: Remove unncessary Optional signatures"

2024-05-02 21:23:48 -04:00

model.py

Tree: Format

2024-05-26 15:48:18 -07:00

sampler_overrides.py

API: Add preset listing for sampler overrides

2024-05-12 01:34:51 -04:00

template.py

API: Split into separate folder

2024-03-12 23:59:30 -04:00

token.py

OAI: Tokenize chat completion messages

2024-04-15 14:17:16 -04:00