kingbri 515b3c2930 OAI: Tokenize chat completion messages ...

Since chat completion messages are a structure, format the prompt
before checking in the tokenizer.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-04-15 14:17:16 -04:00

..

auth.py

Endpoints: Add key permission checker

2024-03-18 00:53:27 -04:00

chat_completion.py

OAI: Add ability to pass extra vars in jinja templates

2024-04-11 09:49:25 -04:00

common.py

OAI: Add response_format parameter

2024-04-09 21:33:31 -04:00

completion.py

API: Fix finish_reason returns

2024-03-18 15:59:28 -04:00

lora.py

Tree: Format

2024-03-13 00:02:55 -04:00

model.py

Model: Fix chunk size handling

2024-04-07 18:39:19 -04:00

sampler_overrides.py

API: Split into separate folder

2024-03-12 23:59:30 -04:00

template.py

API: Split into separate folder

2024-03-12 23:59:30 -04:00

token.py

OAI: Tokenize chat completion messages

2024-04-15 14:17:16 -04:00