kingbri 2a0aaa2e8a OAI: Add ability to pass extra vars in jinja templates ...

A chat completion can now declare extra template_vars to pass when
a template is rendered, opening up the possibility of using state
outside of huggingface's parameters.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-04-11 09:49:25 -04:00

..

auth.py

Endpoints: Add key permission checker

2024-03-18 00:53:27 -04:00

chat_completion.py

OAI: Add ability to pass extra vars in jinja templates

2024-04-11 09:49:25 -04:00

common.py

OAI: Add response_format parameter

2024-04-09 21:33:31 -04:00

completion.py

API: Fix finish_reason returns

2024-03-18 15:59:28 -04:00

lora.py

Tree: Format

2024-03-13 00:02:55 -04:00

model.py

Model: Fix chunk size handling

2024-04-07 18:39:19 -04:00

sampler_overrides.py

API: Split into separate folder

2024-03-12 23:59:30 -04:00

template.py

API: Split into separate folder

2024-03-12 23:59:30 -04:00

token.py

Tree: Format

2024-03-13 00:02:55 -04:00