kingbri c3f7898967 OAI: Add logit bias support ...

Use exllamav2's token bias which is the functional equivalent of
OAI's logit bias parameter.

Strings are casted to integers on request and errors if an invalid
value is passed.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-18 23:53:47 -05:00

..

types

OAI: Add logit bias support

2023-12-18 23:53:47 -05:00

utils.py

Templates: Switch to Jinja2

2023-12-18 23:53:47 -05:00