kingbri 282b5b2931 API: Fix responses and some params ...

Responses were not being properly sent as JSON. Only run pydantic's
JSON function on stream responses. FastAPI does the rest with static
responses.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-11-16 17:11:55 -05:00

..

chat_completion.py

OAI: Add chat completions endpoint

2023-11-16 01:06:07 -05:00

common.py

API: Fix responses and some params

2023-11-16 17:11:55 -05:00

completion.py

Tree: Basic formatting and comments

2023-11-16 11:48:40 -05:00

model.py

Model: Fix gpu split params

2023-11-15 00:55:15 -05:00

token.py

Api: Add ban_eos_token and add_bos_token support

2023-11-15 00:55:15 -05:00