kingbri fd9f3eac87 Model: Add params to current model endpoint ...

Grabs the current model rope params, max seq len, and the draft model
if applicable.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-10 00:40:56 -05:00

..

chat_completion.py

OAI: Fix chat completion streaming

2023-12-01 00:14:24 -05:00

common.py

Tree: Use unwrap and coalesce for optional handling

2023-12-09 21:52:17 -05:00

completion.py

Adding token usage support

2023-11-27 20:05:05 -08:00

lora.py

Implement lora support (#24)

2023-12-08 23:38:08 -05:00

model.py

Model: Add params to current model endpoint

2023-12-10 00:40:56 -05:00

token.py

Api: Add ban_eos_token and add_bos_token support

2023-11-15 00:55:15 -05:00