kingbri ad8807a830 Model: Add support for num_experts_by_token ...

New parameter that's safe to edit in exllamav2 v0.0.11. Only recommended
for people who know what they're doing.

Signed-off-by: kingbri <bdashore3@proton.me>

2023-12-17 18:03:01 -05:00

..

chat_completion.py

OAI: Add ability to specify fastchat prompt template

2023-12-10 15:43:58 -05:00

common.py

OAI: Remove unused parameters

2023-12-15 14:56:43 -05:00

completion.py

Adding token usage support

2023-11-27 20:05:05 -08:00

lora.py

OAI: Add ability to specify fastchat prompt template

2023-12-10 15:43:58 -05:00

model.py

Model: Add support for num_experts_by_token

2023-12-17 18:03:01 -05:00

token.py

Api: Add ban_eos_token and add_bos_token support

2023-11-15 00:55:15 -05:00