kingbri d759a15559 Model: Fix chunk size handling ...

Wrong class attribute name used for max_attention_size and fixes
declaration of the draft model's chunk_size.

Also expose the parameter to the end user in both config and model
load.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-04-07 18:39:19 -04:00

..

auth.py

Endpoints: Add key permission checker

2024-03-18 00:53:27 -04:00

chat_completion.py

API: Fix finish_reason returns

2024-03-18 15:59:28 -04:00

common.py

OAI: Add stream to gen params

2024-03-21 00:55:44 -04:00

completion.py

API: Fix finish_reason returns

2024-03-18 15:59:28 -04:00

lora.py

Tree: Format

2024-03-13 00:02:55 -04:00

model.py

Model: Fix chunk size handling

2024-04-07 18:39:19 -04:00

sampler_overrides.py

API: Split into separate folder

2024-03-12 23:59:30 -04:00

template.py

API: Split into separate folder

2024-03-12 23:59:30 -04:00

token.py

Tree: Format

2024-03-13 00:02:55 -04:00