kingbri d759a15559 Model: Fix chunk size handling ...

Wrong class attribute name used for max_attention_size and fixes
declaration of the draft model's chunk_size.

Also expose the parameter to the end user in both config and model
load.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-04-07 18:39:19 -04:00

..

OAI

Model: Fix chunk size handling

2024-04-07 18:39:19 -04:00

server.py

API: Move OAI to APIRouter

2024-04-06 01:25:31 -04:00