kingbri 8ccd8fe5f8 Model: Initial dynamic generator support ...

Adds basic support for ExllamaV2's dynamic generator. Can generate
a streaming and non-streaming completion.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-05-25 21:16:14 -04:00

..

grammar.py

Model/Grammar: Remove lmfe checks

2024-05-12 22:24:28 -04:00

model.py

Model: Initial dynamic generator support

2024-05-25 21:16:14 -04:00

utils.py

Dependencies: Update ExllamaV2

2024-05-11 19:26:03 -04:00