Brian 2e491472d1 Merge pull request #254 from lucyknada/main ...

add draft_gpu_split option for spec decoding

2025-02-11 16:48:03 -05:00

..

grammar.py

Grammar: Cache the engine vocabulary

2024-12-05 21:36:37 -08:00

model.py

Model: Adjust draft_gpu_split and add to config

2025-02-08 16:09:46 -05:00

utils.py

Dependencies: Update torch, exllamav2, and flash-attn

2025-02-09 01:27:48 -05:00

version.py

Dependencies: Update torch, exllamav2, and flash-attn

2025-02-09 01:27:48 -05:00

vision.py

Dependencies: Fix OpenAPI generation

2024-11-22 17:59:20 -05:00