kingbri b11aac51e2 Model: Add torch.inference_mode() to generator function ...

Provides a speedup to model forward.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-03-30 10:45:28 -04:00

..

grammar.py

Model: Prompt users to install extras if dependencies don't exist

2024-03-22 22:13:55 -04:00

model.py

Model: Add torch.inference_mode() to generator function

2024-03-30 10:45:28 -04:00

utils.py

Dependencies: Update Exllamav2

2024-03-20 15:21:37 -04:00