kingbri fedebadc81 Model: Fix generate window fallback ...

Use max_seq_len as the numerator, not the max_tokens. Mismatched
parameter.

Signed-off-by: kingbri <bdashore3@proton.me>

2024-02-06 14:48:42 -05:00

..

model.py

Model: Fix generate window fallback

2024-02-06 14:48:42 -05:00

utils.py

Requirements: Update exllamav2, torch, and FA2

2024-02-02 23:53:42 -05:00