kingbri b43f0983c8 Model: Fix max_seq_len fallbacks ...

The rope alpha calculation caused an error if max seq len isn't
provided. This is because the model's max sequence length was not
stored as the target for alpha calculation.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>

2025-04-28 14:09:31 -04:00

..

grammar.py

Grammar: Cache the engine vocabulary

2024-12-05 21:36:37 -08:00

model.py

Model: Fix max_seq_len fallbacks

2025-04-28 14:09:31 -04:00

utils.py

Dependencies: Update torch, exllamav2, and flash-attn

2025-02-09 01:27:48 -05:00

version.py

Dependencies: Update torch, exllamav2, and flash-attn

2025-02-09 01:27:48 -05:00

vision.py

Dependencies: Fix OpenAPI generation

2024-11-22 17:59:20 -05:00