theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-15 00:07:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b43f0983c80a955ba82df552f66df8b76f72df4b
tabbyAPI/backends/exllamav2/model.py
kingbri b43f0983c8 Model: Fix max_seq_len fallbacks 
The rope alpha calculation caused an error if max seq len isn't
provided. This is because the model's max sequence length was not
stored as the target for alpha calculation.

Signed-off-by: kingbri <8082010+kingbri1@users.noreply.github.com>
2025-04-28 14:09:31 -04:00

51 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink