theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-14 15:57:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
1c398b0be7257727409cfedeb4e9ece650836576
tabbyAPI/model.py
DocShotgun 1c398b0be7 Add automatic NTK-aware alpha scaling to model 
* enables automatic calculation of NTK-aware alpha scaling for models if the rope_alpha arg is not passed in the config, using the same formula used for draft models
2023-12-02 21:02:29 -08:00

17 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink