theroyallab/tabbyAPI
1
0
Fork 0
mirror of https://github.com/theroyallab/tabbyAPI.git synced 2026-03-15 00:07:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
85387d97adab7b9920095a4fc5fba4a4d37ad6eb
tabbyAPI/backends
History
DocShotgun 85387d97ad Fix disabling flash attention in exl2 config (#136) 
* Model: Fix disabling flash attention in exl2 config

* Model: Pass no_flash_attn to draft config

* Model: Force torch flash SDP off in compatibility mode
2024-06-12 20:00:46 +02:00
..
exllamav2
Fix disabling flash attention in exl2 config (#136)
2024-06-12 20:00:46 +02:00