turboderp-org/exllamav3
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav3.git synced 2026-05-12 16:55:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
894 Commits 3 Branches 34 Tags
4e587cd19bb0d2aaed02485a4bbd41ff70a3d04e
Commit Graph

6 Commits

Author SHA1 Message Date
turboderp
cb50b9fa6a afmoe: Assert topk_groups=1 and use dots router 2026-04-23 21:05:21 +02:00
turboderp
0d3893face Loader: Allow specifying max bsz for autosplit to better estimate recurrent state VRAM overhead 2026-04-18 14:12:29 +02:00
turboderp
7046a5c739 perf.py: Fix cache overflow 2026-04-06 01:58:27 +02:00
turboderp
85cb54c6f3 perf.py: Make sure test context is nontrivial to force more expert diversity 2026-03-07 01:18:27 +01:00
turboderp
b2b6f37e12 perf.py: Error out if test length > cache size 2026-02-17 20:04:13 +01:00
turboderp
428a082276 Add performance test 2026-01-22 23:28:53 +01:00