turboderp-org/exllamav3
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav3.git synced 2026-03-15 00:07:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
749 Commits 3 Branches 25 Tags
master
Commit Graph

14 Commits

Author SHA1 Message Date
MikeRoz47
52c2f5794d Add optional arg to compare_q to allow it to save plots rather than show them 2026-02-15 16:41:18 +00:00
turboderp
aa9a315fd9 compare_q.py: Explicit GC between runs 2025-09-19 19:15:29 +02:00
turboderp
463ebe1841 compare_q.py: Add dark mode 2025-06-12 05:54:57 +02:00
turboderp
32d98c24c1 compare_q.py: Add QTIP wrapper 2025-06-08 15:41:30 +02:00
turboderp
162f99ab8b compare_q.py: Add AnyPrecision models 2025-06-05 02:26:00 +02:00
turboderp
8ff65b8742 compare_q.py: Option to capture logits in streaming mode (for large unquantized models) 2025-05-31 01:11:56 +02:00
turboderp
c0a2028fb5 compare_q.py: Fix some logic for KLD test 2025-05-18 21:55:26 +02:00
turboderp
e1d2fa11d6 compare_q.py: Add -mask arg 2025-05-18 10:58:14 +02:00
turboderp
3873d40ae2 compare_q.py: Add KLD test and some other tweaks 2025-05-16 16:13:26 +02:00
turboderp
a19538cf1e compare_q.py: Some fixes 2025-05-16 00:33:48 +02:00
turboderp
cb7c70cde0 compare_q.py: Add a little versatility to plot 2025-05-14 17:52:21 +02:00
turboderp
9849c92b36 Reduce VRAM overhead in ppl test 2025-04-17 22:22:47 +02:00
turboderp
95b4da216a Improve memory management slightly in compare_q.py 2025-04-06 21:56:40 +02:00
turboderp
543c4b2771 Initial commit 2025-04-06 14:42:49 +02:00