turboderp-org/exllamav3
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav3.git synced 2026-05-13 09:15:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
894 Commits 3 Branches 34 Tags
4e587cd19bb0d2aaed02485a4bbd41ff70a3d04e
Commit Graph

3 Commits

Author SHA1 Message Date
turboderp
0d3893face Loader: Allow specifying max bsz for autosplit to better estimate recurrent state VRAM overhead 2026-04-18 14:12:29 +02:00
turboderp
6b31fc00f5 Add HF tokenizer helper, refactor example 2026-01-11 12:49:12 +01:00
turboderp
0488385eb0 Add simple long-context evaluation script 2025-05-17 16:58:12 +02:00