turboderp-org/exllamav3
1
0
Fork 0
mirror of https://github.com/turboderp-org/exllamav3.git synced 2026-07-12 10:07:31 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,191 Commits 3 Branches 43 Tags
dev
Commit Graph

6 Commits

Author SHA1 Message Date
turboderp
7a149778fb Eval: Triton kernels to compute gathered logprobs and KL-div without manifesting huge intermediate tensors 2026-05-13 23:48:31 +02:00
turboderp
11a2a849cc Eval: Add -gp/--gen_prompt option to eval scripts 2026-05-07 20:34:02 +02:00
turboderp
ef8fd43d1c Cleanup unused imports 2025-11-16 14:25:46 +01:00
turboderp
8377460ac6 prequant_test.py: Disable torch.compile (conflicts with cudaMallocAsync) 2025-08-23 14:55:43 +02:00
turboderp
fce1b96e3f prequant_test.py: Add some more options 2025-06-14 15:00:09 +02:00
turboderp
34d2f1f5fa Add prequant_test script 2025-05-30 19:42:49 +02:00