Logo
Explore Help
Register Sign In
turboderp-org/exllamav3
1
0
Fork 0
You've already forked exllamav3
mirror of https://github.com/turboderp-org/exllamav3.git synced 2026-07-14 11:07:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,218 Commits 3 Branches 43 Tags
dev
Commit Graph

11 Commits

Author SHA1 Message Date
turboderp
116b3c5d0f Fix all ArgumentParser instances (allow_abbrev=False) 2026-07-13 00:33:08 +02:00
turboderp
6af187349e ppl.py: Set dequant mode for MXFP4 tensors in HF path, explicitly move input IDs to model device 2026-07-10 15:01:49 +02:00
turboderp
f3e9ba7ca4 Eval: Update torch_dtype -> dtype 2026-05-29 00:34:18 +02:00
turboderp
7a149778fb Eval: Triton kernels to compute gathered logprobs and KL-div without manifesting huge intermediate tensors 2026-05-13 23:48:31 +02:00
turboderp
11a2a849cc Eval: Add -gp/--gen_prompt option to eval scripts 2026-05-07 20:34:02 +02:00
turboderp
514389a2b5 ppl.py: No default datatype for HF mode 2026-04-05 19:43:46 +02:00
turboderp
9bd2b5ea4d ppl eval: Combine HF and EXL3 evals into single module, add mode that attempts to replicate default llama.cpp eval tokenization and scoring 2026-04-03 23:37:00 +02:00
turboderp
ef8fd43d1c Cleanup unused imports 2025-11-16 14:25:46 +01:00
turboderp
c09f809876 ppl.py: Add length argument 2025-07-15 20:32:47 +02:00
turboderp
9849c92b36 Reduce VRAM overhead in ppl test 2025-04-17 22:22:47 +02:00
turboderp
543c4b2771 Initial commit 2025-04-06 14:42:49 +02:00
Powered by Gitea Version: 1.25.4 Page: 378ms Template: 6ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API