turboderp d8203063dc PPL eval: Transformers FP32 mode

2025-09-04 00:39:09 +02:00

..

eval_texts

Add simple long-context evaluation script

2025-05-17 16:58:12 +02:00

spec

compare_q.py: Add QTIP wrapper

2025-06-08 15:41:30 +02:00

compare_q_anyprecision.py

compare_q.py: Fix/ignore anyprecision imports (Transformers version mismatch)

2025-07-16 09:49:18 +02:00

compare_q_exllamav2.py

compare_q.py: Allow script to run without all backends installed

2025-06-05 02:26:00 +02:00

compare_q_exllamav3.py

compare_q.py: Allow script to run without all backends installed

2025-06-05 02:26:00 +02:00

compare_q_llamacpp.py

compare_q.py: Fix GGUF VRAM computation when output.weight precedes token_embd.weight

2025-06-04 23:34:42 +02:00

compare_q_logits.py

compare_q_logits.py: Fix bug

2025-06-08 15:37:41 +02:00

compare_q_qtip.py

compare_q.py: Add QTIP wrapper

2025-06-08 15:41:30 +02:00

compare_q_transformers.py

compare_q.py: Allow script to run without all backends installed

2025-06-05 02:26:00 +02:00

compare_q.py

compare_q.py: Add dark mode

2025-06-12 05:54:57 +02:00

humaneval.py

HumanEval: Move BOS token to individual prompt template, don't prepend by default when tokenizing

2025-05-11 23:02:07 +02:00

longctx.py

Add simple long-context evaluation script

2025-05-17 16:58:12 +02:00

mmlu.py

MMLU: Random sample option

2025-07-12 21:14:56 +02:00

model_diff.py

model_diff.py: Add option to save IDs and logits

2025-07-15 20:34:10 +02:00

ppl_transformers.py

PPL eval: Transformers FP32 mode

2025-09-04 00:39:09 +02:00

ppl.py

ppl.py: Add length argument

2025-07-15 20:32:47 +02:00

prequant_test.py

prequant_test.py: Disable torch.compile (conflicts with cudaMallocAsync)

2025-08-23 14:55:43 +02:00