turboderp 0445820548 Merge branch 'dev'

2026-07-14 13:17:14 +02:00

..

eval_texts

Add simple long-context evaluation script

2025-05-17 16:58:12 +02:00

prompts

SD eval: Add trivial/sanity test

2026-05-26 00:03:39 +02:00

spec

compare_q.py: Add option to format test dataset with chat template (stable measurements for Gemma4)

2026-04-10 20:59:43 +02:00

bbeh_mini.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

compare_q_anyprecision.py

compare_q.py: Scale model init length to eval length

2026-05-11 14:32:57 +02:00

compare_q_exllamav2.py

refactor: undefined variable cache_size causes nameerror at runtime

2026-06-28 08:36:24 +08:00

compare_q_exllamav3.py

compare_q.py: Scale model init length to eval length

2026-05-11 14:32:57 +02:00

compare_q_llamacpp.py

refactor: bare except: swallows all exceptions and masks broken installs

2026-06-28 08:38:37 +08:00

compare_q_logits.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

compare_q_plot.py

compare_q.py: Add sub-header with dataset info

2026-06-05 14:13:23 +02:00

compare_q_qtip.py

compare_q.py: Scale model init length to eval length

2026-05-11 14:32:57 +02:00

compare_q_transformers.py

compare_q.py: Deduce HF input device from split

2026-06-05 19:43:45 +02:00

compare_q.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

diversity.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

humaneval.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

ifbench.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

longctx.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

mmlu.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

model_diff.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

perf.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

ppl.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

prequant_test.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00

spec_decode.py

Fix all ArgumentParser instances (allow_abbrev=False)

2026-07-13 00:33:08 +02:00