Commit Graph

5 Commits

Author SHA1 Message Date
turboderp
675450d845 Add Q6 and Q8 cache options to eval scripts 2024-06-09 02:13:06 +02:00
turboderp
4dea0c2451 Shuffle option for MMLU eval 2024-06-06 11:54:25 +02:00
turboderp
64440cff9f Use standard prompt format for MMLU 2024-06-01 04:39:10 +02:00
turboderp
823bf11c68 Update MMLU test to use dynamic batching 2024-06-01 03:31:40 +02:00
turboderp
e7cbb300ff Update HumanEval test to dynamic generator 2024-05-31 22:24:16 +02:00