ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-12 15:00:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
521f3bafe5b36ab26f5686e3c4152c101f2d800d
ik_llama.cpp/examples/perplexity/perplexity.cpp
Kawrakow c7bb8e340a HellaSwag: speed up by parallelizing log-prob evaluation (#5020) 
For Mistral-7B and fp16, time on my system goes down from 536 seconds
to 423 seconds for the full evaluation dataset (10042 tasks).

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-01-18 19:18:21 +02:00

40 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink