ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-13 15:30:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
538e806ec1e8284c5b3d636f01f63a5a971c1630
ik_llama.cpp/examples/perplexity/perplexity.cpp
Kawrakow 8eea9170ff winogrande: evaluate log-probs in parallel (#5036) 
This is a relatively minor performance tweak resulting in
~10% speedup on my system.

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-01-19 11:39:11 +02:00

41 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink