ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-10 14:00:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
6d6d12fc86111b19dd3522004e3b64136780f4e2
ik_llama.cpp/examples/quantize/quantize.cpp
Iwan Kawrakow 93a85c62bb q8_k_r8: fastest matrix multiplication known to human kind 
We get PP-512(LLaMA-3.1-8B) = 370 t/s on a Ryzen-7950X!
2024-12-13 18:21:08 +02:00

24 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink