ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-04-28 18:32:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
e65f7e8c8b1a3d3a3805245c0ffce18cce71e79b
ik_llama.cpp/include/llama.h
Iwan Kawrakow 93a85c62bb q8_k_r8: fastest matrix multiplication known to human kind 
We get PP-512(LLaMA-3.1-8B) = 370 t/s on a Ryzen-7950X!
2024-12-13 18:21:08 +02:00

59 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink