ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 23:54:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
fad847d753130dfbdd8bc0260bbf6ea1456ca1d2
ik_llama.cpp/include
History
Iwan Kawrakow fad847d753 Adding q5_0_r4 
We get PP-512(LLaMA-3.1-8B) = 256.7 t/s on a Ryzen-7950X.
We even get TG-128 improvement to 11.7 t/s from 11.1 t/s.
2024-12-03 11:29:57 +02:00
..
llama.h
Adding q5_0_r4
2024-12-03 11:29:57 +02:00