ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 15:44:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
e2ba3d53e5195bf2917be79f989f79b47dc29c5a
ik_llama.cpp/include
History
Iwan Kawrakow 422e5768e4 Adding iq4_nl_x4 
Looks very promising - I get PP-512(LLaMA-3.1-8B) = 230 t/s
on the Ryzen-7950X! This is faster than any other quant and
~40% faster than iq4_nl.
2024-11-30 09:21:04 +02:00
..
llama.h
Adding iq4_nl_x4
2024-11-30 09:21:04 +02:00