Files
ik_llama.cpp/ggml
Iwan Kawrakow 7fa670bb06 q3_k_r4: NEON
We get PP-512(LLaMA-3.1-8B) = 106.9 t/s.
This is 1.93X faster than q3_K_S!
2024-12-11 10:32:42 +01:00
..
2024-07-27 07:55:01 +02:00
2024-12-11 10:32:42 +01:00
2024-07-27 07:55:01 +02:00
2024-10-04 14:43:26 +03:00