Files
ik_llama.cpp/ggml
Iwan Kawrakow 59a3e12508 iq4_xs_r4: NEON
We get PP-512(LLaMA-3.1-8B) = 115.6 t/s on M2-Max,
up from 68.2 t/s for iq4_xs!
2024-12-04 14:52:22 +01:00
..
2024-07-27 07:55:01 +02:00
2024-12-04 09:16:45 +02:00
2024-12-04 14:52:22 +01:00
2024-07-27 07:55:01 +02:00
2024-10-04 14:43:26 +03:00