Iwan Kawrakow
7fa670bb06
q3_k_r4: NEON
We get PP-512(LLaMA-3.1-8B) = 106.9 t/s.
This is 1.93X faster than q3_K_S!
2024-12-11 10:32:42 +01:00
..
2024-07-27 07:55:01 +02:00
2024-12-11 08:01:17 +02:00
2024-12-11 10:32:42 +01:00
2024-07-27 07:55:01 +02:00
2024-10-04 14:43:26 +03:00