Files
ik_llama.cpp/ggml
Iwan Kawrakow 9702ebd078 iq4_nl_x4: minor NEON improvement and cleanup
This gets us to 110.3 t/s. In comparison,
IQ4_NL_4_4 in mainline llama.cpp achieves 92.3 t/s.
2024-12-01 17:15:31 +01:00
..
2024-07-27 07:55:01 +02:00
2024-11-30 09:21:04 +02:00
2024-07-27 07:55:01 +02:00
2024-10-04 14:43:26 +03:00