Files
ik_llama.cpp/ggml
Kawrakow ef95b81733 R4 improvements on ARM_NEON (#125)
* q4_0_r4: 6% faster PP on NEON

* qx_0_r4_q8_0 template

Applied to q4_0_r4 and q5_0_r4. It makes q5_0_r4 PP
~7% faster.

* Apply qx_0_r4_q8_0 template also to q6_0_r4 and iq4_nl_x4

* Simplify

* Minor iq4_xs_r4 improvement on NEON

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-12-08 09:13:10 +01:00
..
2024-07-27 07:55:01 +02:00
2024-12-08 09:13:10 +01:00
2024-07-27 07:55:01 +02:00
2024-10-04 14:43:26 +03:00