Iwan Kawrakow 89510ccce7 q8_k_r4: NEON ...

We get PP-512(LLaMA-3.1-8B) = 159.2 t/s.
Compare this to the 128 t/s we have fr Q8_0_R4.

2024-12-13 18:57:07 +01:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

q8_k_r8: fastest matrix multiplication known to human kind

2024-12-13 18:21:08 +02:00

src

q8_k_r4: NEON

2024-12-13 18:57:07 +01:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Move to c++17 projectwide (#80)

2024-10-04 14:43:26 +03:00