Iwan Kawrakow 87da25f901 q6_k_r4: Better ARM implementation ...

PP-512(LLaMA-3.1-8B) is now 104.2 t/s up from 83.2 t/s.
I.e., q6_k_r4 now beats q6_0_r4.

2024-12-11 11:40:27 +01:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

Q3_K_R4 (#134)

2024-12-11 11:19:00 +01:00

src

q6_k_r4: Better ARM implementation

2024-12-11 11:40:27 +01:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Move to c++17 projectwide (#80)

2024-10-04 14:43:26 +03:00