ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-07 12:30:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ea2de6ee34d2d3121888c7c07f7751819e532026
ik_llama.cpp/ggml
History
Iwan Kawrakow ea2de6ee34 q2_k_r4: NEON 
We get PP-512(LLaMA-3.1-8B) = 106.2 t/s.
TG-128 is 36.02 t/s, which is ~10% higher than q2_K_S.
2024-12-11 16:52:33 +01:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
q2_k_r4: Zen4
2024-12-11 16:28:56 +02:00
src
q2_k_r4: NEON
2024-12-11 16:52:33 +01:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00