ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 15:44:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
99d79116eecceb0f50c8bb814982e5557a6d126e
ik_llama.cpp/ggml
History
Iwan Kawrakow 99d79116ee q6_k_r4: 1st NEON version 
PP-512(LLaMA-3.1-8B) = 78 t/s vs 57.6 t/s for q6_K.
TG-128 is slightly lower rthan q6_K for low number of threads,
becomes very slightly better at 8 threads.
2024-12-10 08:32:24 +01:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Adding q6_k_r4
2024-12-09 19:16:19 +02:00
src
q6_k_r4: 1st NEON version
2024-12-10 08:32:24 +01:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00