ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-10 05:50:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
04e35a3d51ae0aacc98d2427600fb58e83e09f08
ik_llama.cpp/ggml
History
Iwan Kawrakow 04e35a3d51 q4_k_r4: Better ARM implementation 
PP-512(LLaMA-3.1-8B) is now 122.1 t/s up from 110 t/s.
I.e., q4_k_r4 is now (nearly) on par with q4_0_r4.
2024-12-11 13:21:16 +01:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Q3_K_R4 (#134)
2024-12-11 11:19:00 +01:00
src
q4_k_r4: Better ARM implementation
2024-12-11 13:21:16 +01:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00