ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 15:44:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
780929a6d0f614dbb81b1f8b2a89a162cfaf464b
ik_llama.cpp/ggml
History
Iwan Kawrakow 780929a6d0 iq4_knn: ARM_NEON 
Pretty good performance - on M2-Max we get
PP-512(LLaMA-3.1-8B) = 89.5 t/s
TG-128(LLaMA-3.1-8B) = 27.65 t/s
2024-10-18 10:47:59 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
iq4_knn: Basics + CUDA
2024-10-18 11:46:28 +03:00
src
iq4_knn: ARM_NEON
2024-10-18 10:47:59 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00