ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-02 01:50:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
e2ba3d53e5195bf2917be79f989f79b47dc29c5a
ik_llama.cpp/ggml
History
Iwan Kawrakow e2ba3d53e5 iq4_nl_x4: NEON 
On M2-Max we get PP-512(LLaMA-3.1-8B) = 109.7 t/s, up from
82.4 t/s for iq4_nl.
2024-12-01 16:03:36 +01:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Adding iq4_nl_x4
2024-11-30 09:21:04 +02:00
src
iq4_nl_x4: NEON
2024-12-01 16:03:36 +01:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00