ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 23:54:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ik/multi_add
ik_llama.cpp/ggml
History
Iwan Kawrakow 23b7da78d1 Metal: speed up mul_mat_id 
For the Granite-1B MoE model PP-512 goes from
156 t/s to 890 t/s, so nearly a 6X speedup!
2024-10-31 09:47:24 +01:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
multi_add: simplify
2024-10-30 11:02:15 +02:00
src
Metal: speed up mul_mat_id
2024-10-31 09:47:24 +01:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00