ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-22 06:04:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
57df5ccdd7495e67c4d3707cd0a0318f6d04f190
ik_llama.cpp/ggml
History
Iwan Kawrakow 57df5ccdd7 iq2_k: Metal dot product finally works 
It is slow: 45.4 t/s for 7B model vs 50 t/s for iq2_xs,
or 63.3 t/s for q2_K_S.
2024-08-01 09:38:06 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
iq3_k: Basics
2024-08-01 09:38:06 +02:00
src
iq2_k: Metal dot product finally works
2024-08-01 09:38:06 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00