ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-03 18:40:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
050bdfa101be5b78c2dc2286bad915e2eae21645
ik_llama.cpp/ggml
History
Iwan Kawrakow 050bdfa101 iq6_k: CUDA dot product 
90.2 t/s for LLaMA-3.1-8B. Q6_K gives 91.2 t/s, so we are good.
2024-08-09 16:00:31 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
iq6_k: WIP (nothing works)
2024-08-09 16:00:31 +02:00
src
iq6_k: CUDA dot product
2024-08-09 16:00:31 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00