ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-08 23:40:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
07d3b4caece3ab35d3b4216f4e4b6d3bed40a18a
ik_llama.cpp/ggml
History
Iwan Kawrakow 07d3b4caec iq6_k: CUDA dot product 
90.2 t/s for LLaMA-3.1-8B. Q6_K gives 91.2 t/s, so we are good.
2024-08-07 19:24:09 +03:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
iq6_k: WIP (nothing works)
2024-08-07 15:24:16 +03:00
src
iq6_k: CUDA dot product
2024-08-07 19:24:09 +03:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00