ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-13 23:40:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ik/iq2k_experiments
ik_llama.cpp/ggml
History
Iwan Kawrakow f9f15c27b6 iq2_ks: faster Metal 
LLaMA-3.1-8B:
PP-512 = 475.22 ± 0.37 t/s
TG-128 =  45.32 ± 0.03 t/s
2024-10-13 12:23:14 +03:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
iq2ks: basics
2024-10-12 17:54:46 +03:00
src
iq2_ks: faster Metal
2024-10-13 12:23:14 +03:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00