ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 07:34:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
f8a651c38ce2f550a4ac4d0d6ac475c872775baa
ik_llama.cpp/ggml
History
Iwan Kawrakow f8a651c38c iq2_bn_r4: simdify q8_K16 quantization (NEON) 
PP-512 is now 304.7 t/s, and TG-128 @ 8 threads
very slightly outperforms iq2_bn (100.7 t/s vs 99.6 t/s)
2024-12-06 08:12:32 +01:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Adding iq2_bn_r4
2024-12-05 15:18:33 +02:00
src
iq2_bn_r4: simdify q8_K16 quantization (NEON)
2024-12-06 08:12:32 +01:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00