ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-09 13:30:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
58c13d0574ac591b63431bb2f76899507f482dc0
ik_llama.cpp/ggml
History
Iwan Kawrakow 58c13d0574 q8_KV: ARM_NEON 
We get PP-512 = 167 t/s for L3-8B without interleaving!
We do the interleaving on the fly, so I wonder if this
could be done for other quants as well.
2025-02-19 10:03:15 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Adding q8_KV - Basics + AVX2 gemm/gemv
2025-02-19 10:03:15 +02:00
src
q8_KV: ARM_NEON
2025-02-19 10:03:15 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
FA: Add option to build all FA kernels (#197)
2025-02-09 18:59:33 +02:00