ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-01-26 17:20:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b8402290ef9236d92ff85aa0dc2c8b005f348664
ik_llama.cpp/ggml
History
Kawrakow b8402290ef Much faster prompt processing for IQ1_S and IQ1_M on ARM_NEON (#553) 
* iq1_s

66.3 t/s -> 168.8 t/s.

* iq1_m

19 t/s -> 163 t/s.

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2025-06-24 14:21:37 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Fix non rpc build error (#506)
2025-06-08 17:27:00 +03:00
src
Much faster prompt processing for IQ1_S and IQ1_M on ARM_NEON (#553)
2025-06-24 14:21:37 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Better strategy for GPU offload (#520)
2025-06-12 19:25:11 +03:00