ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-04-28 02:11:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
309e32405f7391767850f4c09a6201a10c2dda63
ik_llama.cpp/iqk_mul_mat.cpp
Iwan Kawrakow 309e32405f iqk_mul_mat: AVX2 implementation for iq2_xs 
We get 2.19X for PP-512 (118.9 t/s). TG is mostly OK
(slightly better @ 4 threads, slightly worse @ 16 threads).
2024-06-22 12:02:49 +03:00

141 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink