ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-04-22 15:39:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,200 Commits 838 Branches 1 Tag
a18a564e54b719c0f92a0b9938fa4d7d883a2da9
Commit Graph

2 Commits

Author SHA1 Message Date
Kawrakow
a18a564e54 iqk_mul_mat: faster q3_K TG 
We get 31 t/s up from 26 t/s, but we need to treat
PP differently from TG, else we get a ~10% drop in
PP performance.
 2024-06-22 12:02:49 +03:00
Kawrakow
d434b4751a iqk_mul_mat for llama.cpp 2024-06-22 12:02:49 +03:00