ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-01-26 17:20:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
9dfd69bd934264e9fac41b0971796b7b9ae3c842
ik_llama.cpp/include
History
Kawrakow 9dfd69bd93 IQ2_XXS_R4 (#154) 
* iq2_xxs_r4: Zen4

Disapointing gain: 134.7 t/s -> 151.1 t/s for PP-512
TG-128 is better: 3.45 -> 4.61 t/s @ 1 thread

* Minor

* iq2_xxs_r4: NEON

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-12-20 12:02:42 +01:00
..
llama.h
IQ2_XXS_R4 (#154)
2024-12-20 12:02:42 +01:00