ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 15:44:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
c247793798d2487faeed5eb1162562e98c353bc5
ik_llama.cpp/include
History
Iwan Kawrakow 0137264c6f Adding iq2_bn_r4 
This Zen4-only implementation achieves PP-512 = 826 t/s (!!!)
for Bitnet-1.58b-3B, up from 620 t/s for iq2_bn.
2024-12-05 15:18:33 +02:00
..
llama.h
Adding iq2_bn_r4
2024-12-05 15:18:33 +02:00