Files
ik_llama.cpp/examples/quantize/quantize.cpp
Iwan Kawrakow 707d087927 Bitnet: tiny bity faster 1.625 bpw variant on Metal
We get 70.7 t/s for TG-128 vs 69.5 t/s before.
2024-06-24 16:42:30 +02:00

18 KiB