Files
ik_llama.cpp/examples/quantize-stats
Iwan Kawrakow 9ec145550d Testing Trellis quantization: 4-bit quantized block scales
rmse increases by just 3%, so this is beating iq2_xss in terms
of rmse at the same 2.0625 bpw.
2024-11-21 08:16:40 +02:00
..
WIP
2024-11-21 08:16:40 +02:00