ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-03-02 18:10:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
7bf6e158a996e2454b001345b89ab361d81100d2
ik_llama.cpp/examples/quantize/quantize.cpp
Iwan Kawrakow 426a6e685f iq2_kt: CUDA dequantize 
so we can run perplexity calcs.
As already indicated by rmse, the 2-bit trellis approach is
quite a bit worse than iq2_xxs.
2024-11-21 08:16:41 +02:00

24 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink