Files
ik_llama.cpp/ggml
Iwan Kawrakow 426a6e685f iq2_kt: CUDA dequantize
so we can run perplexity calcs.
As already indicated by rmse, the 2-bit trellis approach is
quite a bit worse than iq2_xxs.
2024-11-21 08:16:41 +02:00
..
2024-07-27 07:55:01 +02:00
2024-11-21 08:16:40 +02:00
2024-11-21 08:16:41 +02:00
2024-07-27 07:55:01 +02:00
2024-10-04 14:43:26 +03:00