Files
ik_llama.cpp/ggml
Iwan Kawrakow 8d2b5bae2b iq3_k: CUDA dot product
Slightly slower than iq3_s - 132 t/s vs 138 t/s for
LLaMA-3.1-8B.
2024-07-30 16:57:39 +03:00
..
2024-07-27 07:55:01 +02:00
2024-07-30 16:11:25 +03:00
2024-07-30 16:57:39 +03:00
2024-07-27 07:55:01 +02:00
2024-07-27 07:55:01 +02:00