Files
ik_llama.cpp/ggml
Iwan Kawrakow 0d19d19af8 iq3_k: CUDA dot product
Slightly slower than iq3_s - 132 t/s vs 138 t/s for
LLaMA-3.1-8B.
2024-08-01 09:38:06 +02:00
..
2024-07-27 07:55:01 +02:00
2024-08-01 09:38:06 +02:00
2024-08-01 09:38:06 +02:00
2024-07-27 07:55:01 +02:00
2024-07-27 07:55:01 +02:00