Files
ik_llama.cpp/ggml
Iwan Kawrakow df066ced5e Seems to be working on CUDA
For a dense model we get 2-3% speedup for PP and ~0.6% for TG.
2025-08-30 12:09:54 +03:00
..
2024-07-27 07:55:01 +02:00
2025-08-30 12:09:54 +03:00
2024-07-27 07:55:01 +02:00