Files
ik_llama.cpp/ggml
Iwan Kawrakow 3e0c2519d3 iq4_ks: faster dot product on Metal
TG-128(LLaMA-3.1-8B) goes to 52.5 t/s up from 48.4 t/s.
2024-10-16 14:04:59 +03:00
..
2024-07-27 07:55:01 +02:00
2024-10-16 14:04:59 +03:00
2024-07-27 07:55:01 +02:00
2024-10-04 14:43:26 +03:00