Files
ik_llama.cpp/ggml
Iwan Kawrakow 30b89f0cf9 Experimenting with flash attention on Zen4
Slightly (~1%) better by keeping qkv accumulators
on the stack and only storing the final result into
the qkv tensor.
2024-08-30 09:21:37 +03:00
..
2024-07-27 07:55:01 +02:00
2024-07-27 07:55:01 +02:00