Iwan Kawrakow 31c85a8949 FlashMLA(CUDA) - allow q8_0 for KV cache ...

This works, and PP is not bad, but TG is still quite a bit slower.

2025-03-11 16:53:05 +02:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

SER - Smart Expert Reduction (#239)

2025-03-02 13:47:38 +02:00

src

FlashMLA(CUDA) - allow q8_0 for KV cache

2025-03-11 16:53:05 +02:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

FA: Add option to build all FA kernels (#197)

2025-02-09 18:59:33 +02:00