Iwan Kawrakow 216ea5890d Fuse up and gate gemms in MoE models ...

Small (~1-2%) but measurable performan ce gain

2025-02-22 08:26:26 +02:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

Q8_KV: 8-bit quantization type targeting the KV cache (#208)

2025-02-19 11:47:07 +02:00

src

Fuse up and gate gemms in MoE models

2025-02-22 08:26:26 +02:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

FA: Add option to build all FA kernels (#197)

2025-02-09 18:59:33 +02:00