Kawrakow 82c4f27332 Fuse the attention gate in Step-3.5-Flash (#1244) ...

* WIP

* This works but is slow

* Turn off the up / gate clamps for now

* OK we need the clamping

* Fuse the clamp (CUDA)

* Fuse the clamp (CPU)

* WIP

* Be able to use merged q, k, v

* Be able to use merged up/gate experts

* Fuse the clamp (CUDA mmvq)

* WIP: graph parallel for Step-3.5

* WIP

* This should be it

* Cleanup

* Fix merge

* Not working attempt to extend fused_mul_unary to the Step-3.5 case

* It works now, but performance gain is very minor

2026-02-07 07:56:58 +02:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

Remove llamafile remnants (#1179)

2026-01-22 13:20:23 +02:00

src

Fuse the attention gate in Step-3.5-Flash (#1244)

2026-02-07 07:56:58 +02:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Remove llamafile remnants (#1179)

2026-01-22 13:20:23 +02:00