Kawrakow 366d66bc1a Fuse add + fused_rms_norm (CUDA) (#852) ...

* Combine all calls to llm_build_norm to a single line

so more easily check what kind of arguments are being passed
by simply using grep.

* Combine add + fused_rms_norm

For many models this happens at each layer: the result of the
layer is added to the ayer input, which then becomes the input
to the next layer, which then is typically normalized via
fused_rms_norm.

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2025-10-21 14:29:50 +03:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

Grouped expert routing (CPU only) (#836)

2025-10-16 14:57:02 +03:00

src

Fuse add + fused_rms_norm (CUDA) (#852)

2025-10-21 14:29:50 +03:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Set default value of GGML_SCHED_MAX_COPIES to 1 (#751)

2025-09-02 07:04:39 +02:00