Kawrakow bc34573356 CPU: faster FA (#797) ...

* Avoid computing FA chunks where the mask is -infinity

* Avoid computing FA chunks where the mask is -infinity also for f16/bf16

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2025-09-26 09:00:25 +02:00

..

cmake

Merge vulkan code from mainline up to commit of 6/28/2025 (#563)

2025-07-02 08:49:42 +02:00

ggml-cann

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

ggml-cuda

Fix #772 (#790)

2025-09-23 16:43:02 +02:00

ggml-sycl

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

iqk

CPU: faster FA (#797)

2025-09-26 09:00:25 +02:00

kompute @ 4565194ed7

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

kompute-shaders

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llamafile

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

vulkan-shaders

Vulkan: a fresh start (#608)

2025-07-15 08:03:13 +02:00

CMakeLists.txt

Offload only activated experts to the GPU (#698)

2025-09-04 12:22:30 +02:00

ggml-aarch64.c

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

ggml-aarch64.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

ggml-alloc.c

Enable CUDA graphs for MoE models + GPT-OSS support (#689)

2025-08-15 09:18:07 +03:00

ggml-backend-impl.h

Merge vulkan code from mainline up to commit of 6/28/2025 (#563)

2025-07-02 08:49:42 +02:00

ggml-backend.cpp

This is very slightly better (#762)

2025-09-05 21:31:02 +02:00

ggml-blas.cpp

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

ggml-cann.cpp

Merge vulkan code from mainline up to commit of 6/28/2025 (#563)

2025-07-02 08:49:42 +02:00

ggml-common.h

AVX512+AVXVNNI GEMM implementation for quants using Q8_K for activations (#710)

2025-08-22 06:27:07 +03:00

ggml-cuda.cu

Fused matrix multiplications (CUDA and CPU) (#796)

2025-09-24 16:52:54 +02:00

ggml-impl.h

MXFP4 (#682)

2025-08-09 08:40:18 +03:00

ggml-kompute.cpp

Merge vulkan code from mainline up to commit of 6/28/2025 (#563)

2025-07-02 08:49:42 +02:00

ggml-metal.m

MXFP4 (#682)

2025-08-09 08:40:18 +03:00

ggml-metal.metal

MXFP4 (#682)

2025-08-09 08:40:18 +03:00

ggml-quants.c

Fix avx2 GEMM mess (v2) (#724)

2025-08-27 08:03:47 +03:00

ggml-quants.h

IQ1_M_R4: better 1.75 bpw quants (#187)

2025-02-06 14:08:52 +02:00

ggml-rpc.cpp

Merge vulkan code from mainline up to commit of 6/28/2025 (#563)

2025-07-02 08:49:42 +02:00

ggml-sycl.cpp

Merge vulkan code from mainline up to commit of 6/28/2025 (#563)

2025-07-02 08:49:42 +02:00

ggml-vulkan.cpp

Vulkan: a fresh start (#608)

2025-07-15 08:03:13 +02:00

ggml.c

Fused matrix multiplications (CUDA and CPU) (#796)

2025-09-24 16:52:54 +02:00