Iwan Kawrakow 10557832b1 cuda: Remove unnecessary device to host copy of row ids ...

We get 3-4% TG speed improvement for DeepSeek-Lite just from that.

2025-05-10 09:49:08 +03:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

Add copyright notices (#317)

2025-04-07 10:43:26 +02:00

src

cuda: Remove unnecessary device to host copy of row ids

2025-05-10 09:49:08 +03:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Compile time option to use bf16 for qunts without MMQ kernels (#261)

2025-03-18 07:37:10 +01:00