Iwan Kawrakow ead4c1e180 POC per row scale: add CUDA TODOs ...

There are two places in ggml-cuda.cu left where it is assumed
that type_size * n_per_row / block_size is the way to compute
and handle row sizes. This does not affect simple usage,
but will lead to issues when tensors are split between GPUs.

2024-09-25 13:10:34 +03:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

POC: per row scale

2024-09-25 13:10:33 +03:00

src

POC per row scale: add CUDA TODOs

2024-09-25 13:10:34 +03:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00