Kawrakow b535dcd416 Fix quantized k-cache without FA (#105) ...

* Added Johannes' changes, still getting NaNs with quantized k-cache.

Also getting NaN's on Johannes's mainline branch.

* This fixes it

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2024-10-24 12:20:30 +02:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

Avoid rebuild of GGML graph for each token (#98)

2024-10-20 08:36:16 +02:00

src

Fix quantized k-cache without FA (#105)

2024-10-24 12:20:30 +02:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Move to c++17 projectwide (#80)

2024-10-04 14:43:26 +03:00