Iwan Kawrakow 4608f0cc6d iq2_kt: SOTA ...

We arrive at
PPL(LLaMA-3.1-8B-Instruct, 8192) = 9.2406
PPL(LLaMA-2-7B,            4096) = 6.4179

2024-11-21 08:16:41 +02:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

Adding iq3_kt

2024-11-21 08:16:41 +02:00

src

iq2_kt: SOTA

2024-11-21 08:16:41 +02:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Move to c++17 projectwide (#80)

2024-10-04 14:43:26 +03:00