ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 23:54:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
dbe085474acf17dd61d67930c55f8a8dfb02c44d
ik_llama.cpp/ggml
History
Iwan Kawrakow dbe085474a iq2_kt: SOTA 
We arrive at
PPL(LLaMA-3.1-8B-Instruct, 8192) = 9.0297
PPL(LLaMA-2-7B,            4096) = 6.3913

Ah, quantization is faster too. About 20% faster.
2024-11-21 08:16:41 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Adding iq4_kt - not competitive at this point
2024-11-21 08:16:41 +02:00
src
iq2_kt: SOTA
2024-11-21 08:16:41 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00