ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-27 08:34:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
e323a5bbb64a77b118a27fbd1428bd397f414ec1
ik_llama.cpp/ggml
History
Iwan Kawrakow e323a5bbb6 iq5_ks 
180 t/s -> 359 t/s. iq5_ks_r4 is 210 t/s.

PPL is actually lower - 7.4160 vs 7.4494 for LlaMA-3.1-8B-Instruct
2025-06-17 10:44:07 +03:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Fix non rpc build error (#506)
2025-06-08 17:27:00 +03:00
src
iq5_ks
2025-06-17 10:44:07 +03:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Better strategy for GPU offload (#520)
2025-06-12 19:25:11 +03:00