ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-24 15:14:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
882fc0235e9327ea2159fe7ad2012996672f170b
ik_llama.cpp/include
History
Iwan Kawrakow 3da565c9c9 iq1_kt: CUDA dequantize 
Testing with LlaMA-3.1-8B-Instruct, we get almost the same PPL
as iq2_xxs, so about 0.2 bpw fewer bits for the same quality.
2025-07-16 16:55:20 +03:00
..
llama.h
iq1_kt: CUDA dequantize
2025-07-16 16:55:20 +03:00