ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-01-26 17:20:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ik/faster_iq3_iq5_quantize
ik_llama.cpp/include
History
Iwan Kawrakow 4f237d44f6 iq3_k: Basics 
Quantize/dequantize, CUDA dequantize.
PPL of LLaMA-3.1-8B is better than iq3_s and iq3_m.
2024-08-01 09:38:06 +02:00
..
llama.h
iq3_k: Basics
2024-08-01 09:38:06 +02:00