ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-04-28 18:32:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
5b06d7999ce551f3de8d93d5eaf23f8fe67cda60
ik_llama.cpp/include/llama.h
Kawrakow fb4cff3458 iq3_k: Basics 
Quantize/dequantize, CUDA dequantize.
PPL of LLaMA-3.1-8B is better than iq3_s and iq3_m.
2024-08-01 09:38:06 +02:00

56 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink