ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-04-28 02:11:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
ba0c7c70ab5b15f1f2be7fb0dfbe0366dda30d6c
ik_llama.cpp/ggml-common.h
Kawrakow cbc8343619 Make IQ1_M work for QK_K = 64 (#6327) 
* iq1_m: make it work for QK_K = 64 (WIP)

* iq1_m: make it work for QK_K = 64 (scalar and AVX2)

* iq1_m: QK_K = 64 seems to work on Metal and ARM_NEON

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-03-27 08:44:27 +01:00

130 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink