Kawrakow baab1d9a1e Fix and optimize iq2k Metal implementation (#86) ...

* I somehow broke iq2_k on Metal? - fix dequantize

* I somehow broke iq2_k on Metal? - fix dot product

* iq2_k: optimize Metal dot product

42.6 t/s -> 46.2 t/s

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2024-10-13 14:30:30 +03:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

include

IQ2_KS: 2.1875 bpw non-linear quantization (#85)

2024-10-13 13:34:30 +03:00

src

Fix and optimize iq2k Metal implementation (#86)

2024-10-13 14:30:30 +03:00

.gitignore

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

CMakeLists.txt

Move to c++17 projectwide (#80)

2024-10-04 14:43:26 +03:00