ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-04-27 09:53:40 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
bb2b894e2e97dbbfc75b96c13d89bbb42426714e
ik_llama.cpp/ggml-metal.m
Kawrakow b962dfb7f1 Metal: faster Q4_0 and Q4_1 matrix x vector kernels (#2212) 
* 3-5% faster Q4_0 on Metal

* 7-25% faster Q4_1 on Metal

* Oops, forgot to delete the original Q4_1 kernel

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2023-07-14 11:46:21 +02:00

49 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink