ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-11 08:50:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
a09de6eaefe105192c906ef4ae41d48c2d2e3aa7
ik_llama.cpp/ggml
History
Kawrakow a09de6eaef iq4_ks: faster dot product on Metal (#90) 
TG-128(LLaMA-3.1-8B) goes to 52.5 t/s up from 48.4 t/s.

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-10-16 14:13:03 +03:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
IQ2_KS: 2.1875 bpw non-linear quantization (#85)
2024-10-13 13:34:30 +03:00
src
iq4_ks: faster dot product on Metal (#90)
2024-10-16 14:13:03 +03:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00