ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-26 08:04:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
db87f766e8434cbc87eadc326ac5acb34ef05a2c
ik_llama.cpp/ggml
History
Iwan Kawrakow db87f766e8 iq4_k: AVX2 implementation 
For LLaMA-3.1-8B we get PP-512 = 203.1 t/s, TG-128 = 12.9 t/s
on the Ryzen-5975X.
2024-07-27 21:10:22 +03:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
iq4_k: basics
2024-07-27 17:05:31 +03:00
src
iq4_k: AVX2 implementation
2024-07-27 21:10:22 +03:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00