ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 15:44:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
2b07aa3f2eb2c4a8019c9faef001a0d0f8a18f5b
ik_llama.cpp/ggml
History
Iwan Kawrakow 2b07aa3f2e q2_k_r4: AVX2 
We get PP-512(LLaMA-3.1-8B) = 287 t/s.

Also cherry-picked the q3_k_r4 AVX2 adaptation that I somehow
forgot to push upstream.
2024-12-11 16:56:51 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
q2_k_r4: Zen4
2024-12-11 16:28:56 +02:00
src
q2_k_r4: AVX2
2024-12-11 16:56:51 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00