ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-04-22 23:49:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
2c2f728afcd11445b251b1e68f084266ad74c32d
ik_llama.cpp/ggml
History
Iwan Kawrakow 2c2f728afc Adding BF16 support for AVX2 
PP performance is the same as fp16 (~153 t/s on Ryzen-5975WX),
but TG is quite a bit lower (3.65 t/s vs 4.72 t/s at 8 threads).
Why?
2025-01-22 08:37:48 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
CPU Flash Attention improvements (#172)
2025-01-15 18:19:22 +02:00
src
Adding BF16 support for AVX2
2025-01-22 08:37:48 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00