ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-25 15:44:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
2afe2e1d41af06c859a579e6244ad2bece9bacd3
ik_llama.cpp/ggml
History
Iwan Kawrakow 2afe2e1d41 Slightly faster FA for bf16 KV cache 
~2-3% sort of thing. Sadly, when we go beyond 8k tokens, the
advantage kind of goes away.
2025-01-13 17:47:47 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Be able to re-quantize MS BitNet I2_S models (#169)
2025-01-10 18:18:04 +02:00
src
Slightly faster FA for bf16 KV cache
2025-01-13 17:47:47 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
Move to c++17 projectwide (#80)
2024-10-04 14:43:26 +03:00