ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-02 20:48:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
dcff697474b70d7a2dd6768614901e6c823089e6
ik_llama.cpp/ggml
History
Kawrakow dcff697474 Better strategy for attention matrix multiplications when generating tokens (#218) 
* This seems to be a better way

to do the attention matrix multiplications in the TG case.

* Cleanup

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2025-02-22 09:38:51 +02:00
..
cmake
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
include
Q8_KV: 8-bit quantization type targeting the KV cache (#208)
2025-02-19 11:47:07 +02:00
src
Better strategy for attention matrix multiplications when generating tokens (#218)
2025-02-22 09:38:51 +02:00
.gitignore
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
CMakeLists.txt
FA: Add option to build all FA kernels (#197)
2025-02-09 18:59:33 +02:00