ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-02-02 12:39:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b762db7c9264199c2d0f66e7d63e3b4884f3fc0c
ik_llama.cpp/include
History
Kawrakow b762db7c92 Option to use MLA without a transposed cache (#235) 
The `-mla` command line option turns into an int from a bool.
mla = 0: use standard attention
mla = 1: use MLA with transposed cache
mla > 1: use MLA without transposed cache

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2025-02-27 16:40:49 +02:00
..
llama.h
Option to use MLA without a transposed cache (#235)
2025-02-27 16:40:49 +02:00