ikawrakow/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-01-27 01:29:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
4071472bdc6bbed54bba716ada18fdf324bb84d2
ik_llama.cpp/include
History
Kawrakow 2e585d4508 Enable faster prompt processing with mainline llama.cpp GGUFs (#409) 
* Enable MLA-3 in crippled GGUFs: WIP

* Enable MLA-3 in crippled GGUFs: seems to work

* Add newly created tensors to model.tensors_by_name

Else they don't get run-time repacked.

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2025-05-12 07:49:51 +03:00
..
llama.h
Enable faster prompt processing with mainline llama.cpp GGUFs (#409)
2025-05-12 07:49:51 +03:00