saood06 ffd87f282e Make prompt cache saving and restoring MLA aware (#497) ...

* Remove kv_l, kvt_l and just use k_l and v_l

* Hopefully take care of missing V cache (MLA)

* Fix save and restore when there is no V cache

* Fix double print

* Update write_kv_cache_data and read_kv_cache_data to be MLA aware

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2025-06-06 11:33:47 +03:00

..

CMakeLists.txt

Be able to repack tensors at run time (#147)

2024-12-17 14:16:34 +01:00

llama-grammar.cpp

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

llama-grammar.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

llama-impl.h

Add copyright notices (#317)

2025-04-07 10:43:26 +02:00

llama-sampling.cpp

Adding top-n-sigma sampler (#489)

2025-06-03 17:35:09 +03:00

llama-sampling.h

Adding top-n-sigma sampler (#489)

2025-06-03 17:35:09 +03:00

llama-vocab.cpp

LlaMA-4 support (text only) (#321)

2025-04-10 09:05:21 +02:00

llama-vocab.h

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

llama.cpp

Make prompt cache saving and restoring MLA aware (#497)

2025-06-06 11:33:47 +03:00

unicode-data.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode-data.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode.cpp

Deepseek V3 support added (#176)

2025-01-23 18:24:10 +02:00

unicode.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00