saood06 d58dee869a Deepseek MLA Optimizations V2 (#195) ...

* Avoid allocating MHA KV cache when MLA is turned on

* Added missing gguf-py file

* Added final optimizations

Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com>

* Make sure we do have wk_b and wv_b before enabling MLA

---------

Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com>
Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>

2025-02-09 09:36:54 +02:00

..

__init__.py

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

constants.py

Deepseek MLA Optimizations

2025-02-08 11:04:01 +02:00

gguf_reader.py

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

gguf_writer.py

Deepseek V3 support added (#176)

2025-01-23 18:24:10 +02:00

gguf.py

gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981)

2023-11-11 08:04:50 +03:00

lazy.py

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

metadata.py

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

py.typed

convert : various script cleanups/fixes + merges and special token handling (#2842)

2023-08-30 11:25:50 +03:00

quants.py

Merge mainline - Aug 12 2024 (#17)

2024-08-12 15:14:32 +02:00

tensor_mapping.py

Deepseek MLA Optimizations V2 (#195)

2025-02-09 09:36:54 +02:00

utility.py

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

vocab.py

Move convert.py to examples/convert-legacy-llama.py (#7430)

2024-05-30 21:40:00 +10:00