Files
sglang/python
xwy-amd8 e6428614ab Fix: add DeepseekV3ForCausalLM to MLA detection list
_load_deepseek_v32_model() rewrites architectures from
DeepseekV32ForCausalLM to DeepseekV3ForCausalLM for transformers
compatibility, but the MLA detection list did not include
DeepseekV3ForCausalLM, causing use_mla_backend=False and
MHATokenToKVPool to be created instead of NSATokenToKVPool/MLATokenToKVPool.
2026-02-26 15:23:59 +00:00
..