mirror of
https://github.com/kvcache-ai/sglang.git
synced 2026-07-12 02:16:57 +00:00
_load_deepseek_v32_model() rewrites architectures from DeepseekV32ForCausalLM to DeepseekV3ForCausalLM for transformers compatibility, but the MLA detection list did not include DeepseekV3ForCausalLM, causing use_mla_backend=False and MHATokenToKVPool to be created instead of NSATokenToKVPool/MLATokenToKVPool.