kvcache-ai/sglang
1
0
Fork 0
mirror of https://github.com/kvcache-ai/sglang.git synced 2026-07-08 08:17:41 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,112 Commits 157 Branches 0 Tags
b01b07aa160f6043553c020b8db93d539715ec6c
Commit Graph

6618 Commits

Author SHA1 Message Date
Yuhao Yang
b01b07aa16 [diffusion] CI: GT generation flow for diffusion CI (#19236) 
Co-authored-by: Prozac614 <dwt614707404@163.com>
 2026-02-28 14:07:45 +08:00
Shangming Cai
b01f3590be [PD] Support PD with context parallel after refactor (#19504) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
 2026-02-28 13:11:15 +08:00
Yilong Zhao
79b1d2bac6 [loader] support presharded fused mlp loading (#19519) 2026-02-27 20:37:24 -08:00
Chang Su
71620122c9 feat(grpc): add multimodal TensorData parsing for vision inference (#19535) 
Signed-off-by: Chang Su <chang.s.su@oracle.com>
 2026-02-27 19:29:43 -08:00
Zheng Duan
a2ea5941d5 [feat] Support nvfp4 quantized model of Qwen3-Next (#17627) 2026-02-27 18:28:47 -08:00
Liangsheng Yin
ac400cb7bb [CLI] Add --model-type override and keep launch_server supported (#19523) 2026-02-27 18:16:31 -08:00
Liangsheng Yin
e08ef06758 [Session] Gate streaming sessions with --enable-streaming-session and spec v2 guard (#19531) 2026-02-27 18:14:55 -08:00
Leon Gao
b5a8e4179e [SGL] sync patch: Remove sync points, prefill cudagraph for DP, disable cache reset in mem check (#19190) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
 2026-02-27 18:11:05 -08:00
chenxu214
5f07ff9271 Added the prefill delayer policy: The prefill deplay range is expanded. (#17456) 
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
 2026-02-28 08:56:49 +08:00
Aurick Qiao
c6cb0c9649 [Session] Add streaming mode with SessionAwareCache fast path (#19171) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-02-27 16:31:08 -08:00
Ziang Li
9469ad089b Fix nvfp4 weight update (#18085) 2026-02-27 14:55:08 -08:00
Alison Shao
6ca7da3e7c Fix nightly VLM accuracy: gemma3n TP fixes + removal, latency thresholds (#19401) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-27 14:24:02 -08:00
yrk111222
e6da514c2c CI: use 'sglang serve' in CI tests (#18597) 
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2026-02-27 14:00:41 -08:00
Baizhou Zhang
776709efe8 [3/n] deepseek_v2.py Refactor: Migrate MLA forward method in deepseek_v2.py (#19122) 2026-02-27 13:37:29 -08:00
wufann
7e46aafebb [AMD] Enable cudagraph for aiter nsa backend and add aiter impl for nsa pr… (#18526) 2026-02-27 13:18:32 -08:00
Shu Wang
1b75d0d1a9 Fix BatchMLAPagedAttentionWrapper query/qo_inptr mismatch for EAGLE (#15601) 2026-02-27 11:35:45 -08:00
ishandhanani
6a1480ce45 Fix HiCacheNixl TypeError: mem_pool_host passed as file_path (#19517) 2026-02-27 10:59:32 -08:00
Mohammad Miadh Angkad
35ef38c61b Remove gpt-oss hybrid swa gate for trtllm_mha (#19079) 2026-02-27 10:30:00 -08:00
Michael
1b79934d34 [AMD] Fix AMD CI test of TestToolChoiceLfm2Moe (#19113) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: yctseng0211 <yctseng@amd.com>
 2026-02-27 10:18:15 -08:00
R0CKSTAR
fe4bc8ebd5 [diffusion] fix: MulAdd 4D path (shift indexing) (#18673) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-02-28 01:52:57 +08:00
Makcum888e
b1249ac909 [Diffusion] [NPU] [CI] fix CI performance (#19486) 2026-02-27 18:23:02 +03:00
Yuan Luo
d2885a9094 [Qwen3-Next] Support gdn fused_rms_norm_gated (#19434) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-02-27 23:08:08 +08:00
joesun
ca5f2e2ed1 [diffusion] fix: Support default response_format=url in /v1/images/generations to avoid 400 errors when response_format is omitted (#19360) 
Co-authored-by: Makcum888e <79456407+Makcum888e@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-27 19:47:38 +08:00
AMD-yanfeiwang
f69ca93d49 [AMD] remove redundancy H2D op in aiter attention backend (#19416) 
Co-authored-by: root <root@mia1-p01-g28.mia.tensorwave.lan>
 2026-02-27 02:15:55 -08:00
Yilong Zhao
07da4bed7b [cache] add conservative estimation (#19482) 2026-02-27 18:14:46 +08:00
fxmarty-amd
9496bbd7b1 [AMD] Use tilelang as default NSA attention backend dispatch on AMD Instinct (#18319) 2026-02-27 01:43:34 -08:00
ympcMark
43fade5f69 [4/N] (Elastic EP) Back up Expert Weights in DRAM (#17374) 
Co-authored-by: UNIDY2002 <unidy2002@outlook.com>
 2026-02-27 15:59:13 +08:00
KnightLTC
eef44ec916 [NPU]kimi k2 thinking bugfix (#19387) 
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
 2026-02-27 15:36:38 +08:00
Cao E
4f0f6cd9d0 Add torch.compile support for qwen3-next on CPU (#12444) 2026-02-26 23:28:03 -08:00
KnightLTC
bc9190435b llama4 npu adapt (#17123) 
Co-authored-by: cy <chenyang08056032@163.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
 2026-02-27 14:52:37 +08:00
Ken J
f0c2089597 [vlm][internVL] Support processor and embedding inputs for InternVL (#19127) 2026-02-26 22:46:48 -08:00
triple-mu
8a56cc5836 [diffusion] model: Fix a performance bug in the Wan model about usp (#19340) 2026-02-27 14:36:23 +08:00
elvischenv
af3eccc9ab [Perf] Eliminate the slice op for Flashinfer trtllm_fp4_block_scale_moe (#15731) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2026-02-26 22:23:40 -08:00
wingedge777
d566816d83 fix qwen3_vl visual module loading (#19333) 2026-02-26 19:44:05 -08:00
Alison Shao
52c8a3632a Fix missing StandardCombineInput import in BF16 flashinfer_trtllm MoE (#19400) 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-26 18:32:08 -08:00
Alison Shao
c2dce06d9f Fix parallel tool call test for speculative decoding variants (#19370) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
 2026-02-26 18:31:20 -08:00
littleyellowbicycle
5b5c509480 [NPU][feature adapt]remote load weight feature adp npu (#17968) 
Co-authored-by: littleYellowBicycle <liguo29@huawei.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
 2026-02-27 10:10:36 +08:00
Yizhong Cao
e567215e44 [bugfix]fix fa4 decoding (#19388) 
Co-authored-by: caoyizhong.cyz <caoyizhong.cyz@alibaba-inc.com>
 2026-02-27 09:48:21 +08:00
Sam (Kesen Li)
5194eef88b [Fix] A followup fix for TRTLLM BF16 MoE (#15303) 2026-02-26 17:14:20 -08:00
billishyahao
f0d78f2e20 [AMD] Fix weight load shape mismatch for amd dsr1 0528 mxfp4 (#19425) 2026-02-26 17:11:59 -08:00
fzyzcjy
4add6ec0f6 Enhance displaying and debuggability in dump comparator (#19466) 2026-02-27 09:06:19 +08:00
fzyzcjy
23cbbd6d41 Integrate packed data context parallel in dump comparator (#19464) 2026-02-27 08:28:36 +08:00
Liangsheng Yin
1a32c0db4d [Minor] Rename misleading chunked to reusing in ReqToTokenPool.alloc() (#19465) 2026-02-26 16:24:03 -08:00
fzyzcjy
8293a914a6 Support token align with packed CP data in dump comparator (#19463) 2026-02-27 08:12:54 +08:00
fzyzcjy
695e93b91f Make reorderer support packed format with CP in dump comparator (#19462) 2026-02-27 08:12:18 +08:00
fzyzcjy
e3cdf6b1a3 Support CP packed format in unsharder in dump comparator (#19461) 2026-02-27 08:11:47 +08:00
fzyzcjy
f2d1b7c4ad Support sequence parallel and trivial dims in dump comparator (#19460) 2026-02-27 08:11:15 +08:00
fzyzcjy
eb2ada3804 Support non-packed format when aligning tokens in dump comparator (#19459) 2026-02-27 08:10:29 +08:00
fzyzcjy
e1e0cfd856 Use named tensors in dump comparator (#19458) 2026-02-27 08:09:55 +08:00
fzyzcjy
eb0e905fc3 Update token layout and cleanup printer in dump comparator (#19457) 2026-02-27 08:09:15 +08:00