kvcache-ai/sglang
1
0
Fork 0
mirror of https://github.com/kvcache-ai/sglang.git synced 2026-07-07 07:47:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
9,813 Commits 157 Branches 0 Tags
48642d5384431cff6ea3eb697b141e98fe6aa106
Commit Graph

6371 Commits

Author SHA1 Message Date
pansicheng
48642d5384 [RadixTree][4/N Refactor]: Move available_and_evictable_str to individual radix cache classes (#17852) 2026-02-19 17:03:15 +08:00
shaharmor98
82a0bafc1c Feat/add fi selective state update kernel call (#18070) 
Signed-off-by: Shahar Mor <smor@nvidia.com>
 2026-02-19 16:56:06 +08:00
Yuwei An
0be30d4b0d Fix PCG MoE Error (#17739) 2026-02-19 16:48:06 +08:00
hlu1
bba2fc49a1 [Qwen3.5] Enable nvfp4 checkpoint (#18937) 2026-02-19 12:24:05 +08:00
hxie
443b1a88d1 Add batched zero copy to NIXL backend (#18850) 
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2026-02-18 16:31:02 -08:00
Bingxu Chen
462267982b [AMD] Fix mi35x dsv32 mtp nightly (#18978) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
 2026-02-18 16:23:17 -08:00
Alison Shao
e2fccb2ee0 Fix flaky Qwen3-Next KL divergence tests by reverting mamba slot release (#18910) 2026-02-19 07:55:16 +08:00
Mengyang Liu
4f980f6f23 [Feature] Implement update_weights_from_disk for SGLang-D (Diffusion … (#18306) 
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
 2026-02-18 11:24:07 -08:00
Tamir Baydasov
150ed881be [4/N] Quantization Refactor: Quark MoE schemes (#18252) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-02-18 19:44:30 +03:00
Ethan (Yusheng) Su
9c5aae4df5 [Fix] Add lora tied lm head support (for Qwen2.5, Gemma, etc model need) (#18634) 2026-02-19 00:34:51 +08:00
Yuhao Yang
5a7ae059e3 Add DP ViT support for Kimi K2.5 (#18689) 2026-02-18 23:03:07 +08:00
zijiexia
eb6ff4a940 [diffusion] fix: refactor task resolution logic in benchmark function for multimodal generation (#18948) 2026-02-18 20:57:42 +08:00
Xiaoyu Zhang
390c154306 [Tiny fix] Super tiny fix mul_add naive forward bug (#18964) 2026-02-18 16:18:43 +08:00
Xiaoyu Zhang
513c12d23f Remove unused fast-hadamard-transform PyTorch extension sources (#18927) 2026-02-18 15:51:07 +08:00
Mick
420a611275 [diffusion] refactor: unify SamplingParams construction and improve DiffGenerator return types (#18928) 2026-02-18 14:56:58 +08:00
DarkSharpness
9d138685c1 [Refactor] Fix test and clean up hicache code (#18555) 2026-02-18 14:37:46 +08:00
William Arnold
95c44cea29 [feat] Add return_routed_experts param to async_generate for parity with generate (#18508) 2026-02-17 22:11:19 -08:00
Neal Vaidya
ac0e493329 feat: add nsa and swa disagg support with nixl (#18939) 
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
 2026-02-18 13:13:26 +08:00
Liangsheng Yin
2d85f01d43 Revert "Fix generated-shared-prefix bench_serving" (#18956) 2026-02-17 20:43:55 -08:00
Zheng Li
fa5698d791 feat: [Qwen3.5] Support block-wise FP8 quantization and model adaptation (#18926) 2026-02-18 11:44:25 +08:00
Yan Ru Pei
83e24e2eb4 Expose priority parameter in Engine.generate() and Engine.async_generate() (#18944) 
Signed-off-by: PeaBrane <peabrane@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-17 19:14:22 -08:00
Alison Shao
34d975b18f Fix eval tests not capturing server launch failures (#18886) 2026-02-18 07:59:03 +08:00
Lianmin Zheng
e02a9bec8d Refactor sampler: Use a better hash function for deterministic sampling and clear dispatch for probs/logprobs/logits sampling paths (#18915) 
Co-authored-by: Sehoon Kim <sehoon@x.ai>
 2026-02-17 15:41:23 -08:00
Liangsheng Yin
83a475e8d7 feat: add cuda core dump CI warpper (#18909) 2026-02-17 14:49:26 -08:00
Ratish P
9a7d6be567 cleanup prefill metrics logging to fix dp-attn metrics (#18778) 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-02-17 14:35:35 -08:00
Qiaolin Yu
3c601db031 Fix generated-shared-prefix bench_serving (#18769) 2026-02-17 14:00:22 -08:00
Nickcp39
48fcd62d1f fix(glm-image): single-GPU T5 config + SP support for 4D latents (#18… (#18739) 
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
 2026-02-17 13:04:32 -08:00
Tamir Baydasov
aeca7d348c [3/N] Quantization Refactor: ModelSlim MoE schemes (#17993) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-02-17 21:38:27 +03:00
Simo Lin
bf08d3f43c [gRPC] Fix scheduler startup broken by context parallel refactor (#18933) 
Co-authored-by: Chang Su <chang.s.su@oracle.com>
 2026-02-17 08:52:11 -08:00
triple-mu
504b2c58cf [diffusion] improve: improve torch.compile for MOVA (#18914) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-18 00:47:38 +08:00
Minglei Zhu
bf52388354 [PCG] support piecewise cuda graph for kimi-linear model (#18849) 2026-02-17 23:31:12 +08:00
Mick
bfe34c90ff Revert "[diffusion] operator: unify rotary embedding impl" (#18929) 2026-02-17 22:56:04 +08:00
Makcum888e
2aa0db7d9c [Diffusion] [NPU] Fix CI run (#18921) 2026-02-17 16:54:19 +03:00
HAI
8bb1037796 ROCm use rotary_embedding from sgl-kernel (#18920) 2026-02-17 03:00:37 -08:00
Makcum888e
5f81ec1ad5 [Diffusion] Fix get model name when model local path end with "/" (#18918) 2026-02-17 13:19:54 +03:00
Ratish P
f6cc02489f [diffusion]: fix sparse video gen 2 backend being applied to cross-attention (#18900) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-02-17 13:17:46 +03:00
HAI
b158f5d4a2 Revert "[AMD] Fix RotaryEmbedding crash on AMD/ROCm (regression from #17934)" (#18922) 2026-02-17 01:07:50 -08:00
billishyahao
899e2be7d0 [TBO] fix cuda graph intermittently becomes disabled bug (#18320) 2026-02-16 22:18:57 -08:00
Michael
5e3103a787 [AMD] Fix RotaryEmbedding crash on AMD/ROCm (regression from #17934) (#18903) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
 2026-02-17 12:59:40 +08:00
Mohammad Miadh Angkad
90a0d66e1e [Tiny] Fix assert syntax warning in compressed_tensors_w4a4_mxint4_moe.py (#18899) 2026-02-17 12:54:30 +08:00
Yilong Zhao
d5307ce022 [misc] adding metadata field in UpdateWeightFromDiskReqInput (#18821) 2026-02-17 12:14:15 +08:00
triple-mu
26b2c63d03 [diffusion] operator: unify rotary embedding impl (#18164) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-17 12:02:48 +08:00
pansicheng
b21390f8f3 Adapt the Qwen2Model._update_causal_mask for transformers==4.57.1 (#18774) 2026-02-17 10:20:41 +08:00
Ratish P
50ca24aebb [diffusion]: fix scheduler crash on ZMQ messages with unexpected frame counts (#17890) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-17 09:45:05 +08:00
Frank Minors
1b659bcb08 Fix GLM-5 fused shared expert (#18804) 
Co-authored-by: FrankMinions <liuchen@shinemo.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-02-16 19:50:39 +00:00
danielafrimi
0ff24159a5 Fix modelopt FP8 create weights (#18447) 
Signed-off-by: root <dafrimi@nvidia.com>
 2026-02-17 00:59:50 +08:00
Tamir Baydasov
eba6af385d [2/N] Quantization Refactor: Compressed tensors MoE schemes (#17503) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
 2026-02-16 18:03:51 +03:00
Estrella-xx
1b3513a7e4 refactor FAKE transfer backend and remove --disaggregation-decode-enable-fake-auto parameter (#18345) 2026-02-16 17:27:02 +03:00
Ratish P
c1d1337afc [diffusion][Wan]: fix sparse attention backends being applied to cross-attention (#17596) 2026-02-16 21:57:58 +08:00
Mohammad Miadh Angkad
b86c6491fa [Perf] ~9.5x faster Blackwell MXFP4 MoE weight loading (#18858) 2026-02-16 19:47:09 +08:00