kvcache-ai/sglang
1
0
Fork 0
mirror of https://github.com/kvcache-ai/sglang.git synced 2026-07-14 19:37:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,173 Commits 157 Branches 0 Tags
70fc4ce3efcf54ca91d239cefd044fc71bda2a02
Commit Graph

1198 Commits

Author SHA1 Message Date
yuefeng Wu
c9f5d1d502 [Diffusion][NPU] add ring sp performance benchmark page in npu (#21811) 2026-04-01 18:53:10 +03:00
amote-i
80b1bc5f56 [NPU] update ascend docs (#21807) 2026-04-01 17:14:26 +08:00
Brayden Zhong
6a9b09847c CUTLASS NVFP4 GEMM improvement of SM120 (#21314) 2026-04-01 09:04:34 +08:00
yuefeng Wu
a20d12ae96 [diffusion][doc]: add ring sp performance benchmark page (#20998) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-30 20:26:05 +03:00
Makcum888e
f4b0e9c64a [diffusion] [NPU] support ring attention on NPU with FA (#21383) 2026-03-30 20:10:55 +03:00
Mick
b76730701b [diffusion] feat: enhance overlay mechanism (#21648) 2026-03-30 19:45:34 +08:00
Michelle Wu
965f03cdc2 [NPU] Update DeepSeek-V3.2 model deployment instructions in documentation (#21468) 
Co-authored-by: wuxue (C) <w00964934@china.huawei.com>
 2026-03-30 15:51:42 +08:00
Aishwarya Ramasethu
c32ee48886 MFU metrics in Prometheus (#19395) 2026-03-29 23:40:06 -07:00
Baizhou Zhang
5b19c9a05d [Doc] Update tips for developer new-comers (#21659) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-29 22:40:36 -07:00
Shu Wang
efebcab43e Support skip-softmax attention (#19089) 2026-03-28 15:55:48 -07:00
Артем Савкин
27071e0a43 [NPU] Update quantization&CI documentation (#21100) 
Co-authored-by: Tamir Baydasov <41994229+TamirBaydasov@users.noreply.github.com>
 2026-03-28 21:42:21 +03:00
Mick
fc9de157f9 [diffusion] feat: support overlay model materialization (#21600) 2026-03-28 23:02:38 +08:00
Baizhou Zhang
edd4d54023 [Clean] Remove deprecated environs (#21536) 2026-03-28 00:35:44 -07:00
Lianmin Zheng
83997080a6 docs: flesh out MAINTAINER.md oncall lists and link GitHub profiles (#21575) 2026-03-27 17:39:16 -07:00
zwang86
5fc5c18bed fix(security): replace unsafe pickle.loads with SafeUnpickler for CVE-2026-3989 (#20904) 2026-03-27 00:43:41 -07:00
SevenJ
2e65c27b29 Api add flush cache timeout (#21413) 
Signed-off-by: root <wenjun7j@gmail.com>
 2026-03-26 14:44:37 -07:00
Nave Assaf
77872a8d55 Update Nemotron Example docs to include Super v3 and Nano 4B (#21416) 
Signed-off-by: Nave Assaf <nassaf@nvidia.com>
 2026-03-25 12:03:19 -04:00
Mick
6425df5c8a [diffusion] doc: consolidate documentation (#21373) 2026-03-25 16:01:32 +08:00
amote-i
2d583799eb Update ascend docs (#20846) 2026-03-25 09:58:44 +03:00
Mick
6cc5717e8a [diffusion] doc: update quantization.md (#21356) 2026-03-25 14:48:38 +08:00
Duyi-Wang
61a902ce88 [AMD][MoRI] Auto-select dispatch quantization type from MoE weight dtype. (#21040) 2026-03-24 22:53:57 -07:00
Jiaxin(Jackson) Deng
c4db64c16b Add Lychee Doc Links Check to Local and CI (#19742) 
Co-authored-by: Zijie Xia <zijie_xia@icloud.com>
Co-authored-by: Zijie Xia <zijiexia@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
 2026-03-24 13:48:26 -07:00
Lianmin Zheng
27ac831a84 docs: improve CI and testing documentation (#21202) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-23 10:48:50 -07:00
kpham-sgl
bc4aaab6a1 [Spec][Ngram] 2/N: Rename branch length to max trie depth (#21181) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-22 23:35:25 -07:00
Xiaoyu Zhang
766d225fcc Add SGLang CUDA crash API logging inspired by FlashInfer (#20910) 2026-03-22 16:39:40 +08:00
kpham-sgl
6d160b42bb [Spec][Ngram] 1/N: Reference based Speculative Decoding refactor (#20393) 2026-03-22 00:55:10 -07:00
Rabinovich
3798a8c88d docs: add out-of-tree model integration guide (#21050) 
Co-authored-by: Yixiao Zeng <yixiao.zeng@xiaopeng.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
 2026-03-20 20:07:46 -07:00
Lianmin Zheng
2d7a262ca3 ci: rename 1/2-gpu-runner labels to 1/2-gpu-h100 (#21008) 2026-03-20 06:04:15 -07:00
Cao E
274581fb77 Add support for more batch sizes in cpu_graph_runner (#13881) 2026-03-19 09:50:56 -07:00
blzheng
cbea9f6909 [CPU] improve numa memory binding (#19666) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-18 22:15:50 -07:00
Xinyuan Tong
d1e95af282 Upgrade transformers==5.3.0 (#17784) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
Co-authored-by: Alison Shao <alisonshao@mac.lan>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-18 13:50:43 -07:00
ishandhanani
8f0f36c64b [1/2] Add ModelExpress coordination for remote instance weight loading - matching TP (#19920) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Ishan Dhanani <ishan@dhanani.dev>
 2026-03-18 13:38:32 -07:00
Lianmin Zheng
46a392658e Refine RL & Post-Training description in README (#20877) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-18 12:43:42 -07:00
Xiaoyu Zhang
20a23e3173 [SKILL] Refine kernel authoring docs and validate add-jit-kernel / add-sgl-kernel end to end with Codex (#20867) 2026-03-18 23:00:33 +08:00
Ke Bao
c42da50289 Update test guide to contribution guide (#20805) 2026-03-18 13:25:16 +08:00
Qiaolin Yu
c5d2528bff Revert "[AMD][MORI] Fix MTP crash with FP4/FP8 dispatch and add NEXTN dispatch env vars." (#20797) 2026-03-17 17:28:09 -07:00
Kangyan-Zhou
3d8fc9a0ca Revert "[Nvidia] Add trtllm mnnvl allreduce with unified flashinfer allreduce fusion api" (#20792) 2026-03-17 11:59:02 -07:00
Shu Wang
d35fea1b2b [Nvidia] Add trtllm mnnvl allreduce with unified flashinfer allreduce fusion api (#12787) 2026-03-17 10:02:45 -07:00
Duyi-Wang
385a35bd11 [AMD][MORI] Fix MTP crash with FP4/FP8 dispatch and add NEXTN dispatch env vars. (#20647) 2026-03-17 01:13:42 -07:00
DefTruth
025691cd9e [diffusion] chore: bump up cache-dit & support quant for diffusers backend (#20361) 2026-03-17 12:51:31 +08:00
amote-i
210d0fbaef Update ascend docs (#20674) 2026-03-16 20:14:26 -07:00
Xiaoyu Zhang
15097c5c3b Release sglang kernel 0.4.0 (#20440) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-16 20:34:58 +08:00
amote-i
da1793f63a update ascend feature docs (#20506) 2026-03-15 20:09:20 -07:00
AnonTokyo
e9fae69e5f docs: align environment variable reference with environ defaults (#20419) 2026-03-15 18:07:29 -07:00
Teng Ma
7c498a6538 [DOC] add documents for encoder global mm cache (#20636) 2026-03-15 16:44:21 -07:00
Mook
23c191afb6 fix(docs): correct quantization documentation (#20301) (#20619) 2026-03-15 12:33:12 -04:00
Liangsheng Yin
fc7f9c1de7 Rename --stream-output to --incremental-streaming-output (#20614) 2026-03-14 23:22:33 -07:00
Matt Van Horn
6c5bf53a36 [Doc] Clarify that --chat-template is required for Qwen3-Reranker (#20596) 
Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-14 23:43:48 +00:00
Baizhou Zhang
39008955ff Revert "[AMD][MORI] Fix MTP crash with FP4/FP8 dispatch and add NEXTN dispatch env vars." (#20602) 2026-03-14 12:12:42 -07:00
Duyi-Wang
0eea80bc00 [AMD][MORI] Fix MTP crash with FP4/FP8 dispatch and add NEXTN dispatch env vars. (#20453) 2026-03-13 14:03:17 -07:00