kvcache-ai/sglang
1
0
Fork 0
mirror of https://github.com/kvcache-ai/sglang.git synced 2026-07-18 17:57:37 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,161 Commits 157 Branches 0 Tags
e67b95d66b092fa36f666fc2a575e76f45464441
Commit Graph

130 Commits

Author SHA1 Message Date
Zhiqiang Xie
9eb75211b1 style refinement for hisparse (#21198) 2026-04-01 01:03:17 -07:00
sglang-bot
ca3ba05a7a chore: bump flashinfer version to 0.6.7 (#21422) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-31 21:18:16 -07:00
Brayden Zhong
6a9b09847c CUTLASS NVFP4 GEMM improvement of SM120 (#21314) 2026-04-01 09:04:34 +08:00
Johnsonms
5bbf347bb3 [jit_kernel] Optimize fused_qknorm_rope: deduplicate sincosf for interleave RoPE (#21654) 2026-04-01 09:04:13 +08:00
Xiaoyu Zhang
cdd7d6a227 Remove obsolete sgl-kernel legacy paths (#21528) 2026-04-01 09:00:20 +08:00
jacky.cheng
8ba992411d [AMD] Fix CI multimodal-gen-test-1-gpu-amd for gen model (#21621) 2026-03-30 23:02:20 -07:00
DarkSharpness
4e480982fa [misc] multiprocess compilation to speed up test (#21483) 2026-03-31 08:56:37 +08:00
huangtingwei
d864622a68 [Hicache & JIT_kernel] Support page first layout & mla jit kernel (#18311) 2026-03-27 08:54:36 -07:00
Xiaoyu Zhang
9238bd08a2 [CI] Register missing jit_kernel test files (#21547) 2026-03-27 19:39:08 +08:00
Xiaoyu Zhang
d633ab7349 [Diffusion] Add qknorm rope fuse kernel (#21440) 2026-03-27 14:27:08 +08:00
Xiaoyu Zhang
e8d46f145c Opt jit qknorm_across_heads cuda kernel (#21503) 2026-03-27 13:30:46 +08:00
Johnsonms
8a56a7b04d [jit_kernel] Migrate cast (downcast_fp8) from sgl-kernel AOT to JIT (#19103) 2026-03-27 13:21:44 +08:00
Johnsonms
c531be455e [jit_kernel] Add fused_qknorm_rope JIT kernel (#19059) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-03-27 13:21:28 +08:00
R0CKSTAR
a305964159 [MLX] Add native MLX execution backend for Apple Silicon Mac (#20342) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2026-03-26 00:09:17 -07:00
Xiaoyu Zhang
7ca015fe65 [Diffusion] Refactor diffusion JIT kernel test layout and narrow CI triggers (#21385) 2026-03-26 15:02:02 +08:00
DarkSharpness
bb29893689 [Fix] Try to fix nvcc compilation error (#21246) 2026-03-26 10:59:36 +08:00
Xiaoyu Zhang
6f2b51ade1 [Diffusion] Optimize diffusion Triton rotary embedding by processing multiple heads per token (#21387) 2026-03-26 08:59:25 +08:00
Xiaoyu Zhang
68f7f00174 [Diffusion] Speed up Qwen select01 Triton modulation kernels (#21318) 2026-03-25 20:48:39 +08:00
DarkSharpness
3d2a61cbf6 [Chore] Clean up JIT compilation flags (#21022) 2026-03-25 18:08:40 +08:00
Yuan Luo
f273ba1ccc [KDA] Support CuTeDSL KDA decode kernel (#21203) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-25 09:47:09 +08:00
DarkSharpness
dfc15b78b0 [misc] clean up kernel API (#21325) 2026-03-25 09:10:23 +08:00
Lianmin Zheng
260abe1fb1 Refactor JIT kernel CI to use run_suite.py registration system (#21239) 2026-03-23 21:17:27 -07:00
Lianmin Zheng
27ac831a84 docs: improve CI and testing documentation (#21202) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-23 10:48:50 -07:00
Johnsonms
777edb6ef7 Fix(jit): support rmsnorm for hidden_size in {64, 128, 256} (#20661) 2026-03-23 23:17:44 +08:00
Yuan Luo
5bdc07d974 [Qwen3.5] Fuse split/reshape/cat ops in GDN projection with Triton kernel (#21019) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-23 23:17:01 +08:00
Lianmin Zheng
814202704b ci: unify PR test suite naming (#21187) 2026-03-23 00:18:45 -07:00
Zhiqiang Xie
13f4f010d8 HiSparse for Sparse Attention (#20343) 2026-03-22 23:09:31 -07:00
Lianmin Zheng
7050011dee Enable JIT clamp_position and resolve_future_token_ids on ROCm (#21116) 2026-03-22 22:33:54 -07:00
Xiaoyu Zhang
c1fe5de69c [Diffusion] Clean up diffusion Triton kernels and modernize custom op registration (#21122) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-22 22:38:57 +08:00
Xiaoyu Zhang
766d225fcc Add SGLang CUDA crash API logging inspired by FlashInfer (#20910) 2026-03-22 16:39:40 +08:00
Xiaoyu Zhang
1b65c0d259 [Diffusion] Fix torch.compile RMSNorm fallback for Z-Image (#20962) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-22 15:38:22 +08:00
Lianmin Zheng
76e4a8662c Replace clamp_position with JIT kernel + platform dispatch (#20999) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-21 21:26:26 -07:00
Xiaoyu Zhang
c076968c52 [CI] Remove obsolete AOT-only jit-kernel benchmarks after sgl-kernel 4.0 (#21075) 2026-03-21 13:40:42 +08:00
Lianmin Zheng
104b10f70a refactor: consolidate is_in_ci (jit_kernel, sgl-kernel benchmarks, tests) (#21009) 2026-03-20 05:55:36 -07:00
xingsy97
f41832795e Add compile-time 256-bit vector guard for pre-Blackwell (#19794) 2026-03-20 18:25:12 +08:00
DarkSharpness
2dd9196079 [JIT Kernel][Feature] Support JIT custom all reduce (rewrite as v2) (#19880) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-03-20 18:24:07 +08:00
Jia Guo
ec01ef9092 Fix torch.compile/dynamo crash with Qwen3 QK-norm in piecewise CUDA g… (#19818) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-20 18:05:09 +08:00
Lianmin Zheng
112b628227 Replace _resolve_future_token_ids with JIT kernel + platform dispatch (#20976) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-20 01:47:03 -07:00
Mohammad Miadh Angkad
3d749c49ca [JIT Kernel] Fix NVFP4 multi-arch compilation failure (#20874) 2026-03-20 10:30:04 +08:00
xingsy97
d20e9a20fa [JIT] Inject target architecture flag into JIT compilation (#20103) 2026-03-17 23:16:49 -07:00
xingsy97
f78d5c3b3c [JIT Kernel] Add hadamard kernel test and benchmark (#20030) 2026-03-17 23:16:35 -07:00
Rain Jiang
cb1e63aba4 bump fa4 to official released fa4 pkg (#20303) 2026-03-17 17:22:56 -07:00
Xiaoyu Zhang
15097c5c3b Release sglang kernel 0.4.0 (#20440) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-16 20:34:58 +08:00
Xiaoyu Zhang
e1eb25880f [Diffusion] Add a benchmark for rmsnorm/fuse_add_rmsnorm (#20632) 2026-03-16 09:50:33 +08:00
Xiaoyu Zhang
25e38216b6 [kernel slimming] Clean many useless sgl-kernel deprecated kernels (#20277) 2026-03-14 16:45:54 +08:00
Xiaoyu Zhang
e00328d1e5 [Diffusion] Opt qwen-image-edit with fuse_residual_layernorm_scale_shift_gate_select01_kernel (#20395) 
Co-authored-by: Yihan Chen <yingluosanqian@gmail.com>
 2026-03-13 13:15:22 +08:00
Xiaoyu Zhang
7ecf07b8f4 [jit_kernel] Temporarily Skip Flaky JIT Kernel GDN Test and Add PR Label (#20436) 2026-03-13 09:34:22 +08:00
Ethan (Yusheng) Su
af2807e146 [LoRA][I] Add MOE LoRA JIT alignment kernel and tests (#19710) 
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Jonah Bernard <96398205+Jonahcb@users.noreply.github.com>
 2026-03-12 12:23:46 -07:00
R0CKSTAR
db97f193b7 [diffusion][llm] macOS support (#19549) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-10 13:11:07 -07:00
Xiaoyu Zhang
60cc06297e [4/n jit_kernel restruct] speed up CI tests and add benchmark workflow (#20268) 2026-03-10 21:37:41 +08:00