Commit Graph

290 Commits

Author SHA1 Message Date
Even Zhou
2aec8b6e1b [Feature] Spec-Overlap supporting DP-ATTN; PD-Disaggregation; npugraph mode (#12443) 2025-11-15 21:51:07 +08:00
Adarsh Shirawalmath
af373636da CI: add server performance test for SGLang diffusion (#13091)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-15 10:11:19 +08:00
Kangyan-Zhou
8f4e18a294 Add missing model for 2-gpu-runner in nightly tests (#13311) 2025-11-14 17:34:43 -08:00
Kangyan-Zhou
e9681444bd Add missing model in model validate list (#13310) 2025-11-14 17:29:21 -08:00
Kangyan-Zhou
04848ba7cb Add 3 models to 2 gpu runner in model downloading from nightly tests (#13261) 2025-11-13 22:59:18 -08:00
Kangyan-Zhou
9bc6a9adbe Update model weight validation logic to handle special weight file naming (#13256) 2025-11-13 22:07:49 -08:00
alisonshao
9bd511a582 Add model validation for all GPU runners to prevent cache corruption (#13171)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
2025-11-13 10:16:41 -08:00
Douglas Yang
03a7e6f4db Add job and runner failure monitor workflow for CI (#13104) 2025-11-12 14:04:50 -08:00
khalilzhk
2d531946db [Ascend][feature] support L1+ L2 radixcache on ascend (#12214)
Co-authored-by: khalilzhk <zhangkaikai12@huawei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
2025-11-12 20:45:24 +08:00
yctseng0211
28b8c5792d Upgrade to ROCm 7.0 image (#13105) 2025-11-11 19:14:28 -08:00
Kangyan-Zhou
9b247f7374 Export runner labels via env var (#13018) 2025-11-11 13:08:54 -08:00
Sai Enduri
c751cb38b0 [AMD CI] Update CI Version Logic. (#13029) 2025-11-10 20:42:00 -08:00
Peng Zhang
012bfc4fdc [9/n] decouple quantization impl from vllm dependency - adjust ci (#12753) 2025-11-10 14:55:19 -08:00
Kangyan-Zhou
c022107f8b Resolve HF download issue and download models before CI run starts for 8-gpu-h200 runners (#12952) 2025-11-10 11:32:05 -08:00
Kangyan-Zhou
93cf60fc64 Fix Deepseek nightly tests (#12906) 2025-11-09 00:26:06 -08:00
Kangyan-Zhou
4b1d163bfd Add HF cleanup logic in ci_install_dependency.sh (#12895) 2025-11-08 22:56:25 -08:00
Kangyan-Zhou
d134096319 Add Deepseek models into nightly tests (#12865) 2025-11-09 13:17:49 +08:00
Baizhou Zhang
e039ff382c [CI] Fix huggingface access for test_flash_attention_4.py (#12846) 2025-11-07 20:07:06 -08:00
alisonshao
0b88d520a0 Add nightly performance test for GPT-OSS 4GPU models (#12805) 2025-11-07 16:54:07 -08:00
alisonshao
fb314d7bb1 Add bot-bump-kernel-version-to-sglang workflow (#12794) 2025-11-06 14:27:40 -08:00
Baizhou Zhang
9a954982de [chore] SGLang tag management in Dockerfile (#12734) 2025-11-05 19:03:26 -08:00
Baizhou Zhang
9ec6031d70 [chore]Remove dockerfile from target file of bump kernel version (#12728) 2025-11-05 18:01:19 -08:00
Kaixi Hou
0711d1509b [NVIDIA] Fix cutedsl backend of MoE (#12353) 2025-11-04 18:54:55 -08:00
alisonshao
fb9582c4e1 Add multi-GPU configurations to nightly-test.yml (#12585) 2025-11-04 16:46:30 -08:00
Shangming Cai
c2d4716da0 chore: bump mooncake version to 0.3.7.post2 (#12599)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-11-04 01:09:31 -08:00
Baizhou Zhang
15efbcb4e7 [chore] Fix update_kernel_whl_index script for multiple cuda version (#12519) 2025-11-03 16:34:14 -08:00
Shangming Cai
ab8b83f71d chore: upgrade mooncake 0.3.7.post1 (#12541)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-11-03 00:34:32 -08:00
Baizhou Zhang
6e29446e45 [hotfix] Remove flashinfer-jit-cache from pyproject (#12530) 2025-11-02 22:11:05 -08:00
Yineng Zhang
0c3543d7d5 chore: upgrade flashinfer 0.5.0 (#12523)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-02 20:54:12 -08:00
Baizhou Zhang
566ade0388 [CI] Build aarch64 kernels for sgl-kernel test (#12480) 2025-11-01 11:55:42 -07:00
Baizhou Zhang
5f98b7fe61 [CI] Fix kernel installation on aarch runners (#12475) 2025-10-31 14:25:27 -07:00
Zaili Wang
50b6842b4b fix: Add default value for backend in sample_mmmu_requests (#12256) 2025-10-31 19:31:40 +08:00
Lianmin Zheng
2d5605e89b Fix ci install to allow prerelease (#12449) 2025-10-31 02:22:15 -07:00
Keyang Ru
72b5f3d0bb [ci] install released version router (#12410) 2025-10-30 21:59:08 -07:00
Kaixi Hou
c0d02cf4d1 [NVIDIA] Add CI workloads for GB200 (#12242) 2025-10-30 14:32:03 -07:00
Lianmin Zheng
6a63a9852e minor code sync (#12403) 2025-10-30 12:49:31 -07:00
Keyang Ru
4d2f17bd0b [router] Function call support for openai router Responses API (#12386) 2025-10-30 12:45:10 -07:00
Baizhou Zhang
b7fdde4bb4 [ci] Fix ci_install_deepep (#12375) 2025-10-30 11:39:14 -07:00
Xiaoyu Zhang
d8fcbaa38d [CI Monitor] Fix ci_monitor perf analyzer bug (#12281) 2025-10-30 09:47:12 -07:00
Even Zhou
cafebef154 [NPU] bugfix for Qwen3-Next and performance update (#11969) 2025-10-30 21:52:16 +08:00
Baizhou Zhang
621dfb8886 Import flash_mla from sgl-kernel (#12135) 2025-10-29 23:54:21 -07:00
Simo Lin
5259becd3c [bug] fix router installation to include additional dependency (#12348) 2025-10-29 12:45:18 -07:00
Baizhou Zhang
587deb15a7 [hotfix] Fix pytest not found in CI (#12311) 2025-10-29 11:07:36 +08:00
fzyzcjy
2a3763c335 Tiny fix sgl-kernel related CI installing the wrong binary (#12283) 2025-10-28 10:29:06 -07:00
Feng Su
ea96106000 [Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 2 (#10804)
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
2025-10-28 01:25:46 -07:00
ishandhanani
285a8e6986 docker: add CUDA13 support in dockerfile and update GDRCopy/NVSHMEM for blackwell support (#11517)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-27 22:00:54 -07:00
Vincent Zhong
b4d2da106e [docs] upd docker files names everywhere (#12133) 2025-10-25 18:20:23 -07:00
Xiaoyu Zhang
d0cff78f54 [CI] Add ci monitor balance workflow (#11962) 2025-10-25 12:14:36 -07:00
Kangyan-Zhou
22f55e1b15 Fix kernel version bump file (#12087) 2025-10-24 20:32:33 -07:00
Mick
8bd26dd4e6 ci: fix night-ci with push retry mechanism (#11765) 2025-10-23 11:31:05 -07:00