billishyahao
|
fbb6098487
|
[AMD] support two batch overlapping for mori ep (#17953)
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
Co-authored-by: Feiyue Zhai <feiyue.zhai@amd.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-02-20 08:45:55 -08:00 |
|
Mohammad Miadh Angkad
|
2f592c3b18
|
[Doc] Add flashinfer_deepgemm to --fp8-gemm-backend (#18982)
|
2026-02-18 14:45:47 -05:00 |
|
Estrella-xx
|
1b3513a7e4
|
refactor FAKE transfer backend and remove --disaggregation-decode-enable-fake-auto parameter (#18345)
|
2026-02-16 17:27:02 +03:00 |
|
Rain Jiang
|
0ffd0a3995
|
Nsa trtllm mla sparse fp8 support with Deepseek v3.2 NVFP4 (#18389)
|
2026-02-16 09:29:54 +08:00 |
|
dongjiyingdjy
|
8b4c364960
|
refactor context parallel state (#17213)
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
|
2026-02-13 23:18:17 +08:00 |
|
danielafrimi
|
e422bcaed8
|
[Mamba] Add float16 support for SSM cache dtype (#18444)
|
2026-02-12 11:27:47 +08:00 |
|
qianyue76
|
f06ab17a73
|
[diffusion] docs: consolidate diffusion documentation into docs (#18095)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: JiaxinD <djx2048@gmail.com>
|
2026-02-11 16:55:07 -08:00 |
|
Baizhou Zhang
|
947927bdb5
|
[V3.2] Change default CP token split method to --round-robin-split (#18613)
|
2026-02-11 20:14:35 +08:00 |
|
Mohammad Miadh Angkad
|
fddef76619
|
[Doc] Fix outdated --fp4-gemm-backend documentation (#18350)
|
2026-02-07 20:42:47 +08:00 |
|
rinbaro
|
de6a03260f
|
[docs] fix misspellings & typos (#18276)
|
2026-02-05 03:35:29 +00:00 |
|
Viacheslav
|
74f716dbd7
|
Gigachat 3 tool parser and tests (#14765)
|
2026-02-02 22:28:34 -08:00 |
|
Ziang Li
|
3c9cc44ff5
|
Add mxfp8 support for online quantization, Triton dense linear, and CUTLASS MoE (#17449)
|
2026-01-29 21:33:57 +08:00 |
|
Baizhou Zhang
|
832c756549
|
[Doc] Tiny update description on torch compile (#17819)
|
2026-01-27 18:59:04 +08:00 |
|
Yi Zhong
|
08fcda2f63
|
add the fa4 mm backend and varlen func (#13539)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-01-23 23:12:06 +08:00 |
|
hxie
|
13f88045b3
|
configuration file support and nixl integration augmentation for hicache-storage-backend-extra-config (#16602)
|
2026-01-22 14:31:48 -08:00 |
|
zijiexia
|
4ecd9afde9
|
[Docs] Rename SGLang Router to SGLang Model Gateway (#17436)
|
2026-01-20 12:31:10 -08:00 |
|
b8zhong
|
f374623fa9
|
[Refactor] Set fp4-gemm-backend=auto on SM100 and rename fp4-gemm-backend with flashinfer_ prefix (#17309)
|
2026-01-19 20:09:07 +08:00 |
|
Glen Liu
|
ad1b4e4728
|
[Feature] overlap LoRA weight loading with compute (#15512)
|
2026-01-19 10:43:17 +08:00 |
|
Xinyuan Tong
|
2069050d3f
|
fix: Handle multiple named chat templates in HuggingFace tokenizers (#17236)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-01-18 17:20:04 +08:00 |
|
shuwenn
|
8ec160ed46
|
feature: support uvicorn access log filter(disable logging /metrics) (#15513)
|
2026-01-15 20:00:06 -08:00 |
|
shuwenn
|
9227d9f60c
|
[Docs] sort and update server_arguments.md (#17163)
|
2026-01-15 12:07:18 -05:00 |
|
Glen Liu
|
6b065298b5
|
[Docs] add routing-key to schedule-policy in docs (#17101)
|
2026-01-14 22:22:07 -05:00 |
|
shuwenn
|
cd33694585
|
feat: add --admin-api-key for finer-grained endpoint auth (#15908)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-01-13 20:21:55 -08:00 |
|
Ratish P
|
c0248d6f37
|
[dpc]: unify DP controller load balancing and simplify dispatch logic (#16258)
|
2026-01-11 12:38:03 +08:00 |
|
Huapeng Zhou
|
078270473a
|
[Doc] Default lora backend: csgmv (#16444)
|
2026-01-05 12:45:49 +08:00 |
|
Yongfei Xu
|
0d244116d2
|
[DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959)
|
2026-01-02 23:49:14 +08:00 |
|
Huaixin Chang
|
c1dfbc777b
|
deprecate prefill-round-robin-balance (#16195)
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-31 22:25:33 +08:00 |
|
Mufeez Amjad
|
cbff7ad985
|
dp-attention: add follow_bootstrap_room + auto load-balance; drop decode_round_robin (#16110)
|
2025-12-30 22:33:06 +08:00 |
|
Xinyuan Tong
|
0a346d3bd9
|
feat: Add limit-mm-data-per-request argument to server arguments (#15418)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-12-20 10:44:47 -08:00 |
|
Yuxuan Zhang
|
b82c7a0ae7
|
[GLM-4.7] GLM-4.7 Tool Parser and Doc Update (#15333)
|
2025-12-19 20:30:44 -08:00 |
|
elvischenv
|
435d1c83c1
|
[Perf] Enable Flashinfer autotune by default (#14357)
|
2025-12-16 23:01:39 -08:00 |
|
Hanming Lu
|
e61dabf5e4
|
[Qwen3-next] support mamba radix cache for overlap scheduler (#14792)
|
2025-12-14 18:54:16 -08:00 |
|
b8zhong
|
55504df2f7
|
Add FP8 Blockwise GEMM Backend Flag --fp8-gemm-backend (#14379)
|
2025-12-09 12:05:56 -08:00 |
|
Rain Jiang
|
ea177372bd
|
support mtp with deepseek r1 nvfp4 model (#13115)
Co-authored-by: Trevor Morris <tmorris@nvidia.com>
|
2025-12-06 00:45:54 -08:00 |
|
Baizhou Zhang
|
42fcf5438f
|
Revert "tiny remove deprecated endpoint call" (#14533)
|
2025-12-05 23:48:54 -08:00 |
|
b8zhong
|
ec7b2c16d9
|
tiny remove deprecated endpoint call (#13607)
|
2025-12-05 09:54:49 -08:00 |
|
b8zhong
|
e6420100ee
|
sync attention doc and ep doc to doctree (#14257)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-01 21:15:22 -08:00 |
|
Lianmin Zheng
|
bc3d2a85af
|
[Minor] update docs (#14212)
|
2025-12-01 02:33:58 -08:00 |
|
Liangsheng Yin
|
6c190cbda0
|
Rename: --hooks to --forward-hooks (#13994)
|
2025-11-26 22:26:28 +08:00 |
|
Binyao Jiang
|
b29769f3b6
|
Move unnecessary input_addr capture under debug mode flag for speed-up (#13690)
|
2025-11-22 11:42:26 -08:00 |
|
wingedge
|
f1be8aa0f2
|
chore: add an unified server arg for multimodal inputs preprocess config(#12149)
Co-authored-by: bianfeng <bianfeng@pinduoduo.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-11-18 12:18:50 +08:00 |
|
Carlo Mussolini
|
df56139226
|
Adding user defined hooks support (#13217)
|
2025-11-17 23:07:37 +08:00 |
|
lixiaolx
|
d368c7451a
|
(1/n)support context parallel with deepseekv3.2-DSA (#12065)
|
2025-11-16 20:12:25 -08:00 |
|
kyleliang-nv
|
597d416070
|
[feature] Add layerwise NVTX support (#11870)
|
2025-11-15 19:20:56 -08:00 |
|
Zhihao Lyu
|
10592e9c08
|
[Ascend][Feat] Add Ascend sampling backend (#12692)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-11-15 21:59:58 +08:00 |
|
Yongfei Xu
|
d91b16eb16
|
Opt tp: tp attn support tp reduce scattered input (#10568)
|
2025-11-15 02:08:12 -08:00 |
|
khalilzhk
|
2d531946db
|
[Ascend][feature] support L1+ L2 radixcache on ascend (#12214)
Co-authored-by: khalilzhk <zhangkaikai12@huawei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2025-11-12 20:45:24 +08:00 |
|
Mattheliu
|
c3bb348dad
|
[Docs] fix dead links in multiple documentation pages (#12764)
|
2025-11-06 10:49:32 -08:00 |
|
b8zhong
|
32ec68faf9
|
keep attention backend document up to date (#12741)
|
2025-11-05 20:41:20 -08:00 |
|
Trevor Morris
|
dbcf85b7f0
|
Add --speculative-moe-runner-backend server arg (#10183)
|
2025-11-04 00:20:56 -08:00 |
|