fzyzcjy
|
9d6029fb92
|
Fix TokenizerManager bottleneck for offline generation (#16456)
|
2026-01-05 16:28:25 +08:00 |
|
Qi Yuhang
|
dcfb92ddbc
|
[diffusion] fix: fix using the sub-optimal fa kernel (#16382)
|
2026-01-05 16:25:41 +08:00 |
|
Netanel Haber
|
bebd625ba1
|
EVS Framework: Support NemotronH_Nano_VL_V2 (#14051)
|
2026-01-05 16:18:07 +08:00 |
|
Lianmin Zheng
|
012dc5866d
|
[Auto Sync] Update scheduler.py (20260104) (#16424)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
Co-authored-by: Jie Ren <no-replay@github.com>
|
2026-01-04 23:32:56 -08:00 |
|
Yuhao Yang
|
10174e1114
|
Revert "[grpc] update api to scheduler in grpc request manager" (#16387)
|
2026-01-04 22:05:39 -08:00 |
|
Yuhao Yang
|
2138ff48c6
|
Revert "[FEAT] optimize tensor zmq transfer for multimodal inputs" (#16386)
|
2026-01-04 22:05:26 -08:00 |
|
Xiaoyu Zhang
|
520c048d55
|
[diffusion] CI: add script for automatically generation ci perf baseline (#16389)
|
2026-01-05 13:18:35 +08:00 |
|
yudian0504
|
561a3e04f6
|
remove redundant mamba_cache clearing actions (#16180)
|
2026-01-05 13:02:07 +08:00 |
|
YAMY
|
12cde0df99
|
[SPEC_V2] Fix Acclen drop when enabling DP Attention for Spec-Overlap (#16310)
|
2026-01-05 11:39:23 +08:00 |
|
Liangsheng Yin
|
a7fd810842
|
Allow editable install without .git with add fallback version in pyproject.toml (#16435)
|
2026-01-05 11:17:20 +08:00 |
|
Kangyan-Zhou
|
ca80c19b55
|
Revert "[diffusion] feat: support warmup with resolutions" (#16433)
|
2026-01-04 18:44:05 -08:00 |
|
fzyzcjy
|
1e7b326482
|
Super tiny fix main code (#16432)
|
2026-01-05 10:34:25 +08:00 |
|
CHEN Xi
|
e267ca0beb
|
[diffusion] doc: document LoRA support in CLI (#16375)
|
2026-01-05 10:20:30 +08:00 |
|
Mick
|
9a8ba3c189
|
[diffusion] feat: support warmup with resolutions (#16330)
|
2026-01-05 10:16:26 +08:00 |
|
Xiaoyu Zhang
|
0fee6bc632
|
[JIT kernel] Apply jit per_tensor_quant_fp8 kernel (#15836)
|
2026-01-05 10:15:00 +08:00 |
|
fzyzcjy
|
12df16607b
|
Tiny speed up kimi detokenizer by 10x (#16427)
|
2026-01-05 09:12:05 +08:00 |
|
Douglas Yang
|
87699d48eb
|
fix: only publish trace from tp 0 (#16411)
|
2026-01-04 12:17:08 -08:00 |
|
Alison Shao
|
52c604342c
|
chore: print test list at beginning and end of run_suite.py (#16334)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-01-04 11:52:52 -08:00 |
|
Ke Bao
|
76bc07a335
|
Move swa memory pool to a seperate file (#16347)
|
2026-01-04 22:39:30 +08:00 |
|
Ke Bao
|
b328cd20bb
|
Skip local attn init metadata for mimo swa model (#16349)
|
2026-01-04 22:38:36 +08:00 |
|
Douglas Yang
|
16e00651dd
|
fix: health check adding test delays (#16381)
|
2026-01-04 00:28:32 -08:00 |
|
fzyzcjy
|
1b2b95d8d1
|
Super tiny cleanup unused function (#16376)
|
2026-01-04 15:08:12 +08:00 |
|
Yuan Luo
|
5f3eb377e0
|
[VLM] Support request level max_dynamic_patch for OpenAI request (#16268)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-01-04 13:04:43 +08:00 |
|
fzyzcjy
|
d7aa0ce72f
|
Support multiple engines for router simulation in schedule simulator (#16368)
|
2026-01-04 11:46:05 +08:00 |
|
fzyzcjy
|
e797f0c570
|
Support offline generation scenario for prefill delayer (#16363)
|
2026-01-04 11:05:10 +08:00 |
|
fzyzcjy
|
5d4b7c78bf
|
Fix memory leak in prefill delayer (#16358)
|
2026-01-04 10:11:18 +08:00 |
|
fzyzcjy
|
24e116ef6a
|
Enhance schedule simulator and add several e2e scenarios (#16357)
|
2026-01-04 10:02:38 +08:00 |
|
fzyzcjy
|
8ca9597057
|
Tiny support sticky routing algorithm in schedule simulator (#16355)
|
2026-01-04 08:36:52 +08:00 |
|
Hudson Xing
|
f4ab2ec5be
|
Add unified metrics collection framework (v1) (#16064)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-03 16:30:38 -08:00 |
|
fy
|
25fa2ac290
|
Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434)
|
2026-01-04 08:16:42 +08:00 |
|
fzyzcjy
|
ef5ac6f01e
|
Support shared prefix (gsp) in schedule simulator (#16353)
|
2026-01-04 08:03:16 +08:00 |
|
fzyzcjy
|
2337b1bbb0
|
Refactor and fix prefill delayer (scheduler enhancer) (#16269)
|
2026-01-04 07:15:06 +08:00 |
|
Chang Su
|
7bc13c906c
|
[grpc] update api to scheduler in grpc request manager (#16350)
|
2026-01-03 10:54:31 -08:00 |
|
Chi McIsaac
|
dcacc492d0
|
[diffusion] fix: fix RuntimeError in SageAttention3 on Blackwell with Qwen-Image (#16335)
Co-authored-by: qimcis <qimcis@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-01-03 22:12:53 +08:00 |
|
fzyzcjy
|
87ef05e2e1
|
Support simple schedule simulator (#16344)
|
2026-01-03 22:05:40 +08:00 |
|
fzyzcjy
|
b65c9889a0
|
Fix incorrect running batch size in prefill stats (#15941)
|
2026-01-03 20:49:54 +08:00 |
|
fzyzcjy
|
c7c0d97fc6
|
Tiny support whitelisted headers in request logging (#16342)
|
2026-01-03 20:10:58 +08:00 |
|
shengzhaotian
|
6bc5a52fd2
|
[NPU] Adapt qwen3-next W8A8 on NPU (#16164)
|
2026-01-03 19:41:20 +08:00 |
|
Mick
|
2c09de343e
|
[diffusion] improve: skip loading vision module for text encoders (#16304)
|
2026-01-03 19:30:45 +08:00 |
|
Mick
|
38d48de93d
|
[diffusion] CI: simplify warmup (#16303)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-03 18:09:38 +08:00 |
|
fzyzcjy
|
7f2fa2167b
|
Tiny add --log-requests-target (#16338)
|
2026-01-03 17:28:27 +08:00 |
|
Xiaoyu Zhang
|
d0fb24ee7b
|
[Diffusion] Flux2 tp support (#16219)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-01-03 17:02:27 +08:00 |
|
Siyuan Chen
|
9a414b164c
|
[Performance] Optimze the performance of Qwen25VL (#15640)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-01-02 23:15:36 -08:00 |
|
Alison Shao
|
5b4f790200
|
[diffusion] CI: add CI validation for diffusion model downloads (#16311)
|
2026-01-03 14:12:45 +08:00 |
|
Teng Ma
|
bdde949619
|
[HiCache] Add PP Support with suffix pp rank (#15175)
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-01-03 13:49:21 +08:00 |
|
fzyzcjy
|
9821fae5c6
|
Tiny add explanations to realtime token metric labels (#16009)
|
2026-01-03 12:36:55 +08:00 |
|
siyu
|
078d96213a
|
[FEAT] optimize tensor zmq transfer for multimodal inputs (#13592)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-01-03 12:23:23 +08:00 |
|
b8zhong
|
74a166cb86
|
[Fix] Only add SM90 and SM100 to check for auto-enabling TRT Allreduce Fusion (#16283)
|
2026-01-03 11:43:17 +08:00 |
|
triple-mu
|
888e126ac9
|
[diffusion] comment: fix typo (#16257)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-01-03 11:42:04 +08:00 |
|
Baizhou Zhang
|
bb23a8fe77
|
[Tiny]Remove progress bar for fp8 ue8m0 quant when unneeded (#16177)
|
2026-01-03 10:54:12 +08:00 |
|