Teng Ma 00126648e2 [PD] Add EFA disaggregation transport

2026-05-10 23:51:29 +08:00

..

adaptive_speculative_decoding.md

[SPEC][1/N] feat: add adaptive speculative_num_steps for EAGLE topk=1 (#21599)

2026-04-20 14:25:04 -07:00

attention_backend.md

[Speculative Decoding] Add FA4-based Spec Support (#21080)

2026-04-04 02:09:45 -07:00

breakable_cuda_graph.md

Introduce CUDA graph debug mode with breakable CUDA graph (#19102)

2026-04-11 00:36:56 -07:00

checkpoint_engine.md

[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)

2025-10-30 10:39:27 +08:00

cuda_graph_for_multi_modal_encoder.md

[VLM] Add doc for ViT CUDA Graph (#16343)

2026-01-04 10:05:23 +08:00

deterministic_inference.md

[Documentation] add doc for deterministic inference (#11956)

2025-10-22 12:36:15 -05:00

dp_dpa_smg_guide.md

Enhance SMG guide with RL rollout systems benefits (#18588)

2026-02-10 20:20:45 -08:00

dp_for_multi_modal_encoder.md

[docs] fix misspellings & typos (#18276)

2026-02-05 03:35:29 +00:00

epd_disaggregation.md

[DOC] add documents for encoder global mm cache (#20636)

2026-03-15 16:44:21 -07:00

expert_parallelism.md

[Feature] Integrate Elastic NIXL-EP into SGLang (#19248)

2026-03-11 17:37:43 +08:00

forward_hooks.md

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

hicache_best_practices.md

[HiCache] Support heterogeneous tp for hicache storage (#18541)

2026-02-25 00:13:57 -08:00

hicache_design.md

configuration file support and nixl integration augmentation for hicache-storage-backend-extra-config (#16602)

2026-01-22 14:31:48 -08:00

hicache_storage_runtime_attach_detach.md

refactor: extract FanOutCommunicator and use declarative spec table (#22967)

2026-04-16 15:37:19 -07:00

hicache.rst

[HiCache][HA 1/N] Support HiCache storage runtime attach/detach (#15892)

2026-01-26 19:33:19 -08:00

hisparse_guide.md

[HiSparse]: Update HiSparse's user-guide (#22499)

2026-04-10 15:06:43 +08:00

hyperparameter_tuning.md

[Docs] Rename SGLang Router to SGLang Model Gateway (#17436)

2026-01-20 12:31:10 -08:00

lora.ipynb

[Feature] add LoRADrainer to address high P99 TTFT (#17913)

2026-05-02 16:13:43 -07:00

object_storage.md

Direct model loading from object storage with Runai Model Streamer (#17948)

2026-04-01 18:41:22 -07:00

observability.md

Update docs (#13391)

2025-11-16 19:36:33 -08:00

pd_disaggregation.md

[PD] Add EFA disaggregation transport

2026-05-10 23:51:29 +08:00

piecewise_cuda_graph.md

Piecewise Cuda Graph Docs (#19738)

2026-03-03 11:51:17 +08:00

pipeline_parallelism.md

[Doc] Update pipeline parallelism documentation (#17414)

2026-01-20 20:10:56 +08:00

quantization.md

✨ [diffusion][npu][quant] Add MXFP8 quantization support for Wan2.2 Diffusion on Ascend NPU (#20922)

2026-05-07 21:30:56 +03:00

quantized_kv_cache.md

add doc for quantized kv cache (#14348)

2025-12-04 13:01:05 -08:00

rfork.md

[1/2] Add ModelExpress coordination for remote instance weight loading - matching TP (#19920)

2026-03-18 13:38:32 -07:00

separate_reasoning.ipynb

[CI] feat: add early exit to wait_for_server when process dies (#18602)

2026-02-13 16:46:09 -08:00

server_arguments.md

feat(scheduler): add adaptive queue-based prefill delayer trigger (#23189)

2026-05-08 16:54:30 -07:00

sgl_model_gateway.md

fix(router): configure HTTP client connection settings (#24330)

2026-05-07 11:42:45 -07:00

sglang_for_rl.md

[Feature] Implement update_weights_from_disk for SGLang-D (Diffusion … (#18306)

2026-02-18 11:24:07 -08:00

speculative_decoding.md

[SPEC][1/N] feat: add adaptive speculative_num_steps for EAGLE topk=1 (#21599)

2026-04-20 14:25:04 -07:00

structured_outputs_for_reasoning_models.ipynb

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00

structured_outputs.ipynb

Add Lychee Doc Links Check to Local and CI (#19742)

2026-03-24 13:48:26 -07:00

tool_parser.ipynb

[CI] feat: add early exit to wait_for_server when process dies (#18602)

2026-02-13 16:46:09 -08:00

vlm_query.ipynb

Upgrade transformers==5.3.0 (#17784)

2026-03-18 13:50:43 -07:00