[PR #5] Automatically detects RDMA devices, eliminating complex manual setup for mooncake #4

New issue

Open

opened 2026-10-29 21:06:23 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 21:06:23 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/sglang/pull/5
Author: @whybeyoung
Created: 4/11/2025
Status: 🔄 Open

Base: main ← Head: auto-detect-net

📝 Commits (3)

c7204a8 Feature Add auto load config
28f772a modified: srt/disaggregation/transfer_engine/mooncake.py
5330079 Fix modified: srt/disaggregation/rdma_device_utils.py

📊 Changes

7 files changed (+194 additions, -9 deletions)

View changed files

📝 python/sglang/srt/disaggregation/conn.py (+1 -1)
📝 python/sglang/srt/disaggregation/decode.py (+1 -0)
📝 python/sglang/srt/disaggregation/prefill.py (+3 -0)
➕ python/sglang/srt/disaggregation/rdma_device_utils.py (+152 -0)
📝 python/sglang/srt/disaggregation/transfer_engine/mooncake.py (+26 -8)
📝 python/sglang/srt/managers/scheduler.py (+1 -0)
📝 python/sglang/srt/utils.py (+10 -0)

📄 Description

Automatically detects RDMA devices, eliminating complex manual setup for mooncake

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/sglang/pull/5 **Author:** [@whybeyoung](https://github.com/whybeyoung) **Created:** 4/11/2025 **Status:** 🔄 Open **Base:** `main` ← **Head:** `auto-detect-net` --- ### 📝 Commits (3) - [`c7204a8`](https://github.com/kvcache-ai/sglang/commit/c7204a8427cffe57a94efba026b100ca3096b472) Feature Add auto load config - [`28f772a`](https://github.com/kvcache-ai/sglang/commit/28f772a706fb237094ab96a10736a91c8d2a66f5) modified: srt/disaggregation/transfer_engine/mooncake.py - [`5330079`](https://github.com/kvcache-ai/sglang/commit/5330079955e2ca55d32bb598d8c9fb476a8df04f) Fix modified: srt/disaggregation/rdma_device_utils.py ### 📊 Changes **7 files changed** (+194 additions, -9 deletions) <details> <summary>View changed files</summary> 📝 `python/sglang/srt/disaggregation/conn.py` (+1 -1) 📝 `python/sglang/srt/disaggregation/decode.py` (+1 -0) 📝 `python/sglang/srt/disaggregation/prefill.py` (+3 -0) ➕ `python/sglang/srt/disaggregation/rdma_device_utils.py` (+152 -0) 📝 `python/sglang/srt/disaggregation/transfer_engine/mooncake.py` (+26 -8) 📝 `python/sglang/srt/managers/scheduler.py` (+1 -0) 📝 `python/sglang/srt/utils.py` (+10 -0) </details> ### 📄 Description Automatically detects RDMA devices, eliminating complex manual setup for mooncake --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi added the

pull-request

label

2026-10-29 21:06:23 +00:00

No labels

pull-request

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

kvcache-ai/sglang#4

No description provided.

Rows
Columns