[PR #202] [MERGED] [Feature] use randomly-selected port in TCP-based OOB communication #1392

New issue

Closed

opened 2026-10-29 21:27:02 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 21:27:02 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/202
Author: @alogfans
Created: 4/3/2025
Status: ✅ Merged
Merged: 4/3/2025
Merged by: @stmatengss

Base: main ← Head: random-rpc-port

📝 Commits (4)

e26d6e0 [Feature] support basic topology-aware in sglang adaptor layer
d676b53 [Feature] use randomly-selected port in TCP-based OOB communication
b9dd558 add address detection
0aaafea relax the styled requirement of local_hostname

📊 Changes

6 files changed (+195 additions, -60 deletions)

View changed files

📝 CMakeLists.txt (+1 -1)
📝 mooncake-integration/sglang/sglang_adaptor.cpp (+61 -33)
📝 mooncake-integration/vllm/vllm_adaptor.cpp (+33 -24)
📝 mooncake-transfer-engine/include/transfer_metadata_plugin.h (+4 -0)
📝 mooncake-transfer-engine/src/transfer_engine.cpp (+30 -2)
📝 mooncake-transfer-engine/src/transfer_metadata_plugin.cpp (+66 -0)

📄 Description

No description provided

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/202 **Author:** [@alogfans](https://github.com/alogfans) **Created:** 4/3/2025 **Status:** ✅ Merged **Merged:** 4/3/2025 **Merged by:** [@stmatengss](https://github.com/stmatengss) **Base:** `main` ← **Head:** `random-rpc-port` --- ### 📝 Commits (4) - [`e26d6e0`](https://github.com/kvcache-ai/Mooncake/commit/e26d6e0fed6a63042de295e566c7040b54062ca7) [Feature] support basic topology-aware in sglang adaptor layer - [`d676b53`](https://github.com/kvcache-ai/Mooncake/commit/d676b53fe0952c92cd8807b9cd4042b1067d548e) [Feature] use randomly-selected port in TCP-based OOB communication - [`b9dd558`](https://github.com/kvcache-ai/Mooncake/commit/b9dd5585679de3aad4e013510e357ef613c0eb48) add address detection - [`0aaafea`](https://github.com/kvcache-ai/Mooncake/commit/0aaafea7f9c8c506cd8b20d3d14c41b8b25210a3) relax the styled requirement of local_hostname ### 📊 Changes **6 files changed** (+195 additions, -60 deletions) <details> <summary>View changed files</summary> 📝 `CMakeLists.txt` (+1 -1) 📝 `mooncake-integration/sglang/sglang_adaptor.cpp` (+61 -33) 📝 `mooncake-integration/vllm/vllm_adaptor.cpp` (+33 -24) 📝 `mooncake-transfer-engine/include/transfer_metadata_plugin.h` (+4 -0) 📝 `mooncake-transfer-engine/src/transfer_engine.cpp` (+30 -2) 📝 `mooncake-transfer-engine/src/transfer_metadata_plugin.cpp` (+66 -0) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 21:27:02 +00:00