[PR #56] [MERGED] [Transfer Engine] fix metadata server connection string builder in vllm intergation #1300

New issue

Closed

opened 2026-10-29 21:26:11 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 21:26:11 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/56
Author: @alogfans
Created: 1/2/2025
Status: ✅ Merged
Merged: 1/2/2025
Merged by: @ShangmingCai

Base: main ← Head: vllm-adaptor-metadata-uri-fix

📝 Commits (1)

3941f13 fix metadata server builder in vllm intergation component

📊 Changes

1 file changed (+4 additions, -2 deletions)

View changed files

📝 mooncake-integration/vllm/vllm_adaptor.cpp (+4 -2)

📄 Description

Mooncake supports vllm integration with etcd/redis/http as metadata service. You can change it in mooncake.json

{
  "prefill_url": "192.168.0.137:13003",
  "decode_url": "192.168.0.139:13003",
  "metadata_server": "192.168.0.139:2379", # you can add protocol prefix like "etcd://", "redis://" or "http://"
  "protocol": "rdma", # if you use protocol prefix in metadata_server, this field is ignored
  "device_name": "erdma_0"
}

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/56 **Author:** [@alogfans](https://github.com/alogfans) **Created:** 1/2/2025 **Status:** ✅ Merged **Merged:** 1/2/2025 **Merged by:** [@ShangmingCai](https://github.com/ShangmingCai) **Base:** `main` ← **Head:** `vllm-adaptor-metadata-uri-fix` --- ### 📝 Commits (1) - [`3941f13`](https://github.com/kvcache-ai/Mooncake/commit/3941f135aa4dacf56204f382828620a8ccfda45f) fix metadata server builder in vllm intergation component ### 📊 Changes **1 file changed** (+4 additions, -2 deletions) <details> <summary>View changed files</summary> 📝 `mooncake-integration/vllm/vllm_adaptor.cpp` (+4 -2) </details> ### 📄 Description Mooncake supports vllm integration with etcd/redis/http as metadata service. You can change it in mooncake.json ``` { "prefill_url": "192.168.0.137:13003", "decode_url": "192.168.0.139:13003", "metadata_server": "192.168.0.139:2379", # you can add protocol prefix like "etcd://", "redis://" or "http://" "protocol": "rdma", # if you use protocol prefix in metadata_server, this field is ignored "device_name": "erdma_0" } ``` --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 21:26:11 +00:00