[GH-ISSUE #68] How to set `protocol` parameter when prefill and decode in the same node? #37

New issue

Closed

opened 2026-10-29 21:08:16 +00:00 by bsakaguchi · 4 comments

bsakaguchi commented

2026-10-29 21:08:16 +00:00

Owner

Originally created by @gujingit on GitHub (Jan 7, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/68

How to set protocol parameter when prefill and decode in the same node? RDMA or TCP?

Originally created by @gujingit on GitHub (Jan 7, 2025). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/68 How to set `protocol` parameter when prefill and decode in the same node? RDMA or TCP?

bsakaguchi

2026-10-29 21:08:16 +00:00

closed this issue
added the
stale

auto-closed
labels

bsakaguchi commented

2026-10-29 21:08:17 +00:00

Author

Owner

@doujiang24 commented on GitHub (Jan 8, 2025):

This parameter will be retired soon, instead, choose protocol automatically base on the topology, see #69
For now, use rdma could be better performance when there is rdma nic.

@doujiang24 commented on GitHub (Jan 8, 2025): This parameter will be retired soon, instead, choose protocol automatically base on the topology, see #69 For now, use rdma could be better performance when there is rdma nic.

bsakaguchi commented

2026-10-29 21:08:17 +00:00

Author

Owner

@stmatengss commented on GitHub (Jan 9, 2025):

We will support shared memory transport for P/D in the same node (see #48 ). It doesn't depend on additional hardware. PR will be released soon.

@stmatengss commented on GitHub (Jan 9, 2025): We will support shared memory transport for P/D in the same node (see #48 ). It doesn't depend on additional hardware. PR will be released soon.

bsakaguchi commented

2026-10-29 21:08:17 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 23, 2026):

This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

@github-actions[bot] commented on GitHub (Jul 23, 2026): This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

bsakaguchi commented

2026-10-29 21:08:17 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 30, 2026):

Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

@github-actions[bot] commented on GitHub (Jul 30, 2026): Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

bsakaguchi referenced this issue

2026-10-29 21:26:06 +00:00

[PR #37] [MERGED] [TransferEngine][feature] add the http metadata server. #1294