mirror of
https://github.com/kvcache-ai/Mooncake.git
synced 2026-11-05 01:17:55 +00:00
[GH-ISSUE #383] 同一台机器上试用SGLang PD分离无法工作，https://github.com/kvcache-ai/Mooncake/blob/main/doc/en/sglang-integration-v1.md#to-run-prefill-instance-and-decode-instance-on-the-same-node #133
Labels
No labels
ascend
auto-closed
bug
bug
CI/Build
Common
documentation
enhancement
feature request
good first issue
help wanted
high priority
MetaX
nightly-failure
pull-request
PyTorch Backend
question
RFC
Roadmap
stale
Store
Tests
Transfer Engine
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/Mooncake#133
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @taohui on GitHub (May 20, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/383
我在同一台机器上按照https://github.com/kvcache-ai/Mooncake/blob/main/doc/en/sglang-integration-v1.md#to-run-prefill-instance-and-decode-instance-on-the-same-node 中的方式使用SGLang无法工作，使用RoCE，报”Mooncake memory registration failed.“，不使用RoCE可以启动，但传输的时候，显示
E0520 06:53:47.272128 18592 tcp_transport.cpp:136] Session::writeBody failed. Error: Bad address (value: 14), total_transferred_bytes_: 0, current transferred_bytes: 0
E0520 06:53:47.272198 18592 tcp_transport.cpp:136] Session::writeBody failed. Error: Bad address (value: 14), total_transferred_bytes_: 0, current transferred_bytes: 0
E0520 06:53:47.272285 18592 tcp_transport.cpp:136] Session::writeBody failed. Error: Bad address (value: 14), total_transferred_bytes_: 0, current transferred_bytes: 0
E0520 06:53:47.272302 18592 tcp_transport.cpp:136] Session::writeBody failed. Error: Bad address (value: 14), total_transferred_bytes_: 0, current transferred_bytes: 0
E0520 06:53:47.272325 18592 tcp_transport.cpp:136] Session::writeBody failed. Error: Bad address (value: 14), total_transferred_bytes_: 0, current transferred_bytes: 0
E0520 06:53:47.272337 18592 tcp_transport.cpp:136] Session::writeBody failed. Error: Bad address (value: 14), total_transferred_bytes_: 0, current transferred_bytes: 0
[2025-05-20 06:53:47 TP1] Mooncake Transfer Engine Return Error.
请问有没有详细一点介绍怎么在同一个节点上使用PD分离的例子，应不应该用RoCE，如何配置？
@stmatengss commented on GitHub (May 21, 2025):
First, check if your server supports GDR.
@github-actions[bot] commented on GitHub (Jul 11, 2026):
This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.
@github-actions[bot] commented on GitHub (Jul 19, 2026):
Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.