[GH-ISSUE #185] When deploying with multiple machines, the following error was encountered #158

Closed
opened 2026-10-26 09:55:21 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @nannaer on GitHub (Jun 4, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/185

When deploying PD-separated Deepseek v3 and running multi-machine Decode with two machines, it works normally. However, when using four machines, the following errors occur. I hope to get your help. Figure 1 shows the error on the master machine, and Figure 2 shows the error on the sub machine. I'm not sure whether this error is related to DeepEP or not. Can anyone provide some help?

Image

Image

Originally created by @nannaer on GitHub (Jun 4, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/185 When deploying PD-separated Deepseek v3 and running multi-machine Decode with two machines, it works normally. However, when using four machines, the following errors occur. I hope to get your help. Figure 1 shows the error on the master machine, and Figure 2 shows the error on the sub machine. I'm not sure whether this error is related to DeepEP or not. Can anyone provide some help? ![Image](https://github.com/user-attachments/assets/92cf6955-b009-4bdb-b9c4-2a4ad3492211) ![Image](https://github.com/user-attachments/assets/b5d572c9-1bb6-429b-8081-881320c835c7)
Author
Owner

@sphish commented on GitHub (Jun 5, 2025):

It seems that your program encountered an issue while establishing TCP socket connections. Please check your TCP network environment.

<!-- gh-comment-id:2942568748 --> @sphish commented on GitHub (Jun 5, 2025): It seems that your program encountered an issue while establishing TCP socket connections. Please check your TCP network environment.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepEP#158
No description provided.