[GH-ISSUE #259] Question Regarding Low-Latency Buffer Layout #195

Closed
opened 2026-10-26 09:56:22 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @ZhiyiHu1999 on GitHub (Jun 26, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/259

Hello! I want to ask why num_experts is not multiplied to calculate dispatch_send_buffer_bytes. I think for the worst case that every expert may have the chance to be sent all dispatched tokens.

github.com/deepseek-ai/DeepEP@bd429ffefc/csrc/config.hpp (L144-L148)

Thanks a lot!

Originally created by @ZhiyiHu1999 on GitHub (Jun 26, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/259 Hello! I want to ask why `num_experts` is not multiplied to calculate `dispatch_send_buffer_bytes`. I think for the worst case that every expert may have the chance to be sent all dispatched tokens. https://github.com/deepseek-ai/DeepEP/blob/bd429ffefc50cad10b5b17d63eed47c0ab8db72a/csrc/config.hpp#L144-L148 Thanks a lot!
Author
Owner

@ZhiyiHu1999 commented on GitHub (Jun 26, 2025):

I found out. Thanks a lot!

<!-- gh-comment-id:3007112377 --> @ZhiyiHu1999 commented on GitHub (Jun 26, 2025): I found out. Thanks a lot!
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepEP#195
No description provided.