mirror of
https://github.com/deepseek-ai/DeepEP.git
synced 2026-11-05 00:47:32 +00:00
[GH-ISSUE #80] About the number of messages chunked in IBGDA #75
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepEP#75
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @GitAlice123 on GitHub (Mar 19, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/80
Why theoretically 3 for maximum?
@LyricZhao commented on GitHub (Mar 21, 2025):
Assuming the message size (maximum ~KB level) is much smaller than the page size (i.e.
NVSHMEM_CUMEM_GRANULARITY, normally very large >100 MB). So the worst case of getting local/remote key is, the message is splitted into two pages at local, two pages at remote, totally 3 pages.e.g.
| chunk 0 --- | chunk 1 ------ | chunk 2 --------- |
| local page i | local page i + 1 ------------------ |
| remote page j ------------- | remote page j + 1 |
@LyricZhao commented on GitHub (Mar 21, 2025):
You can ignore that note as the while loop can proceed more than 3 chunks. But we tried some code simplication and optimizations here for the theretical maximum, but it didn't work.