mirror of
https://github.com/deepseek-ai/DeepEP.git
synced 2026-11-05 00:47:32 +00:00
[GH-ISSUE #669] [Performance] Question about performance of Deepep v2, the role of the prefer-overlap-with-compute parameter #394
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepEP#394
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @shenhongqian on GitHub (Jun 22, 2026).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/669
I would like to ask, what are the execution commands for the performance of the two machines shown in the figure below, and do they need to include --prefer-overlap-with-compute 1 ?
I am not aligned with the official performance data in my local environment, and the following are the test results.
[1]python tests/elastic/test_ep.py --num-processes 8 --allow-hybrid-mode 1 --num-sms 12 --reuse-elastic-buffer --num-topk 8 --num-tokens 8192 --prefer-overlap-with-compute 1 --num-qps 65
[2]python tests/elastic/test_ep.py --num-processes 8 --allow-hybrid-mode 1 --num-sms 12 --reuse-elastic-buffer --num-topk 8 --num-tokens 8192 --prefer-overlap-with-compute 0 --num-qps 65
@shenhongqian commented on GitHub (Jun 22, 2026):
Can you help me take a look at this issue? Thank you @sphish @LyricZhao
@alpha-baby commented on GitHub (Jun 23, 2026):
maybe you could try SMs == 16 , and will Improve the performance of combine
@kzlxd commented on GitHub (Jul 27, 2026):
@shenhongqian --prefer-overlap-with-compute 1 is necessary