mirror of
https://github.com/deepseek-ai/DeepEP.git
synced 2026-11-05 00:47:32 +00:00
[GH-ISSUE #62] Exception: Capture cuda graph failed: CUDA error: capturing stream has unjoined work #60
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepEP#60
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @liz-badada on GitHub (Mar 10, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/62
Hi,
I tried with cuda-graph capturing feature when intergrating DeepEP, but got "CUDA error: capturing stream has unjoined work".
Any comments?
Thanks!
@LyricZhao commented on GitHub (Mar 10, 2025):
Which series of kernels are you capturing, low-latency kernels? (Normal kernels doesn't support CUDA graph due to CPU sync)
I guess this is not related to DeepEP, but some capturing issues, e.g. https://stackoverflow.com/questions/79496131/trying-to-end-stream-capture-fails-due-to-unjoined-work-but-synchronizing-fai.
For low-latency kernels, the recommended way to use is a single stream with hook.
@liz-badada commented on GitHub (Mar 10, 2025):
Yes, Normal Kernels currently, thanks for the information!