[GH-ISSUE #487] How to use CUmemFabricHandle? #315

Open
opened 2026-10-26 09:58:28 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @kzlxd on GitHub (Nov 10, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/487

CU_CHECK(cuMemCreate(&handle, size, &fabric_prop_, 0));报错call='cuMemCreate(&handle, size, &fabric_prop_, 0)' Reason=operation not permitted.
I encountered this error when testing the hybrid EP on the B200. How should I resolve it?

Originally created by @kzlxd on GitHub (Nov 10, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/487 CU_CHECK(cuMemCreate(&handle, size, &fabric_prop_, 0));报错call='cuMemCreate(&handle, size, &fabric_prop_, 0)' Reason=operation not permitted. I encountered this error when testing the hybrid EP on the B200. How should I resolve it?
Author
Owner

@Autumn1998 commented on GitHub (Jan 30, 2026):

CUmemFabricHandle is only supported on the NVL72. please use the inter-node API for the hybrid-ep

<!-- gh-comment-id:3822612587 --> @Autumn1998 commented on GitHub (Jan 30, 2026): CUmemFabricHandle is only supported on the NVL72. please use the inter-node API for the hybrid-ep
Author
Owner
<!-- gh-comment-id:4068681876 --> @101nobody commented on GitHub (Mar 16, 2026): FYI: https://forums.developer.nvidia.com/t/cudevicegetattribute-shows-i-can-use-fabric-handle-but-actually-i-cannot/336426
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepEP#315
No description provided.