[GH-ISSUE #319] Is there any plan to support fp4? #220

Open
opened 2026-10-26 09:56:53 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @truecrab on GitHub (Jul 21, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/319

Blackwell hardware has started to support the nvfp4 kernel. Will the deepep interface support nvfp4 in the future?

Originally created by @truecrab on GitHub (Jul 21, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/319 Blackwell hardware has started to support the nvfp4 kernel. Will the deepep interface support nvfp4 in the future?
Author
Owner

@LyricZhao commented on GitHub (Jul 30, 2025):

We don't have Blackwell GPUs on hands, but I believe the change is small to support FP4. As dispatch will treat any data type as bytes, while combine is always using BF16.

<!-- gh-comment-id:3134589917 --> @LyricZhao commented on GitHub (Jul 30, 2025): We don't have Blackwell GPUs on hands, but I believe the change is small to support FP4. As dispatch will treat any data type as bytes, while combine is always using BF16.
Author
Owner

@LyricZhao commented on GitHub (Jul 30, 2025):

We may plan to support this in the next 2-3 months.

<!-- gh-comment-id:3134590626 --> @LyricZhao commented on GitHub (Jul 30, 2025): We may plan to support this in the next 2-3 months.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepEP#220
No description provided.