[GH-ISSUE #367] question about fp8fp4 mega moe weights load #175

Open
opened 2026-10-26 21:14:13 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @wukong1992 on GitHub (Jun 25, 2026).
Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/367

why smem_sfb full barrier need to * 2:github.com/deepseek-ai/DeepGEMM@54e2261240/deep_gemm/include/deep_gemm/impls/sm100_fp8_fp4_mega_moe.cuh (L757)

Originally created by @wukong1992 on GitHub (Jun 25, 2026). Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/367 why smem_sfb full barrier need to * 2:https://github.com/deepseek-ai/DeepGEMM/blob/54e22612409371d6364144b69086735beb54e98b/deep_gemm/include/deep_gemm/impls/sm100_fp8_fp4_mega_moe.cuh#L757
Author
Owner

@xuzhiyuan1 commented on GitHub (Jun 29, 2026):

2-SM UMMA

<!-- gh-comment-id:4831149140 --> @xuzhiyuan1 commented on GitHub (Jun 29, 2026): 2-SM UMMA
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepGEMM#175
No description provided.