[GH-ISSUE #178] m_grouped_fp8_gemm_nt_contiguous stuck on matrix shape (1, 1,24576, 1536) #101

Closed
opened 2026-10-26 21:12:36 +00:00 by bsakaguchi · 3 comments
Owner

Originally created by @lizhiqihhh on GitHub (Aug 29, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/178

Hi, there,

I am testing the kernel m_grouped_fp8_gemm_nt_contiguous with [group, m per group, N ,K ] = [1, 1, 24576, 1536] on H200. However, the program is stuck. Could you please advise on how to resolve this?

Many thanks!

Originally created by @lizhiqihhh on GitHub (Aug 29, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/178 Hi, there, I am testing the kernel **m_grouped_fp8_gemm_nt_contiguous** with [group, m per group, N ,K ] = [1, 1, 24576, 1536] on H200. However, the program is stuck. Could you please advise on how to resolve this? Many thanks!
Author
Owner

@LyricZhao commented on GitHub (Aug 29, 2025):

cc @zheanxu

<!-- gh-comment-id:3236058076 --> @LyricZhao commented on GitHub (Aug 29, 2025): cc @zheanxu
Author
Owner

@zheanxu commented on GitHub (Aug 29, 2025):

Hi @lizhiqihhh, I tested m_grouped_fp8_gemm_nt_contiguous with the matrix shape [1, 1, 24576, 1536] and found it didn’t get stuck. In addition, this kernel assumes that the m of each group is aligned to 128; otherwise, it could cause low performance or other unexpected issues.

<!-- gh-comment-id:3236145703 --> @zheanxu commented on GitHub (Aug 29, 2025): Hi @lizhiqihhh, I tested m_grouped_fp8_gemm_nt_contiguous with the matrix shape [1, 1, 24576, 1536] and found it didn’t get stuck. In addition, this kernel assumes that the m of each group is aligned to 128; otherwise, it could cause low performance or other unexpected issues.
Author
Owner

@lizhiqihhh commented on GitHub (Sep 1, 2025):

Thanks

<!-- gh-comment-id:3241495245 --> @lizhiqihhh commented on GitHub (Sep 1, 2025): Thanks
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepGEMM#101
No description provided.