deepseek-ai/DeepGEMM
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepGEMM.git synced 2026-11-05 00:47:26 +00:00
Code Issues 162 Projects Packages Wiki Activity

[GH-ISSUE #132] The replacement of deep_gemm.wgrad_gemm_fp8_fp8_fp32_nt after Add more GPU architectures support (#112) #76

New issue
Closed
opened 2026-10-26 21:11:58 +00:00 by bsakaguchi · 3 comments
bsakaguchi commented 2026-10-26 21:11:58 +00:00
Owner
Copy link

Originally created by @goldhuang on GitHub (Jul 23, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/132

Hello,

Thanks for adding the backward support! But the original backward kernel wgrad_gemm_fp8_fp8_fp32_nt is removed by #112.
Which kernel should I use with latest main branch?

Thanks!

Originally created by @goldhuang on GitHub (Jul 23, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/132 Hello, Thanks for adding the backward support! But the original backward kernel wgrad_gemm_fp8_fp8_fp32_nt is removed by #112. Which kernel should I use with latest main branch? Thanks!
bsakaguchi commented 2026-10-26 21:11:59 +00:00
Author
Owner
Copy link

@LyricZhao commented on GitHub (Jul 30, 2025):

Sorry, we currently remove it and plan to add a faster impl for that later. Maybe in the next two weeks.

<!-- gh-comment-id:3135013652 --> @LyricZhao commented on GitHub (Jul 30, 2025): Sorry, we currently remove it and plan to add a faster impl for that later. Maybe in the next two weeks.
bsakaguchi commented 2026-10-26 21:12:00 +00:00
Author
Owner
Copy link

@haochengxi commented on GitHub (Oct 7, 2025):

Hi, are there any updates on the weight gradient kernel? Thanks for the amazing work!

<!-- gh-comment-id:3378812472 --> @haochengxi commented on GitHub (Oct 7, 2025): Hi, are there any updates on the weight gradient kernel? Thanks for the amazing work!
bsakaguchi commented 2026-10-26 21:12:01 +00:00
Author
Owner
Copy link

@LyricZhao commented on GitHub (Oct 9, 2025):

Already included in fp8_gemm_nt (https://github.com/deepseek-ai/DeepGEMM/blob/main/csrc/apis/gemm.hpp#L14) with recipe=(1, 1, 128). Kernel code: https://github.com/deepseek-ai/DeepGEMM/blob/main/deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d2d.cuh.

Closing this issue now.

<!-- gh-comment-id:3383701224 --> @LyricZhao commented on GitHub (Oct 9, 2025): Already included in `fp8_gemm_nt` (https://github.com/deepseek-ai/DeepGEMM/blob/main/csrc/apis/gemm.hpp#L14) with `recipe=(1, 1, 128)`. Kernel code: https://github.com/deepseek-ai/DeepGEMM/blob/main/deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d2d.cuh. Closing this issue now.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
public-sync-20261014
0930-release
nv_dev
fix-mega-moe-fence
public-release-2609
public-release-2607
public-release-2606
mega-update
public-release-260416
ko3n1g/ci/build-wheels
nv_dev_f8e8fb5
nv_dev_950d31a
nv_dev_67fc648
nv_dev_c491439
nv_dev_4ff3f54
v2.1.1.post3
v2.1.1.post2
v2.1.1.post1
v2.1.1
v2.1.0
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepGEMM#76
No description provided.