mirror of
https://github.com/deepseek-ai/DeepGEMM.git
synced 2026-11-05 00:47:26 +00:00
[GH-ISSUE #136] ~5% performance regression for grouped GEMMs on H100 #78
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepGEMM#78
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @danthe3rd on GitHub (Jul 24, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/136
Hi,
I ran some benchmarks and observed a performance regression after #112 on H100. Below are the benchmarks results I get before and after:
Before #112 (
03d0be3d2d)After update (main) - PT 2.8 nightly cu129
@LyricZhao commented on GitHub (Jul 30, 2025):
Thanks, @LJC00118 will follow this up.
@LJC00118 commented on GitHub (Aug 4, 2025):
Hi @danthe3rd
Thanks for reporting this. The performance difference in grouped GEMMs is likely due to random seed variance—we've seen up to 20% fluctuation in m-grouped masked GEMMs depending on the seed. When tested with identical random seed and generator, both versions show consistent performance.