[PR #347] [MERGED] Multiple updates and refactorings #379

New issue

Closed

opened 2026-10-26 21:17:04 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-26 21:17:04 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepGEMM/pull/347
Author: @RayWang96
Created: 6/1/2026
Status: ✅ Merged
Merged: 6/1/2026
Merged by: @LyricZhao

Base: main ← Head: june_update

📝 Commits (1)

2b8dfd0 Multiple updates and refactorings

📊 Changes

29 files changed (+544 additions, -428 deletions)

View changed files

📝 csrc/apis/attention.hpp (+2 -2)
📝 csrc/apis/einsum.hpp (+1 -2)
📝 csrc/apis/gemm.hpp (+2 -2)
📝 csrc/apis/mega.hpp (+4 -2)
📝 csrc/jit_kernels/heuristics/mega_moe.hpp (+71 -35)
📝 csrc/jit_kernels/impls/runtime_utils.hpp (+3 -2)
📝 csrc/jit_kernels/impls/sm100_fp8_fp4_mega_moe.hpp (+12 -6)
📝 csrc/jit_kernels/impls/sm90_fp8_gemm_1d2d.hpp (+2 -1)
📝 csrc/jit_kernels/impls/smxx_fp8_fp4_paged_mqa_logits.hpp (+3 -2)
📝 deep_gemm/include/deep_gemm/comm/barrier.cuh (+3 -3)
📝 deep_gemm/include/deep_gemm/impls/sm100_bf16_gemm.cuh (+6 -6)
📝 deep_gemm/include/deep_gemm/impls/sm100_fp4_mqa_logits.cuh (+8 -8)
📝 deep_gemm/include/deep_gemm/impls/sm100_fp4_paged_mqa_logits.cuh (+9 -9)
📝 deep_gemm/include/deep_gemm/impls/sm100_fp8_fp4_gemm_1d1d.cuh (+8 -10)
📝 deep_gemm/include/deep_gemm/impls/sm100_fp8_fp4_mega_moe.cuh (+178 -198)
📝 deep_gemm/include/deep_gemm/impls/sm100_fp8_paged_mqa_logits.cuh (+3 -4)
📝 deep_gemm/include/deep_gemm/impls/sm90_bf16_gemm.cuh (+10 -4)
📝 deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d1d.cuh (+5 -2)
📝 deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d2d.cuh (+6 -1)
📝 deep_gemm/include/deep_gemm/layout/sym_buffer.cuh (+3 -0)

...and 9 more files

📄 Description

Optimize FP8/FP4 Mega MoE dispatch, scheduling, and shared memory layout
Add BF16 accumulation/output support updates for GEMM paths
Improve paged MQA scheduler and attention coverage
Minor fixes and test updates

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepGEMM/pull/347 **Author:** [@RayWang96](https://github.com/RayWang96) **Created:** 6/1/2026 **Status:** ✅ Merged **Merged:** 6/1/2026 **Merged by:** [@LyricZhao](https://github.com/LyricZhao) **Base:** `main` ← **Head:** `june_update` --- ### 📝 Commits (1) - [`2b8dfd0`](https://github.com/deepseek-ai/DeepGEMM/commit/2b8dfd0e84ed12de5f9bbc8fc66be270e07b4c7a) Multiple updates and refactorings ### 📊 Changes **29 files changed** (+544 additions, -428 deletions) <details> <summary>View changed files</summary> 📝 `csrc/apis/attention.hpp` (+2 -2) 📝 `csrc/apis/einsum.hpp` (+1 -2) 📝 `csrc/apis/gemm.hpp` (+2 -2) 📝 `csrc/apis/mega.hpp` (+4 -2) 📝 `csrc/jit_kernels/heuristics/mega_moe.hpp` (+71 -35) 📝 `csrc/jit_kernels/impls/runtime_utils.hpp` (+3 -2) 📝 `csrc/jit_kernels/impls/sm100_fp8_fp4_mega_moe.hpp` (+12 -6) 📝 `csrc/jit_kernels/impls/sm90_fp8_gemm_1d2d.hpp` (+2 -1) 📝 `csrc/jit_kernels/impls/smxx_fp8_fp4_paged_mqa_logits.hpp` (+3 -2) 📝 `deep_gemm/include/deep_gemm/comm/barrier.cuh` (+3 -3) 📝 `deep_gemm/include/deep_gemm/impls/sm100_bf16_gemm.cuh` (+6 -6) 📝 `deep_gemm/include/deep_gemm/impls/sm100_fp4_mqa_logits.cuh` (+8 -8) 📝 `deep_gemm/include/deep_gemm/impls/sm100_fp4_paged_mqa_logits.cuh` (+9 -9) 📝 `deep_gemm/include/deep_gemm/impls/sm100_fp8_fp4_gemm_1d1d.cuh` (+8 -10) 📝 `deep_gemm/include/deep_gemm/impls/sm100_fp8_fp4_mega_moe.cuh` (+178 -198) 📝 `deep_gemm/include/deep_gemm/impls/sm100_fp8_paged_mqa_logits.cuh` (+3 -4) 📝 `deep_gemm/include/deep_gemm/impls/sm90_bf16_gemm.cuh` (+10 -4) 📝 `deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d1d.cuh` (+5 -2) 📝 `deep_gemm/include/deep_gemm/impls/sm90_fp8_gemm_1d2d.cuh` (+6 -1) 📝 `deep_gemm/include/deep_gemm/layout/sym_buffer.cuh` (+3 -0) _...and 9 more files_ </details> ### 📄 Description * Optimize FP8/FP4 Mega MoE dispatch, scheduling, and shared memory layout * Add BF16 accumulation/output support updates for GEMM paths * Improve paged MQA scheduler and attention coverage * Minor fixes and test updates --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-26 21:17:04 +00:00