[PR #459] [CLOSED] Add guards for scales when the type is bf16 #583

New issue

Closed

opened 2026-10-27 21:04:16 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-27 21:04:16 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepEP/pull/459
Author: @bnellnm
Created: 10/16/2025
Status: ❌ Closed

Base: hybrid-ep ← Head: fix-bf16-scales

📝 Commits (1)

12c6d62 Add guards for scales when the type is bf16

📊 Changes

4 files changed (+50 additions, -23 deletions)

View changed files

📝 csrc/hybrid_ep/backend/hybrid_ep_backend.cuh (+3 -3)
📝 csrc/hybrid_ep/executor/executor.cu (+9 -4)
📝 csrc/hybrid_ep/hybrid_ep.cu (+35 -13)
📝 csrc/hybrid_ep/utils.cuh (+3 -3)

📄 Description

I'm working on integrating the DeepEP hybrid kernels with vLLM and ran into problems when running with bf16 tokens. I added some checks to allow for null scales for bf16 and it fixed the crashes I was running into.

cc @jershi425 , @Autumn1998

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepEP/pull/459 **Author:** [@bnellnm](https://github.com/bnellnm) **Created:** 10/16/2025 **Status:** ❌ Closed **Base:** `hybrid-ep` ← **Head:** `fix-bf16-scales` --- ### 📝 Commits (1) - [`12c6d62`](https://github.com/deepseek-ai/DeepEP/commit/12c6d62744bda74a6e51cb06dccaad6cd04756b7) Add guards for scales when the type is bf16 ### 📊 Changes **4 files changed** (+50 additions, -23 deletions) <details> <summary>View changed files</summary> 📝 `csrc/hybrid_ep/backend/hybrid_ep_backend.cuh` (+3 -3) 📝 `csrc/hybrid_ep/executor/executor.cu` (+9 -4) 📝 `csrc/hybrid_ep/hybrid_ep.cu` (+35 -13) 📝 `csrc/hybrid_ep/utils.cuh` (+3 -3) </details> ### 📄 Description I'm working on integrating the DeepEP hybrid kernels with vLLM and ran into problems when running with bf16 tokens. I added some checks to allow for null scales for bf16 and it fixed the crashes I was running into. cc @jershi425 , @Autumn1998 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-27 21:04:16 +00:00