deepseek-ai/DeepGEMM

Fork 0

mirror of https://github.com/deepseek-ai/DeepGEMM.git synced 2026-11-05 00:47:26 +00:00

[GH-ISSUE #210] [Feature] Support Bias #123

New issue

Open

opened 2026-10-26 21:13:03 +00:00 by bsakaguchi · 5 comments

bsakaguchi commented

2026-10-26 21:13:03 +00:00

Owner

Originally created by @complexfilter on GitHub (Oct 8, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/210

I was wondering if deepgemm can support bias computation. I think bias term is widely existing in linear layers.

Without bias support, we need to write dedicated kernels to perform sum operator. Compared with fused operator, extra time is needed to read and write the matrix.

Originally created by @complexfilter on GitHub (Oct 8, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepGEMM/issues/210 I was wondering if deepgemm can support bias computation. I think bias term is widely existing in linear layers. Without bias support, we need to write dedicated kernels to perform sum operator. Compared with fused operator, extra time is needed to read and write the matrix.

bsakaguchi commented

2026-10-26 21:13:04 +00:00

Author

Owner

@scuchenxiang commented on GitHub (Oct 19, 2025):

hi, @LyricZhao , I was wondering if deepgemm can support C = A*B+C in gemm， like the impl in wgemm.

@scuchenxiang commented on GitHub (Oct 19, 2025): hi, @LyricZhao , I was wondering if deepgemm can support C = A*B+C in gemm， like the impl in wgemm.

bsakaguchi commented

2026-10-26 21:13:04 +00:00

Author

Owner

@LyricZhao commented on GitHub (Oct 20, 2025):

I was wondering if deepgemm can support C = A*B+C in gemm

Yes, we can do D = C + A @ B. But C should have the same shape with the output matrix (D). And inplace version is the fastest (C's ptr == D's ptr).

@LyricZhao commented on GitHub (Oct 20, 2025): > I was wondering if deepgemm can support C = A*B+C in gemm Yes, we can do `D = C + A @ B`. But C should have the same shape with the output matrix (D). And inplace version is the fastest (C's ptr == D's ptr).

bsakaguchi commented

2026-10-26 21:13:05 +00:00

Author

Owner

@LyricZhao commented on GitHub (Oct 20, 2025):

For bias support, we don't have some plans, as we don't have such demand internally. Adding support may cost extra maintainence efforts. Maybe later.

@LyricZhao commented on GitHub (Oct 20, 2025): For bias support, we don't have some plans, as we don't have such demand internally. Adding support may cost extra maintainence efforts. Maybe later.

bsakaguchi commented

2026-10-26 21:13:05 +00:00

Author

Owner

@scuchenxiang commented on GitHub (Oct 20, 2025):

I was wondering if deepgemm can support C = A*B+C in gemm

Yes, we can do D = C + A @ B. But C should have the same shape with the output matrix (D). And inplace version is the fastest (C's ptr == D's ptr).

Hi, @LyricZhao , I was also wondering is this feature likely to be released?

@scuchenxiang commented on GitHub (Oct 20, 2025): > > I was wondering if deepgemm can support C = A*B+C in gemm > > Yes, we can do `D = C + A @ B`. But C should have the same shape with the output matrix (D). And inplace version is the fastest (C's ptr == D's ptr). Hi, @LyricZhao , I was also wondering is this feature likely to be released?

bsakaguchi commented

2026-10-26 21:13:05 +00:00

Author

Owner

@LyricZhao commented on GitHub (Oct 20, 2025):

D = C + A @ B is already included in main.

@LyricZhao commented on GitHub (Oct 20, 2025): `D = C + A @ B` is already included in main.

No labels

pull-request

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

deepseek-ai/DeepGEMM#123

No description provided.

Rows
Columns