[GH-ISSUE #39] 训练MoE的时候会出现loss = 0 的情况 #37

Open
opened 2026-10-26 21:01:58 +00:00 by bsakaguchi · 0 comments
Owner

Originally created by @AlenjandroWang on GitHub (Aug 14, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-MoE/issues/39

Uploading QQ截图20240801000702.png…

Originally created by @AlenjandroWang on GitHub (Aug 14, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-MoE/issues/39 ![Uploading QQ截图20240801000702.png…]()
Sign in to join this conversation.
No labels
pull-request
WIP
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-MoE#37
No description provided.