[GH-ISSUE #12] How to fully finetune MoE on multiple nodes #11

Closed
opened 2026-10-26 21:01:37 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @ftgreat on GitHub (Jan 16, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-MoE/issues/12

Thanks for you reply.

Originally created by @ftgreat on GitHub (Jan 16, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-MoE/issues/12 Thanks for you reply.
Author
Owner

@Xingxiangrui commented on GitHub (Feb 13, 2024):

DeepSeek-MoE is supported on LLaMA-factory

https://github.com/hiyouga/LLaMA-Factory

<!-- gh-comment-id:1939991483 --> @Xingxiangrui commented on GitHub (Feb 13, 2024): DeepSeek-MoE is supported on LLaMA-factory https://github.com/hiyouga/LLaMA-Factory
Sign in to join this conversation.
No labels
pull-request
WIP
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-MoE#11
No description provided.