mirror of
https://github.com/deepseek-ai/DeepSeek-V2.git
synced 2026-11-05 00:47:23 +00:00
[GH-ISSUE #40] How to fine-tune deepseek v2 models? #39
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/DeepSeek-V2#39
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @satkatai on GitHub (May 19, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-V2/issues/40
Hi,
Can you please give us instructions about fine-tuning deepseekv2 model? Can we use
finetune.pyscript fromDeepSeek-MoEhttps://github.com/deepseek-ai/DeepSeek-MoE/blob/main/finetune/finetune.py
@luofuli commented on GitHub (May 27, 2024):
No plans...
@xidongyuandong commented on GitHub (Jul 13, 2024):
why,we have the needs
@TMelikhov commented on GitHub (Jul 25, 2024):
We are also very interested to do this. So far our experiments have been unsuccessful. It would be incredible if we could get some clues.
@xidongyuandong commented on GitHub (Jul 26, 2024):
what is the problem? i have use some repo like MFTCoder/Firefly to train it successful except for the eval during training; and loss decrease normal. These training pipeline will be ok?
@xidongyuandong commented on GitHub (Jul 26, 2024):
@xidongyuandong commented on GitHub (Jul 26, 2024):
like this
