deepseek-ai/ESFT
1
0
Fork 0
mirror of https://github.com/deepseek-ai/ESFT.git synced 2026-11-05 00:57:35 +00:00
Code Issues 7 Projects Packages Wiki Activity

[GH-ISSUE #19] LoRA configs & scripts #13

New issue
Closed
opened 2026-10-26 21:06:44 +00:00 by bsakaguchi · 1 comment
bsakaguchi commented 2026-10-26 21:06:44 +00:00
Owner
Copy link

Originally created by @xfxcwynlc on GitHub (May 12, 2025).
Original GitHub issue: https://github.com/deepseek-ai/ESFT/issues/19

While trying to reproduce the experiment, I’m not able to match the training time reported in the paper. With my current LoRA configuration, the run takes roughly two hours.
Could you please share the LoRA configuration file and the scripts you used for fine-tuning the vanilla model? Thanks a lot :)

Originally created by @xfxcwynlc on GitHub (May 12, 2025). Original GitHub issue: https://github.com/deepseek-ai/ESFT/issues/19 While trying to reproduce the experiment, I’m not able to match the training time reported in the paper. With my current LoRA configuration, the run takes roughly two hours. Could you please share the LoRA configuration file and the scripts you used for fine-tuning the vanilla model? Thanks a lot :)
bsakaguchi commented 2026-10-26 21:06:45 +00:00
Author
Owner
Copy link

@ZihanWang314 commented on GitHub (May 22, 2025):

Our experiments were ran on 2*8 A100 GPUs in the DeepSeek GPU cluster, so it is normal to run longer if you have less than 16 GPUs. We currently do not have the plan to add direct lora training support since all configs are listed in the paper and you can easily implement them with other awesome packages like accelerate:)

<!-- gh-comment-id:2900255618 --> @ZihanWang314 commented on GitHub (May 22, 2025): Our experiments were ran on 2*8 A100 GPUs in the DeepSeek GPU cluster, so it is normal to run longer if you have less than 16 GPUs. We currently do not have the plan to add direct lora training support since all configs are listed in the paper and you can easily implement them with other awesome packages like accelerate:)
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
No results found.
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/ESFT#13
No description provided.