[PR #44] add fine-tuning code with lora support #93

Open
opened 2026-10-26 21:08:05 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepSeek-Coder-V2/pull/44
Author: @Muhtasham
Created: 8/25/2024
Status: 🔄 Open

Base: main ← Head: main


📝 Commits (1)

  • 19bdb69 add finetuning code with lora support

📊 Changes

5 files changed (+542 additions, -0 deletions)

View changed files

➕ finetune/README.md (+90 -0)
➕ finetune/configs/ds_config_zero2_no_offload.json (+22 -0)
➕ finetune/configs/ds_config_zero3.json (+51 -0)
➕ finetune/finetune_deepseekcoder.py (+366 -0)
➕ finetune/requirements.txt (+13 -0)

📄 Description

Closes #35 #41 #58


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepSeek-Coder-V2/pull/44 **Author:** [@Muhtasham](https://github.com/Muhtasham) **Created:** 8/25/2024 **Status:** 🔄 Open **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (1) - [`19bdb69`](https://github.com/deepseek-ai/DeepSeek-Coder-V2/commit/19bdb69bb566bbbb649022a26e2c6799685d2ba1) add finetuning code with lora support ### 📊 Changes **5 files changed** (+542 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `finetune/README.md` (+90 -0) ➕ `finetune/configs/ds_config_zero2_no_offload.json` (+22 -0) ➕ `finetune/configs/ds_config_zero3.json` (+51 -0) ➕ `finetune/finetune_deepseekcoder.py` (+366 -0) ➕ `finetune/requirements.txt` (+13 -0) </details> ### 📄 Description Closes #35 #41 #58 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-Coder-V2#93
No description provided.