[GH-ISSUE #10] deepseek-vl系列的微调支持 (finetune) #8

Closed
opened 2026-10-26 21:08:44 +00:00 by bsakaguchi · 8 comments
Owner

Originally created by @Jintao-Huang on GitHub (Mar 12, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL/issues/10

ms-swift大模型训练框架已经支持了deepseek-vl系列模型的推理和微调~

最佳实践可以查看这里:
https://github.com/modelscope/swift/blob/main/docs/source/Multi-Modal/deepseek-vl%E6%9C%80%E4%BD%B3%E5%AE%9E%E8%B7%B5.md

Originally created by @Jintao-Huang on GitHub (Mar 12, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-VL/issues/10 ms-swift大模型训练框架已经支持了deepseek-vl系列模型的推理和微调~ 最佳实践可以查看这里: https://github.com/modelscope/swift/blob/main/docs/source/Multi-Modal/deepseek-vl%E6%9C%80%E4%BD%B3%E5%AE%9E%E8%B7%B5.md
Author
Owner

@RERV commented on GitHub (Mar 12, 2024):

Thank you for supporting DeepSeek-VL!

<!-- gh-comment-id:1991722992 --> @RERV commented on GitHub (Mar 12, 2024): Thank you for supporting DeepSeek-VL!
Author
Owner

@soloice commented on GitHub (Mar 13, 2024):

@Jintao-Huang Can you kindly confirm if swift can be used to finetune visual encoder? If so, how? If not, what's the simplest way to support it?

<!-- gh-comment-id:1994097232 --> @soloice commented on GitHub (Mar 13, 2024): @Jintao-Huang Can you kindly confirm [if swift can be used to finetune visual encoder](https://github.com/deepseek-ai/DeepSeek-VL/issues/6#issuecomment-1992731315)? If so, how? If not, what's the simplest way to support it?
Author
Owner

@xs818818 commented on GitHub (Mar 13, 2024):

还有就是lora微调后怎么部署使用

<!-- gh-comment-id:1994391175 --> @xs818818 commented on GitHub (Mar 13, 2024): 还有就是lora微调后怎么部署使用
Author
Owner

@SinanAkkoyun commented on GitHub (Mar 13, 2024):

@soloice Thank you very much for asking

<!-- gh-comment-id:1994636078 --> @SinanAkkoyun commented on GitHub (Mar 13, 2024): @soloice Thank you very much for asking
Author
Owner

@Jintao-Huang commented on GitHub (Mar 13, 2024):

LoRA fine-tuning and merge-LoRA have been supported for both the visual encoder and aligner.
Full parameter fine-tuning is also supported.
😊

<!-- gh-comment-id:1995994037 --> @Jintao-Huang commented on GitHub (Mar 13, 2024): LoRA fine-tuning and merge-LoRA have been supported for both the visual encoder and aligner. Full parameter fine-tuning is also supported. 😊
Author
Owner

@SinanAkkoyun commented on GitHub (Mar 13, 2024):

I am super grateful for your work, thank you a lot!!! ❤️

<!-- gh-comment-id:1996000652 --> @SinanAkkoyun commented on GitHub (Mar 13, 2024): I am super grateful for your work, thank you a lot!!! ❤️
Author
Owner

@Ethanscuter commented on GitHub (Mar 18, 2025):

最佳实践的link已经打不开了,可以重新给一个link吗?谢谢

<!-- gh-comment-id:2733767836 --> @Ethanscuter commented on GitHub (Mar 18, 2025): 最佳实践的link已经打不开了,可以重新给一个link吗?谢谢
Author
Owner

@HugNature commented on GitHub (Mar 26, 2025):

最佳实践的link已经打不开了,可以重新给一个link吗?谢谢
可以参考一下
https://mp.weixin.qq.com/s/SiVNGbe8M1k18YlVCZqLNA

<!-- gh-comment-id:2753263244 --> @HugNature commented on GitHub (Mar 26, 2025): > 最佳实践的link已经打不开了,可以重新给一个link吗?谢谢 可以参考一下 https://mp.weixin.qq.com/s/SiVNGbe8M1k18YlVCZqLNA
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-VL#8
No description provided.