[GH-ISSUE #2] can you please share sharded (<2gb / bin) model? #2

Closed
opened 2026-10-26 21:01:29 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @amrrs on GitHub (Nov 29, 2023).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/2

Thanks for this. The 7B model can be fit in Google colab given there model are tiny pieces.
Example: https://huggingface.co/bn22/Mistral-7B-Instruct-v0.1-sharded

Originally created by @amrrs on GitHub (Nov 29, 2023). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-LLM/issues/2 Thanks for this. The 7B model can be fit in Google colab given there model are tiny pieces. Example: https://huggingface.co/bn22/Mistral-7B-Instruct-v0.1-sharded
Author
Owner

@luofuli commented on GitHub (Feb 4, 2024):

The example link has been 404. And we don't have a plan to share the shaded model. Therefore, I close the issue.

<!-- gh-comment-id:1925801590 --> @luofuli commented on GitHub (Feb 4, 2024): The example link has been 404. And we don't have a plan to share the shaded model. Therefore, I close the issue.
Author
Owner

@amrrs commented on GitHub (Feb 4, 2024):

For anyone else coming here, someone else on HF had already shared a sharded model - https://huggingface.co/notzero/deepseek_sharded/tree/main (I'm not sure of the legitimacy or the content of it, use at your own risk)

<!-- gh-comment-id:1925908408 --> @amrrs commented on GitHub (Feb 4, 2024): For anyone else coming here, someone else on HF had already shared a sharded model - https://huggingface.co/notzero/deepseek_sharded/tree/main (I'm not sure of the legitimacy or the content of it, use at your own risk)
Sign in to join this conversation.
No labels
bug
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-LLM#2
No description provided.