deepseek-ai/DeepSeek-Coder-V2
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-Coder-V2.git synced 2026-11-05 00:57:27 +00:00
Code Issues 79 Projects Packages Wiki Activity

[GH-ISSUE #53] Clarification on Code Implementation in DeepSeek vs Llama #50

New issue
Open
opened 2026-10-26 21:07:36 +00:00 by bsakaguchi · 2 comments
bsakaguchi commented 2026-10-26 21:07:36 +00:00
Owner
Copy link

Originally created by @dog14230pp on GitHub (Oct 7, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder-V2/issues/53

Dear Authors,

Thank you for providing such excellent work for the community to use!

I have a question regarding an implementation detail. In Line 338, it appears that the code is adapted from Llama. However, when looking closer, the implementation in DeepSeek seems to differ, particularly from Line 363 to Line 367, compared to Llama’s implementation in Line 223.

Could you explain the reasoning behind this difference? Were there specific considerations that led to this change?

I look forward to your response. Thank you again for your great work!

Best regards,

Originally created by @dog14230pp on GitHub (Oct 7, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder-V2/issues/53 Dear Authors, Thank you for providing such excellent work for the community to use! I have a question regarding an implementation detail. In [Line 338](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Base/blob/ea9b066cee82f82906fdd58898cb3788b1c5d770/modeling_deepseek.py#L338), it appears that the code is adapted from Llama. However, when looking closer, the implementation in DeepSeek seems to differ, particularly from [Line 363](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Base/blob/main/modeling_deepseek.py#L363) to [Line 367](https://huggingface.co/deepseek-ai/DeepSeek-Coder-V2-Lite-Base/blob/main/modeling_deepseek.py#L367), compared to Llama’s implementation in [Line 223](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py#L223). Could you explain the reasoning behind this difference? Were there specific considerations that led to this change? I look forward to your response. Thank you again for your great work! Best regards,
bsakaguchi commented 2026-10-26 21:07:37 +00:00
Author
Owner
Copy link

@kelsthevibe commented on GitHub (Jan 28, 2025):

I am interested as well.

<!-- gh-comment-id:2619490816 --> @kelsthevibe commented on GitHub (Jan 28, 2025): I am interested as well.
bsakaguchi commented 2026-10-26 21:07:37 +00:00
Author
Owner
Copy link

@rasrenato commented on GitHub (Feb 10, 2025):

Hi!
I tried to analyze the differences between DeepSeek-Coder-V2 and Llama, as mentioned in this issue. However, I couldn't find the source code in this repository—only licenses and the paper.
Is the implementation of DeepSeek-Coder-V2 publicly available? If so, where can we find it?

Thanks in advance for your clarification! 🚀

<!-- gh-comment-id:2647439832 --> @rasrenato commented on GitHub (Feb 10, 2025): Hi! I tried to analyze the differences between DeepSeek-Coder-V2 and Llama, as mentioned in this issue. However, I couldn't find the source code in this repository—only licenses and the paper. Is the implementation of DeepSeek-Coder-V2 publicly available? If so, where can we find it? Thanks in advance for your clarification! 🚀
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
No results found.
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-Coder-V2#50
No description provided.