deepseek-ai/DeepSeek-Coder
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-Coder.git synced 2026-11-05 00:57:19 +00:00
Code Issues 177 Projects Packages Wiki Activity

[GH-ISSUE #3] Discussion about possible contamination? #2

New issue
Closed
opened 2026-10-26 21:01:54 +00:00 by bsakaguchi · 4 comments
bsakaguchi commented 2026-10-26 21:01:54 +00:00
Owner
Copy link

Originally created by @zkx06111 on GitHub (Nov 2, 2023).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/3

Hi, I appreciate your great contribution to the open-source community!

I wonder if there's any measure you took to prevent contamination in your training corpus or any discussion about it in your technical report.

Thanks

Originally created by @zkx06111 on GitHub (Nov 2, 2023). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/3 Hi, I appreciate your great contribution to the open-source community! I wonder if there's any measure you took to prevent contamination in your training corpus or any discussion about it in your technical report. Thanks
bsakaguchi 2026-10-26 21:01:54 +00:00
bsakaguchi commented 2026-10-26 21:01:55 +00:00
Author
Owner
Copy link

@guoday commented on GitHub (Nov 4, 2023):

What's meaning of contamination? Do you mean low-quality code?

<!-- gh-comment-id:1793313999 --> @guoday commented on GitHub (Nov 4, 2023): What's meaning of contamination? Do you mean low-quality code?
bsakaguchi commented 2026-10-26 21:01:55 +00:00
Author
Owner
Copy link

@jeff31415 commented on GitHub (Nov 4, 2023):

What's meaning of contamination? Do you mean low-quality code?

I think he/she means the potential leak of eval sets(eg Human Eval) into pretaining corpus, and the effectiveness of benchmark, sience achievening 79% pass@1 on HumanEval is not common before.🤔

<!-- gh-comment-id:1793335916 --> @jeff31415 commented on GitHub (Nov 4, 2023): > What's meaning of contamination? Do you mean low-quality code? I think he/she means the potential leak of eval sets(eg Human Eval) into pretaining corpus, and the effectiveness of benchmark, sience achievening 79% pass@1 on HumanEval is not common before.🤔
bsakaguchi commented 2026-10-26 21:01:56 +00:00
Author
Owner
Copy link

@guoday commented on GitHub (Nov 4, 2023):

I see. We use the same method as https://github.com/bigcode-project/bigcode-dataset/tree/main/decontamination.
As we said here, we apply the same filtering rules as StarcoderData to filter data, including decontamination.

<!-- gh-comment-id:1793337333 --> @guoday commented on GitHub (Nov 4, 2023): I see. We use the same method as https://github.com/bigcode-project/bigcode-dataset/tree/main/decontamination. As we said [here](https://github.com/deepseek-ai/deepseek-coder#3-procedure-of-data-creation-and-model-training), we apply the same filtering rules as [StarcoderData](https://github.com/bigcode-project/bigcode-dataset) to filter data, including decontamination.
bsakaguchi commented 2026-10-26 21:01:56 +00:00
Author
Owner
Copy link

@zkx06111 commented on GitHub (Nov 5, 2023):

Thanks for the clarification!

<!-- gh-comment-id:1793854499 --> @zkx06111 commented on GitHub (Nov 5, 2023): Thanks for the clarification!
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
ydj/leetcode
bingxuan/dev
ydj/mbpp
No results found.
Labels
Clear labels   
documentation

   
ENV

   
pull-request
Mirrored from GitHub Pull Request

  
research question

   
WIP
No labels
documentation
ENV
pull-request
research question
WIP
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-Coder#2
No description provided.