deepseek-ai/DeepSeek-Coder
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-Coder.git synced 2026-11-05 00:57:19 +00:00
Code Issues 177 Projects Packages Wiki Activity

[GH-ISSUE #7] 请问可以发布更多关于数据清洗的细节吗？ #4

New issue
Open
opened 2026-10-26 21:01:57 +00:00 by bsakaguchi · 7 comments
bsakaguchi commented 2026-10-26 21:01:57 +00:00
Owner
Copy link

Originally created by @Casi11as on GitHub (Nov 3, 2023).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/7

目前第一步数据清洗是与starcoder相同，想学习了解后面是如何过滤掉低质量代码、语法错误或可读性差的代码的。

谢谢！

Originally created by @Casi11as on GitHub (Nov 3, 2023). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/7 目前第一步数据清洗是与starcoder相同，想学习了解后面是如何过滤掉低质量代码、语法错误或可读性差的代码的。 谢谢！
bsakaguchi commented 2026-10-26 21:01:58 +00:00
Author
Owner
Copy link

@guoday commented on GitHub (Nov 4, 2023):

之后会有技术报告出来的

<!-- gh-comment-id:1793313689 --> @guoday commented on GitHub (Nov 4, 2023): 之后会有技术报告出来的
bsakaguchi commented 2026-10-26 21:01:58 +00:00
Author
Owner
Copy link

@Casi11as commented on GitHub (Nov 6, 2023):

之后会有技术报告出来的
好的，多谢，会持续关注的

<!-- gh-comment-id:1793968331 --> @Casi11as commented on GitHub (Nov 6, 2023): > 之后会有技术报告出来的 好的，多谢，会持续关注的
bsakaguchi commented 2026-10-26 21:01:58 +00:00
Author
Owner
Copy link

@i-love-doufunao commented on GitHub (Nov 9, 2023):

We also are closely paying attention to how to preprocessing code dataset, especially how to handle the dependencies among code file

<!-- gh-comment-id:1803099814 --> @i-love-doufunao commented on GitHub (Nov 9, 2023): We also are closely paying attention to how to preprocessing code dataset, especially how to handle the dependencies among code file
bsakaguchi commented 2026-10-26 21:01:59 +00:00
Author
Owner
Copy link

@Rosacess commented on GitHub (Nov 10, 2023):

  • Step 2: Parsing the dependencies of files within the same repository to rearrange the file positions based on their dependencies.
  • Step 3: Concatenating dependent files to form a single example and employ repo-level minhash for deduplication.
    期待发布这两部分的更多细节
<!-- gh-comment-id:1805282575 --> @Rosacess commented on GitHub (Nov 10, 2023): - Step 2: Parsing the dependencies of files within the same repository to rearrange the file positions based on their dependencies. - Step 3: Concatenating dependent files to form a single example and employ repo-level minhash for deduplication. 期待发布这两部分的更多细节
bsakaguchi commented 2026-10-26 21:01:59 +00:00
Author
Owner
Copy link

@wyjksyjs commented on GitHub (Nov 14, 2023):

之后会有技术报告出来的

请问技术报告里包含SFT数据的构造方法吗，以及SFT数据是否开源？顺便问一下技术报告什么时候能出来，很期待👍

<!-- gh-comment-id:1809682366 --> @wyjksyjs commented on GitHub (Nov 14, 2023): > 之后会有技术报告出来的 请问技术报告里包含SFT数据的构造方法吗，以及SFT数据是否开源？顺便问一下技术报告什么时候能出来，很期待👍
bsakaguchi commented 2026-10-26 21:01:59 +00:00
Author
Owner
Copy link

@i-love-doufunao commented on GitHub (Nov 26, 2023):

请问这部分内容现在有更新吗？

<!-- gh-comment-id:1826767739 --> @i-love-doufunao commented on GitHub (Nov 26, 2023): 请问这部分内容现在有更新吗？
bsakaguchi commented 2026-10-26 21:01:59 +00:00
Author
Owner
Copy link

@ali8zake commented on GitHub (Dec 2, 2023):

ding 一个

<!-- gh-comment-id:1837040695 --> @ali8zake commented on GitHub (Dec 2, 2023): ding 一个
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
ydj/leetcode
bingxuan/dev
ydj/mbpp
No results found.
Labels
Clear labels   
documentation

   
ENV

   
pull-request
Mirrored from GitHub Pull Request

  
research question

   
WIP
No labels
documentation
ENV
pull-request
research question
WIP
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-Coder#4
No description provided.