[GH-ISSUE #33] Instruction dataset? #25

Closed
opened 2026-10-26 21:02:22 +00:00 by bsakaguchi · 4 comments
Owner

Originally created by @cdj0311 on GitHub (Nov 14, 2023).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/33

Hi,
The humaneval of deepseek-7b-instruct is 78.6%, but I can't get the result, which datasets are you training?

Originally created by @cdj0311 on GitHub (Nov 14, 2023). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Coder/issues/33 Hi, The humaneval of deepseek-7b-instruct is 78.6%, but I can't get the result, which datasets are you training?
Author
Owner

@guoday commented on GitHub (Nov 22, 2023):

For open-source datasets, you can try using wizardcoder datasets. We have tried it and it can achieve 78% accuracy.

<!-- gh-comment-id:1822044133 --> @guoday commented on GitHub (Nov 22, 2023): For open-source datasets, you can try using wizardcoder datasets. We have tried it and it can achieve 78% accuracy.
Author
Owner

@II-Matto commented on GitHub (Nov 22, 2023):

@guoday What are the "wizardcoder datasets" exactly and are they publicly available? The authors do not seem to have released the data. It would be so kind of you to provide a link to the mentioned data. Many thanks.

<!-- gh-comment-id:1822414184 --> @II-Matto commented on GitHub (Nov 22, 2023): @guoday What are the "wizardcoder datasets" exactly and are they publicly available? The authors do not seem to have released the data. It would be so kind of you to provide a link to the mentioned data. Many thanks.
Author
Owner

@guoday commented on GitHub (Nov 22, 2023):

https://huggingface.co/datasets/theblackcat102/evol-codealpaca-v1

<!-- gh-comment-id:1822578268 --> @guoday commented on GitHub (Nov 22, 2023): https://huggingface.co/datasets/theblackcat102/evol-codealpaca-v1
Author
Owner

@II-Matto commented on GitHub (Nov 22, 2023):

Thanks. I will perform some decontamination and try it for fine-tuning.

<!-- gh-comment-id:1822617085 --> @II-Matto commented on GitHub (Nov 22, 2023): Thanks. I will perform some decontamination and try it for fine-tuning.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-Coder#25
No description provided.