[GH-ISSUE #17] GRPO implementation #15

Closed
opened 2026-10-26 21:10:44 +00:00 by bsakaguchi · 4 comments
Owner

Originally created by @hank0316 on GitHub (Jan 21, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/17

Hi Deepseek Team,

Thank you for your brilliant work! I’m currently trying to experiment with GRPO, but I couldn’t find its implementation. Do you have any plans to release the training code?

Originally created by @hank0316 on GitHub (Jan 21, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-R1/issues/17 Hi Deepseek Team, Thank you for your brilliant work! I’m currently trying to experiment with GRPO, but I couldn’t find its implementation. Do you have any plans to release the training code?
Author
Owner

@meigel commented on GitHub (Jan 25, 2025):

https://huggingface.co/docs/trl/main/en/grpo_trainer

<!-- gh-comment-id:2613938608 --> @meigel commented on GitHub (Jan 25, 2025): https://huggingface.co/docs/trl/main/en/grpo_trainer
Author
Owner

@github-actions[bot] commented on GitHub (Feb 25, 2025):

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!

<!-- gh-comment-id:2680068400 --> @github-actions[bot] commented on GitHub (Feb 25, 2025): This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. If you believe this issue is still relevant, please leave a comment to keep it open. Thank you for your contributions!
Author
Owner

@syyuan2021 commented on GitHub (Mar 12, 2025):

Is the GRPO trainer on huggingface the same as in the DeepseekMath paper?

<!-- gh-comment-id:2718780007 --> @syyuan2021 commented on GitHub (Mar 12, 2025): Is the GRPO trainer on huggingface the same as in the DeepseekMath paper?
Author
Owner
<!-- gh-comment-id:3148265327 --> @lemonsi commented on GitHub (Aug 3, 2025): https://github.com/huggingface/trl/blob/main/trl/trainer/grpo_trainer.py
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-R1#15
No description provided.