[GH-ISSUE #237] GenEval Score Janus-Pro 1B #191

Open
opened 2026-10-26 21:13:50 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @helia95 on GitHub (Apr 16, 2026).
Original GitHub issue: https://github.com/deepseek-ai/Janus/issues/237

Hi, thanks for sharing the repo.

I'm trying to reproduce the GenEval score of 0.73 reported for Janus-Pro 1B.
Can you share the sampling hyperparameters used to obtain this result?

Thanks!

Originally created by @helia95 on GitHub (Apr 16, 2026). Original GitHub issue: https://github.com/deepseek-ai/Janus/issues/237 Hi, thanks for sharing the repo. I'm trying to reproduce the GenEval score of 0.73 reported for Janus-Pro 1B. Can you share the sampling hyperparameters used to obtain this result? Thanks!
Author
Owner

@hiSandog commented on GitHub (Jun 25, 2026):

For GenEval reproducibility, the most useful details would be the full sampling recipe rather than only one or two knobs: guidance scale, number of samples per prompt, image resolution, seed policy, negative prompt if any, and the exact GenEval evaluator/version used. If the reported 0.73 is best-of-N or averaged over multiple seeds, that distinction would also help people compare their local Janus-Pro-1B runs fairly.

<!-- gh-comment-id:4797814738 --> @hiSandog commented on GitHub (Jun 25, 2026): For GenEval reproducibility, the most useful details would be the full sampling recipe rather than only one or two knobs: guidance scale, number of samples per prompt, image resolution, seed policy, negative prompt if any, and the exact GenEval evaluator/version used. If the reported 0.73 is best-of-N or averaged over multiple seeds, that distinction would also help people compare their local Janus-Pro-1B runs fairly.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/Janus#191
No description provided.