[GH-ISSUE #19] DeepSeek-Prover-V1.5-Base performs significantly worse than DeepSeek-Prover-V1 in Table 1 #12

Open
opened 2026-10-26 21:06:34 +00:00 by bsakaguchi · 0 comments
Owner

Originally created by @vadimkantorov on GitHub (Apr 10, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Prover-V1.5/issues/19

Hi! Thanks for open-sourcing!

What is the intuition in Tab. 1 / Single-Pass Whole-Proof Generation Methods for DeepSeek-Prover-V1.5-Base to fare much worse than DeepSeek-Prover-V1: (@ 128): 29.7% vs 46.1%

If I understood well from Sec. 2.1, DeepSeek-Prover-V1.5-Base was obtained by fine-tuning DeepSeek-Prover-V1. Is it correct? (or was it trained from scratch? or initialized from some other pretrained model? maybe DeepSeekMath 7B?) If so, what is the explanation for such degradation?

Thank you!

Image

Image

Originally created by @vadimkantorov on GitHub (Apr 10, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Prover-V1.5/issues/19 Hi! Thanks for open-sourcing! What is the intuition in Tab. 1 / `Single-Pass Whole-Proof Generation Methods` for `DeepSeek-Prover-V1.5-Base` to fare much worse than `DeepSeek-Prover-V1`: (@ 128): 29.7% vs 46.1% If I understood well from Sec. 2.1, `DeepSeek-Prover-V1.5-Base` was obtained by fine-tuning DeepSeek-Prover-V1. Is it correct? (or was it trained from scratch? or initialized from some other pretrained model? maybe `DeepSeekMath 7B`?) If so, what is the explanation for such degradation? Thank you! ![Image](https://github.com/user-attachments/assets/d13d0802-3cb9-4d47-b8e2-123110a5eca8) ![Image](https://github.com/user-attachments/assets/37e5e660-032c-4117-9ff5-e012262655d2)
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-Prover-V1.5#12
No description provided.