deepseek-ai/DeepSeek-Prover-V1.5
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepSeek-Prover-V1.5.git synced 2026-11-05 00:57:20 +00:00
Code Issues 12 Projects Packages Wiki Activity

[GH-ISSUE #11] Seems that all models are loaded to the first GPU? #8

New issue
Open
opened 2026-10-26 21:06:31 +00:00 by bsakaguchi · 3 comments
bsakaguchi commented 2026-10-26 21:06:31 +00:00
Owner
Copy link

Originally created by @DDDOH on GitHub (Nov 25, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Prover-V1.5/issues/11

I use four A100 run python -m prover.launch --config=configs/RMaxTS.py --log_dir=logs/RMaxTS_results
But always get cuda out of memory error.

I added some print message:
image

Then i get
image

All models are tried to load in first GPU. Is this expected? Or maybe pytorch behavior is different for new version (I am using '2.5.1+cu121', and the version in requirement.txt is 2.2.1)

Originally created by @DDDOH on GitHub (Nov 25, 2024). Original GitHub issue: https://github.com/deepseek-ai/DeepSeek-Prover-V1.5/issues/11 I use four A100 run `python -m prover.launch --config=configs/RMaxTS.py --log_dir=logs/RMaxTS_results` But always get cuda out of memory error. I added some print message: <img width="845" alt="image" src="https://github.com/user-attachments/assets/c6c1afc6-4c9e-42f8-92c0-6324d258c3ee"> Then i get <img width="514" alt="image" src="https://github.com/user-attachments/assets/1e72ca33-a0dc-49de-b26f-8ff917043499"> All models are tried to load in first GPU. Is this expected? Or maybe pytorch behavior is different for new version (I am using '2.5.1+cu121', and the version in requirement.txt is 2.2.1)
bsakaguchi commented 2026-10-26 21:06:33 +00:00
Author
Owner
Copy link

@Luobots commented on GitHub (Dec 15, 2024):

Same error. VLLM can't set the cuda index.

<!-- gh-comment-id:2543946062 --> @Luobots commented on GitHub (Dec 15, 2024): Same error. VLLM can't set the cuda index.
bsakaguchi commented 2026-10-26 21:06:33 +00:00
Author
Owner
Copy link

@zzhisthebest commented on GitHub (Jan 4, 2025):

@Luobots How to solve this problem?I meet the same error.

<!-- gh-comment-id:2570412701 --> @zzhisthebest commented on GitHub (Jan 4, 2025): @Luobots How to solve this problem?I meet the same error.
bsakaguchi commented 2026-10-26 21:06:33 +00:00
Author
Owner
Copy link

@chuxuecao commented on GitHub (Apr 24, 2025):

@zzhisthebest Hi, have you solved the problem?

<!-- gh-comment-id:2826848761 --> @chuxuecao commented on GitHub (Apr 24, 2025): @zzhisthebest Hi, have you solved the problem?
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
No results found.
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepSeek-Prover-V1.5#8
No description provided.