deepseek-ai/DreamCraft3D
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DreamCraft3D.git synced 2026-11-05 01:07:44 +00:00
Code Issues 35 Projects Packages Wiki Activity

[GH-ISSUE #42] Process killed when trying to load Stable Zero123 #41

New issue
Closed
opened 2026-10-26 21:03:33 +00:00 by bsakaguchi · 2 comments
bsakaguchi commented 2026-10-26 21:03:33 +00:00
Owner
Copy link

Originally created by @Inkapa on GitHub (Feb 2, 2024).
Original GitHub issue: https://github.com/deepseek-ai/DreamCraft3D/issues/42

Hello, I've just set up dreamcraft3d with WSL, but when running the first command of the first Stage (NeRF & NeuS) the process gets killed after trying to load Stable Zero123 with no traceback or errors. I've tried this with a custom image and the example mushroom_log_rgba.png

I'm running it from WSL (Ubuntu 22.04.3 LTS) with torch 2.2.0 and CUDA 12.3, GPU is an RTX 4090

(venv) bebop@DESKTOP:~/DreamCraft3D$ python launch.py --config configs/dreamcraft3d-coarse-nerf.yaml --train system.prompt_processor.prompt="$prompt" data.image_path="$image_path"

/home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_5m_224 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_5m_224. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
  return register_model(fn_wrapper)
/home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_11m_224 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_11m_224. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
  return register_model(fn_wrapper)
/home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_21m_224 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_21m_224. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
  return register_model(fn_wrapper)
/home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_21m_384 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_21m_384. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
  return register_model(fn_wrapper)
/home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_21m_512 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_21m_512. This is because the name being registered conflicts with an existing name. Please check if this is not expected.
  return register_model(fn_wrapper)
Seed set to 0
[INFO] Loading Deep Floyd ...

A mixture of fp16 and non-fp16 filenames will be loaded.
Loaded fp16 filenames:
[safety_checker/model.fp16.safetensors, text_encoder/model.fp16-00002-of-00002.safetensors, unet/diffusion_pytorch_model.fp16.safetensors, text_encoder/model.fp16-00001-of-00002.safetensors]
Loaded non-fp16 filenames:
[watermarker/diffusion_pytorch_model.safetensors
If this behavior is not expected, please check your folder structure.
Loading pipeline components...: 100%|█████████████████████████████████████| 3/3 [00:00<00:00, 13.94it/s]
[INFO] Loaded Deep Floyd!
[INFO] Loading Stable Zero123 ...
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.53 M params.
Keeping EMAs of 688.
making attention of type 'vanilla' with 512 in_channels
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
making attention of type 'vanilla' with 512 in_channels
Killed

The same issue arises whether I use stable_zero123.ckpt that I got from https://huggingface.co/stabilityai/stable-zero123 or zero123-xl.ckpt that is downloaded by the load/zero123/download.sh script

Originally created by @Inkapa on GitHub (Feb 2, 2024). Original GitHub issue: https://github.com/deepseek-ai/DreamCraft3D/issues/42 Hello, I've just set up dreamcraft3d with WSL, but when running the first command of the first Stage (NeRF & NeuS) the process gets killed after trying to load Stable Zero123 with no traceback or errors. I've tried this with a custom image and the example `mushroom_log_rgba.png` I'm running it from WSL (Ubuntu 22.04.3 LTS) with torch 2.2.0 and CUDA 12.3, GPU is an RTX 4090 ``` (venv) bebop@DESKTOP:~/DreamCraft3D$ python launch.py --config configs/dreamcraft3d-coarse-nerf.yaml --train system.prompt_processor.prompt="$prompt" data.image_path="$image_path" /home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_5m_224 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_5m_224. This is because the name being registered conflicts with an existing name. Please check if this is not expected. return register_model(fn_wrapper) /home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_11m_224 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_11m_224. This is because the name being registered conflicts with an existing name. Please check if this is not expected. return register_model(fn_wrapper) /home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_21m_224 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_21m_224. This is because the name being registered conflicts with an existing name. Please check if this is not expected. return register_model(fn_wrapper) /home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_21m_384 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_21m_384. This is because the name being registered conflicts with an existing name. Please check if this is not expected. return register_model(fn_wrapper) /home/bebop/DreamCraft3D/venv/lib/python3.10/site-packages/controlnet_aux/segment_anything/modeling/tiny_vit_sam.py:654: UserWarning: Overwriting tiny_vit_21m_512 in registry with controlnet_aux.segment_anything.modeling.tiny_vit_sam.tiny_vit_21m_512. This is because the name being registered conflicts with an existing name. Please check if this is not expected. return register_model(fn_wrapper) Seed set to 0 [INFO] Loading Deep Floyd ... A mixture of fp16 and non-fp16 filenames will be loaded. Loaded fp16 filenames: [safety_checker/model.fp16.safetensors, text_encoder/model.fp16-00002-of-00002.safetensors, unet/diffusion_pytorch_model.fp16.safetensors, text_encoder/model.fp16-00001-of-00002.safetensors] Loaded non-fp16 filenames: [watermarker/diffusion_pytorch_model.safetensors If this behavior is not expected, please check your folder structure. Loading pipeline components...: 100%|█████████████████████████████████████| 3/3 [00:00<00:00, 13.94it/s] [INFO] Loaded Deep Floyd! [INFO] Loading Stable Zero123 ... LatentDiffusion: Running in eps-prediction mode DiffusionWrapper has 859.53 M params. Keeping EMAs of 688. making attention of type 'vanilla' with 512 in_channels Working with z of shape (1, 4, 32, 32) = 4096 dimensions. making attention of type 'vanilla' with 512 in_channels Killed ``` The same issue arises whether I use `stable_zero123.ckpt` that I got from https://huggingface.co/stabilityai/stable-zero123 or `zero123-xl.ckpt` that is downloaded by the `load/zero123/download.sh` script
bsakaguchi commented 2026-10-26 21:03:34 +00:00
Author
Owner
Copy link

@Inkapa commented on GitHub (Feb 2, 2024):

Managed to get Stable Zero123 to load after increasing WSL2's swap amount through .wslconfig (cf: https://learn.microsoft.com/en-us/windows/wsl/wsl-config#wslconfig) and using the data.height=128 data.width=128 data.random_camera.height=128 data.random_camera.width=128 arguments

<!-- gh-comment-id:1924891307 --> @Inkapa commented on GitHub (Feb 2, 2024): Managed to get Stable Zero123 to load after increasing WSL2's swap amount through `.wslconfig` (cf: https://learn.microsoft.com/en-us/windows/wsl/wsl-config#wslconfig) and using the `data.height=128 data.width=128 data.random_camera.height=128 data.random_camera.width=128` arguments
bsakaguchi commented 2026-10-26 21:03:34 +00:00
Author
Owner
Copy link

@fantasy-fish commented on GitHub (May 13, 2024):

May I know what the memory size is on your machine?

<!-- gh-comment-id:2107891528 --> @fantasy-fish commented on GitHub (May 13, 2024): May I know what the memory size is on your machine?
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
No results found.
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DreamCraft3D#41
No description provided.