[GH-ISSUE #5] DynamicVRAM (comfy-aimdo 0.2.1) fails to initialize on Windows with PyTorch 2.10.0+cu130 (CUDA 13), falling back to legacy ModelPatcher #3

Closed
opened 2026-10-26 22:23:23 +00:00 by bsakaguchi · 4 comments
Owner

Originally created by @phazei on GitHub (Feb 25, 2026).
Original GitHub issue: https://github.com/Comfy-Org/comfy-aimdo/issues/5

Environment

  • OS: Windows 11
  • GPU: RTX 3090 (24GB)
  • Driver: 581.80
  • ComfyUI: 0.15.0
  • Frontend: 1.39.16
  • Python: 3.12.11
  • PyTorch: 2.10.0+cu130
  • Torch CUDA runtime: 13.0
  • comfy-aimdo: 0.2.1
  • CUDA Toolkit installed: 12.6 (cudart64_12.dll on PATH)

Launch Args

--fast --disable-cuda-malloc

Issue

ComfyUI logs:

No working comfy-aimdo install detected. DynamicVRAM support disabled.
Falling back to legacy ModelPatcher.

comfy_aimdo imports successfully in Python, and CUDA 12.6 12.8 (I just updated that, I have 12.8 and 13.0) runtime DLL is resolvable via PATH. DynamicVRAM still does not initialize.

I'm not sure what else to try

Originally created by @phazei on GitHub (Feb 25, 2026). Original GitHub issue: https://github.com/Comfy-Org/comfy-aimdo/issues/5 ### Environment * **OS:** Windows 11 * **GPU:** RTX 3090 (24GB) * **Driver:** 581.80 * **ComfyUI:** 0.15.0 * **Frontend:** 1.39.16 * **Python:** 3.12.11 * **PyTorch:** 2.10.0+cu130 * **Torch CUDA runtime:** 13.0 * **comfy-aimdo:** 0.2.1 * **CUDA Toolkit installed:** 12.6 (cudart64_12.dll on PATH) ### Launch Args ``` --fast --disable-cuda-malloc ``` ### Issue ComfyUI logs: ``` No working comfy-aimdo install detected. DynamicVRAM support disabled. Falling back to legacy ModelPatcher. ``` `comfy_aimdo` imports successfully in Python, and CUDA ~12.6~ 12.8 (I just updated that, I have 12.8 and 13.0) runtime DLL is resolvable via PATH. DynamicVRAM still does not initialize. I'm not sure what else to try
Author
Owner

@phazei commented on GitHub (Feb 25, 2026):

(venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>pip show comfy-aimdo
Name: comfy-aimdo
Version: 0.2.1
Summary: AI Model Dynamic Offloader for ComfyUI
Home-page:
Author: rattus
Author-email:
License:
Location: D:\AITools\StabilityMatrixData\Packages\ComfyUI\venv\Lib\site-packages
Requires:
Required-by:

(venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "import comfy_aimdo, comfy_aimdo.control as c; print('import OK'); print('cuda:', import('torch').version.cuda); print('control file:', c.file)"
import OK
cuda: 13.0
control file: D:\AITools\StabilityMatrixData\Packages\ComfyUI\venv\Lib\site-packages\comfy_aimdo\control.py

(venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "from comfy_aimdo import control; print(control.init())"
True

(venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "import comfy.model_management as m; print('dynamic_vram:', getattr(m, 'dynamic_vram', None))"
dynamic_vram: None

I tried launching with --fast dynamic_vram --disable-cuda-malloc as well with no change

<!-- gh-comment-id:3957295088 --> @phazei commented on GitHub (Feb 25, 2026): (venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>pip show comfy-aimdo Name: comfy-aimdo Version: 0.2.1 Summary: AI Model Dynamic Offloader for ComfyUI Home-page: Author: rattus Author-email: License: Location: D:\AITools\StabilityMatrixData\Packages\ComfyUI\venv\Lib\site-packages Requires: Required-by: (venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "import comfy_aimdo, comfy_aimdo.control as c; print('import OK'); print('cuda:', __import__('torch').version.cuda); print('control file:', c.__file__)" import OK cuda: 13.0 control file: D:\AITools\StabilityMatrixData\Packages\ComfyUI\venv\Lib\site-packages\comfy_aimdo\control.py (venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "from comfy_aimdo import control; print(control.init())" True (venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "import comfy.model_management as m; print('dynamic_vram:', getattr(m, 'dynamic_vram', None))" dynamic_vram: None I tried launching with `--fast dynamic_vram --disable-cuda-malloc` as well with no change
Author
Owner

@phazei commented on GitHub (Feb 25, 2026):

(venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "import comfy_aimdo.control as c, torch; print(c.init()); print(c.init_device(torch.cuda.current_device()))"
True
aimdo: src-win/cuda-detour.c:35:ALL:aimdo_setup_hooks: cudart64_12.dll not foundFalse

(venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>where cudart64_12.dll
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\bin\cudart64_12.dll

(venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "import ctypes; ctypes.CDLL(r'C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\bin\cudart64_12.dll'); print('loaded')"
loaded

<!-- gh-comment-id:3957342685 --> @phazei commented on GitHub (Feb 25, 2026): (venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "import comfy_aimdo.control as c, torch; print(c.init()); print(c.init_device(torch.cuda.current_device()))" True aimdo: src-win/cuda-detour.c:35:ALL:aimdo_setup_hooks: cudart64_12.dll not foundFalse (venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>where cudart64_12.dll C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\bin\cudart64_12.dll (venv) D:\AITools\StabilityMatrixData\Packages\ComfyUI>python -c "import ctypes; ctypes.CDLL(r'C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.8\bin\cudart64_12.dll'); print('loaded')" loaded
Author
Owner

@rattus128 commented on GitHub (Feb 25, 2026):

Thanks for the report. There is an issue in cuda13 + recent versions of Aimdo. Will post a fix shortly.

<!-- gh-comment-id:3958086792 --> @rattus128 commented on GitHub (Feb 25, 2026): Thanks for the report. There is an issue in cuda13 + recent versions of Aimdo. Will post a fix shortly.
Author
Owner

@rattus128 commented on GitHub (Feb 25, 2026):

When comfy Aimdo 0.2.2 filters through this should be fixed.

<!-- gh-comment-id:3960930250 --> @rattus128 commented on GitHub (Feb 25, 2026): When comfy Aimdo 0.2.2 filters through this should be fixed.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
Comfy-Org/comfy-aimdo#3
No description provided.