[GH-ISSUE #28] not an issue (yet), question re aimdo #8

New issue

Open

opened 2026-10-26 22:23:28 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented

2026-10-26 22:23:28 +00:00

Owner

Originally created by @FilipeF12 on GitHub (Mar 24, 2026).
Original GitHub issue: https://github.com/Comfy-Org/comfy-aimdo/issues/28

From your CAVEATS: "What you should generally do though, is completely flush the pytorch caching allocator before each new model run, which avoids completely un-used reservations from taking priority over the next models weights."

Who is the 'you' in that sentence?

And..

When I start ComfyUI I have begun seeing this:

aimdo: src-win/cuda-detour.c:77:INFO:aimdo_setup_hooks: found driver at 00007FF9B1540000, installing 4 hooks
aimdo: src-win/cuda-detour.c:61:DEBUG:install_hook_entrys: hooks successfully installed
aimdo: src/control.c:69:INFO:comfy-aimdo inited for GPU: NVIDIA GeForce RTX 3090 (VRAM: 24575 MB)
DynamicVRAM support detected and enabled

I have no recollection of installing anything having to do with memory management. Or is this just built-in to ComfyUI now (version 0.18.2)

Thanks

Originally created by @FilipeF12 on GitHub (Mar 24, 2026). Original GitHub issue: https://github.com/Comfy-Org/comfy-aimdo/issues/28 From your **CAVEATS**: "What you should generally do though, is completely flush the pytorch caching allocator before each new model run, which avoids completely un-used reservations from taking priority over the next models weights." Who is the '**_you_**' in that sentence? And.. When I start ComfyUI I have begun seeing this: aimdo: src-win/cuda-detour.c:77:INFO:aimdo_setup_hooks: found driver at 00007FF9B1540000, installing 4 hooks aimdo: src-win/cuda-detour.c:61:DEBUG:install_hook_entrys: hooks successfully installed aimdo: src/control.c:69:INFO:comfy-aimdo inited for GPU: NVIDIA GeForce RTX 3090 (VRAM: 24575 MB) DynamicVRAM support detected and enabled I have no recollection of installing anything having to do with memory management. Or is this just built-in to ComfyUI now (version 0.18.2) Thanks

bsakaguchi commented

2026-10-26 22:23:29 +00:00

Author

Owner

@rattus128 commented on GitHub (Mar 28, 2026):

You is the integrating software. Aimdo is a code library so its more information for developers reading and itegrating. ComfyUI does what it says, thats written for anyone else who wants to use Aimdo in a different way.

This is build into comfy now. Its just another python dependency and module in the Comfy ecosystem. Have a look at requirements.txt to see comfyUI python packages of which we are just one of many.

@rattus128 commented on GitHub (Mar 28, 2026): You is the integrating software. Aimdo is a code library so its more information for developers reading and itegrating. ComfyUI does what it says, thats written for anyone else who wants to use Aimdo in a different way. This is build into comfy now. Its just another python dependency and module in the Comfy ecosystem. Have a look at requirements.txt to see comfyUI python packages of which we are just one of many.

bsakaguchi commented

2026-10-26 22:23:29 +00:00

Author

Owner

@FilipeF12 commented on GitHub (Mar 28, 2026):

Thanks. I believe I read somewhere that when I launch the version of comfyU with comfyUI-amido built-in, that the task manager will show 100% vram usage, but it is in fact not using 100% of vram.

I do know that when I run the new version of comfyUI with comfyui-amido built-in, some workflows hang forever*. So I launch comfyUI with the following flag:

-disable-dynamic-vram

forever is relative. more than :15 minutes. with the flag above, under a minute.

let me know if you need system info or logs.

@FilipeF12 commented on GitHub (Mar 28, 2026): Thanks. I believe I read somewhere that when I launch the version of comfyU with comfyUI-amido built-in, that the task manager will show 100% vram usage, but it is in fact not using 100% of vram. I do know that when I run the new version of comfyUI with comfyui-amido built-in, some workflows hang forever*. So I launch comfyUI with the following flag: -disable-dynamic-vram * forever is relative. more than :15 minutes. with the flag above, under a minute. let me know if you need system info or logs.

bsakaguchi referenced this issue

2026-10-26 22:24:11 +00:00

[PR #8] [MERGED] Aggregate allocations between polling intervals to catch OOMs #57