Comfy-Org/embedded-docs
1
0
Fork 0
mirror of https://github.com/Comfy-Org/embedded-docs.git synced 2026-11-05 00:17:31 +00:00
Code Issues 6 Projects Packages Wiki Activity

[GH-ISSUE #65] Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (TrainLoraNode) #16

New issue
Closed
opened 2026-10-26 22:08:05 +00:00 by bsakaguchi · 1 comment
bsakaguchi commented 2026-10-26 22:08:05 +00:00
Owner
Copy link

Originally created by @mrfrosty009 on GitHub (Nov 27, 2025).
Original GitHub issue: https://github.com/Comfy-Org/embedded-docs/issues/65

ComfyUI Error Report

Error Details

  • Node ID: 1
  • Node Type: TrainLoraNode
  • Exception Type: RuntimeError
  • Exception Message: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu!

Stack Trace

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 510, in execute
    output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs)
                                                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 324, in get_output_data
    return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 292, in _async_map_node_over_list
    await process_inputs(input_data_all, 0, input_is_list=input_is_list)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 286, in process_inputs
    result = f(**inputs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_api\internal\__init__.py", line 149, in wrapped_func
    return method(locked_class, **inputs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_api\latest\_io.py", line 1275, in EXECUTE_NORMALIZED
    to_return = cls.execute(*args, **kwargs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 627, in execute
    guider.sample(
    ~~~~~~~~~~~~~^
        noise.generate_noise({"samples": latents}),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ...<3 lines>...
        seed=noise.seed,
        ^^^^^^^^^^^^^^^^
    )
    ^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 1035, in sample
    output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 997, in outer_sample
    output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 980, in inner_sample
    samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 160, in sample
    loss = self.fwd_bwd(
        model_wrap,
    ...<7 lines>...
        bwd=True,
    )

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 107, in fwd_bwd
    x0_pred = model_wrap(
        xt.requires_grad_(True),
        batch_sigmas.requires_grad_(True),
        **batch_extra_args,
    )

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 953, in __call__
    return self.outer_predict_noise(*args, **kwargs)
           ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 960, in outer_predict_noise
    ).execute(x, timestep, model_options, seed)
      ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 963, in predict_noise
    return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 381, in sampling_function
    out = calc_cond_batch(model, conds, x, timestep, model_options)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 206, in calc_cond_batch
    return _calc_cond_batch_outer(model, conds, x_in, timestep, model_options)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 214, in _calc_cond_batch_outer
    return executor.execute(model, conds, x_in, timestep, model_options)
           ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 326, in _calc_cond_batch
    output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks)
             ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 161, in apply_model
    return comfy.patcher_extension.WrapperExecutor.new_class_executor(
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    ...<2 lines>...
        comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.APPLY_MODEL, transformer_options)
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    ).execute(x, t, c_concat, c_crossattn, control, transformer_options, **kwargs)
    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 203, in _apply_model
    model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl
    return forward_call(*args, **kwargs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\lumina\model.py", line 548, in forward
    return comfy.patcher_extension.WrapperExecutor.new_class_executor(
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    ...<2 lines>...
        comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.DIFFUSION_MODEL, kwargs.get("transformer_options", {}))
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    ).execute(x, timesteps, context, num_tokens, attention_mask, **kwargs)
    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\lumina\model.py", line 567, in _forward
    t = self.t_embedder(t * self.time_scale, dtype=x.dtype)  # (N, D)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl
    return forward_call(*args, **kwargs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 274, in checkpointing_fwd
    return torch.utils.checkpoint.checkpoint(fwd, args, kwargs, use_reentrant=False)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_compile.py", line 53, in inner
    return disable_fn(*args, **kwargs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\eval_frame.py", line 1044, in _fn
    return fn(*args, **kwargs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\utils\checkpoint.py", line 503, in checkpoint
    ret = function(*args, **kwargs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 271, in fwd
    return org_forward(*args, **kwargs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\modules\diffusionmodules\mmdit.py", line 227, in forward
    t_emb = self.mlp(t_freq)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl
    return forward_call(*args, **kwargs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\container.py", line 250, in forward
    input = module(input)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl
    return forward_call(*args, **kwargs)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 164, in forward
    return self.forward_comfy_cast_weights(*args, **kwargs)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 156, in forward_comfy_cast_weights
    weight, bias, offload_stream = cast_bias_weight(self, input, offloadable=True)
                                   ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 123, in cast_bias_weight
    weight = f(weight)

  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\weight_adapter\lora.py", line 51, in __call__
    weight = w + scale * diff.reshape(w.shape)
             ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

System Information

  • ComfyUI Version: 0.3.75
  • Arguments: ComfyUI\main.py --windows-standalone-build
  • OS: nt
  • Python Version: 3.13.9 (tags/v3.13.9:8183fa5, Oct 14 2025, 14:09:13) [MSC v.1944 64 bit (AMD64)]
  • Embedded Python: true
  • PyTorch Version: 2.9.1+cu130

Devices

  • Name: cuda:0 NVIDIA GeForce RTX 4080 : cudaMallocAsync
    • Type: cuda
    • VRAM Total: 17170956288
    • VRAM Free: 15776874496
    • Torch VRAM Total: 0
    • Torch VRAM Free: 0

Logs

2025-11-27T05:17:00.767181 - [START] Security scan2025-11-27T05:17:00.767203 - 
2025-11-27T05:17:01.493821 - [DONE] Security scan2025-11-27T05:17:01.493840 - 
2025-11-27T05:17:01.584196 - ## ComfyUI-Manager: installing dependencies done.2025-11-27T05:17:01.584304 - 
2025-11-27T05:17:01.584358 - ** ComfyUI startup time:2025-11-27T05:17:01.584434 -  2025-11-27T05:17:01.584477 - 2025-11-27 05:17:01.5842025-11-27T05:17:01.584505 - 
2025-11-27T05:17:01.584539 - ** Platform:2025-11-27T05:17:01.584565 -  2025-11-27T05:17:01.584588 - Windows2025-11-27T05:17:01.584612 - 
2025-11-27T05:17:01.584647 - ** Python version:2025-11-27T05:17:01.584677 -  2025-11-27T05:17:01.584711 - 3.13.9 (tags/v3.13.9:8183fa5, Oct 14 2025, 14:09:13) [MSC v.1944 64 bit (AMD64)]2025-11-27T05:17:01.584739 - 
2025-11-27T05:17:01.584773 - ** Python executable:2025-11-27T05:17:01.584948 -  2025-11-27T05:17:01.584992 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\python.exe2025-11-27T05:17:01.585018 - 
2025-11-27T05:17:01.585049 - ** ComfyUI Path:2025-11-27T05:17:01.585077 -  2025-11-27T05:17:01.585135 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI2025-11-27T05:17:01.585180 - 
2025-11-27T05:17:01.585209 - ** ComfyUI Base Folder Path:2025-11-27T05:17:01.585250 -  2025-11-27T05:17:01.585281 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI2025-11-27T05:17:01.585306 - 
2025-11-27T05:17:01.585375 - ** User directory:2025-11-27T05:17:01.585410 -  2025-11-27T05:17:01.585791 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\user2025-11-27T05:17:01.585835 - 
2025-11-27T05:17:01.585860 - ** ComfyUI-Manager config path:2025-11-27T05:17:01.585881 -  2025-11-27T05:17:01.585901 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\user\default\ComfyUI-Manager\config.ini2025-11-27T05:17:01.585934 - 
2025-11-27T05:17:01.585965 - ** Log path:2025-11-27T05:17:01.585986 -  2025-11-27T05:17:01.586013 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\user\comfyui.log2025-11-27T05:17:01.586035 - 
2025-11-27T05:17:02.304316 - 
Prestartup times for custom nodes:
2025-11-27T05:17:02.304486 -    0.0 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\rgthree-comfy
2025-11-27T05:17:02.304549 -    1.8 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-manager
2025-11-27T05:17:02.304591 - 
2025-11-27T05:17:02.686079 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\cuda\__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
  import pynvml  # type: ignore[import]
2025-11-27T05:17:03.294073 - Checkpoint files will always be loaded safely.
2025-11-27T05:17:03.370969 - Total VRAM 16376 MB, total RAM 130408 MB
2025-11-27T05:17:03.371120 - pytorch version: 2.9.1+cu130
2025-11-27T05:17:03.371459 - Set vram state to: NORMAL_VRAM
2025-11-27T05:17:03.371743 - Device: cuda:0 NVIDIA GeForce RTX 4080 : cudaMallocAsync
2025-11-27T05:17:03.382945 - Enabled pinned memory 58683.0
2025-11-27T05:17:03.394883 - working around nvidia conv3d memory bug.
2025-11-27T05:17:03.950123 - Using pytorch attention
2025-11-27T05:17:04.999040 - Python version: 3.13.9 (tags/v3.13.9:8183fa5, Oct 14 2025, 14:09:13) [MSC v.1944 64 bit (AMD64)]
2025-11-27T05:17:04.999157 - ComfyUI version: 0.3.75
2025-11-27T05:17:05.011368 - ComfyUI frontend version: 1.32.9
2025-11-27T05:17:05.012165 - [Prompt Server] web root: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\comfyui_frontend_package\static
2025-11-27T05:17:05.411704 - Total VRAM 16376 MB, total RAM 130408 MB
2025-11-27T05:17:05.411934 - pytorch version: 2.9.1+cu130
2025-11-27T05:17:05.412202 - Set vram state to: NORMAL_VRAM
2025-11-27T05:17:05.412469 - Device: cuda:0 NVIDIA GeForce RTX 4080 : cudaMallocAsync
2025-11-27T05:17:05.423188 - Enabled pinned memory 58683.0
2025-11-27T05:17:05.905192 - [Crystools INFO] Crystools version: 1.27.4
2025-11-27T05:17:05.922814 - [Crystools INFO] Platform release: 11
2025-11-27T05:17:05.923023 - [Crystools INFO] JETSON: Not detected.
2025-11-27T05:17:05.923620 - [Crystools INFO] CPU: Intel(R) Core(TM) Ultra 7 265K - Arch: AMD64 - OS: Windows 11
2025-11-27T05:17:05.933267 - [Crystools INFO] pynvml (NVIDIA) initialized.
2025-11-27T05:17:05.933473 - [Crystools INFO] GPU/s:
2025-11-27T05:17:05.947343 - [Crystools INFO] 0) NVIDIA GeForce RTX 4080
2025-11-27T05:17:05.947596 - [Crystools INFO] NVIDIA Driver: 581.57
2025-11-27T05:17:05.956131 - ### Loading: ComfyUI-Manager (V3.37.1)
2025-11-27T05:17:05.956531 - [ComfyUI-Manager] network_mode: public
2025-11-27T05:17:06.049575 - ### ComfyUI Version: v0.3.75-12-geaf68c9b | Released on '2025-11-26'
2025-11-27T05:17:06.079283 - [C:\Users\Mr_x_Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux] | INFO -> Using ckpts path: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux\ckpts2025-11-27T05:17:06.079555 - 
2025-11-27T05:17:06.079837 - [C:\Users\Mr_x_Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux] | INFO -> Using symlinks: False2025-11-27T05:17:06.080041 - 
2025-11-27T05:17:06.080326 - [C:\Users\Mr_x_Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux] | INFO -> Using ort providers: ['CUDAExecutionProvider', 'DirectMLExecutionProvider', 'OpenVINOExecutionProvider', 'ROCMExecutionProvider', 'CPUExecutionProvider', 'CoreMLExecutionProvider']2025-11-27T05:17:06.080520 - 
2025-11-27T05:17:06.131033 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
2025-11-27T05:17:06.137373 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
2025-11-27T05:17:06.193005 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json
2025-11-27T05:17:06.239167 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
2025-11-27T05:17:06.271391 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
2025-11-27T05:17:07.356246 - Using pytorch attention
2025-11-27T05:17:07.366191 - (RES4LYF) Init2025-11-27T05:17:07.366272 - 
2025-11-27T05:17:07.366471 - (RES4LYF) Importing beta samplers.2025-11-27T05:17:07.366673 - 
2025-11-27T05:17:07.378854 - (RES4LYF) Importing legacy samplers.2025-11-27T05:17:07.379020 - 
2025-11-27T05:17:07.395034 - 
2025-11-27T05:17:07.395376 - [rgthree-comfy] Loaded 48 magnificent nodes. 🎉2025-11-27T05:17:07.395618 - 
2025-11-27T05:17:07.395782 - 
2025-11-27T05:17:07.397250 - 
Import times for custom nodes:
2025-11-27T05:17:07.397509 -    0.0 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\websocket_image_save.py
2025-11-27T05:17:07.397683 -    0.0 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_ultimatesdupscale
2025-11-27T05:17:07.397930 -    0.0 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\rgthree-comfy
2025-11-27T05:17:07.398071 -    0.1 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-manager
2025-11-27T05:17:07.398257 -    0.2 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\RES4LYF
2025-11-27T05:17:07.398297 -    0.2 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Crystools
2025-11-27T05:17:07.398510 -    0.5 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux
2025-11-27T05:17:07.398661 -    0.5 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_layerstyle
2025-11-27T05:17:07.398697 - 
2025-11-27T05:17:07.576407 - Context impl SQLiteImpl.
2025-11-27T05:17:07.576634 - Will assume non-transactional DDL.
2025-11-27T05:17:07.577697 - No target revision found.
2025-11-27T05:17:07.601632 - Starting server

2025-11-27T05:17:07.602063 - To see the GUI go to: http://127.0.0.1:8188
2025-11-27T05:17:09.476972 - FETCH ComfyRegistry Data: 5/1082025-11-27T05:17:09.477058 - 
2025-11-27T05:17:10.988273 - got prompt
2025-11-27T05:17:11.305057 - CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
2025-11-27T05:17:12.793037 - Using pytorch attention in VAE
2025-11-27T05:17:12.793813 - Using pytorch attention in VAE
2025-11-27T05:17:12.886524 - VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
2025-11-27T05:17:12.944865 - model weight dtype torch.bfloat16, manual cast: None
2025-11-27T05:17:12.945472 - model_type FLOW
2025-11-27T05:17:13.391264 - FETCH ComfyRegistry Data: 10/1082025-11-27T05:17:13.395859 - 
2025-11-27T05:17:14.039123 - unet missing: ['norm_final.weight']
2025-11-27T05:17:15.988492 - Encoding 24 images with VAE...
2025-11-27T05:17:15.988889 - Requested to load AutoencodingEngine
2025-11-27T05:17:16.052426 - loaded completely; 13462.50 MB usable, 159.87 MB loaded, full load: True
2025-11-27T05:17:17.222043 - Encoding 24 texts with CLIP...
2025-11-27T05:17:17.222646 - Requested to load ZImageTEModel_
2025-11-27T05:17:18.685628 - loaded completely; 13310.93 MB usable, 7672.25 MB loaded, full load: True
2025-11-27T05:17:19.078820 - FETCH ComfyRegistry Data: 15/1082025-11-27T05:17:19.079075 - 
2025-11-27T05:17:20.895576 - Created dataset with 24 latents and 24 conditioning.
2025-11-27T05:17:20.896523 - Saving 24 samples to 1 shards in C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\output\z-skill...
2025-11-27T05:17:20.905072 - Saved shard 1/1: shard_0000.pkl (24 samples)
2025-11-27T05:17:20.905561 - Successfully saved 24 samples to C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\output\z-skill.
2025-11-27T05:17:20.908861 - Latent shapes: {torch.Size([1, 16, 64, 64])}
2025-11-27T05:17:20.909927 - Total Images: 24, Total Captions: 24
2025-11-27T05:17:21.082961 - Requested to load Lumina2
2025-11-27T05:17:22.867382 - 0 models unloaded.
2025-11-27T05:17:23.312797 - FETCH ComfyRegistry Data: 20/1082025-11-27T05:17:23.312894 - 
2025-11-27T05:17:26.277620 - loaded completely; 95367431640625005117571072.00 MB usable, 11783.35 MB loaded, full load: True
2025-11-27T05:17:26.323633 - 0 models unloaded.
2025-11-27T05:17:26.716811 - FETCH ComfyRegistry Data: 25/1082025-11-27T05:17:26.717013 - 
2025-11-27T05:17:26.793425 - loaded partially: 10279.21 MB loaded, lowvram patches: 0
2025-11-27T05:17:26.846380 - 
Training LoRA:   0%|                                                                           | 0/100 [00:00<?, ?it/s]2025-11-27T05:17:26.846537 - 
2025-11-27T05:17:26.875166 - !!! Exception during processing !!! Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu!
2025-11-27T05:17:26.880591 - Traceback (most recent call last):
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 510, in execute
    output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs)
                                                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 324, in get_output_data
    return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 292, in _async_map_node_over_list
    await process_inputs(input_data_all, 0, input_is_list=input_is_list)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 286, in process_inputs
    result = f(**inputs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_api\internal\__init__.py", line 149, in wrapped_func
    return method(locked_class, **inputs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_api\latest\_io.py", line 1275, in EXECUTE_NORMALIZED
    to_return = cls.execute(*args, **kwargs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 627, in execute
    guider.sample(
    ~~~~~~~~~~~~~^
        noise.generate_noise({"samples": latents}),
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ...<3 lines>...
        seed=noise.seed,
        ^^^^^^^^^^^^^^^^
    )
    ^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 1035, in sample
    output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 997, in outer_sample
    output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 980, in inner_sample
    samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 160, in sample
    loss = self.fwd_bwd(
        model_wrap,
    ...<7 lines>...
        bwd=True,
    )
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 107, in fwd_bwd
    x0_pred = model_wrap(
        xt.requires_grad_(True),
        batch_sigmas.requires_grad_(True),
        **batch_extra_args,
    )
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 953, in __call__
    return self.outer_predict_noise(*args, **kwargs)
           ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 960, in outer_predict_noise
    ).execute(x, timestep, model_options, seed)
      ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 963, in predict_noise
    return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 381, in sampling_function
    out = calc_cond_batch(model, conds, x, timestep, model_options)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 206, in calc_cond_batch
    return _calc_cond_batch_outer(model, conds, x_in, timestep, model_options)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 214, in _calc_cond_batch_outer
    return executor.execute(model, conds, x_in, timestep, model_options)
           ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 326, in _calc_cond_batch
    output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks)
             ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 161, in apply_model
    return comfy.patcher_extension.WrapperExecutor.new_class_executor(
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    ...<2 lines>...
        comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.APPLY_MODEL, transformer_options)
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    ).execute(x, t, c_concat, c_crossattn, control, transformer_options, **kwargs)
    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 203, in _apply_model
    model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\lumina\model.py", line 548, in forward
    return comfy.patcher_extension.WrapperExecutor.new_class_executor(
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    ...<2 lines>...
        comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.DIFFUSION_MODEL, kwargs.get("transformer_options", {}))
        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    ).execute(x, timesteps, context, num_tokens, attention_mask, **kwargs)
    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute
    return self.original(*args, **kwargs)
           ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\lumina\model.py", line 567, in _forward
    t = self.t_embedder(t * self.time_scale, dtype=x.dtype)  # (N, D)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 274, in checkpointing_fwd
    return torch.utils.checkpoint.checkpoint(fwd, args, kwargs, use_reentrant=False)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_compile.py", line 53, in inner
    return disable_fn(*args, **kwargs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\eval_frame.py", line 1044, in _fn
    return fn(*args, **kwargs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\utils\checkpoint.py", line 503, in checkpoint
    ret = function(*args, **kwargs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 271, in fwd
    return org_forward(*args, **kwargs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\modules\diffusionmodules\mmdit.py", line 227, in forward
    t_emb = self.mlp(t_freq)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\container.py", line 250, in forward
    input = module(input)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl
    return forward_call(*args, **kwargs)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 164, in forward
    return self.forward_comfy_cast_weights(*args, **kwargs)
           ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 156, in forward_comfy_cast_weights
    weight, bias, offload_stream = cast_bias_weight(self, input, offloadable=True)
                                   ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 123, in cast_bias_weight
    weight = f(weight)
  File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\weight_adapter\lora.py", line 51, in __call__
    weight = w + scale * diff.reshape(w.shape)
             ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu!

2025-11-27T05:17:26.885194 - Prompt executed in 15.89 seconds

Attached Workflow

Please make sure that workflow does not contain any sensitive information such as API keys or passwords.

{"id":"9ab275bd-5353-4184-a58b-17b899810b86","revision":0,"last_node_id":16,"last_link_id":17,"nodes":[{"id":2,"type":"MakeTrainingDataset","pos":[281.06026385707173,217.11701794489449],"size":[270,98],"flags":{},"order":5,"mode":0,"inputs":[{"localized_name":"images","name":"images","type":"IMAGE","link":12},{"localized_name":"vae","name":"vae","type":"VAE","link":6},{"localized_name":"clip","name":"clip","type":"CLIP","link":17},{"localized_name":"texts","name":"texts","shape":7,"type":"STRING","widget":{"name":"texts"},"link":null}],"outputs":[{"localized_name":"latents","name":"latents","shape":6,"type":"LATENT","links":[1,3]},{"localized_name":"conditioning","name":"conditioning","shape":6,"type":"CONDITIONING","links":[2,4]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"MakeTrainingDataset"},"widgets_values":[""]},{"id":12,"type":"UNETLoader","pos":[351.9783391228834,-6.471913795928025],"size":[270,82],"flags":{},"order":0,"mode":0,"inputs":[{"localized_name":"unet_name","name":"unet_name","type":"COMBO","widget":{"name":"unet_name"},"link":null},{"localized_name":"weight_dtype","name":"weight_dtype","type":"COMBO","widget":{"name":"weight_dtype"},"link":null}],"outputs":[{"localized_name":"MODEL","name":"MODEL","type":"MODEL","links":[13]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"UNETLoader"},"widgets_values":["z_image_turbo_bf16.safetensors","default"]},{"id":11,"type":"ImageScale","pos":[-76.48503227472786,93.99535949730489],"size":[270,130],"flags":{},"order":4,"mode":0,"inputs":[{"localized_name":"image","name":"image","type":"IMAGE","link":11},{"localized_name":"upscale_method","name":"upscale_method","type":"COMBO","widget":{"name":"upscale_method"},"link":null},{"localized_name":"width","name":"width","type":"INT","widget":{"name":"width"},"link":null},{"localized_name":"height","name":"height","type":"INT","widget":{"name":"height"},"link":null},{"localized_name":"crop","name":"crop","type":"COMBO","widget":{"name":"crop"},"link":null}],"outputs":[{"localized_name":"IMAGE","name":"IMAGE","type":"IMAGE","links":[12]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"ImageScale"},"widgets_values":["nearest-exact",512,512,"disabled"]},{"id":5,"type":"VAELoader","pos":[-365.35082874885404,291.70635720805205],"size":[270,58],"flags":{},"order":1,"mode":0,"inputs":[{"localized_name":"vae_name","name":"vae_name","type":"COMBO","widget":{"name":"vae_name"},"link":null}],"outputs":[{"localized_name":"VAE","name":"VAE","type":"VAE","links":[6]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"VAELoader"},"widgets_values":["z-image_vae.safetensors"]},{"id":16,"type":"CLIPLoader","pos":[-358.4690403156899,390.8060643115864],"size":[270,106],"flags":{},"order":2,"mode":0,"inputs":[{"localized_name":"clip_name","name":"clip_name","type":"COMBO","widget":{"name":"clip_name"},"link":null},{"localized_name":"type","name":"type","type":"COMBO","widget":{"name":"type"},"link":null},{"localized_name":"device","name":"device","shape":7,"type":"COMBO","widget":{"name":"device"},"link":null}],"outputs":[{"localized_name":"CLIP","name":"CLIP","type":"CLIP","links":[17]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"CLIPLoader"},"widgets_values":["qwen_3_4b.safetensors","lumina2","default"]},{"id":1,"type":"TrainLoraNode","pos":[1117.7665637046055,228.49712230917353],"size":[300.751953125,430],"flags":{},"order":7,"mode":0,"inputs":[{"localized_name":"model","name":"model","type":"MODEL","link":13},{"localized_name":"latents","name":"latents","type":"LATENT","link":3},{"localized_name":"positive","name":"positive","type":"CONDITIONING","link":4},{"localized_name":"batch_size","name":"batch_size","type":"INT","widget":{"name":"batch_size"},"link":null},{"localized_name":"grad_accumulation_steps","name":"grad_accumulation_steps","type":"INT","widget":{"name":"grad_accumulation_steps"},"link":null},{"localized_name":"steps","name":"steps","type":"INT","widget":{"name":"steps"},"link":null},{"localized_name":"learning_rate","name":"learning_rate","type":"FLOAT","widget":{"name":"learning_rate"},"link":null},{"localized_name":"rank","name":"rank","type":"INT","widget":{"name":"rank"},"link":null},{"localized_name":"optimizer","name":"optimizer","type":"COMBO","widget":{"name":"optimizer"},"link":null},{"localized_name":"loss_function","name":"loss_function","type":"COMBO","widget":{"name":"loss_function"},"link":null},{"localized_name":"seed","name":"seed","type":"INT","widget":{"name":"seed"},"link":null},{"localized_name":"training_dtype","name":"training_dtype","type":"COMBO","widget":{"name":"training_dtype"},"link":null},{"localized_name":"lora_dtype","name":"lora_dtype","type":"COMBO","widget":{"name":"lora_dtype"},"link":null},{"localized_name":"algorithm","name":"algorithm","type":"COMBO","widget":{"name":"algorithm"},"link":null},{"localized_name":"gradient_checkpointing","name":"gradient_checkpointing","type":"BOOLEAN","widget":{"name":"gradient_checkpointing"},"link":null},{"localized_name":"existing_lora","name":"existing_lora","type":"COMBO","widget":{"name":"existing_lora"},"link":null}],"outputs":[{"localized_name":"model_with_lora","name":"model","type":"MODEL","links":[16]},{"localized_name":"lora","name":"lora","type":"LORA_MODEL","links":[15]},{"localized_name":"loss","name":"loss_map","type":"LOSS_MAP","links":null},{"localized_name":"steps","name":"steps","type":"INT","links":null}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"TrainLoraNode"},"widgets_values":[1,1,100,0.0005,8,"AdamW","MSE",111975901213814,"randomize","bf16","bf16","LoRA",true,"[None]"]},{"id":3,"type":"SaveTrainingDataset","pos":[691.9911110917468,567.2750145698383],"size":[270,102],"flags":{},"order":6,"mode":0,"inputs":[{"localized_name":"latents","name":"latents","type":"LATENT","link":1},{"localized_name":"conditioning","name":"conditioning","type":"CONDITIONING","link":2},{"localized_name":"folder_name","name":"folder_name","type":"STRING","widget":{"name":"folder_name"},"link":null},{"localized_name":"shard_size","name":"shard_size","type":"INT","widget":{"name":"shard_size"},"link":null}],"outputs":[],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"SaveTrainingDataset"},"widgets_values":["z-skill",10000]},{"id":9,"type":"LoadImageDataSetFromFolder","pos":[-437.97022147685044,32.927016907300526],"size":[301.4439453125,58],"flags":{},"order":3,"mode":0,"inputs":[{"localized_name":"folder","name":"folder","type":"COMBO","widget":{"name":"folder"},"link":null}],"outputs":[{"localized_name":"images","name":"images","shape":6,"type":"IMAGE","links":[11]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"LoadImageDataSetFromFolder"},"widgets_values":["z-image-dataset"]},{"id":14,"type":"SaveLoRA","pos":[1780.2717938918026,383.35445663271577],"size":[270,82],"flags":{},"order":9,"mode":0,"inputs":[{"localized_name":"lora","name":"lora","type":"LORA_MODEL","link":15},{"localized_name":"prefix","name":"prefix","type":"STRING","widget":{"name":"prefix"},"link":null},{"localized_name":"steps","name":"steps","shape":7,"type":"INT","widget":{"name":"steps"},"link":null}],"outputs":[],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"SaveLoRA"},"widgets_values":["loras/z-skill",100]},{"id":15,"type":"UNetSave","pos":[1739.667288470156,186.62354802458594],"size":[270,58],"flags":{},"order":8,"mode":0,"inputs":[{"localized_name":"model","name":"model","type":"MODEL","link":16},{"localized_name":"filename_prefix","name":"filename_prefix","type":"STRING","widget":{"name":"filename_prefix"},"link":null}],"outputs":[],"properties":{"cnr_id":"RES4LYF","ver":"46de917234f9fef3f2ab411c41e07aa3c633f4f7","Node name for S&R":"UNetSave"},"widgets_values":["models/z-skill"]}],"links":[[1,2,0,3,0,"LATENT"],[2,2,1,3,1,"CONDITIONING"],[3,2,0,1,1,"LATENT"],[4,2,1,1,2,"CONDITIONING"],[6,5,0,2,1,"VAE"],[11,9,0,11,0,"IMAGE"],[12,11,0,2,0,"IMAGE"],[13,12,0,1,0,"MODEL"],[15,1,1,14,0,"LORA_MODEL"],[16,1,0,15,0,"MODEL"],[17,16,0,2,2,"CLIP"]],"groups":[],"config":{},"extra":{"workflowRendererVersion":"LG","ds":{"scale":0.6934334949441672,"offset":[542.8371659626396,565.2992128502808]}},"version":0.4}

Additional Context

(Please add any additional context or steps to reproduce the error here)

Originally created by @mrfrosty009 on GitHub (Nov 27, 2025). Original GitHub issue: https://github.com/Comfy-Org/embedded-docs/issues/65 # ComfyUI Error Report ## Error Details - **Node ID:** 1 - **Node Type:** TrainLoraNode - **Exception Type:** RuntimeError - **Exception Message:** Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! ## Stack Trace ``` File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 510, in execute output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 324, in get_output_data return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 292, in _async_map_node_over_list await process_inputs(input_data_all, 0, input_is_list=input_is_list) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 286, in process_inputs result = f(**inputs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_api\internal\__init__.py", line 149, in wrapped_func return method(locked_class, **inputs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_api\latest\_io.py", line 1275, in EXECUTE_NORMALIZED to_return = cls.execute(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 627, in execute guider.sample( ~~~~~~~~~~~~~^ noise.generate_noise({"samples": latents}), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... seed=noise.seed, ^^^^^^^^^^^^^^^^ ) ^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 1035, in sample output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 997, in outer_sample output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 980, in inner_sample samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 160, in sample loss = self.fwd_bwd( model_wrap, ...<7 lines>... bwd=True, ) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 107, in fwd_bwd x0_pred = model_wrap( xt.requires_grad_(True), batch_sigmas.requires_grad_(True), **batch_extra_args, ) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 953, in __call__ return self.outer_predict_noise(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 960, in outer_predict_noise ).execute(x, timestep, model_options, seed) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 963, in predict_noise return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 381, in sampling_function out = calc_cond_batch(model, conds, x, timestep, model_options) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 206, in calc_cond_batch return _calc_cond_batch_outer(model, conds, x_in, timestep, model_options) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 214, in _calc_cond_batch_outer return executor.execute(model, conds, x_in, timestep, model_options) ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 326, in _calc_cond_batch output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 161, in apply_model return comfy.patcher_extension.WrapperExecutor.new_class_executor( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ...<2 lines>... comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.APPLY_MODEL, transformer_options) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ).execute(x, t, c_concat, c_crossattn, control, transformer_options, **kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 203, in _apply_model model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl return forward_call(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\lumina\model.py", line 548, in forward return comfy.patcher_extension.WrapperExecutor.new_class_executor( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ...<2 lines>... comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.DIFFUSION_MODEL, kwargs.get("transformer_options", {})) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ).execute(x, timesteps, context, num_tokens, attention_mask, **kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\lumina\model.py", line 567, in _forward t = self.t_embedder(t * self.time_scale, dtype=x.dtype) # (N, D) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl return forward_call(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 274, in checkpointing_fwd return torch.utils.checkpoint.checkpoint(fwd, args, kwargs, use_reentrant=False) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_compile.py", line 53, in inner return disable_fn(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\eval_frame.py", line 1044, in _fn return fn(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\utils\checkpoint.py", line 503, in checkpoint ret = function(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 271, in fwd return org_forward(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\modules\diffusionmodules\mmdit.py", line 227, in forward t_emb = self.mlp(t_freq) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl return forward_call(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\container.py", line 250, in forward input = module(input) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl return forward_call(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 164, in forward return self.forward_comfy_cast_weights(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 156, in forward_comfy_cast_weights weight, bias, offload_stream = cast_bias_weight(self, input, offloadable=True) ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 123, in cast_bias_weight weight = f(weight) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\weight_adapter\lora.py", line 51, in __call__ weight = w + scale * diff.reshape(w.shape) ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ``` ## System Information - **ComfyUI Version:** 0.3.75 - **Arguments:** ComfyUI\main.py --windows-standalone-build - **OS:** nt - **Python Version:** 3.13.9 (tags/v3.13.9:8183fa5, Oct 14 2025, 14:09:13) [MSC v.1944 64 bit (AMD64)] - **Embedded Python:** true - **PyTorch Version:** 2.9.1+cu130 ## Devices - **Name:** cuda:0 NVIDIA GeForce RTX 4080 : cudaMallocAsync - **Type:** cuda - **VRAM Total:** 17170956288 - **VRAM Free:** 15776874496 - **Torch VRAM Total:** 0 - **Torch VRAM Free:** 0 ## Logs ``` 2025-11-27T05:17:00.767181 - [START] Security scan2025-11-27T05:17:00.767203 - 2025-11-27T05:17:01.493821 - [DONE] Security scan2025-11-27T05:17:01.493840 - 2025-11-27T05:17:01.584196 - ## ComfyUI-Manager: installing dependencies done.2025-11-27T05:17:01.584304 - 2025-11-27T05:17:01.584358 - ** ComfyUI startup time:2025-11-27T05:17:01.584434 - 2025-11-27T05:17:01.584477 - 2025-11-27 05:17:01.5842025-11-27T05:17:01.584505 - 2025-11-27T05:17:01.584539 - ** Platform:2025-11-27T05:17:01.584565 - 2025-11-27T05:17:01.584588 - Windows2025-11-27T05:17:01.584612 - 2025-11-27T05:17:01.584647 - ** Python version:2025-11-27T05:17:01.584677 - 2025-11-27T05:17:01.584711 - 3.13.9 (tags/v3.13.9:8183fa5, Oct 14 2025, 14:09:13) [MSC v.1944 64 bit (AMD64)]2025-11-27T05:17:01.584739 - 2025-11-27T05:17:01.584773 - ** Python executable:2025-11-27T05:17:01.584948 - 2025-11-27T05:17:01.584992 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\python.exe2025-11-27T05:17:01.585018 - 2025-11-27T05:17:01.585049 - ** ComfyUI Path:2025-11-27T05:17:01.585077 - 2025-11-27T05:17:01.585135 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI2025-11-27T05:17:01.585180 - 2025-11-27T05:17:01.585209 - ** ComfyUI Base Folder Path:2025-11-27T05:17:01.585250 - 2025-11-27T05:17:01.585281 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI2025-11-27T05:17:01.585306 - 2025-11-27T05:17:01.585375 - ** User directory:2025-11-27T05:17:01.585410 - 2025-11-27T05:17:01.585791 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\user2025-11-27T05:17:01.585835 - 2025-11-27T05:17:01.585860 - ** ComfyUI-Manager config path:2025-11-27T05:17:01.585881 - 2025-11-27T05:17:01.585901 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\user\default\ComfyUI-Manager\config.ini2025-11-27T05:17:01.585934 - 2025-11-27T05:17:01.585965 - ** Log path:2025-11-27T05:17:01.585986 - 2025-11-27T05:17:01.586013 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\user\comfyui.log2025-11-27T05:17:01.586035 - 2025-11-27T05:17:02.304316 - Prestartup times for custom nodes: 2025-11-27T05:17:02.304486 - 0.0 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\rgthree-comfy 2025-11-27T05:17:02.304549 - 1.8 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-manager 2025-11-27T05:17:02.304591 - 2025-11-27T05:17:02.686079 - C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\cuda\__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you. import pynvml # type: ignore[import] 2025-11-27T05:17:03.294073 - Checkpoint files will always be loaded safely. 2025-11-27T05:17:03.370969 - Total VRAM 16376 MB, total RAM 130408 MB 2025-11-27T05:17:03.371120 - pytorch version: 2.9.1+cu130 2025-11-27T05:17:03.371459 - Set vram state to: NORMAL_VRAM 2025-11-27T05:17:03.371743 - Device: cuda:0 NVIDIA GeForce RTX 4080 : cudaMallocAsync 2025-11-27T05:17:03.382945 - Enabled pinned memory 58683.0 2025-11-27T05:17:03.394883 - working around nvidia conv3d memory bug. 2025-11-27T05:17:03.950123 - Using pytorch attention 2025-11-27T05:17:04.999040 - Python version: 3.13.9 (tags/v3.13.9:8183fa5, Oct 14 2025, 14:09:13) [MSC v.1944 64 bit (AMD64)] 2025-11-27T05:17:04.999157 - ComfyUI version: 0.3.75 2025-11-27T05:17:05.011368 - ComfyUI frontend version: 1.32.9 2025-11-27T05:17:05.012165 - [Prompt Server] web root: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\comfyui_frontend_package\static 2025-11-27T05:17:05.411704 - Total VRAM 16376 MB, total RAM 130408 MB 2025-11-27T05:17:05.411934 - pytorch version: 2.9.1+cu130 2025-11-27T05:17:05.412202 - Set vram state to: NORMAL_VRAM 2025-11-27T05:17:05.412469 - Device: cuda:0 NVIDIA GeForce RTX 4080 : cudaMallocAsync 2025-11-27T05:17:05.423188 - Enabled pinned memory 58683.0 2025-11-27T05:17:05.905192 - [Crystools INFO] Crystools version: 1.27.4 2025-11-27T05:17:05.922814 - [Crystools INFO] Platform release: 11 2025-11-27T05:17:05.923023 - [Crystools INFO] JETSON: Not detected. 2025-11-27T05:17:05.923620 - [Crystools INFO] CPU: Intel(R) Core(TM) Ultra 7 265K - Arch: AMD64 - OS: Windows 11 2025-11-27T05:17:05.933267 - [Crystools INFO] pynvml (NVIDIA) initialized. 2025-11-27T05:17:05.933473 - [Crystools INFO] GPU/s: 2025-11-27T05:17:05.947343 - [Crystools INFO] 0) NVIDIA GeForce RTX 4080 2025-11-27T05:17:05.947596 - [Crystools INFO] NVIDIA Driver: 581.57 2025-11-27T05:17:05.956131 - ### Loading: ComfyUI-Manager (V3.37.1) 2025-11-27T05:17:05.956531 - [ComfyUI-Manager] network_mode: public 2025-11-27T05:17:06.049575 - ### ComfyUI Version: v0.3.75-12-geaf68c9b | Released on '2025-11-26' 2025-11-27T05:17:06.079283 - [C:\Users\Mr_x_Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux] | INFO -> Using ckpts path: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux\ckpts2025-11-27T05:17:06.079555 - 2025-11-27T05:17:06.079837 - [C:\Users\Mr_x_Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux] | INFO -> Using symlinks: False2025-11-27T05:17:06.080041 - 2025-11-27T05:17:06.080326 - [C:\Users\Mr_x_Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux] | INFO -> Using ort providers: ['CUDAExecutionProvider', 'DirectMLExecutionProvider', 'OpenVINOExecutionProvider', 'ROCMExecutionProvider', 'CPUExecutionProvider', 'CoreMLExecutionProvider']2025-11-27T05:17:06.080520 - 2025-11-27T05:17:06.131033 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json 2025-11-27T05:17:06.137373 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json 2025-11-27T05:17:06.193005 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json 2025-11-27T05:17:06.239167 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json 2025-11-27T05:17:06.271391 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json 2025-11-27T05:17:07.356246 - Using pytorch attention 2025-11-27T05:17:07.366191 - (RES4LYF) Init2025-11-27T05:17:07.366272 - 2025-11-27T05:17:07.366471 - (RES4LYF) Importing beta samplers.2025-11-27T05:17:07.366673 - 2025-11-27T05:17:07.378854 - (RES4LYF) Importing legacy samplers.2025-11-27T05:17:07.379020 - 2025-11-27T05:17:07.395034 - 2025-11-27T05:17:07.395376 - [rgthree-comfy] Loaded 48 magnificent nodes. 🎉2025-11-27T05:17:07.395618 - 2025-11-27T05:17:07.395782 - 2025-11-27T05:17:07.397250 - Import times for custom nodes: 2025-11-27T05:17:07.397509 - 0.0 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\websocket_image_save.py 2025-11-27T05:17:07.397683 - 0.0 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_ultimatesdupscale 2025-11-27T05:17:07.397930 - 0.0 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\rgthree-comfy 2025-11-27T05:17:07.398071 - 0.1 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-manager 2025-11-27T05:17:07.398257 - 0.2 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\RES4LYF 2025-11-27T05:17:07.398297 - 0.2 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Crystools 2025-11-27T05:17:07.398510 - 0.5 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux 2025-11-27T05:17:07.398661 - 0.5 seconds: C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_layerstyle 2025-11-27T05:17:07.398697 - 2025-11-27T05:17:07.576407 - Context impl SQLiteImpl. 2025-11-27T05:17:07.576634 - Will assume non-transactional DDL. 2025-11-27T05:17:07.577697 - No target revision found. 2025-11-27T05:17:07.601632 - Starting server 2025-11-27T05:17:07.602063 - To see the GUI go to: http://127.0.0.1:8188 2025-11-27T05:17:09.476972 - FETCH ComfyRegistry Data: 5/1082025-11-27T05:17:09.477058 - 2025-11-27T05:17:10.988273 - got prompt 2025-11-27T05:17:11.305057 - CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16 2025-11-27T05:17:12.793037 - Using pytorch attention in VAE 2025-11-27T05:17:12.793813 - Using pytorch attention in VAE 2025-11-27T05:17:12.886524 - VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16 2025-11-27T05:17:12.944865 - model weight dtype torch.bfloat16, manual cast: None 2025-11-27T05:17:12.945472 - model_type FLOW 2025-11-27T05:17:13.391264 - FETCH ComfyRegistry Data: 10/1082025-11-27T05:17:13.395859 - 2025-11-27T05:17:14.039123 - unet missing: ['norm_final.weight'] 2025-11-27T05:17:15.988492 - Encoding 24 images with VAE... 2025-11-27T05:17:15.988889 - Requested to load AutoencodingEngine 2025-11-27T05:17:16.052426 - loaded completely; 13462.50 MB usable, 159.87 MB loaded, full load: True 2025-11-27T05:17:17.222043 - Encoding 24 texts with CLIP... 2025-11-27T05:17:17.222646 - Requested to load ZImageTEModel_ 2025-11-27T05:17:18.685628 - loaded completely; 13310.93 MB usable, 7672.25 MB loaded, full load: True 2025-11-27T05:17:19.078820 - FETCH ComfyRegistry Data: 15/1082025-11-27T05:17:19.079075 - 2025-11-27T05:17:20.895576 - Created dataset with 24 latents and 24 conditioning. 2025-11-27T05:17:20.896523 - Saving 24 samples to 1 shards in C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\output\z-skill... 2025-11-27T05:17:20.905072 - Saved shard 1/1: shard_0000.pkl (24 samples) 2025-11-27T05:17:20.905561 - Successfully saved 24 samples to C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\output\z-skill. 2025-11-27T05:17:20.908861 - Latent shapes: {torch.Size([1, 16, 64, 64])} 2025-11-27T05:17:20.909927 - Total Images: 24, Total Captions: 24 2025-11-27T05:17:21.082961 - Requested to load Lumina2 2025-11-27T05:17:22.867382 - 0 models unloaded. 2025-11-27T05:17:23.312797 - FETCH ComfyRegistry Data: 20/1082025-11-27T05:17:23.312894 - 2025-11-27T05:17:26.277620 - loaded completely; 95367431640625005117571072.00 MB usable, 11783.35 MB loaded, full load: True 2025-11-27T05:17:26.323633 - 0 models unloaded. 2025-11-27T05:17:26.716811 - FETCH ComfyRegistry Data: 25/1082025-11-27T05:17:26.717013 - 2025-11-27T05:17:26.793425 - loaded partially: 10279.21 MB loaded, lowvram patches: 0 2025-11-27T05:17:26.846380 - Training LoRA: 0%| | 0/100 [00:00<?, ?it/s]2025-11-27T05:17:26.846537 - 2025-11-27T05:17:26.875166 - !!! Exception during processing !!! Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! 2025-11-27T05:17:26.880591 - Traceback (most recent call last): File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 510, in execute output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 324, in get_output_data return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 292, in _async_map_node_over_list await process_inputs(input_data_all, 0, input_is_list=input_is_list) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\execution.py", line 286, in process_inputs result = f(**inputs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_api\internal\__init__.py", line 149, in wrapped_func return method(locked_class, **inputs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_api\latest\_io.py", line 1275, in EXECUTE_NORMALIZED to_return = cls.execute(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 627, in execute guider.sample( ~~~~~~~~~~~~~^ noise.generate_noise({"samples": latents}), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<3 lines>... seed=noise.seed, ^^^^^^^^^^^^^^^^ ) ^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 1035, in sample output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 997, in outer_sample output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed, latent_shapes=latent_shapes) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 980, in inner_sample samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 160, in sample loss = self.fwd_bwd( model_wrap, ...<7 lines>... bwd=True, ) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 107, in fwd_bwd x0_pred = model_wrap( xt.requires_grad_(True), batch_sigmas.requires_grad_(True), **batch_extra_args, ) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 953, in __call__ return self.outer_predict_noise(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 960, in outer_predict_noise ).execute(x, timestep, model_options, seed) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 963, in predict_noise return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 381, in sampling_function out = calc_cond_batch(model, conds, x, timestep, model_options) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 206, in calc_cond_batch return _calc_cond_batch_outer(model, conds, x_in, timestep, model_options) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 214, in _calc_cond_batch_outer return executor.execute(model, conds, x_in, timestep, model_options) ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\samplers.py", line 326, in _calc_cond_batch output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks) ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 161, in apply_model return comfy.patcher_extension.WrapperExecutor.new_class_executor( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ...<2 lines>... comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.APPLY_MODEL, transformer_options) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ).execute(x, t, c_concat, c_crossattn, control, transformer_options, **kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\model_base.py", line 203, in _apply_model model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl return forward_call(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\lumina\model.py", line 548, in forward return comfy.patcher_extension.WrapperExecutor.new_class_executor( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ...<2 lines>... comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.DIFFUSION_MODEL, kwargs.get("transformer_options", {})) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ).execute(x, timesteps, context, num_tokens, attention_mask, **kwargs) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\patcher_extension.py", line 112, in execute return self.original(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\lumina\model.py", line 567, in _forward t = self.t_embedder(t * self.time_scale, dtype=x.dtype) # (N, D) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl return forward_call(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 274, in checkpointing_fwd return torch.utils.checkpoint.checkpoint(fwd, args, kwargs, use_reentrant=False) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_compile.py", line 53, in inner return disable_fn(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\_dynamo\eval_frame.py", line 1044, in _fn return fn(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\utils\checkpoint.py", line 503, in checkpoint ret = function(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy_extras\nodes_train.py", line 271, in fwd return org_forward(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ldm\modules\diffusionmodules\mmdit.py", line 227, in forward t_emb = self.mlp(t_freq) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl return forward_call(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\container.py", line 250, in forward input = module(input) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1775, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1786, in _call_impl return forward_call(*args, **kwargs) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 164, in forward return self.forward_comfy_cast_weights(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 156, in forward_comfy_cast_weights weight, bias, offload_stream = cast_bias_weight(self, input, offloadable=True) ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 123, in cast_bias_weight weight = f(weight) File "C:\Users\Mr.Frosty\Documents\ComfyUI_windows_portable\ComfyUI\comfy\weight_adapter\lora.py", line 51, in __call__ weight = w + scale * diff.reshape(w.shape) ~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! 2025-11-27T05:17:26.885194 - Prompt executed in 15.89 seconds ``` ## Attached Workflow Please make sure that workflow does not contain any sensitive information such as API keys or passwords. ``` {"id":"9ab275bd-5353-4184-a58b-17b899810b86","revision":0,"last_node_id":16,"last_link_id":17,"nodes":[{"id":2,"type":"MakeTrainingDataset","pos":[281.06026385707173,217.11701794489449],"size":[270,98],"flags":{},"order":5,"mode":0,"inputs":[{"localized_name":"images","name":"images","type":"IMAGE","link":12},{"localized_name":"vae","name":"vae","type":"VAE","link":6},{"localized_name":"clip","name":"clip","type":"CLIP","link":17},{"localized_name":"texts","name":"texts","shape":7,"type":"STRING","widget":{"name":"texts"},"link":null}],"outputs":[{"localized_name":"latents","name":"latents","shape":6,"type":"LATENT","links":[1,3]},{"localized_name":"conditioning","name":"conditioning","shape":6,"type":"CONDITIONING","links":[2,4]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"MakeTrainingDataset"},"widgets_values":[""]},{"id":12,"type":"UNETLoader","pos":[351.9783391228834,-6.471913795928025],"size":[270,82],"flags":{},"order":0,"mode":0,"inputs":[{"localized_name":"unet_name","name":"unet_name","type":"COMBO","widget":{"name":"unet_name"},"link":null},{"localized_name":"weight_dtype","name":"weight_dtype","type":"COMBO","widget":{"name":"weight_dtype"},"link":null}],"outputs":[{"localized_name":"MODEL","name":"MODEL","type":"MODEL","links":[13]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"UNETLoader"},"widgets_values":["z_image_turbo_bf16.safetensors","default"]},{"id":11,"type":"ImageScale","pos":[-76.48503227472786,93.99535949730489],"size":[270,130],"flags":{},"order":4,"mode":0,"inputs":[{"localized_name":"image","name":"image","type":"IMAGE","link":11},{"localized_name":"upscale_method","name":"upscale_method","type":"COMBO","widget":{"name":"upscale_method"},"link":null},{"localized_name":"width","name":"width","type":"INT","widget":{"name":"width"},"link":null},{"localized_name":"height","name":"height","type":"INT","widget":{"name":"height"},"link":null},{"localized_name":"crop","name":"crop","type":"COMBO","widget":{"name":"crop"},"link":null}],"outputs":[{"localized_name":"IMAGE","name":"IMAGE","type":"IMAGE","links":[12]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"ImageScale"},"widgets_values":["nearest-exact",512,512,"disabled"]},{"id":5,"type":"VAELoader","pos":[-365.35082874885404,291.70635720805205],"size":[270,58],"flags":{},"order":1,"mode":0,"inputs":[{"localized_name":"vae_name","name":"vae_name","type":"COMBO","widget":{"name":"vae_name"},"link":null}],"outputs":[{"localized_name":"VAE","name":"VAE","type":"VAE","links":[6]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"VAELoader"},"widgets_values":["z-image_vae.safetensors"]},{"id":16,"type":"CLIPLoader","pos":[-358.4690403156899,390.8060643115864],"size":[270,106],"flags":{},"order":2,"mode":0,"inputs":[{"localized_name":"clip_name","name":"clip_name","type":"COMBO","widget":{"name":"clip_name"},"link":null},{"localized_name":"type","name":"type","type":"COMBO","widget":{"name":"type"},"link":null},{"localized_name":"device","name":"device","shape":7,"type":"COMBO","widget":{"name":"device"},"link":null}],"outputs":[{"localized_name":"CLIP","name":"CLIP","type":"CLIP","links":[17]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"CLIPLoader"},"widgets_values":["qwen_3_4b.safetensors","lumina2","default"]},{"id":1,"type":"TrainLoraNode","pos":[1117.7665637046055,228.49712230917353],"size":[300.751953125,430],"flags":{},"order":7,"mode":0,"inputs":[{"localized_name":"model","name":"model","type":"MODEL","link":13},{"localized_name":"latents","name":"latents","type":"LATENT","link":3},{"localized_name":"positive","name":"positive","type":"CONDITIONING","link":4},{"localized_name":"batch_size","name":"batch_size","type":"INT","widget":{"name":"batch_size"},"link":null},{"localized_name":"grad_accumulation_steps","name":"grad_accumulation_steps","type":"INT","widget":{"name":"grad_accumulation_steps"},"link":null},{"localized_name":"steps","name":"steps","type":"INT","widget":{"name":"steps"},"link":null},{"localized_name":"learning_rate","name":"learning_rate","type":"FLOAT","widget":{"name":"learning_rate"},"link":null},{"localized_name":"rank","name":"rank","type":"INT","widget":{"name":"rank"},"link":null},{"localized_name":"optimizer","name":"optimizer","type":"COMBO","widget":{"name":"optimizer"},"link":null},{"localized_name":"loss_function","name":"loss_function","type":"COMBO","widget":{"name":"loss_function"},"link":null},{"localized_name":"seed","name":"seed","type":"INT","widget":{"name":"seed"},"link":null},{"localized_name":"training_dtype","name":"training_dtype","type":"COMBO","widget":{"name":"training_dtype"},"link":null},{"localized_name":"lora_dtype","name":"lora_dtype","type":"COMBO","widget":{"name":"lora_dtype"},"link":null},{"localized_name":"algorithm","name":"algorithm","type":"COMBO","widget":{"name":"algorithm"},"link":null},{"localized_name":"gradient_checkpointing","name":"gradient_checkpointing","type":"BOOLEAN","widget":{"name":"gradient_checkpointing"},"link":null},{"localized_name":"existing_lora","name":"existing_lora","type":"COMBO","widget":{"name":"existing_lora"},"link":null}],"outputs":[{"localized_name":"model_with_lora","name":"model","type":"MODEL","links":[16]},{"localized_name":"lora","name":"lora","type":"LORA_MODEL","links":[15]},{"localized_name":"loss","name":"loss_map","type":"LOSS_MAP","links":null},{"localized_name":"steps","name":"steps","type":"INT","links":null}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"TrainLoraNode"},"widgets_values":[1,1,100,0.0005,8,"AdamW","MSE",111975901213814,"randomize","bf16","bf16","LoRA",true,"[None]"]},{"id":3,"type":"SaveTrainingDataset","pos":[691.9911110917468,567.2750145698383],"size":[270,102],"flags":{},"order":6,"mode":0,"inputs":[{"localized_name":"latents","name":"latents","type":"LATENT","link":1},{"localized_name":"conditioning","name":"conditioning","type":"CONDITIONING","link":2},{"localized_name":"folder_name","name":"folder_name","type":"STRING","widget":{"name":"folder_name"},"link":null},{"localized_name":"shard_size","name":"shard_size","type":"INT","widget":{"name":"shard_size"},"link":null}],"outputs":[],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"SaveTrainingDataset"},"widgets_values":["z-skill",10000]},{"id":9,"type":"LoadImageDataSetFromFolder","pos":[-437.97022147685044,32.927016907300526],"size":[301.4439453125,58],"flags":{},"order":3,"mode":0,"inputs":[{"localized_name":"folder","name":"folder","type":"COMBO","widget":{"name":"folder"},"link":null}],"outputs":[{"localized_name":"images","name":"images","shape":6,"type":"IMAGE","links":[11]}],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"LoadImageDataSetFromFolder"},"widgets_values":["z-image-dataset"]},{"id":14,"type":"SaveLoRA","pos":[1780.2717938918026,383.35445663271577],"size":[270,82],"flags":{},"order":9,"mode":0,"inputs":[{"localized_name":"lora","name":"lora","type":"LORA_MODEL","link":15},{"localized_name":"prefix","name":"prefix","type":"STRING","widget":{"name":"prefix"},"link":null},{"localized_name":"steps","name":"steps","shape":7,"type":"INT","widget":{"name":"steps"},"link":null}],"outputs":[],"properties":{"cnr_id":"comfy-core","ver":"0.3.75","Node name for S&R":"SaveLoRA"},"widgets_values":["loras/z-skill",100]},{"id":15,"type":"UNetSave","pos":[1739.667288470156,186.62354802458594],"size":[270,58],"flags":{},"order":8,"mode":0,"inputs":[{"localized_name":"model","name":"model","type":"MODEL","link":16},{"localized_name":"filename_prefix","name":"filename_prefix","type":"STRING","widget":{"name":"filename_prefix"},"link":null}],"outputs":[],"properties":{"cnr_id":"RES4LYF","ver":"46de917234f9fef3f2ab411c41e07aa3c633f4f7","Node name for S&R":"UNetSave"},"widgets_values":["models/z-skill"]}],"links":[[1,2,0,3,0,"LATENT"],[2,2,1,3,1,"CONDITIONING"],[3,2,0,1,1,"LATENT"],[4,2,1,1,2,"CONDITIONING"],[6,5,0,2,1,"VAE"],[11,9,0,11,0,"IMAGE"],[12,11,0,2,0,"IMAGE"],[13,12,0,1,0,"MODEL"],[15,1,1,14,0,"LORA_MODEL"],[16,1,0,15,0,"MODEL"],[17,16,0,2,2,"CLIP"]],"groups":[],"config":{},"extra":{"workflowRendererVersion":"LG","ds":{"scale":0.6934334949441672,"offset":[542.8371659626396,565.2992128502808]}},"version":0.4} ``` ## Additional Context (Please add any additional context or steps to reproduce the error here)
bsakaguchi commented 2026-10-26 22:08:06 +00:00
Author
Owner
Copy link

@christian-byrne commented on GitHub (Nov 27, 2025):

Please post this in https://github.com/comfyanonymous/ComfyUI

<!-- gh-comment-id:3584337586 --> @christian-byrne commented on GitHub (Nov 27, 2025): Please post this in https://github.com/comfyanonymous/ComfyUI
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
0521
docs-update-0512
add-auto-pr-action
Train-LoRA-Node-docs
LossGraphNode
LoadImage
add-readme-info
bl-verbump
bump-version-0.1.1
v0.5.16
v0.5.15
v0.5.14
v0.5.13
v0.5.12
v0.5.11
v0.5.10
v0.5.9
v0.5.8
v0.5.7
v0.5.6
v0.5.5
v0.5.4
v0.5.3
v0.5.2
v0.5.1
v0.5.0
v0.4.4
v0.4.3
Labels
Clear labels   
documentation

   
High priority

   
High priority

   
High priority

   
pull-request
Mirrored from GitHub Pull Request

  
wontfix
No labels
documentation
High priority
High priority
High priority
pull-request
wontfix
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
Comfy-Org/embedded-docs#16
No description provided.