rattus 117e214354 ModelPatcherDynamic: force load non leaf weights (#12433) ...

The current behaviour of the default ModelPatcher is to .to a model
only if its fully loaded, which is how random non-leaf weights get
loaded in non-LowVRAM conditions.

The however means they never get loaded in dynamic_vram. In the
dynamic_vram case, force load them to the GPU.

2026-02-12 19:51:50 -05:00

71 KiB

Raw Blame History

View Raw