rattus ecd2a19661 Fix lora Extraction in offload conditions (+ dynamic_vram mode) (#12479) ...

* lora_extract: Add a trange

If you bite off more than your GPU can chew, this kinda just hangs.
Give a rough indication of progress counting the weights in a trange.

* lora_extract: Support on-the-fly patching

Use the on-the-fly approach from the regular model saving logic for
lora extraction too. Switch off force_cast_weights accordingly.

This gets extraction working in dynamic vram while also supporting
extraction on GPU offloaded.

2026-02-15 20:28:51 -05:00

5.6 KiB

Raw Blame History

View Raw