mirror of
https://github.com/comfyanonymous/ComfyUI.git
synced 2026-02-24 17:04:04 +00:00
[Trainer] training with proper offloading (#12189)
* Fix bypass dtype/device moving * Force offloading mode for training * training context var * offloading implementation in training node * fix wrong input type * Support bypass load lora model, correct adapter/offloading handling
This commit is contained in:
@@ -55,6 +55,11 @@ cpu_state = CPUState.GPU
|
||||
|
||||
total_vram = 0
|
||||
|
||||
|
||||
# Training Related State
|
||||
in_training = False
|
||||
|
||||
|
||||
def get_supported_float8_types():
|
||||
float8_types = []
|
||||
try:
|
||||
|
||||
Reference in New Issue
Block a user