7 Commits

Author SHA1 Message Date
Jaret Burkett
add83df5cc Fixed issue with training hidream when batch size is larger than 1 2025-04-21 17:26:29 +00:00
Jaret Burkett
77001ee77f Upodate model tag on loras 2025-04-19 10:41:27 -06:00
Jaret Burkett
0f99fce004 Adjust hidream lora names to work with comfy 2025-04-16 09:24:23 -06:00
Jaret Burkett
524bd2edfc Make flash attn optional. Handle larger batch sizes. 2025-04-14 14:34:46 +00:00
Jaret Burkett
3a5ea2c742 Remove some moe stuff for finetuning. Drastically reduces vram usage 2025-04-14 00:57:34 +00:00
Jaret Burkett
f80cf99f40 Hidream is training, but has a memory leak 2025-04-13 23:28:18 +00:00
Jaret Burkett
594e166ca3 Initial support for hidream. Still a WIP 2025-04-13 13:50:11 -06:00