ostris/ai-toolkit
1
0
Fork 0
mirror of https://github.com/ostris/ai-toolkit.git synced 2026-01-26 16:39:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

Setup to retrain guidance embedding for flux. Use defualt timestep distribution for flux

Browse Source
This commit is contained in:
Jaret Burkett
2024-08-04 10:37:23 -06:00
parent 88acc28d7f
commit f321de7bdb
3 changed files with 28 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
extensions_built_in/sd_trainer/SDTrainer.py
View File

@@ -330,7 +330,12 @@ class SDTrainer(BaseSDTrainProcess):
elif self.sd.is_rectified_flow:
# only if preconditioning model outputs
# if not preconditioning, (target = noise - batch.latents) is used
# if not preconditioning, (target = noise - batch.latents)
# target = noise - batch.latents
# if preconditioning outputs, target latents
target = batch.latents.detach()
else:
target = noise