ostris/ai-toolkit
1
0
Fork 0
mirror of https://github.com/ostris/ai-toolkit.git synced 2026-04-30 03:01:28 +00:00
Code Issues Packages Projects Releases Wiki Activity

Added ability to activate experimental blank stabilization during training to zero out latents with blank prompts.

Browse Source
This commit is contained in:
Jaret Burkett
2026-02-04 13:00:03 -07:00
parent 42acb0d4be
commit 5c37db04f9
2 changed files with 11 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
jobs/process/BaseSDTrainProcess.py
View File

@@ -1336,6 +1336,14 @@ class BaseSDTrainProcess(BaseTrainProcess):
latent_multiplier = normalizer
latents = latents * latent_multiplier
if self.train_config.do_blank_stabilization:
# zero out latents with blank prompts
blank_latent = torch.zeros_like(latents)
for i, prompt in enumerate(conditioned_prompts):
if prompt.strip() == '':
latents[i] = blank_latent[i]
batch.latents = latents
# normalize latents to a mean of 0 and an std of 1