ostris/ai-toolkit
1
0
Fork 0
mirror of https://github.com/ostris/ai-toolkit.git synced 2026-04-23 07:49:24 +00:00
Code Issues Packages Projects Releases Wiki Activity

Allow quantizing the te independently on flux. added lognorm_blend timestep schedule

Browse Source
This commit is contained in:
Jaret Burkett
2025-01-18 18:02:31 -07:00
parent 4723f23c0d
commit fadb2f3a76
3 changed files with 9 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
toolkit/stable_diffusion_model.py
View File

@@ -696,7 +696,7 @@ class StableDiffusion:
text_encoder_2.to(self.device_torch, dtype=dtype)
flush()
if self.model_config.quantize:
if self.model_config.quantize_te:
print("Quantizing T5")
quantize(text_encoder_2, weights=qfloat8)
freeze(text_encoder_2)