Commit Graph

511 Commits

Author SHA1 Message Date
Jaret Burkett
03bc431279 Fixed an issue training lumina 2 2025-06-24 10:29:47 -06:00
Jaret Burkett
f3eb1dff42 Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss 2025-06-24 08:51:29 -06:00
Jaret Burkett
ba1274d99e Added a guidance burning loss. Modified DFE to work with new model. Bug fixes 2025-06-23 08:38:27 -06:00
Jaret Burkett
8602470952 Updated diffusion feature extractor 2025-06-19 15:36:10 -06:00
Jaret Burkett
989ebfaa11 Added a basic torch profiler that can be used in config during development to find some obvious issues. 2025-06-17 13:03:39 -06:00
Jaret Burkett
1cc663a664 Performance optimizations for pre processing the batch 2025-06-17 07:37:41 -06:00
Jaret Burkett
1c2b7298dd More work on mean flow loss. Moved it to an adapter. Still not functioning properly though. 2025-06-16 07:17:35 -06:00
Jaret Burkett
c0314ba325 Fixed some issues with training mean flow algo. Still testing WIP 2025-06-16 07:14:59 -06:00
Jaret Burkett
fc83eb7691 WIP on mean flow loss. Still a WIP. 2025-06-12 08:00:51 -06:00
Hameer Abbasi
5e86139e0a Fix NameError. 2025-06-11 15:07:20 +02:00
Hameer Abbasi
c5d6b74fea Fix caption loading. 2025-06-11 15:05:31 +02:00
Jaret Burkett
97e101522c Increase ema feedback amount. Normalize the dfe 4 image embeds 2025-06-10 08:01:13 -06:00
Jaret Burkett
eefa93f16e Various code to support experiments. 2025-06-09 11:19:21 -06:00
Jaret Burkett
22cdfadab6 Added new timestep weighing strategy 2025-06-04 01:16:02 -06:00
Jaret Burkett
adc31ec77d Small updates and bug fixes for various things 2025-06-03 20:08:35 -06:00
Jaret Burkett
b6d25fcd10 Improvements to vae trainer. Adjust denoise prediction of DFE v3 2025-05-30 12:06:47 -06:00
Jaret Burkett
79499fa795 Allow fine tuning pruned versions of chroma. Allow flash attention 2 for chroma if it is installed. 2025-05-21 07:02:50 -06:00
Jaret Burkett
48e11cf843 Fallback unwrapping logic if fails 2025-05-21 03:10:33 -06:00
Jaret Burkett
fca7fd6c38 Merge branch 'main' of github.com:ostris/ai-toolkit 2025-05-21 02:20:06 -06:00
Jaret Burkett
e5181d23cd Added some experimental training techniques. Ignore for now. Still in testing. 2025-05-21 02:19:54 -06:00
Jaret Burkett
4f896c0d8a Fixed issue where sampling fails if doing a full finetune for some models 2025-05-17 19:37:55 +00:00
Jaret Burkett
1210050ead Reworked control generator. It is now significantly faster. Also uses better pose model with better license. 2025-05-08 14:35:55 -06:00
Jaret Burkett
43cb5603ad Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models 2025-05-07 12:06:30 -06:00
Jaret Burkett
d9700bdb99 Added initial support for f-lite model 2025-05-01 11:15:18 -06:00
Jaret Burkett
5890e67a46 Various bug fixes 2025-04-29 09:30:33 -06:00
Jaret Burkett
2b4c525489 Reworked automagic optimizer and did more testing. Starting to really like it. Working well. 2025-04-28 08:01:10 -06:00
Jaret Burkett
88b3fbae37 Various experiments and minor bug fixes for edge cases 2025-04-25 13:44:38 -06:00
Jaret Burkett
12e3095d8a Fixed issue with saving base model version 2025-04-19 14:34:01 -06:00
Jaret Burkett
77001ee77f Upodate model tag on loras 2025-04-19 10:41:27 -06:00
Jaret Burkett
d455e76c4f Cleanup 2025-04-18 11:44:49 -06:00
Jaret Burkett
bfe29e2151 Removed all submodules. Submodule free now, yay. 2025-04-18 10:39:15 -06:00
Jaret Burkett
5f312cd46b Remove ip adapter submodule 2025-04-18 09:59:42 -06:00
Jaret Burkett
c90615f8bb Add model hooks to polarity loss 2025-04-17 09:00:10 -06:00
Jaret Burkett
fd6026ab73 Merge pull request #278 from ostris/hidream
Add Hidream support
2025-04-16 13:48:27 -06:00
Jaret Burkett
fecc64e646 Update hidream defaults, pass additional information to flow guidance 2025-04-16 13:03:04 -06:00
Jaret Burkett
c12036df95 Added ability to use short captions from json caption file 2025-04-16 08:32:28 -06:00
Jaret Burkett
89c0f688db Merge branch 'main' into hidream 2025-04-13 21:16:07 -06:00
Jaret Burkett
1e0bff653c Fix new bug I accidently introduced with lora 2025-04-13 21:15:07 -06:00
Jaret Burkett
f80cf99f40 Hidream is training, but has a memory leak 2025-04-13 23:28:18 +00:00
Jaret Burkett
ca3ce0f34c Make it easier to designate lora blocks for new models. Improve i2v adapter speed. Fix issue with i2v adapter where cached torch tensor was wrong range. 2025-04-13 13:49:13 -06:00
Jaret Burkett
6fb44db6a0 Finished up first frame for i2v adapter 2025-04-12 17:13:04 -06:00
Jaret Burkett
4a43589666 Use a shuffled embedding as unconditional for i2v adapter 2025-04-11 10:44:43 -06:00
Jaret Burkett
059155174a Added mask diffirential mask dialation for flex2. Handle video for the i2v adapter 2025-04-10 11:50:01 -06:00
Jaret Burkett
9794416a5d Fixed bug when loading video datasets 2025-04-10 08:16:05 -06:00
Jaret Burkett
d8bdc03256 Allow full control of caption extensions 2025-04-10 07:42:04 -06:00
Jaret Burkett
96ba2fd129 Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose. 2025-04-09 13:35:04 -06:00
Jaret Burkett
615b0d0e94 Added initial support for training i2v adapter WIP 2025-04-09 08:06:29 -06:00
Jaret Burkett
a8680c75eb Added initial support for finetuning wan i2v WIP 2025-04-07 20:34:38 -06:00
Jaret Burkett
38ad5a4644 Fixed issue with video dataset sizing 2025-04-07 12:46:41 -06:00
Jaret Burkett
6c8b5ab606 Added some more useful error handeling and logging 2025-04-07 08:01:37 -06:00