Jaret Burkett
5b5aadadb8
Add LTX-2 Support ( #644 )
...
* WIP, adding support for LTX2
* Training on images working
* Fix loading comfy models
* Handle converting and deconverting lora so it matches original format
* Reworked ui to habdle ltx and propert dataset default overwriting.
* Update the way lokr saves to it is more compatable with comfy
* Audio loading and synchronization/resampling is working
* Add audio to training. Does it work? Maybe, still testing.
* Fixed fps default issue for sound
* Have ui set fps for accurate audio mapping on ltx
* Added audio procession options to the ui for ltx
* Clean up requirements
2026-01-13 04:55:30 -07:00
Jaret Burkett
2e7b2d9926
Added Differential Guidance training target
2025-11-10 09:38:25 -07:00
Jaret Burkett
6f308fc46e
When soing guidance loss, make CFG zero an optional target instead of a forced one.
2025-11-04 09:16:15 -07:00
Jaret Burkett
42e5e3cd1c
Adjust DFE to handle 5 dimension latent spaces
2025-10-27 07:48:44 -06:00
Jaret Burkett
80418209b8
Fixe a variable that could nt be declared when doing blank prompt preservation
2025-10-23 16:19:56 -06:00
Jaret Burkett
ee206cfa18
Added blank prompt preservation
2025-10-22 14:55:13 -06:00
Jaret Burkett
91b87e06a1
Reordered logs
2025-10-15 09:15:06 -06:00
Jaret Burkett
7e34a03113
Added queing system to the UI
2025-10-14 12:00:42 -06:00
Jaret Burkett
2ba4000704
Allow masked losses with video models
2025-09-30 14:57:07 -06:00
Jaret Burkett
454be0958a
Initial support for qwen image edit plus
2025-09-24 11:39:10 -06:00
Jaret Burkett
f74475161e
Add stepped loss type
2025-09-22 15:50:12 -06:00
Jaret Burkett
28728a1e92
Added experimental dfe 5
2025-09-21 10:48:52 -06:00
Jaret Burkett
3cdf50cbfc
Merge pull request #426 from squewel/prior_reg
...
Dataset-level prior regularization
2025-09-18 03:03:18 -06:00
max
e4ae97e790
add dataset-level distillation-style regularization
2025-09-18 01:11:19 +03:00
Jaret Burkett
218f673e3d
Added support for new concept slider training script to CLI and UI
2025-09-16 10:22:34 -06:00
Jaret Burkett
645046701b
Comment out fast stop watcher. Could potentiallty be causing some weird issues. Need to investigate.
2025-09-04 08:26:57 -06:00
Jaret Burkett
193c1b2dfa
Add a watcher to constantly check for stop signal from the UI. This will force a stop within 2 seconds instead of having to wait on a long hung process.
2025-08-31 16:58:01 -06:00
Jaret Burkett
1f541bc5d8
Changes to handle a different DFE arch
2025-08-27 11:05:16 -06:00
Jaret Burkett
aa99784b89
Add control to prompot encodings in the trainer when not cached
2025-08-21 16:52:13 -06:00
Jaret Burkett
bf2700f7be
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
2025-08-21 16:41:17 -06:00
Jaret Burkett
b3e666daf4
Fix issue with wan22 14b where timesteps were generated not in the current boundary.
2025-08-16 21:16:48 -06:00
Jaret Burkett
8ea2cf00f6
Added training to the ui. Still testing, but everything seems to be working.
2025-08-16 05:51:37 -06:00
Jaret Burkett
bb6db3d635
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
2025-08-07 10:27:55 -06:00
Jaret Burkett
8d9c47316a
Work on mean flow. Minor bug fixes. Omnigen improvements
2025-06-26 13:46:20 -06:00
Jaret Burkett
18513ec866
Merged in from main
2025-06-24 10:56:54 -06:00
Jaret Burkett
f3eb1dff42
Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss
2025-06-24 08:51:29 -06:00
Jaret Burkett
ba1274d99e
Added a guidance burning loss. Modified DFE to work with new model. Bug fixes
2025-06-23 08:38:27 -06:00
Jaret Burkett
8602470952
Updated diffusion feature extractor
2025-06-19 15:36:10 -06:00
Jaret Burkett
1cc663a664
Performance optimizations for pre processing the batch
2025-06-17 07:37:41 -06:00
Jaret Burkett
1c2b7298dd
More work on mean flow loss. Moved it to an adapter. Still not functioning properly though.
2025-06-16 07:17:35 -06:00
Jaret Burkett
c0314ba325
Fixed some issues with training mean flow algo. Still testing WIP
2025-06-16 07:14:59 -06:00
Jaret Burkett
cbf04b8d53
Fixed some issues with training mean flow algo. Still testing WIP
2025-06-14 12:24:00 -06:00
Jaret Burkett
fc83eb7691
WIP on mean flow loss. Still a WIP.
2025-06-12 08:00:51 -06:00
Jaret Burkett
eefa93f16e
Various code to support experiments.
2025-06-09 11:19:21 -06:00
Jaret Burkett
22cdfadab6
Added new timestep weighing strategy
2025-06-04 01:16:02 -06:00
Jaret Burkett
adc31ec77d
Small updates and bug fixes for various things
2025-06-03 20:08:35 -06:00
Jaret Burkett
e5181d23cd
Added some experimental training techniques. Ignore for now. Still in testing.
2025-05-21 02:19:54 -06:00
Jaret Burkett
5890e67a46
Various bug fixes
2025-04-29 09:30:33 -06:00
Jaret Burkett
6fb44db6a0
Finished up first frame for i2v adapter
2025-04-12 17:13:04 -06:00
Jaret Burkett
cd37ccfc2e
Use gradient checkpointing on DFE models if set
2025-04-11 10:45:39 -06:00
Jaret Burkett
059155174a
Added mask diffirential mask dialation for flex2. Handle video for the i2v adapter
2025-04-10 11:50:01 -06:00
Jaret Burkett
a8680c75eb
Added initial support for finetuning wan i2v WIP
2025-04-07 20:34:38 -06:00
Jaret Burkett
a42c5a1de5
Adjust buckets for flex2
2025-04-02 06:47:41 -06:00
Jaret Burkett
c083a0e5ea
Allow DFE to not have a VAE
2025-03-30 09:23:01 -06:00
Jaret Burkett
5365200da1
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
2025-03-27 16:07:00 -06:00
Jaret Burkett
ce4c5291a0
Added experimental wavelet loss
2025-03-26 18:11:23 -06:00
Jaret Burkett
45be82d5d6
Handle inpainting training for control_lora adapter
2025-03-24 13:17:47 -06:00
Jaret Burkett
f10937e6da
Handle multi control inputs for control lora training
2025-03-23 07:37:08 -06:00
Jaret Burkett
9a902c067f
Show the console log on the job overview in the ui.
2025-03-21 11:45:36 -06:00
Jaret Burkett
3a6b24f4c8
Added a way to secure the UI. Plus various bug fixes and quality of life updates
2025-03-20 08:07:09 -06:00
