Jaret Burkett
5b5aadadb8
Add LTX-2 Support ( #644 )
...
* WIP, adding support for LTX2
* Training on images working
* Fix loading comfy models
* Handle converting and deconverting lora so it matches original format
* Reworked ui to habdle ltx and propert dataset default overwriting.
* Update the way lokr saves to it is more compatable with comfy
* Audio loading and synchronization/resampling is working
* Add audio to training. Does it work? Maybe, still testing.
* Fixed fps default issue for sound
* Have ui set fps for accurate audio mapping on ltx
* Added audio procession options to the ui for ltx
* Clean up requirements
2026-01-13 04:55:30 -07:00
Jaret Burkett
87edca1b2b
Added initial support to initiate lora training from an existing lora
2025-12-22 12:49:15 -07:00
Jaret Burkett
ba00eea7d9
Add loss graph to the ui
2025-12-18 10:08:59 -07:00
Jaret Burkett
e6c5aead3b
Fix issue that prevented ramtorch layer offloading with z_image
2025-12-02 16:14:34 -07:00
Jaret Burkett
2e7b2d9926
Added Differential Guidance training target
2025-11-10 09:38:25 -07:00
Jaret Burkett
6f308fc46e
When soing guidance loss, make CFG zero an optional target instead of a forced one.
2025-11-04 09:16:15 -07:00
Jaret Burkett
ee206cfa18
Added blank prompt preservation
2025-10-22 14:55:13 -06:00
Jaret Burkett
0d8a33dc16
Offload ARA with the layer if doing layer offloading. Add support to offload the LoRA. Still needs optimizer support
2025-10-21 06:03:27 -06:00
Jaret Burkett
1f81bc4060
Fix issue where text encoder could be the wrong quantization and fail when using memory manager
2025-10-15 11:01:30 -06:00
Jaret Burkett
1bc6dee127
Change auto_memory to be layer_offloading and allow you to set the amount to unload
2025-10-10 13:12:32 -06:00
Jaret Burkett
4e5707854f
Initial support for RamTorch. Still a WIP
2025-10-05 13:03:26 -06:00
Jaret Burkett
3086a58e5b
git status
2025-10-01 14:12:17 -06:00
Jaret Burkett
3b1f7b0948
Allow user to set the attention backend. Add method to recomver from the occasional OOM if it is a rare event. Still exit if it ooms 3 times in a row.
2025-09-27 08:56:15 -06:00
Jaret Burkett
1069dee0e4
Added ui sopport for multi control samples and datasets. Added qwen image edit 5209 to the ui
2025-09-25 11:10:02 -06:00
Jaret Burkett
454be0958a
Initial support for qwen image edit plus
2025-09-24 11:39:10 -06:00
Jaret Burkett
3cdf50cbfc
Merge pull request #426 from squewel/prior_reg
...
Dataset-level prior regularization
2025-09-18 03:03:18 -06:00
max
e4ae97e790
add dataset-level distillation-style regularization
2025-09-18 01:11:19 +03:00
Jaret Burkett
218f673e3d
Added support for new concept slider training script to CLI and UI
2025-09-16 10:22:34 -06:00
Jaret Burkett
af6fdaaaf9
Add ability to train a full rank LoRA. (experimental)
2025-09-09 07:36:25 -06:00
Jaret Burkett
f699f4be5f
Add ability to set transparent color for control images
2025-09-02 11:08:44 -06:00
Jaret Burkett
85dcae6e2b
Set full size control images to default true
2025-09-02 10:30:42 -06:00
Jaret Burkett
7040d8d73b
Preperation for audio
2025-09-02 07:26:50 -06:00
Jaret Burkett
bf2700f7be
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
2025-08-21 16:41:17 -06:00
Jaret Burkett
8ea2cf00f6
Added training to the ui. Still testing, but everything seems to be working.
2025-08-16 05:51:37 -06:00
Jaret Burkett
3413fa537f
Wan22 14b training is working, still need tons of testing and some bug fixes
2025-08-14 13:03:27 -06:00
Jaret Burkett
85bad57df3
Fix bug that would use EMA when set false
2025-08-13 11:39:40 -06:00
Jaret Burkett
77b10d884d
Add support for training with an accuracy recovery adapter with qwen image
2025-08-12 08:21:36 -06:00
Jaret Burkett
bb6db3d635
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
2025-08-07 10:27:55 -06:00
Jaret Burkett
5d8922fca2
Add ability to designate a dataset as i2v or t2v for models that support it
2025-08-06 09:29:47 -06:00
Jaret Burkett
77dc38a574
Some work on caching text embeddings
2025-07-26 09:22:04 -06:00
Jaret Burkett
f500b9f240
Add ability to do more advanced sample prompt objects to prepart for a UI rework on control images and other things.
2025-07-17 07:13:35 -06:00
Jaret Burkett
60ef2f1df7
Added support for FLUX.1-Kontext-dev
2025-06-26 15:24:37 -06:00
Jaret Burkett
f3eb1dff42
Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss
2025-06-24 08:51:29 -06:00
Jaret Burkett
ba1274d99e
Added a guidance burning loss. Modified DFE to work with new model. Bug fixes
2025-06-23 08:38:27 -06:00
Jaret Burkett
8602470952
Updated diffusion feature extractor
2025-06-19 15:36:10 -06:00
Jaret Burkett
fc83eb7691
WIP on mean flow loss. Still a WIP.
2025-06-12 08:00:51 -06:00
Jaret Burkett
eefa93f16e
Various code to support experiments.
2025-06-09 11:19:21 -06:00
Jaret Burkett
22cdfadab6
Added new timestep weighing strategy
2025-06-04 01:16:02 -06:00
Jaret Burkett
e5181d23cd
Added some experimental training techniques. Ignore for now. Still in testing.
2025-05-21 02:19:54 -06:00
Jaret Burkett
43cb5603ad
Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models
2025-05-07 12:06:30 -06:00
Jaret Burkett
88b3fbae37
Various experiments and minor bug fixes for edge cases
2025-04-25 13:44:38 -06:00
Jaret Burkett
c12036df95
Added ability to use short captions from json caption file
2025-04-16 08:32:28 -06:00
Jaret Burkett
d8bdc03256
Allow full control of caption extensions
2025-04-10 07:42:04 -06:00
Jaret Burkett
96ba2fd129
Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose.
2025-04-09 13:35:04 -06:00
Jaret Burkett
615b0d0e94
Added initial support for training i2v adapter WIP
2025-04-09 08:06:29 -06:00
Jaret Burkett
a8680c75eb
Added initial support for finetuning wan i2v WIP
2025-04-07 20:34:38 -06:00
Jaret Burkett
860d892214
Pixel shuffle adapter. Some bug fixes thrown in
2025-03-29 21:15:01 -06:00
Jaret Burkett
5365200da1
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
2025-03-27 16:07:00 -06:00
Jaret Burkett
ce4c5291a0
Added experimental wavelet loss
2025-03-26 18:11:23 -06:00
Jaret Burkett
6021a3dbc0
Change inpainting mask to zero out on latents instead of image for inpaint area.
2025-03-24 14:16:52 -06:00
