80 Commits

Author SHA1 Message Date
Jaret Burkett
a6da9e37ac Add support for FLUX.2 klein base models 2026-01-17 17:46:25 -07:00
Jaret Burkett
0efed794b4 Fix issue where flux2 would ignore single control image on training 2026-01-17 20:26:35 +00:00
Jaret Burkett
e40d7ac605 Ignore i2v on ltx is training on images 2026-01-14 18:46:27 -07:00
Jaret Burkett
9848de7946 Fix issue with ltx cached latents if there is no audio. 2026-01-14 17:27:01 -07:00
Jaret Burkett
73dedbf662 Do caching of latents, first frame and audio when caching latents for LTX2 2026-01-14 11:05:23 -07:00
Jaret Burkett
64fe29b182 Support img 2 vid training for ltx-2 2026-01-13 19:04:56 -07:00
Jaret Burkett
5b5aadadb8 Add LTX-2 Support (#644)
* WIP, adding support for LTX2

* Training on images working

* Fix loading comfy models

* Handle converting and deconverting lora so it matches original format

* Reworked ui to habdle ltx and propert dataset default overwriting.

* Update the way lokr saves to it is more compatable with comfy

* Audio loading and synchronization/resampling is working

* Add audio to training. Does it work? Maybe, still testing.

* Fixed fps default issue for sound

* Have ui set fps for accurate audio mapping on ltx

* Added audio procession options to the ui for ltx

* Clean up requirements
2026-01-13 04:55:30 -07:00
Jaret Burkett
0d5c181843 Fixed issue where the control images would sometimes be ignored on qwen_image_edit_2511 2025-12-30 16:40:49 +00:00
Jaret Burkett
e6c5aead3b Fix issue that prevented ramtorch layer offloading with z_image 2025-12-02 16:14:34 -07:00
Jaret Burkett
4e62c38df5 Add support for training Z-Image Turbo with a de-distill training adapter 2025-11-28 08:08:53 -07:00
Jaret Burkett
01cf480233 Add FLUX.2 official weights 2025-11-25 08:52:19 -07:00
Jaret Burkett
dadbeda197 Update test weights 2025-11-23 10:51:50 -07:00
Jaret Burkett
af8e9ea149 Add initial support for FLUX.2 2025-11-18 11:17:38 -07:00
Jaret Burkett
c984369294 Fixed resizing of control image resolution for Qwen Image Edit 2509 when using match_target_res 2025-10-30 06:30:01 -06:00
Jaret Burkett
ff14cd6343 Fix check for making sure vae is on the right device. 2025-10-21 14:49:20 -06:00
Jaret Burkett
76ce757e0c Added initial support for layer offloading wit Wan 2.2 14B models. 2025-10-20 14:54:30 -06:00
Jaret Burkett
b7f85928f3 Fix issue with chroma when not quantizing 2025-10-19 12:13:05 -06:00
Jaret Burkett
0c9e1c3deb Fixed some fringe cases for qwen image edit. 2025-10-13 17:10:46 +00:00
Jaret Burkett
e9c4d94256 Allow for matching target resolution with control images for Qwen Image Edit 2509 2025-10-10 14:24:27 -06:00
Jaret Burkett
1bc6dee127 Change auto_memory to be layer_offloading and allow you to set the amount to unload 2025-10-10 13:12:32 -06:00
Jaret Burkett
8068755b0a Fixed issue with wan 2.2 getting stuck on CPU 2025-10-09 17:24:25 +00:00
Jaret Burkett
4e5707854f Initial support for RamTorch. Still a WIP 2025-10-05 13:03:26 -06:00
Jaret Burkett
b7c04efb44 A commit with the adits properly named improvements to qwen image edit plus workflow. Fixed a bug. Dont norm the cfg 2025-10-01 14:13:15 -06:00
Jaret Burkett
3086a58e5b git status 2025-10-01 14:12:17 -06:00
Jaret Burkett
67ed563e03 fix issue with multi batch size on qwen-image-edit-plus 2025-09-30 09:04:56 -06:00
Jaret Burkett
6da417261c Add extra detachments just to be sure on qiep 2025-09-27 08:53:59 -06:00
Jaret Burkett
e04f55c553 Fixed scaling issue with control images 2025-09-26 11:49:53 -06:00
Jaret Burkett
454be0958a Initial support for qwen image edit plus 2025-09-24 11:39:10 -06:00
Jaret Burkett
20dfe1b4d5 Small double tap of detach on qwen just for good measure 2025-09-18 08:22:04 -06:00
Jaret Burkett
b95c17dc17 Add initial support for chroma radiance 2025-09-10 08:41:05 -06:00
Jaret Burkett
056711d4ed Fix issue with wan22 14b that woudl load both transformers temporarily resulting in oom on 24GB. 2025-08-28 13:06:31 -06:00
Jaret Burkett
119653c3f2 Force width, height, and num frames to always be the proper sizes for Wan 2.2 models 2025-08-25 10:33:28 -06:00
Jaret Burkett
e1fd411665 Added support for Chroma1 official release. Will still use single file verstion instead of the diffusers version. 2025-08-23 09:06:28 -06:00
Jaret Burkett
bf2700f7be Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere. 2025-08-21 16:41:17 -06:00
Jaret Burkett
83deaec417 Minor bug fixes 2025-08-21 08:05:34 -06:00
Jaret Burkett
d2bbe1872c Add support for fine tuning Wan 2.2 I2V 14B 2025-08-18 11:43:32 -06:00
Jaret Burkett
b3e666daf4 Fix issue with wan22 14b where timesteps were generated not in the current boundary. 2025-08-16 21:16:48 -06:00
Jaret Burkett
6fffadfc0e Fixed a bug that prevented training just one stage of Wan 2.2 14b 2025-08-16 18:07:21 -06:00
Jaret Burkett
8ea2cf00f6 Added training to the ui. Still testing, but everything seems to be working. 2025-08-16 05:51:37 -06:00
Jaret Burkett
1c96b95617 Fix issue where sometimes the transformer does not get loaded properly. 2025-08-14 14:24:41 -06:00
Jaret Burkett
3413fa537f Wan22 14b training is working, still need tons of testing and some bug fixes 2025-08-14 13:03:27 -06:00
Jaret Burkett
259d68d440 Added a flushg during sampling to prevent spikes on low vram qwen 2025-08-12 12:57:18 -06:00
Jaret Burkett
77b10d884d Add support for training with an accuracy recovery adapter with qwen image 2025-08-12 08:21:36 -06:00
Jaret Burkett
4ad18f3d00 Clip max token embeddings to the max rope length for qwen image to solve for an error for super long captions > 1024 2025-08-10 08:44:41 -06:00
Jaret Burkett
f0105c33a7 Fixed issue that sometimes happens in qwen image where text seq length is wrong 2025-08-09 16:33:05 -06:00
Jaret Burkett
bb6db3d635 Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized 2025-08-07 10:27:55 -06:00
Jaret Burkett
4c4a10d439 Remove vision model from qwen text encoder as it is not needed for image generation currently 2025-08-06 11:40:02 -06:00
Jaret Burkett
14ccf2f3ce Refactor qwen5b model code to be qwen 5b specific 2025-08-06 10:54:56 -06:00
Jaret Burkett
5d8922fca2 Add ability to designate a dataset as i2v or t2v for models that support it 2025-08-06 09:29:47 -06:00
Jaret Burkett
93202c7a2b Training working for Qwen Image 2025-08-04 21:14:30 +00:00