Jaret Burkett
73dedbf662
Do caching of latents, first frame and audio when caching latents for LTX2
2026-01-14 11:05:23 -07:00
Jaret Burkett
5b5aadadb8
Add LTX-2 Support ( #644 )
...
* WIP, adding support for LTX2
* Training on images working
* Fix loading comfy models
* Handle converting and deconverting lora so it matches original format
* Reworked ui to habdle ltx and propert dataset default overwriting.
* Update the way lokr saves to it is more compatable with comfy
* Audio loading and synchronization/resampling is working
* Add audio to training. Does it work? Maybe, still testing.
* Fixed fps default issue for sound
* Have ui set fps for accurate audio mapping on ltx
* Added audio procession options to the ui for ltx
* Clean up requirements
2026-01-13 04:55:30 -07:00
Jaret Burkett
a767b82b60
Fixed issue with new logger when ooming
2025-12-25 16:57:34 +00:00
Jaret Burkett
454be0958a
Initial support for qwen image edit plus
2025-09-24 11:39:10 -06:00
squewel
e27e229b36
add prior_reg flag to FileItemDTO
2025-09-18 02:09:39 +03:00
Jaret Burkett
bf2700f7be
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
2025-08-21 16:41:17 -06:00
Jaret Burkett
bb6db3d635
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
2025-08-07 10:27:55 -06:00
Jaret Burkett
5d8922fca2
Add ability to designate a dataset as i2v or t2v for models that support it
2025-08-06 09:29:47 -06:00
Jaret Burkett
24cd94929e
Fix bug that can happen with fast processing dataset
2025-06-25 14:01:08 -06:00
Jaret Burkett
f3eb1dff42
Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss
2025-06-24 08:51:29 -06:00
Jaret Burkett
9794416a5d
Fixed bug when loading video datasets
2025-04-10 08:16:05 -06:00
Jaret Burkett
38ad5a4644
Fixed issue with video dataset sizing
2025-04-07 12:46:41 -06:00
Jaret Burkett
3d131fb27a
Added a file signature check on the dataset size caching system to invalidate cached dimensions if the file changes.
2025-04-01 07:39:36 -06:00
Jaret Burkett
45be82d5d6
Handle inpainting training for control_lora adapter
2025-03-24 13:17:47 -06:00
Jaret Burkett
b829983b16
Added ability to load video datasets and train with them
2025-03-19 09:54:26 -06:00
Jaret Burkett
bedb8197a2
Fixed issue with sizes for some images being loaded sideways resulting in squished images.
2024-10-20 11:51:29 -06:00
Jaret Burkett
86b5938cf3
Fixed the webp bug finally.
2024-09-25 13:56:00 -06:00
Jaret Burkett
58dffd43a8
Added caching to image sizes so we dont do it every time.
2024-07-15 19:07:41 -06:00
Jaret Burkett
10e1ecf1e8
Added single value adapter training
2024-04-28 06:04:47 -06:00
Jaret Burkett
b96913d73c
Improvements to dataloader
2024-04-27 09:28:28 -06:00
Jaret Burkett
337945de9a
Added this not that guidance. Added ability to replace prompts.
2024-02-28 20:10:14 -07:00
Jaret Burkett
1ae1017748
Bug fixes. added ability to use l1 loss. varous other tests and improvements
2024-01-31 06:30:54 -07:00
Jaret Burkett
645b27f97a
Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.
2024-01-04 12:59:38 -07:00
Jaret Burkett
0f8daa5612
Bug fixes, work on maing IP adapters more customizable.
2023-12-24 08:32:39 -07:00
Jaret Burkett
0f597f453e
Switched ip adapter dataloader to clip_image paths so the control paths can be used for training assistant adapters while training ip adapters
2023-12-20 10:32:24 -07:00
Jaret Burkett
1ee62562a4
diffirential guidance is WORKING (from what I can tell)
2023-11-07 19:24:12 -07:00
Jaret Burkett
8a9e8f708f
Added base for using guidance during training. Still not working right.
2023-11-05 04:03:32 -07:00
Jaret Burkett
d742792ee4
Fixed issue with not loading short prompt
2023-10-24 16:19:32 -06:00
Jaret Burkett
002279cec3
Allow short and long caption combinations like form the new captioning system. Merge the network into the model before inference and reextract when done. Doubles inference speed on locon models during inference. allow splitting a batch into individual components and run them through alone. Basicallt gradient accumulation with single batch size.
2023-10-24 16:02:07 -06:00
Jaret Burkett
07bf7bd7de
Allow augmentations and targeting different loss types fron the config file
2023-10-18 03:04:57 -06:00
Jaret Burkett
bb1d3793e3
Added ability to add masks to dataloader and sd trainer to adjust weight of image
2023-10-09 11:21:00 -06:00
Jaret Burkett
f73402473b
Bug fixes. Added some functionality to help with private extensions
2023-10-05 07:09:34 -06:00
Jaret Burkett
579650eaf8
Fixed big issue with bucketing dataloader and added random cripping to a point of interest
2023-10-02 18:31:08 -06:00
Jaret Burkett
085787b799
Allow loading auxillery images from dataloader
2023-09-30 07:28:23 -06:00
Jaret Burkett
19255cdc7c
Bugfixes. Added small augmentations to dataloader. Will switch to abluminations soon though. Added ability to adjust step count on start to override what is in the file
2023-09-20 05:30:10 -06:00
Jaret Burkett
181f237a7b
added flipping x and y for dataset loader
2023-09-17 08:42:54 -06:00
Jaret Burkett
ae70200d3c
Bug fixes, speed improvements, compatability adjustments withdiffusers updates
2023-09-13 07:03:53 -06:00
Jaret Burkett
d74dd636ee
Memory optimizations. Default to using cudamalloc when torch 2.0 for mem allocation
2023-09-12 04:30:23 -06:00
Jaret Burkett
34bfeba229
Massive speed increase. Added latent caching both to disk and to memory
2023-09-10 08:54:49 -06:00
Jaret Burkett
714854ee86
Hude rework to move the batch to a DTO to make it far more modular to the future ui
2023-08-29 10:22:19 -06:00
Jaret Burkett
e866c75638
Built base interfaces for a DTO to handle batch infomation transports for the dataloader
2023-08-28 12:43:31 -06:00
