Jaret Burkett
73dedbf662
Do caching of latents, first frame and audio when caching latents for LTX2
2026-01-14 11:05:23 -07:00
Jaret Burkett
5b5aadadb8
Add LTX-2 Support ( #644 )
...
* WIP, adding support for LTX2
* Training on images working
* Fix loading comfy models
* Handle converting and deconverting lora so it matches original format
* Reworked ui to habdle ltx and propert dataset default overwriting.
* Update the way lokr saves to it is more compatable with comfy
* Audio loading and synchronization/resampling is working
* Add audio to training. Does it work? Maybe, still testing.
* Fixed fps default issue for sound
* Have ui set fps for accurate audio mapping on ltx
* Added audio procession options to the ui for ltx
* Clean up requirements
2026-01-13 04:55:30 -07:00
Jaret Burkett
2e7b2d9926
Added Differential Guidance training target
2025-11-10 09:38:25 -07:00
Jaret Burkett
ff14cd6343
Fix check for making sure vae is on the right device.
2025-10-21 14:49:20 -06:00
Jaret Burkett
4e5707854f
Initial support for RamTorch. Still a WIP
2025-10-05 13:03:26 -06:00
Jaret Burkett
3086a58e5b
git status
2025-10-01 14:12:17 -06:00
Jaret Burkett
454be0958a
Initial support for qwen image edit plus
2025-09-24 11:39:10 -06:00
Jaret Burkett
ea01a1c7d0
Fixed a bug where samples would fail if merging in lora on sampling for unquantized models. Quantize non ARA modules as uint8 when using an ARA
2025-08-25 09:21:40 -06:00
Jaret Burkett
bf2700f7be
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
2025-08-21 16:41:17 -06:00
Jaret Burkett
8ea2cf00f6
Added training to the ui. Still testing, but everything seems to be working.
2025-08-16 05:51:37 -06:00
Jaret Burkett
bb6db3d635
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
2025-08-07 10:27:55 -06:00
Jaret Burkett
f453e28ea3
Fixed deprecation of lumina pipeline error
2025-07-29 08:26:51 -06:00
Jaret Burkett
77dc38a574
Some work on caching text embeddings
2025-07-26 09:22:04 -06:00
Jaret Burkett
03bc431279
Fixed an issue training lumina 2
2025-06-24 10:29:47 -06:00
Jaret Burkett
8602470952
Updated diffusion feature extractor
2025-06-19 15:36:10 -06:00
Jaret Burkett
1cc663a664
Performance optimizations for pre processing the batch
2025-06-17 07:37:41 -06:00
Jaret Burkett
79499fa795
Allow fine tuning pruned versions of chroma. Allow flash attention 2 for chroma if it is installed.
2025-05-21 07:02:50 -06:00
Jaret Burkett
e5181d23cd
Added some experimental training techniques. Ignore for now. Still in testing.
2025-05-21 02:19:54 -06:00
Jaret Burkett
d9700bdb99
Added initial support for f-lite model
2025-05-01 11:15:18 -06:00
Jaret Burkett
5890e67a46
Various bug fixes
2025-04-29 09:30:33 -06:00
Jaret Burkett
2b4c525489
Reworked automagic optimizer and did more testing. Starting to really like it. Working well.
2025-04-28 08:01:10 -06:00
Jaret Burkett
88b3fbae37
Various experiments and minor bug fixes for edge cases
2025-04-25 13:44:38 -06:00
Jaret Burkett
77001ee77f
Upodate model tag on loras
2025-04-19 10:41:27 -06:00
Jaret Burkett
bfe29e2151
Removed all submodules. Submodule free now, yay.
2025-04-18 10:39:15 -06:00
Jaret Burkett
ca3ce0f34c
Make it easier to designate lora blocks for new models. Improve i2v adapter speed. Fix issue with i2v adapter where cached torch tensor was wrong range.
2025-04-13 13:49:13 -06:00
Jaret Burkett
96ba2fd129
Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose.
2025-04-09 13:35:04 -06:00
Jaret Burkett
a8680c75eb
Added initial support for finetuning wan i2v WIP
2025-04-07 20:34:38 -06:00
Jaret Burkett
77763a3e5c
Update divisiblity of SD3
2025-04-02 06:49:06 -06:00
Jaret Burkett
5ea19b6292
small bug fixes
2025-03-30 20:09:40 -06:00
Jaret Burkett
860d892214
Pixel shuffle adapter. Some bug fixes thrown in
2025-03-29 21:15:01 -06:00
Jaret Burkett
5365200da1
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
2025-03-27 16:07:00 -06:00
Jaret Burkett
45be82d5d6
Handle inpainting training for control_lora adapter
2025-03-24 13:17:47 -06:00
Jaret Burkett
f10937e6da
Handle multi control inputs for control lora training
2025-03-23 07:37:08 -06:00
Jaret Burkett
f5aa4232fa
Added ability to quantize with torchao
2025-03-20 16:28:54 -06:00
Jaret Burkett
3812957bc9
Added ability to train control loras. Other important bug fixes thrown in
2025-03-14 18:03:00 -06:00
Jaret Burkett
e6739f7eb2
Convert wan lora weights on save to be something comfy can handle
2025-03-08 12:55:11 -07:00
Jaret Burkett
4fe33f51c1
Fix issue with picking layers for quantization, adjust layers fo better quantization of cogview4
2025-03-05 13:44:40 -07:00
Jaret Burkett
6f6fb90812
Added cogview4. Loss still needs work.
2025-03-04 18:43:52 -07:00
Jaret Burkett
8bb47d1bfe
Merge branch 'main' into wan21
2025-03-04 00:31:57 -07:00
Jaret Burkett
c5e0c2bbe2
Fixes to allow for redux assisted training
2025-03-03 16:27:19 -07:00
Jaret Burkett
acc79956aa
WIP create new class to add new models more easily
2025-03-01 13:49:02 -07:00
Jaret Burkett
56d8d6bd81
Capture speed from the timer for the ui
2025-02-23 14:38:46 -07:00
Jaret Burkett
60f848a877
Send more data when loading the model to the ui
2025-02-23 12:49:54 -07:00
Jaret Burkett
adcf884c0f
Built out the ui trainer plugin with db comminication
2025-02-21 05:53:35 -07:00
Jaret Burkett
4af6c5cf30
Work on supporting flex.2 potential arch
2025-02-17 14:10:25 -07:00
Jaret Burkett
7679105d52
Added llm text encoder adapter
2025-02-13 08:28:32 -07:00
Jaret Burkett
2622de1e01
DFE tweaks. Adding support for more llms as text encoders
2025-02-13 04:31:49 -07:00
Jaret Burkett
9a7266275d
Wokr on lumina2
2025-02-08 14:52:39 -07:00
Jaret Burkett
d138f07365
Imitial lumina3 support
2025-02-08 10:59:53 -07:00
Jaret Burkett
216ab164ce
Experimental features and bug fixes
2025-02-04 13:36:34 -07:00
