Jaret Burkett
171535833a
Add Mac OS support for Apple Silicon ( #770 )
...
* Made an install script and auto updates env for mac
* GPU sensors and initial training working for MAC. Still WIP.
* Switch dataloader to single threaded until I can work around some mac pickeling issues.
* Get quantization working on mac
* Fix mac exclusive imports so they don't break other builds.
* Add mac instructions to the UI
2026-03-30 09:37:47 -06:00
Jaret Burkett
5642b656b9
Fix audio issues with ltx2 models. Silent codec fails now raised. Auto convert surround sound audio to stereo. Invalidate old caches just to be safe so they recache now.
2026-03-23 20:08:33 +00:00
Jaret Burkett
1ce2428722
Shrink text embeds to max token length for LTX-2. Drastically reduces cached text embedding sizes
2026-01-28 12:54:49 -07:00
Jaret Burkett
73dedbf662
Do caching of latents, first frame and audio when caching latents for LTX2
2026-01-14 11:05:23 -07:00
Jaret Burkett
5b5aadadb8
Add LTX-2 Support ( #644 )
...
* WIP, adding support for LTX2
* Training on images working
* Fix loading comfy models
* Handle converting and deconverting lora so it matches original format
* Reworked ui to habdle ltx and propert dataset default overwriting.
* Update the way lokr saves to it is more compatable with comfy
* Audio loading and synchronization/resampling is working
* Add audio to training. Does it work? Maybe, still testing.
* Fixed fps default issue for sound
* Have ui set fps for accurate audio mapping on ltx
* Added audio procession options to the ui for ltx
* Clean up requirements
2026-01-13 04:55:30 -07:00
Jaret Burkett
2e7b2d9926
Added Differential Guidance training target
2025-11-10 09:38:25 -07:00
Jaret Burkett
ff14cd6343
Fix check for making sure vae is on the right device.
2025-10-21 14:49:20 -06:00
Jaret Burkett
4e5707854f
Initial support for RamTorch. Still a WIP
2025-10-05 13:03:26 -06:00
Jaret Burkett
3086a58e5b
git status
2025-10-01 14:12:17 -06:00
Jaret Burkett
454be0958a
Initial support for qwen image edit plus
2025-09-24 11:39:10 -06:00
Jaret Burkett
ea01a1c7d0
Fixed a bug where samples would fail if merging in lora on sampling for unquantized models. Quantize non ARA modules as uint8 when using an ARA
2025-08-25 09:21:40 -06:00
Jaret Burkett
bf2700f7be
Initial support for finetuning qwen image. Will only work with caching for now, need to add controls everywhere.
2025-08-21 16:41:17 -06:00
Jaret Burkett
8ea2cf00f6
Added training to the ui. Still testing, but everything seems to be working.
2025-08-16 05:51:37 -06:00
Jaret Burkett
bb6db3d635
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
2025-08-07 10:27:55 -06:00
Jaret Burkett
f453e28ea3
Fixed deprecation of lumina pipeline error
2025-07-29 08:26:51 -06:00
Jaret Burkett
77dc38a574
Some work on caching text embeddings
2025-07-26 09:22:04 -06:00
Jaret Burkett
03bc431279
Fixed an issue training lumina 2
2025-06-24 10:29:47 -06:00
Jaret Burkett
8602470952
Updated diffusion feature extractor
2025-06-19 15:36:10 -06:00
Jaret Burkett
1cc663a664
Performance optimizations for pre processing the batch
2025-06-17 07:37:41 -06:00
Jaret Burkett
79499fa795
Allow fine tuning pruned versions of chroma. Allow flash attention 2 for chroma if it is installed.
2025-05-21 07:02:50 -06:00
Jaret Burkett
e5181d23cd
Added some experimental training techniques. Ignore for now. Still in testing.
2025-05-21 02:19:54 -06:00
Jaret Burkett
d9700bdb99
Added initial support for f-lite model
2025-05-01 11:15:18 -06:00
Jaret Burkett
5890e67a46
Various bug fixes
2025-04-29 09:30:33 -06:00
Jaret Burkett
2b4c525489
Reworked automagic optimizer and did more testing. Starting to really like it. Working well.
2025-04-28 08:01:10 -06:00
Jaret Burkett
88b3fbae37
Various experiments and minor bug fixes for edge cases
2025-04-25 13:44:38 -06:00
Jaret Burkett
77001ee77f
Upodate model tag on loras
2025-04-19 10:41:27 -06:00
Jaret Burkett
bfe29e2151
Removed all submodules. Submodule free now, yay.
2025-04-18 10:39:15 -06:00
Jaret Burkett
ca3ce0f34c
Make it easier to designate lora blocks for new models. Improve i2v adapter speed. Fix issue with i2v adapter where cached torch tensor was wrong range.
2025-04-13 13:49:13 -06:00
Jaret Burkett
96ba2fd129
Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose.
2025-04-09 13:35:04 -06:00
Jaret Burkett
a8680c75eb
Added initial support for finetuning wan i2v WIP
2025-04-07 20:34:38 -06:00
Jaret Burkett
77763a3e5c
Update divisiblity of SD3
2025-04-02 06:49:06 -06:00
Jaret Burkett
5ea19b6292
small bug fixes
2025-03-30 20:09:40 -06:00
Jaret Burkett
860d892214
Pixel shuffle adapter. Some bug fixes thrown in
2025-03-29 21:15:01 -06:00
Jaret Burkett
5365200da1
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
2025-03-27 16:07:00 -06:00
Jaret Burkett
45be82d5d6
Handle inpainting training for control_lora adapter
2025-03-24 13:17:47 -06:00
Jaret Burkett
f10937e6da
Handle multi control inputs for control lora training
2025-03-23 07:37:08 -06:00
Jaret Burkett
f5aa4232fa
Added ability to quantize with torchao
2025-03-20 16:28:54 -06:00
Jaret Burkett
3812957bc9
Added ability to train control loras. Other important bug fixes thrown in
2025-03-14 18:03:00 -06:00
Jaret Burkett
e6739f7eb2
Convert wan lora weights on save to be something comfy can handle
2025-03-08 12:55:11 -07:00
Jaret Burkett
4fe33f51c1
Fix issue with picking layers for quantization, adjust layers fo better quantization of cogview4
2025-03-05 13:44:40 -07:00
Jaret Burkett
6f6fb90812
Added cogview4. Loss still needs work.
2025-03-04 18:43:52 -07:00
Jaret Burkett
8bb47d1bfe
Merge branch 'main' into wan21
2025-03-04 00:31:57 -07:00
Jaret Burkett
c5e0c2bbe2
Fixes to allow for redux assisted training
2025-03-03 16:27:19 -07:00
Jaret Burkett
acc79956aa
WIP create new class to add new models more easily
2025-03-01 13:49:02 -07:00
Jaret Burkett
56d8d6bd81
Capture speed from the timer for the ui
2025-02-23 14:38:46 -07:00
Jaret Burkett
60f848a877
Send more data when loading the model to the ui
2025-02-23 12:49:54 -07:00
Jaret Burkett
adcf884c0f
Built out the ui trainer plugin with db comminication
2025-02-21 05:53:35 -07:00
Jaret Burkett
4af6c5cf30
Work on supporting flex.2 potential arch
2025-02-17 14:10:25 -07:00
Jaret Burkett
7679105d52
Added llm text encoder adapter
2025-02-13 08:28:32 -07:00
Jaret Burkett
2622de1e01
DFE tweaks. Adding support for more llms as text encoders
2025-02-13 04:31:49 -07:00
