Jaret Burkett
|
bb6db3d635
|
Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized
|
2025-08-07 10:27:55 -06:00 |
|
Jaret Burkett
|
f453e28ea3
|
Fixed deprecation of lumina pipeline error
|
2025-07-29 08:26:51 -06:00 |
|
Jaret Burkett
|
77dc38a574
|
Some work on caching text embeddings
|
2025-07-26 09:22:04 -06:00 |
|
Jaret Burkett
|
03bc431279
|
Fixed an issue training lumina 2
|
2025-06-24 10:29:47 -06:00 |
|
Jaret Burkett
|
8602470952
|
Updated diffusion feature extractor
|
2025-06-19 15:36:10 -06:00 |
|
Jaret Burkett
|
1cc663a664
|
Performance optimizations for pre processing the batch
|
2025-06-17 07:37:41 -06:00 |
|
Jaret Burkett
|
79499fa795
|
Allow fine tuning pruned versions of chroma. Allow flash attention 2 for chroma if it is installed.
|
2025-05-21 07:02:50 -06:00 |
|
Jaret Burkett
|
e5181d23cd
|
Added some experimental training techniques. Ignore for now. Still in testing.
|
2025-05-21 02:19:54 -06:00 |
|
Jaret Burkett
|
d9700bdb99
|
Added initial support for f-lite model
|
2025-05-01 11:15:18 -06:00 |
|
Jaret Burkett
|
5890e67a46
|
Various bug fixes
|
2025-04-29 09:30:33 -06:00 |
|
Jaret Burkett
|
2b4c525489
|
Reworked automagic optimizer and did more testing. Starting to really like it. Working well.
|
2025-04-28 08:01:10 -06:00 |
|
Jaret Burkett
|
88b3fbae37
|
Various experiments and minor bug fixes for edge cases
|
2025-04-25 13:44:38 -06:00 |
|
Jaret Burkett
|
77001ee77f
|
Upodate model tag on loras
|
2025-04-19 10:41:27 -06:00 |
|
Jaret Burkett
|
bfe29e2151
|
Removed all submodules. Submodule free now, yay.
|
2025-04-18 10:39:15 -06:00 |
|
Jaret Burkett
|
ca3ce0f34c
|
Make it easier to designate lora blocks for new models. Improve i2v adapter speed. Fix issue with i2v adapter where cached torch tensor was wrong range.
|
2025-04-13 13:49:13 -06:00 |
|
Jaret Burkett
|
96ba2fd129
|
Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose.
|
2025-04-09 13:35:04 -06:00 |
|
Jaret Burkett
|
a8680c75eb
|
Added initial support for finetuning wan i2v WIP
|
2025-04-07 20:34:38 -06:00 |
|
Jaret Burkett
|
77763a3e5c
|
Update divisiblity of SD3
|
2025-04-02 06:49:06 -06:00 |
|
Jaret Burkett
|
5ea19b6292
|
small bug fixes
|
2025-03-30 20:09:40 -06:00 |
|
Jaret Burkett
|
860d892214
|
Pixel shuffle adapter. Some bug fixes thrown in
|
2025-03-29 21:15:01 -06:00 |
|
Jaret Burkett
|
5365200da1
|
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
|
2025-03-27 16:07:00 -06:00 |
|
Jaret Burkett
|
45be82d5d6
|
Handle inpainting training for control_lora adapter
|
2025-03-24 13:17:47 -06:00 |
|
Jaret Burkett
|
f10937e6da
|
Handle multi control inputs for control lora training
|
2025-03-23 07:37:08 -06:00 |
|
Jaret Burkett
|
f5aa4232fa
|
Added ability to quantize with torchao
|
2025-03-20 16:28:54 -06:00 |
|
Jaret Burkett
|
3812957bc9
|
Added ability to train control loras. Other important bug fixes thrown in
|
2025-03-14 18:03:00 -06:00 |
|
Jaret Burkett
|
e6739f7eb2
|
Convert wan lora weights on save to be something comfy can handle
|
2025-03-08 12:55:11 -07:00 |
|
Jaret Burkett
|
4fe33f51c1
|
Fix issue with picking layers for quantization, adjust layers fo better quantization of cogview4
|
2025-03-05 13:44:40 -07:00 |
|
Jaret Burkett
|
6f6fb90812
|
Added cogview4. Loss still needs work.
|
2025-03-04 18:43:52 -07:00 |
|
Jaret Burkett
|
8bb47d1bfe
|
Merge branch 'main' into wan21
|
2025-03-04 00:31:57 -07:00 |
|
Jaret Burkett
|
c5e0c2bbe2
|
Fixes to allow for redux assisted training
|
2025-03-03 16:27:19 -07:00 |
|
Jaret Burkett
|
acc79956aa
|
WIP create new class to add new models more easily
|
2025-03-01 13:49:02 -07:00 |
|
Jaret Burkett
|
56d8d6bd81
|
Capture speed from the timer for the ui
|
2025-02-23 14:38:46 -07:00 |
|
Jaret Burkett
|
60f848a877
|
Send more data when loading the model to the ui
|
2025-02-23 12:49:54 -07:00 |
|
Jaret Burkett
|
adcf884c0f
|
Built out the ui trainer plugin with db comminication
|
2025-02-21 05:53:35 -07:00 |
|
Jaret Burkett
|
4af6c5cf30
|
Work on supporting flex.2 potential arch
|
2025-02-17 14:10:25 -07:00 |
|
Jaret Burkett
|
7679105d52
|
Added llm text encoder adapter
|
2025-02-13 08:28:32 -07:00 |
|
Jaret Burkett
|
2622de1e01
|
DFE tweaks. Adding support for more llms as text encoders
|
2025-02-13 04:31:49 -07:00 |
|
Jaret Burkett
|
9a7266275d
|
Wokr on lumina2
|
2025-02-08 14:52:39 -07:00 |
|
Jaret Burkett
|
d138f07365
|
Imitial lumina3 support
|
2025-02-08 10:59:53 -07:00 |
|
Jaret Burkett
|
216ab164ce
|
Experimental features and bug fixes
|
2025-02-04 13:36:34 -07:00 |
|
Jaret Burkett
|
e6180d1e1d
|
Bug fixes
|
2025-01-31 13:23:01 -07:00 |
|
Jaret Burkett
|
15a57bc89f
|
Add new version of DFE. Kitchen sink
|
2025-01-31 11:42:27 -07:00 |
|
Jaret Burkett
|
34a1c6947a
|
Added flux_shift as timestep type
|
2025-01-27 07:35:00 -07:00 |
|
Jaret Burkett
|
5e663746b8
|
Working multi gpu training. Still need a lot of tweaks and testing.
|
2025-01-25 16:46:20 -07:00 |
|
Jaret Burkett
|
fadb2f3a76
|
Allow quantizing the te independently on flux. added lognorm_blend timestep schedule
|
2025-01-18 18:02:31 -07:00 |
|
Jaret Burkett
|
4723f23c0d
|
Added ability to split up flux across gpus (experimental). Changed the way timestep scheduling works to prep for more specific schedules.
|
2024-12-31 07:06:55 -07:00 |
|
Jaret Burkett
|
8ef07a9c36
|
Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications
|
2024-12-15 08:59:27 -07:00 |
|
Jaret Burkett
|
6509ba4484
|
Fix seed generation to make it deterministic so it is consistant from gpu to gpu
|
2024-11-15 12:11:13 -07:00 |
|
Jaret Burkett
|
4aa19b5c1d
|
Only quantize flux T5 is also quantizing model. Load TE from original name and path if fine tuning.
|
2024-10-29 14:25:31 -06:00 |
|
Jaret Burkett
|
22cd40d7b9
|
Improvements for full tuning flux. Added debugging launch config for vscode
|
2024-10-29 04:54:08 -06:00 |
|