Jaret Burkett
|
22cdfadab6
|
Added new timestep weighing strategy
|
2025-06-04 01:16:02 -06:00 |
|
Jaret Burkett
|
e5181d23cd
|
Added some experimental training techniques. Ignore for now. Still in testing.
|
2025-05-21 02:19:54 -06:00 |
|
Jaret Burkett
|
43cb5603ad
|
Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models
|
2025-05-07 12:06:30 -06:00 |
|
Jaret Burkett
|
88b3fbae37
|
Various experiments and minor bug fixes for edge cases
|
2025-04-25 13:44:38 -06:00 |
|
Jaret Burkett
|
c12036df95
|
Added ability to use short captions from json caption file
|
2025-04-16 08:32:28 -06:00 |
|
Jaret Burkett
|
d8bdc03256
|
Allow full control of caption extensions
|
2025-04-10 07:42:04 -06:00 |
|
Jaret Burkett
|
96ba2fd129
|
Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose.
|
2025-04-09 13:35:04 -06:00 |
|
Jaret Burkett
|
615b0d0e94
|
Added initial support for training i2v adapter WIP
|
2025-04-09 08:06:29 -06:00 |
|
Jaret Burkett
|
a8680c75eb
|
Added initial support for finetuning wan i2v WIP
|
2025-04-07 20:34:38 -06:00 |
|
Jaret Burkett
|
860d892214
|
Pixel shuffle adapter. Some bug fixes thrown in
|
2025-03-29 21:15:01 -06:00 |
|
Jaret Burkett
|
5365200da1
|
Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.
|
2025-03-27 16:07:00 -06:00 |
|
Jaret Burkett
|
ce4c5291a0
|
Added experimental wavelet loss
|
2025-03-26 18:11:23 -06:00 |
|
Jaret Burkett
|
6021a3dbc0
|
Change inpainting mask to zero out on latents instead of image for inpaint area.
|
2025-03-24 14:16:52 -06:00 |
|
Jaret Burkett
|
45be82d5d6
|
Handle inpainting training for control_lora adapter
|
2025-03-24 13:17:47 -06:00 |
|
Jaret Burkett
|
f10937e6da
|
Handle multi control inputs for control lora training
|
2025-03-23 07:37:08 -06:00 |
|
Jaret Burkett
|
f5aa4232fa
|
Added ability to quantize with torchao
|
2025-03-20 16:28:54 -06:00 |
|
Jaret Burkett
|
b829983b16
|
Added ability to load video datasets and train with them
|
2025-03-19 09:54:26 -06:00 |
|
Jaret Burkett
|
3812957bc9
|
Added ability to train control loras. Other important bug fixes thrown in
|
2025-03-14 18:03:00 -06:00 |
|
Jaret Burkett
|
386e68a422
|
Fixed a bug that changes all samples to webp
|
2025-03-08 18:02:56 -07:00 |
|
Jaret Burkett
|
391cf80fea
|
Added training for Wan2.1. Not finalized, wait.
|
2025-03-07 13:53:44 -07:00 |
|
Jaret Burkett
|
6f6fb90812
|
Added cogview4. Loss still needs work.
|
2025-03-04 18:43:52 -07:00 |
|
Jaret Burkett
|
8bb47d1bfe
|
Merge branch 'main' into wan21
|
2025-03-04 00:31:57 -07:00 |
|
Jaret Burkett
|
7ae31c9ae9
|
Added LoKr to the ui
|
2025-03-02 08:49:01 -07:00 |
|
Jaret Burkett
|
b16819f8e7
|
Added LoKr support
|
2025-03-02 06:57:50 -07:00 |
|
Jaret Burkett
|
acc79956aa
|
WIP create new class to add new models more easily
|
2025-03-01 13:49:02 -07:00 |
|
Jaret Burkett
|
f6e16e582a
|
Added Differential Output Preservation Loss to trainer and ui
|
2025-02-25 20:12:36 -07:00 |
|
Jaret Burkett
|
b366e46f1c
|
Added more settings to the training config
|
2025-02-23 12:34:52 -07:00 |
|
Jaret Burkett
|
4af6c5cf30
|
Work on supporting flex.2 potential arch
|
2025-02-17 14:10:25 -07:00 |
|
Jaret Burkett
|
87e557cf1e
|
Bug fixes and improvements to llmadapter
|
2025-02-15 07:18:07 -07:00 |
|
Jaret Burkett
|
bd8d7dc081
|
fixed various issues with llm attention masking. Added block training on the llm adapter.
|
2025-02-14 11:24:01 -07:00 |
|
Jaret Burkett
|
2622de1e01
|
DFE tweaks. Adding support for more llms as text encoders
|
2025-02-13 04:31:49 -07:00 |
|
Jaret Burkett
|
0b8a32def7
|
merged in lumina2 branch
|
2025-02-12 09:33:03 -07:00 |
|
Jaret Burkett
|
787bb37e76
|
Small fixed for DFE, polar guidance, and other things
|
2025-02-12 09:27:44 -07:00 |
|
Jaret Burkett
|
d138f07365
|
Imitial lumina3 support
|
2025-02-08 10:59:53 -07:00 |
|
Jaret Burkett
|
c6d8eedb94
|
Added ability to use consistent noise for each image in a dataset by hashing the path and using that as a seed.
|
2025-02-08 07:13:48 -07:00 |
|
Jaret Burkett
|
216ab164ce
|
Experimental features and bug fixes
|
2025-02-04 13:36:34 -07:00 |
|
Jaret Burkett
|
04abe57c76
|
Added weighing to DFE
|
2025-01-22 08:50:57 -07:00 |
|
Jaret Burkett
|
89dd041b97
|
Added ability to pair samples with a closer noise with optimal_noise_pairing_samples
|
2025-01-21 18:30:10 -07:00 |
|
Jaret Burkett
|
29122b1a54
|
Added code to handle diffusion feature extraction loss
|
2025-01-21 14:21:34 -07:00 |
|
Jaret Burkett
|
fadb2f3a76
|
Allow quantizing the te independently on flux. added lognorm_blend timestep schedule
|
2025-01-18 18:02:31 -07:00 |
|
Jaret Burkett
|
4723f23c0d
|
Added ability to split up flux across gpus (experimental). Changed the way timestep scheduling works to prep for more specific schedules.
|
2024-12-31 07:06:55 -07:00 |
|
Jaret Burkett
|
8ef07a9c36
|
Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications
|
2024-12-15 08:59:27 -07:00 |
|
Jaret Burkett
|
96d418bb95
|
Added support for full finetuning flux with randomized param activation. Examples coming soon
|
2024-11-21 13:05:32 -07:00 |
|
Jaret Burkett
|
4aa19b5c1d
|
Only quantize flux T5 is also quantizing model. Load TE from original name and path if fine tuning.
|
2024-10-29 14:25:31 -06:00 |
|
Jaret Burkett
|
22cd40d7b9
|
Improvements for full tuning flux. Added debugging launch config for vscode
|
2024-10-29 04:54:08 -06:00 |
|
Jaret Burkett
|
9f94c7b61e
|
Added experimental param multiplier to the ema module
|
2024-10-22 09:25:52 -06:00 |
|
Jaret Burkett
|
3922981996
|
Added some additional experimental things to the vision direct encoder
|
2024-10-10 19:42:26 +00:00 |
|
Jaret Burkett
|
a800c9d19e
|
Add a method to have an inference only lora
|
2024-10-04 10:06:53 -06:00 |
|
Jaret Burkett
|
67e0aca750
|
Added ability to load clip pairs randomly from folder. Other small bug fixes
|
2024-10-03 10:03:49 -06:00 |
|
Jaret Burkett
|
e4c82803e1
|
Handle random resizing for pixtral input on direct vision adapter
|
2024-09-28 14:53:38 -06:00 |
|