Jaret Burkett
|
4747716867
|
Fixed issue with adapters not providing gradients with new grad activator
|
2024-10-29 14:22:10 -06:00 |
|
Jaret Burkett
|
7d9ab22405
|
Rework ip adapter and vision direct adapters to apply to the single transformer blocks even though they are not cross attn.
|
2024-09-01 10:40:42 -06:00 |
|
Jaret Burkett
|
60232def91
|
Made peleminary arch for flux ip adapter training
|
2024-08-28 08:55:39 -06:00 |
|
Jaret Burkett
|
338c77d677
|
Fixed breaking change with diffusers. Allow flowmatch on normal stable diffusion models.
|
2024-08-22 14:36:22 -06:00 |
|
Jaret Burkett
|
a939cf3730
|
WIP - adding support for flux DoRA and ip adapter training
|
2024-08-22 04:36:39 -06:00 |
|
Jaret Burkett
|
11e426fdf1
|
Various features and fixes. Too much brain fog to do a proper description
|
2024-07-18 07:34:14 -06:00 |
|
Jaret Burkett
|
c062b7716c
|
Varous bug fixes
|
2024-07-10 15:20:04 -06:00 |
|
Jaret Burkett
|
f6b21f47bb
|
Increased the number of heads for ip adapters.
|
2024-06-28 16:09:52 +00:00 |
|
Jaret Burkett
|
7165f2d25a
|
Work to omprove pixart training
|
2024-06-23 20:46:48 +00:00 |
|
Jaret Burkett
|
833c833f28
|
WIP on SAFE encoder. Work on fp16 training improvements. Various other tweaks and improvements
|
2024-05-27 10:50:24 -06:00 |
|
Jaret Burkett
|
5a45c709cd
|
Work on ipadapters and custom adapters
|
2024-05-13 06:37:54 -06:00 |
|
Jaret Burkett
|
5da3613e0b
|
Bug fixes and minor features
|
2024-04-25 06:14:31 -06:00 |
|
Jaret Burkett
|
2d0a1be59d
|
Bug fixes
|
2024-04-16 03:48:13 -06:00 |
|
Jaret Burkett
|
7284aab7c0
|
Added specialized scaler training to ip adapters
|
2024-04-05 08:17:09 -06:00 |
|
Jaret Burkett
|
427847ac4c
|
Small tweaks and fixes for specialized ip adapter training
|
2024-03-26 11:35:26 -06:00 |
|
Jaret Burkett
|
d87b49882c
|
Work on embedding adapters
|
2024-03-11 15:18:42 -06:00 |
|
Jaret Burkett
|
b0a0f28191
|
Bug fixes
|
2024-02-25 08:28:29 -07:00 |
|
Jaret Burkett
|
49c41e6a5f
|
Bug fixes. allow for random negative prompts
|
2024-02-21 04:51:52 -07:00 |
|
Jaret Burkett
|
2478554c95
|
Bug fixes. Added IP adapter training for Pixart
|
2024-02-17 10:06:57 -07:00 |
|
Jaret Burkett
|
e074058faa
|
Work on additional image embedding methods. Finalized zipper resampler. It works amazing
|
2024-02-10 09:00:05 -07:00 |
|
Jaret Burkett
|
a8481c1670
|
randomly adjust scale of unconditional noise on ip adapters if training with cfg
|
2024-02-06 03:44:54 -07:00 |
|
Jaret Burkett
|
e18e0cb5f8
|
Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction
|
2024-02-05 07:40:03 -07:00 |
|
Jaret Burkett
|
1ae1017748
|
Bug fixes. added ability to use l1 loss. varous other tests and improvements
|
2024-01-31 06:30:54 -07:00 |
|
Jaret Burkett
|
92b9c71d44
|
Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs
|
2024-01-28 08:20:03 -07:00 |
|
Jaret Burkett
|
e190fbaeb8
|
Prepwork for ilora
|
2024-01-12 06:41:15 -07:00 |
|
Jaret Burkett
|
290393f7ae
|
Imporvements to ip weight adaptation. Bug fixes. Added masking to direct guidance loss. Allow importing a file for random triggers. Handle bas meta images with improper sizing.
|
2024-01-11 12:22:16 -07:00 |
|
Jaret Burkett
|
b2a54c8f36
|
Added siglip support
|
2024-01-09 20:52:21 -07:00 |
|
Jaret Burkett
|
b767d29b3c
|
Adjustments to the clip preprocessor. Allow merging in new weights for ip adapters so you can change the arcitecture while maintaining as much data as possible
|
2024-01-06 11:56:53 -07:00 |
|
Jaret Burkett
|
645b27f97a
|
Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.
|
2024-01-04 12:59:38 -07:00 |
|
Jaret Burkett
|
65c08b09c3
|
Added ability to do cfg during training. Various bug fixes
|
2024-01-02 11:29:57 -07:00 |
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
Jaret Burkett
|
0892dec4a5
|
Fixed some new bugs i added. woops
|
2023-12-28 14:03:42 -07:00 |
|
Jaret Burkett
|
eeee4a1620
|
Created a size agnostic feature encoder (SAFE) model to be trained in replace of CLIP for ip adapters. It is mostly conv layers so will hopefully be able to handle facial features better than clip can. Also bug fixes
|
2023-12-28 12:20:27 -07:00 |
|
Jaret Burkett
|
0f8daa5612
|
Bug fixes, work on maing IP adapters more customizable.
|
2023-12-24 08:32:39 -07:00 |
|
Jaret Burkett
|
7703e3a15e
|
Fixes for sdxl ip adapter training. Bug fixes
|
2023-12-21 11:15:58 -07:00 |
|
Jaret Burkett
|
0f597f453e
|
Switched ip adapter dataloader to clip_image paths so the control paths can be used for training assistant adapters while training ip adapters
|
2023-12-20 10:32:24 -07:00 |
|
Jaret Burkett
|
dfb64b5957
|
Allow ip adapters to be much more variable in their creation
|
2023-12-20 06:18:33 -07:00 |
|
Jaret Burkett
|
82098e5d6e
|
Added more functionality for ip adapters
|
2023-12-19 09:54:56 -07:00 |
|
Jaret Burkett
|
b653906715
|
Fixed ip adapter training. Works now
|
2023-12-17 08:22:59 -07:00 |
|
Jaret Burkett
|
830e87cb87
|
Added IP adapter training. Not functioning correctly yet
|
2023-09-24 02:39:43 -06:00 |
|