Jaret Burkett
|
9beea1c268
|
Flux training should work now... maybe
|
2024-08-03 09:17:34 -06:00 |
|
Jaret Burkett
|
47744373f2
|
Change img multiplier math
|
2024-07-30 11:33:41 -06:00 |
|
Jaret Burkett
|
443c996e7f
|
Do a noisy unconsitional for vision direct
|
2024-07-29 15:42:26 -06:00 |
|
Jaret Burkett
|
e81e19fd0f
|
Added target_norm_std which is a game changer
|
2024-07-28 16:08:33 -06:00 |
|
Jaret Burkett
|
80aa2dbb80
|
New image generation img2img. various tweaks and fixes
|
2024-07-24 04:13:41 -06:00 |
|
Jaret Burkett
|
8d799031cf
|
Remove reg as prior pred
|
2024-07-21 02:34:12 -06:00 |
|
Jaret Burkett
|
22d2f6e28f
|
Fixed issue with grad scaling
|
2024-07-20 08:21:57 -06:00 |
|
Jaret Burkett
|
11e426fdf1
|
Various features and fixes. Too much brain fog to do a proper description
|
2024-07-18 07:34:14 -06:00 |
|
Jaret Burkett
|
e4558dff4b
|
Partial implementation for training auraflow.
|
2024-07-12 12:11:38 -06:00 |
|
Jaret Burkett
|
c062b7716c
|
Varous bug fixes
|
2024-07-10 15:20:04 -06:00 |
|
Jaret Burkett
|
603ceca3ca
|
added ema
|
2024-06-28 10:03:26 -06:00 |
|
Jaret Burkett
|
657fd09f25
|
Added more control over Sigma sizes
|
2024-06-26 08:57:53 -06:00 |
|
Jaret Burkett
|
37cebd9458
|
WIP Ilora
|
2024-06-14 09:31:01 -06:00 |
|
Jaret Burkett
|
bd10d2d668
|
Some work on sd3 training. Not working
|
2024-06-13 12:19:16 -06:00 |
|
Jaret Burkett
|
cb5d28cba9
|
Added working ilora trainer
|
2024-06-12 09:33:45 -06:00 |
|
Jaret Burkett
|
3f3636b788
|
Bug fixes and little improvements here and there.
|
2024-06-08 06:24:20 -06:00 |
|
Jaret Burkett
|
833c833f28
|
WIP on SAFE encoder. Work on fp16 training improvements. Various other tweaks and improvements
|
2024-05-27 10:50:24 -06:00 |
|
Jaret Burkett
|
68b7e159bc
|
Bug Fixes
|
2024-05-17 08:41:20 -06:00 |
|
Jaret Burkett
|
5a45c709cd
|
Work on ipadapters and custom adapters
|
2024-05-13 06:37:54 -06:00 |
|
Jaret Burkett
|
10e1ecf1e8
|
Added single value adapter training
|
2024-04-28 06:04:47 -06:00 |
|
Jaret Burkett
|
5a70b7f38d
|
Added pixart sigma support, but it wont work until i address breaking changes with lora code in diffusers so it can be upgraded.
|
2024-04-20 10:46:56 -06:00 |
|
Jaret Burkett
|
377b81ee3e
|
Adjustments to guidance
|
2024-04-19 15:00:35 -06:00 |
|
Jaret Burkett
|
2d0a1be59d
|
Bug fixes
|
2024-04-16 03:48:13 -06:00 |
|
Jaret Burkett
|
7284aab7c0
|
Added specialized scaler training to ip adapters
|
2024-04-05 08:17:09 -06:00 |
|
Jaret Burkett
|
427847ac4c
|
Small tweaks and fixes for specialized ip adapter training
|
2024-03-26 11:35:26 -06:00 |
|
Jaret Burkett
|
016687bda1
|
Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.
|
2024-03-17 10:21:47 -06:00 |
|
Jaret Burkett
|
72de68d8aa
|
WIP on clip vision encoder
|
2024-03-13 07:24:08 -06:00 |
|
Jaret Burkett
|
f1cb87fe9e
|
fixed bug the kept learning rates the same
|
2024-03-06 09:23:32 -07:00 |
|
Jaret Burkett
|
b01e8d889a
|
Added stochastic rounding to adafactor. ILora adjustments
|
2024-03-05 07:07:09 -07:00 |
|
Jaret Burkett
|
337945de9a
|
Added this not that guidance. Added ability to replace prompts.
|
2024-02-28 20:10:14 -07:00 |
|
Jaret Burkett
|
1bd94f0f01
|
Added early DoRA support, but will change shortly. Dont use right now.
|
2024-02-23 05:55:41 -07:00 |
|
Jaret Burkett
|
9ffa8c3711
|
Fixed issue when there is no adapter
|
2024-02-22 02:59:59 -07:00 |
|
Jaret Burkett
|
b68c3ef734
|
Added te aug adapter
|
2024-02-21 21:30:26 -07:00 |
|
Jaret Burkett
|
49c41e6a5f
|
Bug fixes. allow for random negative prompts
|
2024-02-21 04:51:52 -07:00 |
|
Jaret Burkett
|
2478554c95
|
Bug fixes. Added IP adapter training for Pixart
|
2024-02-17 10:06:57 -07:00 |
|
Jaret Burkett
|
93b52932c1
|
Added training for pixart-a
|
2024-02-13 16:00:04 -07:00 |
|
Jaret Burkett
|
4ec4025cbb
|
Added adapter modules for text encoders and direct vision
|
2024-02-12 08:46:18 -07:00 |
|
Jaret Burkett
|
e074058faa
|
Work on additional image embedding methods. Finalized zipper resampler. It works amazing
|
2024-02-10 09:00:05 -07:00 |
|
Jaret Burkett
|
e18e0cb5f8
|
Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction
|
2024-02-05 07:40:03 -07:00 |
|
Jaret Burkett
|
177c7130ec
|
improved correction of pred norm by targeting the prior
|
2024-02-01 06:31:04 -07:00 |
|
Jaret Burkett
|
1ae1017748
|
Bug fixes. added ability to use l1 loss. varous other tests and improvements
|
2024-01-31 06:30:54 -07:00 |
|
Jaret Burkett
|
92b9c71d44
|
Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs
|
2024-01-28 08:20:03 -07:00 |
|
Jaret Burkett
|
f17ad8d794
|
various bug fixes. Created an contextual alpha mask module to calculate alpha mask
|
2024-01-18 16:34:27 -07:00 |
|
Jaret Burkett
|
eebd3c8212
|
Initial training script for photomaker training. Needs a little more work.
|
2024-01-15 18:46:26 -07:00 |
|
Jaret Burkett
|
5276975fb0
|
Added additional config options for custom plugins I needed
|
2024-01-15 08:31:09 -07:00 |
|
Jaret Burkett
|
290393f7ae
|
Imporvements to ip weight adaptation. Bug fixes. Added masking to direct guidance loss. Allow importing a file for random triggers. Handle bas meta images with improper sizing.
|
2024-01-11 12:22:16 -07:00 |
|
Jaret Burkett
|
645b27f97a
|
Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.
|
2024-01-04 12:59:38 -07:00 |
|
Jaret Burkett
|
65c08b09c3
|
Added ability to do cfg during training. Various bug fixes
|
2024-01-02 11:29:57 -07:00 |
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
Jaret Burkett
|
bafacf3b65
|
Initial commit
|
2023-12-29 13:07:35 -07:00 |
|