Jaret Burkett
|
272c8608c2
|
Make a CFG version of flux pipeline
|
2024-08-05 16:35:53 -06:00 |
|
Jaret Burkett
|
187663ab55
|
Use peft format for flux loras so they are compatible with diffusers. allow loading an assistant lora
|
2024-08-05 14:34:37 -06:00 |
|
Jaret Burkett
|
edb7e827ee
|
Adjusted flow matching so target noise multiplier works properly with it.
|
2024-08-05 11:40:05 -06:00 |
|
Jaret Burkett
|
0ea27011d5
|
Bug fix
|
2024-08-04 11:07:19 -06:00 |
|
Jaret Burkett
|
f321de7bdb
|
Setup to retrain guidance embedding for flux. Use defualt timestep distribution for flux
|
2024-08-04 10:37:23 -06:00 |
|
Jaret Burkett
|
9beea1c268
|
Flux training should work now... maybe
|
2024-08-03 09:17:34 -06:00 |
|
Jaret Burkett
|
369aa143bc
|
Only train a few blocks on flux (for now)
|
2024-08-03 07:02:27 -06:00 |
|
Jaret Burkett
|
87ba867fdc
|
Added flux training. Still a WIP. Wont train right without rectified flow working right
|
2024-08-02 15:00:30 -06:00 |
|
Jaret Burkett
|
e81e19fd0f
|
Added target_norm_std which is a game changer
|
2024-07-28 16:08:33 -06:00 |
|
Jaret Burkett
|
0bc4d555c7
|
A lot of pixart sigma training tweaks
|
2024-07-28 11:23:18 -06:00 |
|
Jaret Burkett
|
11e426fdf1
|
Various features and fixes. Too much brain fog to do a proper description
|
2024-07-18 07:34:14 -06:00 |
|
Jaret Burkett
|
e4558dff4b
|
Partial implementation for training auraflow.
|
2024-07-12 12:11:38 -06:00 |
|
Jaret Burkett
|
045e4a6e15
|
Save entire pixart model again
|
2024-07-07 07:56:48 -06:00 |
|
Jaret Burkett
|
cab8a1c7b8
|
WIP to add the caption_proj weight to pixart sigma TE adapter
|
2024-07-06 13:00:21 -06:00 |
|
Jaret Burkett
|
657fd09f25
|
Added more control over Sigma sizes
|
2024-06-26 08:57:53 -06:00 |
|
Jaret Burkett
|
7165f2d25a
|
Work to omprove pixart training
|
2024-06-23 20:46:48 +00:00 |
|
Jaret Burkett
|
5d47244c57
|
Added support for pixart sigma loras
|
2024-06-16 11:56:30 -06:00 |
|
Jaret Burkett
|
696f73c30d
|
Removed variant
|
2024-06-14 17:09:47 -06:00 |
|
Jaret Burkett
|
37cebd9458
|
WIP Ilora
|
2024-06-14 09:31:01 -06:00 |
|
Jaret Burkett
|
bd10d2d668
|
Some work on sd3 training. Not working
|
2024-06-13 12:19:16 -06:00 |
|
Jaret Burkett
|
3f3636b788
|
Bug fixes and little improvements here and there.
|
2024-06-08 06:24:20 -06:00 |
|
Jaret Burkett
|
68b7e159bc
|
Bug Fixes
|
2024-05-17 08:41:20 -06:00 |
|
Jaret Burkett
|
10e1ecf1e8
|
Added single value adapter training
|
2024-04-28 06:04:47 -06:00 |
|
Jaret Burkett
|
b96913d73c
|
Improvements to dataloader
|
2024-04-27 09:28:28 -06:00 |
|
Jaret Burkett
|
5da3613e0b
|
Bug fixes and minor features
|
2024-04-25 06:14:31 -06:00 |
|
Jaret Burkett
|
5a70b7f38d
|
Added pixart sigma support, but it wont work until i address breaking changes with lora code in diffusers so it can be upgraded.
|
2024-04-20 10:46:56 -06:00 |
|
Jaret Burkett
|
7284aab7c0
|
Added specialized scaler training to ip adapters
|
2024-04-05 08:17:09 -06:00 |
|
Jaret Burkett
|
427847ac4c
|
Small tweaks and fixes for specialized ip adapter training
|
2024-03-26 11:35:26 -06:00 |
|
Jaret Burkett
|
016687bda1
|
Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.
|
2024-03-17 10:21:47 -06:00 |
|
Jaret Burkett
|
72de68d8aa
|
WIP on clip vision encoder
|
2024-03-13 07:24:08 -06:00 |
|
Jaret Burkett
|
337945de9a
|
Added this not that guidance. Added ability to replace prompts.
|
2024-02-28 20:10:14 -07:00 |
|
Jaret Burkett
|
561914d8e6
|
Removed old code for fixing multistep sampler that is no longer needed
|
2024-02-25 11:53:35 -07:00 |
|
Jaret Burkett
|
b68c3ef734
|
Added te aug adapter
|
2024-02-21 21:30:26 -07:00 |
|
Jaret Burkett
|
49c41e6a5f
|
Bug fixes. allow for random negative prompts
|
2024-02-21 04:51:52 -07:00 |
|
Jaret Burkett
|
2478554c95
|
Bug fixes. Added IP adapter training for Pixart
|
2024-02-17 10:06:57 -07:00 |
|
Jaret Burkett
|
93b52932c1
|
Added training for pixart-a
|
2024-02-13 16:00:04 -07:00 |
|
Jaret Burkett
|
4ec4025cbb
|
Added adapter modules for text encoders and direct vision
|
2024-02-12 08:46:18 -07:00 |
|
Jaret Burkett
|
e18e0cb5f8
|
Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction
|
2024-02-05 07:40:03 -07:00 |
|
Jaret Burkett
|
177c7130ec
|
improved correction of pred norm by targeting the prior
|
2024-02-01 06:31:04 -07:00 |
|
Jaret Burkett
|
1ae1017748
|
Bug fixes. added ability to use l1 loss. varous other tests and improvements
|
2024-01-31 06:30:54 -07:00 |
|
Jaret Burkett
|
f17ad8d794
|
various bug fixes. Created an contextual alpha mask module to calculate alpha mask
|
2024-01-18 16:34:27 -07:00 |
|
Jaret Burkett
|
eebd3c8212
|
Initial training script for photomaker training. Needs a little more work.
|
2024-01-15 18:46:26 -07:00 |
|
Jaret Burkett
|
5276975fb0
|
Added additional config options for custom plugins I needed
|
2024-01-15 08:31:09 -07:00 |
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
Jaret Burkett
|
bafacf3b65
|
Initial commit
|
2023-12-29 13:07:35 -07:00 |
|
Jaret Burkett
|
eeee4a1620
|
Created a size agnostic feature encoder (SAFE) model to be trained in replace of CLIP for ip adapters. It is mostly conv layers so will hopefully be able to handle facial features better than clip can. Also bug fixes
|
2023-12-28 12:20:27 -07:00 |
|
Jaret Burkett
|
05ae95ca89
|
Added a clip vision adapter trainer. Only works for sd15 for now
|
2023-12-24 13:26:04 -07:00 |
|
Jaret Burkett
|
b653906715
|
Fixed ip adapter training. Works now
|
2023-12-17 08:22:59 -07:00 |
|
Jaret Burkett
|
39870411d8
|
More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes
|
2023-12-15 06:02:10 -07:00 |
|
Jaret Burkett
|
eaa0fb6253
|
Tons of bug fixes and improvements to special training. Fixed slider training.
|
2023-12-09 16:38:10 -07:00 |
|