Jaret Burkett
|
a6aa4b2c7d
|
Added ability to set timesteps to linear for flowmatching schedule
|
2024-08-11 13:06:08 -06:00 |
|
Jaret Burkett
|
e69a520616
|
Reworked timestep distribution on flowmatch sampler when training.
|
2024-08-08 06:01:45 -06:00 |
|
Jaret Burkett
|
acafe9984f
|
Adjustments to loading of flux. Added a feedback to ema
|
2024-08-07 13:17:26 -06:00 |
|
Jaret Burkett
|
c2424087d6
|
8 bit training working on flux
|
2024-08-06 11:53:27 -06:00 |
|
Jaret Burkett
|
edb7e827ee
|
Adjusted flow matching so target noise multiplier works properly with it.
|
2024-08-05 11:40:05 -06:00 |
|
Jaret Burkett
|
f321de7bdb
|
Setup to retrain guidance embedding for flux. Use defualt timestep distribution for flux
|
2024-08-04 10:37:23 -06:00 |
|
Jaret Burkett
|
9beea1c268
|
Flux training should work now... maybe
|
2024-08-03 09:17:34 -06:00 |
|
Jaret Burkett
|
87ba867fdc
|
Added flux training. Still a WIP. Wont train right without rectified flow working right
|
2024-08-02 15:00:30 -06:00 |
|
Jaret Burkett
|
03613c523f
|
Bugfixes and cleanup
|
2024-08-01 11:45:12 -06:00 |
|
Jaret Burkett
|
47744373f2
|
Change img multiplier math
|
2024-07-30 11:33:41 -06:00 |
|
Jaret Burkett
|
0bc4d555c7
|
A lot of pixart sigma training tweaks
|
2024-07-28 11:23:18 -06:00 |
|
Jaret Burkett
|
80aa2dbb80
|
New image generation img2img. various tweaks and fixes
|
2024-07-24 04:13:41 -06:00 |
|
Jaret Burkett
|
11e426fdf1
|
Various features and fixes. Too much brain fog to do a proper description
|
2024-07-18 07:34:14 -06:00 |
|
Jaret Burkett
|
58dffd43a8
|
Added caching to image sizes so we dont do it every time.
|
2024-07-15 19:07:41 -06:00 |
|
Jaret Burkett
|
e4558dff4b
|
Partial implementation for training auraflow.
|
2024-07-12 12:11:38 -06:00 |
|
Jaret Burkett
|
c008405480
|
Added after model load hook
|
2024-07-09 15:34:48 -06:00 |
|
Jaret Burkett
|
acb06d6ff3
|
Bug fixes
|
2024-07-03 10:56:34 -06:00 |
|
Jaret Burkett
|
603ceca3ca
|
added ema
|
2024-06-28 10:03:26 -06:00 |
|
Jaret Burkett
|
7165f2d25a
|
Work to omprove pixart training
|
2024-06-23 20:46:48 +00:00 |
|
Jaret Burkett
|
5d47244c57
|
Added support for pixart sigma loras
|
2024-06-16 11:56:30 -06:00 |
|
Jaret Burkett
|
bd10d2d668
|
Some work on sd3 training. Not working
|
2024-06-13 12:19:16 -06:00 |
|
Jaret Burkett
|
cb5d28cba9
|
Added working ilora trainer
|
2024-06-12 09:33:45 -06:00 |
|
Jaret Burkett
|
3f3636b788
|
Bug fixes and little improvements here and there.
|
2024-06-08 06:24:20 -06:00 |
|
Jaret Burkett
|
5a45c709cd
|
Work on ipadapters and custom adapters
|
2024-05-13 06:37:54 -06:00 |
|
Jaret Burkett
|
10e1ecf1e8
|
Added single value adapter training
|
2024-04-28 06:04:47 -06:00 |
|
Jaret Burkett
|
5da3613e0b
|
Bug fixes and minor features
|
2024-04-25 06:14:31 -06:00 |
|
Jaret Burkett
|
7284aab7c0
|
Added specialized scaler training to ip adapters
|
2024-04-05 08:17:09 -06:00 |
|
Jaret Burkett
|
016687bda1
|
Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.
|
2024-03-17 10:21:47 -06:00 |
|
Jaret Burkett
|
f1cb87fe9e
|
fixed bug the kept learning rates the same
|
2024-03-06 09:23:32 -07:00 |
|
Jaret Burkett
|
b01e8d889a
|
Added stochastic rounding to adafactor. ILora adjustments
|
2024-03-05 07:07:09 -07:00 |
|
Jaret Burkett
|
337945de9a
|
Added this not that guidance. Added ability to replace prompts.
|
2024-02-28 20:10:14 -07:00 |
|
Jaret Burkett
|
1bd94f0f01
|
Added early DoRA support, but will change shortly. Dont use right now.
|
2024-02-23 05:55:41 -07:00 |
|
Jaret Burkett
|
93b52932c1
|
Added training for pixart-a
|
2024-02-13 16:00:04 -07:00 |
|
Jaret Burkett
|
92b9c71d44
|
Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs
|
2024-01-28 08:20:03 -07:00 |
|
Jaret Burkett
|
f17ad8d794
|
various bug fixes. Created an contextual alpha mask module to calculate alpha mask
|
2024-01-18 16:34:27 -07:00 |
|
Jaret Burkett
|
eebd3c8212
|
Initial training script for photomaker training. Needs a little more work.
|
2024-01-15 18:46:26 -07:00 |
|
Jaret Burkett
|
5276975fb0
|
Added additional config options for custom plugins I needed
|
2024-01-15 08:31:09 -07:00 |
|
Jaret Burkett
|
e190fbaeb8
|
Prepwork for ilora
|
2024-01-12 06:41:15 -07:00 |
|
Jaret Burkett
|
645b27f97a
|
Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.
|
2024-01-04 12:59:38 -07:00 |
|
Jaret Burkett
|
afc231efc1
|
Added reference adapters, many bug fixes, more ip adapter work and customizability
|
2024-01-01 17:15:53 -07:00 |
|
Jaret Burkett
|
d11ed7f66c
|
Big fixes and added method to standardize values in both latent and pixel space before feeding into the network. Target values were determined over huge generated regularization sets.
|
2023-12-26 06:19:48 -07:00 |
|
Jaret Burkett
|
05ae95ca89
|
Added a clip vision adapter trainer. Only works for sd15 for now
|
2023-12-24 13:26:04 -07:00 |
|
Jaret Burkett
|
dfb64b5957
|
Allow ip adapters to be much more variable in their creation
|
2023-12-20 06:18:33 -07:00 |
|
Jaret Burkett
|
b653906715
|
Fixed ip adapter training. Works now
|
2023-12-17 08:22:59 -07:00 |
|
Jaret Burkett
|
39870411d8
|
More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes
|
2023-12-15 06:02:10 -07:00 |
|
Jaret Burkett
|
eaa0fb6253
|
Tons of bug fixes and improvements to special training. Fixed slider training.
|
2023-12-09 16:38:10 -07:00 |
|
Jaret Burkett
|
7624241032
|
More fixes for noise schedules and fixed targeted guidance inverted masked prior
|
2023-11-29 10:13:31 -07:00 |
|
Jaret Burkett
|
792a5e37e2
|
Numerous fixes for time sampling. Still not perfect
|
2023-11-28 07:34:43 -07:00 |
|
Jaret Burkett
|
d7e55b6ad4
|
Bug fixes, negative prompting during training, hardened catching
|
2023-11-24 07:25:11 -07:00 |
|
Jaret Burkett
|
fbec68681d
|
Added timestep modifications to lcm scheduler for more evenly spaced timesteps
|
2023-11-17 23:26:52 -07:00 |
|