98 Commits

Author	SHA1	Message	Date
Jaret Burkett	10e1ecf1e8	Added single value adapter training	2024-04-28 06:04:47 -06:00
Jaret Burkett	b96913d73c	Improvements to dataloader	2024-04-27 09:28:28 -06:00
Jaret Burkett	5da3613e0b	Bug fixes and minor features	2024-04-25 06:14:31 -06:00
Jaret Burkett	5a70b7f38d	Added pixart sigma support, but it wont work until i address breaking changes with lora code in diffusers so it can be upgraded.	2024-04-20 10:46:56 -06:00
Jaret Burkett	7284aab7c0	Added specialized scaler training to ip adapters	2024-04-05 08:17:09 -06:00
Jaret Burkett	427847ac4c	Small tweaks and fixes for specialized ip adapter training	2024-03-26 11:35:26 -06:00
Jaret Burkett	016687bda1	Adapter work. Bug fixes. Auto adjust LR when resuming optimizer.	2024-03-17 10:21:47 -06:00
Jaret Burkett	72de68d8aa	WIP on clip vision encoder	2024-03-13 07:24:08 -06:00
Jaret Burkett	337945de9a	Added this not that guidance. Added ability to replace prompts.	2024-02-28 20:10:14 -07:00
Jaret Burkett	561914d8e6	Removed old code for fixing multistep sampler that is no longer needed	2024-02-25 11:53:35 -07:00
Jaret Burkett	b68c3ef734	Added te aug adapter	2024-02-21 21:30:26 -07:00
Jaret Burkett	49c41e6a5f	Bug fixes. allow for random negative prompts	2024-02-21 04:51:52 -07:00
Jaret Burkett	2478554c95	Bug fixes. Added IP adapter training for Pixart	2024-02-17 10:06:57 -07:00
Jaret Burkett	93b52932c1	Added training for pixart-a	2024-02-13 16:00:04 -07:00
Jaret Burkett	4ec4025cbb	Added adapter modules for text encoders and direct vision	2024-02-12 08:46:18 -07:00
Jaret Burkett	e18e0cb5f8	Added comparitive loss when training clip encoder. Allow selecting clip layer. on ip adapter. Improvements to prior prediction	2024-02-05 07:40:03 -07:00
Jaret Burkett	177c7130ec	improved correction of pred norm by targeting the prior	2024-02-01 06:31:04 -07:00
Jaret Burkett	1ae1017748	Bug fixes. added ability to use l1 loss. varous other tests and improvements	2024-01-31 06:30:54 -07:00
Jaret Burkett	f17ad8d794	various bug fixes. Created an contextual alpha mask module to calculate alpha mask	2024-01-18 16:34:27 -07:00
Jaret Burkett	eebd3c8212	Initial training script for photomaker training. Needs a little more work.	2024-01-15 18:46:26 -07:00
Jaret Burkett	5276975fb0	Added additional config options for custom plugins I needed	2024-01-15 08:31:09 -07:00
Jaret Burkett	afc231efc1	Added reference adapters, many bug fixes, more ip adapter work and customizability	2024-01-01 17:15:53 -07:00
Jaret Burkett	bafacf3b65	Initial commit	2023-12-29 13:07:35 -07:00
Jaret Burkett	eeee4a1620	Created a size agnostic feature encoder (SAFE) model to be trained in replace of CLIP for ip adapters. It is mostly conv layers so will hopefully be able to handle facial features better than clip can. Also bug fixes	2023-12-28 12:20:27 -07:00
Jaret Burkett	05ae95ca89	Added a clip vision adapter trainer. Only works for sd15 for now	2023-12-24 13:26:04 -07:00
Jaret Burkett	b653906715	Fixed ip adapter training. Works now	2023-12-17 08:22:59 -07:00
Jaret Burkett	39870411d8	More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes	2023-12-15 06:02:10 -07:00
Jaret Burkett	eaa0fb6253	Tons of bug fixes and improvements to special training. Fixed slider training.	2023-12-09 16:38:10 -07:00
Jaret Burkett	bd2bce9b92	Switched to trailing timestep spacing to make timesteps for consistant across schedulers. Honed in on targeted guidance. It is finally perfect. (I think)	2023-11-29 14:32:48 -07:00
Jaret Burkett	7624241032	More fixes for noise schedules and fixed targeted guidance inverted masked prior	2023-11-29 10:13:31 -07:00
Jaret Burkett	bef10a639c	Merge remote-tracking branch 'origin/development' ... # Conflicts: # toolkit/stable_diffusion_model.py	2023-11-28 10:40:05 -07:00
Jaret Burkett	c2a4b8e058	More timestep fixes	2023-11-28 10:34:08 -07:00
Jaret Burkett	792a5e37e2	Numerous fixes for time sampling. Still not perfect	2023-11-28 07:34:43 -07:00
Jaret Burkett	fbec68681d	Added timestep modifications to lcm scheduler for more evenly spaced timesteps	2023-11-17 23:26:52 -07:00
Jaret Burkett	ad50921c41	Sampling tests and added fixes for cleanups	2023-11-16 08:33:23 -07:00
Jaret Burkett	e47006ed70	Added some features for an LCM condenser plugin	2023-11-15 08:56:45 -07:00
Jaret Burkett	4f9cdd916a	added prompt dropout to happen indempendently on each TE	2023-11-14 05:26:51 -07:00
Jaret Burkett	1ee62562a4	diffirential guidance is WORKING (from what I can tell)	2023-11-07 19:24:12 -07:00
Jaret Burkett	dc8448d958	Added a way pass refiner ratio to sample config	2023-11-06 09:22:58 -07:00
Jaret Burkett	93ea955d7c	Added refiner fine tuning. Works, but needs some polish.	2023-11-05 17:15:03 -07:00
Jaret Burkett	d35733ac06	Added support for training ssd-1B. Added support for saving models into diffusers format. We can currently save in safetensors format for ssd-1b, but diffusers cannot load it yet.	2023-11-03 05:01:16 -06:00
Jaret Burkett	ceaf1d9454	Various bug fixes, wip stuff, and tweaks	2023-11-02 18:19:20 -06:00
Jaret Burkett	7d707b2fe6	Added masking to slider training. Something is still weird though	2023-11-01 14:51:29 -06:00
Jaret Burkett	6f3e0d5af2	Improved lorm extraction and training	2023-10-28 08:21:59 -06:00
Jaret Burkett	0a79ac9604	Added lorm. WIP	2023-10-26 18:23:51 -06:00
Jaret Burkett	9636194c09	Added fuyu captioning	2023-10-25 14:14:53 -06:00
Jaret Burkett	002279cec3	Allow short and long caption combinations like form the new captioning system. Merge the network into the model before inference and reextract when done. Doubles inference speed on locon models during inference. allow splitting a batch into individual components and run them through alone. Basicallt gradient accumulation with single batch size.	2023-10-24 16:02:07 -06:00
Jaret Burkett	9905a1e205	Fixes and longer prompts	2023-10-22 08:57:37 -06:00
Jaret Burkett	b1cfafa0c6	always prompt both even when training only one encoder	2023-10-07 11:23:09 -06:00
Jaret Burkett	cac8754399	Allow for training loras on onle one text encoder for sdxl	2023-10-06 08:11:56 -06:00