46 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jaret Burkett	c35b78f0d4	Added random weight adjuster to prevent overfitting	2023-07-29 17:14:14 -06:00
Jaret Burkett	8ba1b11557	Merge branch 'sdxl' into WIP ... # Conflicts: # jobs/process/BaseSDTrainProcess.py # jobs/process/TrainSliderProcess.py	2023-07-29 14:29:18 -06:00
Jaret Burkett	9cdf2dd6e4	Bug fixes	2023-07-29 13:39:57 -06:00
Jaret Burkett	1e50b39442	Work on slider rework	2023-07-28 18:11:10 -06:00
Jaret Burkett	5fc2bb5d9c	Information trainer	2023-07-28 08:16:29 -06:00
Jaret Burkett	c7640b0865	WIP diffusers pipeline is weird. Starting to hate sdxl	2023-07-27 17:35:24 -06:00
Jaret Burkett	b2e2e4bf47	Added sd1.5 and 2.1 do the diffusers pipeline flow	2023-07-27 12:34:48 -06:00
Jaret Burkett	596e57a6a6	Pipelines working on SDXL for noise prediction	2023-07-27 11:24:33 -06:00
Jaret Burkett	6ab8b8b0f1	WIP. just need to put it here	2023-07-27 01:46:30 -06:00
Jaret Burkett	2305e55c82	Moving over to a highly difussers flow for xl	2023-07-26 18:25:01 -06:00
Jaret Burkett	d3ad195b51	Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird	2023-07-26 16:19:50 -06:00
Jaret Burkett	40e60fa021	Finially found that bug. ugh	2023-07-25 15:28:20 -06:00
Jaret Burkett	cb70c03273	SDXL should be working, but I broke something where it is not converging.	2023-07-25 13:50:59 -06:00
Jaret Burkett	52f02d53f1	switched to xl branch on sd-scripts	2023-07-25 07:41:08 -06:00
Jaret Burkett	7032717294	Added ability to just erase or enhance concepts from a model	2023-07-24 17:33:45 -06:00
Jaret Burkett	61dd818608	Added anchors to regulate the lora	2023-07-24 14:59:16 -06:00
Jaret Burkett	390192c6a1	Moved the base SD training process to a parent class so we can do some more creative stuff without copy pasta	2023-07-24 11:29:39 -06:00
Jaret Burkett	e6fb0229bf	Added better optimizer chooised and param support	2023-07-24 09:21:58 -06:00
Jaret Burkett	9a2819900c	added target weight to targets	2023-07-23 14:08:37 -06:00
Jaret Burkett	452f2a6da2	Added info, config, etc for lora extracotr and slider trainer	2023-07-23 13:13:45 -06:00
Jaret Burkett	9367089d48	Added example for slider training that will run as is	2023-07-23 11:24:12 -06:00
Jaret Burkett	434fb22458	Adde dnoise offset	2023-07-22 15:01:01 -06:00
Jaret Burkett	3f4f429c4a	Reworked the balancing and swapping of the lora during training to make it much more stable when trained	2023-07-22 14:13:39 -06:00
Jaret Burkett	ce8e7a1271	Added prompt flag to adjust network multiplier	2023-07-22 00:05:15 -06:00
Jaret Burkett	596e59dd6d	Slider training functioning, time to perfect it	2023-07-21 22:06:49 -06:00
Jaret Burkett	ddcd9069e1	Base for loopback lora training setup, still working on proper sliders	2023-07-21 18:26:02 -06:00
Jaret Burkett	aa13251877	Actually addind the Process class.....	2023-07-20 15:46:23 -06:00
Jaret Burkett	0761656a90	Added my good ole pattern loss. God I love that thing, conv transpose pattern instantly wiped from vae	2023-07-20 15:44:16 -06:00
Jaret Burkett	982e0be7a9	Removed train config, updating it, and added my llvae as pytorch model	2023-07-20 14:12:28 -06:00
Jaret Burkett	c29b9d075f	Setup the base process for merging things. WIP	2023-07-20 07:39:31 -06:00
Jaret Burkett	557732e7ff	Added Critic support to VAE training. Still tweaking and working on it. Many other fixes	2023-07-19 15:57:32 -06:00
Jaret Burkett	6ada328d8d	Fixed issues with vgg19 preprocessing. Added yaml support on config file	2023-07-19 06:12:57 -06:00
Jaret Burkett	8d8229dfc0	Handle conversions back to ldm for saving	2023-07-18 19:34:35 -06:00
Jaret Burkett	17c13eef88	Default to only training mse. Did a lot of cleanup with script. Added logging via tensorboard.	2023-07-18 09:40:51 -06:00
Jaret Burkett	94d52572d4	Style and content loss working	2023-07-18 07:47:01 -06:00
Jaret Burkett	439310e4dc	Made a very basic vae trainer.	2023-07-17 19:03:50 -06:00
Jaret Burkett	78b59c5e99	Added support for 3cleir, not fully tested	2023-07-16 15:35:14 -06:00
Jaret Burkett	9df7af1720	Adjusted some names and allow to ignore text encoder on extract	2023-07-16 12:52:39 -06:00
Jaret Burkett	a61914ddd9	Add support for threshold, ratio, and quantile on traditional LoRa	2023-07-12 20:02:22 -06:00
Jaret Burkett	8d6edae9fd	Added support for traditional LoRa extract using LoCon script	2023-07-12 19:51:40 -06:00
Jaret Burkett	57f14e5ef2	WIP implementing training	2023-07-12 08:23:46 -06:00
Jaret Burkett	47d094e528	Setup base for training jobs. Added sd-scripts as a submodule	2023-07-08 13:50:59 -06:00
Jaret Burkett	37354b006e	Reworked so everything is in classes for easy expansion. Single entry point for all config files now.	2023-07-08 09:51:42 -06:00
Jaret Burkett	27df03a486	Actually fixed meta data	2023-07-05 22:00:58 -06:00
Jaret Burkett	18077ba265	Fixed issue with meta.	2023-07-05 16:49:59 -06:00
Jaret Burkett	e4de8983c9	Initial commit	2023-07-05 16:44:58 -06:00