586 Commits

Author	SHA1	Message	Date
Jaret Burkett	2bf3e529ce	Set gradient checkpointing on unet enabled by default. Help out immensly with sdxl backprop spikes	2023-08-01 15:43:27 -06:00
Jaret Burkett	8b8d53888d	Added Model rescale and prepared a release upgrade	2023-08-01 13:49:54 -06:00
Jaret Burkett	63cacf4362	Merge remote-tracking branch 'origin/main' into WIP	2023-07-31 15:14:28 -06:00
Jaret Burkett	c1b1e800df	Updated module names to be compatable with ney koyha unet	2023-07-31 13:16:29 -06:00
Jaret Burkett	7726911562	Allow name to be passed through command line	2023-07-31 11:56:57 -06:00
Jaret Burkett	1e50b39442	Work on slider rework	2023-07-28 18:11:10 -06:00
Jaret Burkett	5fc2bb5d9c	Information trainer	2023-07-28 08:16:29 -06:00
Jaret Burkett	c7640b0865	WIP diffusers pipeline is weird. Starting to hate sdxl	2023-07-27 17:35:24 -06:00
Jaret Burkett	b2e2e4bf47	Added sd1.5 and 2.1 do the diffusers pipeline flow	2023-07-27 12:34:48 -06:00
Jaret Burkett	596e57a6a6	Pipelines working on SDXL for noise prediction	2023-07-27 11:24:33 -06:00
Jaret Burkett	6ab8b8b0f1	WIP. just need to put it here	2023-07-27 01:46:30 -06:00
Jaret Burkett	d3ad195b51	Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird	2023-07-26 16:19:50 -06:00
Jaret Burkett	cb70c03273	SDXL should be working, but I broke something where it is not converging.	2023-07-25 13:50:59 -06:00
Jaret Burkett	7032717294	Added ability to just erase or enhance concepts from a model	2023-07-24 17:33:45 -06:00
Jaret Burkett	61dd818608	Added anchors to regulate the lora	2023-07-24 14:59:16 -06:00
Jaret Burkett	390192c6a1	Moved the base SD training process to a parent class so we can do some more creative stuff without copy pasta	2023-07-24 11:29:39 -06:00
Jaret Burkett	e6fb0229bf	Added better optimizer chooised and param support	2023-07-24 09:21:58 -06:00
Jaret Burkett	9367089d48	Added example for slider training that will run as is	2023-07-23 11:24:12 -06:00
Jaret Burkett	434fb22458	Adde dnoise offset	2023-07-22 15:01:01 -06:00
Jaret Burkett	ddcd9069e1	Base for loopback lora training setup, still working on proper sliders	2023-07-21 18:26:02 -06:00
Jaret Burkett	0761656a90	Added my good ole pattern loss. God I love that thing, conv transpose pattern instantly wiped from vae	2023-07-20 15:44:16 -06:00
Jaret Burkett	982e0be7a9	Removed train config, updating it, and added my llvae as pytorch model	2023-07-20 14:12:28 -06:00
Jaret Burkett	557732e7ff	Added Critic support to VAE training. Still tweaking and working on it. Many other fixes	2023-07-19 15:57:32 -06:00
Jaret Burkett	6ada328d8d	Fixed issues with vgg19 preprocessing. Added yaml support on config file	2023-07-19 06:12:57 -06:00
Jaret Burkett	8d8229dfc0	Handle conversions back to ldm for saving	2023-07-18 19:34:35 -06:00
Jaret Burkett	17c13eef88	Default to only training mse. Did a lot of cleanup with script. Added logging via tensorboard.	2023-07-18 09:40:51 -06:00
Jaret Burkett	94d52572d4	Style and content loss working	2023-07-18 07:47:01 -06:00
Jaret Burkett	439310e4dc	Made a very basic vae trainer.	2023-07-17 19:03:50 -06:00
Jaret Burkett	9df7af1720	Adjusted some names and allow to ignore text encoder on extract	2023-07-16 12:52:39 -06:00
Jaret Burkett	8d6edae9fd	Added support for traditional LoRa extract using LoCon script	2023-07-12 19:51:40 -06:00
Jaret Burkett	57f14e5ef2	WIP implementing training	2023-07-12 08:23:46 -06:00
Jaret Burkett	47d094e528	Setup base for training jobs. Added sd-scripts as a submodule	2023-07-08 13:50:59 -06:00
Jaret Burkett	37354b006e	Reworked so everything is in classes for easy expansion. Single entry point for all config files now.	2023-07-08 09:51:42 -06:00
Jaret Burkett	27df03a486	Actually fixed meta data	2023-07-05 22:00:58 -06:00
Jaret Burkett	18077ba265	Fixed issue with meta.	2023-07-05 16:49:59 -06:00
Jaret Burkett	e4de8983c9	Initial commit	2023-07-05 16:44:58 -06:00