202 Commits

Author	SHA1	Message	Date
Jaret Burkett	e5181d23cd	Added some experimental training techniques. Ignore for now. Still in testing.	2025-05-21 02:19:54 -06:00
Jaret Burkett	6174ba474e	Fixed issue with chroma sampling	2025-05-10 18:30:23 +00:00
Jaret Burkett	43cb5603ad	Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models	2025-05-07 12:06:30 -06:00
Jaret Burkett	d9700bdb99	Added initial support for f-lite model	2025-05-01 11:15:18 -06:00
Jaret Burkett	5890e67a46	Various bug fixes	2025-04-29 09:30:33 -06:00
Jaret Burkett	add83df5cc	Fixed issue with training hidream when batch size is larger than 1	2025-04-21 17:26:29 +00:00
Jaret Burkett	77001ee77f	Upodate model tag on loras	2025-04-19 10:41:27 -06:00
Jaret Burkett	0f99fce004	Adjust hidream lora names to work with comfy	2025-04-16 09:24:23 -06:00
Jaret Burkett	524bd2edfc	Make flash attn optional. Handle larger batch sizes.	2025-04-14 14:34:46 +00:00
Jaret Burkett	3a5ea2c742	Remove some moe stuff for finetuning. Drastically reduces vram usage	2025-04-14 00:57:34 +00:00
Jaret Burkett	f80cf99f40	Hidream is training, but has a memory leak	2025-04-13 23:28:18 +00:00
Jaret Burkett	594e166ca3	Initial support for hidream. Still a WIP	2025-04-13 13:50:11 -06:00
Jaret Burkett	6fb44db6a0	Finished up first frame for i2v adapter	2025-04-12 17:13:04 -06:00
Jaret Burkett	cd37ccfc2e	Use gradient checkpointing on DFE models if set	2025-04-11 10:45:39 -06:00
Jaret Burkett	059155174a	Added mask diffirential mask dialation for flex2. Handle video for the i2v adapter	2025-04-10 11:50:01 -06:00
Jaret Burkett	a8680c75eb	Added initial support for finetuning wan i2v WIP	2025-04-07 20:34:38 -06:00
Jaret Burkett	7c21eac1b3	Added support for Lodestone Rock's Chroma model	2025-04-05 13:21:36 -06:00
Jaret Burkett	2b901cca39	Small tweaks and bug fixes and future proofing	2025-04-05 12:39:45 -06:00
Jaret Burkett	ac1ee559c5	Added bluring to mask for flex2	2025-04-02 07:55:51 -06:00
Jaret Burkett	a42c5a1de5	Adjust buckets for flex2	2025-04-02 06:47:41 -06:00
Jaret Burkett	c083a0e5ea	Allow DFE to not have a VAE	2025-03-30 09:23:01 -06:00
Jaret Burkett	5365200da1	Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.	2025-03-27 16:07:00 -06:00
Jaret Burkett	ce4c5291a0	Added experimental wavelet loss	2025-03-26 18:11:23 -06:00
Jaret Burkett	45be82d5d6	Handle inpainting training for control_lora adapter	2025-03-24 13:17:47 -06:00
Jaret Burkett	f10937e6da	Handle multi control inputs for control lora training	2025-03-23 07:37:08 -06:00
Jaret Burkett	9a902c067f	Show the console log on the job overview in the ui.	2025-03-21 11:45:36 -06:00
Jaret Burkett	3a6b24f4c8	Added a way to secure the UI. Plus various bug fixes and quality of life updates	2025-03-20 08:07:09 -06:00
Jaret Burkett	3812957bc9	Added ability to train control loras. Other important bug fixes thrown in	2025-03-14 18:03:00 -06:00
Jaret Burkett	242c04a0b8	Fix error with training video models with batch greater than 1	2025-03-08 18:47:27 -07:00
Jaret Burkett	6f6fb90812	Added cogview4. Loss still needs work.	2025-03-04 18:43:52 -07:00
Jaret Burkett	60539c0b0f	Allow using prior loss with a custom adapter	2025-03-01 08:01:14 -07:00
Jaret Burkett	d360e76661	fixed issue with dop prompt replacement	2025-02-26 13:35:18 -07:00
Jaret Burkett	6ec23ed226	Fixed issue when doing inverted masked prior with flowmatching algos	2025-02-26 12:12:32 -07:00
Jaret Burkett	f6e16e582a	Added Differential Output Preservation Loss to trainer and ui	2025-02-25 20:12:36 -07:00
Jaret Burkett	440ba5fb3d	Spawn windows in an cmd terminal. Should be working now, but not sure on my system	2025-02-24 08:54:56 -07:00
Jaret Burkett	56d8d6bd81	Capture speed from the timer for the ui	2025-02-23 14:38:46 -07:00
Jaret Burkett	3e49337a58	Set step to the last step saved at when exiting	2025-02-23 13:21:22 -07:00
Jaret Burkett	60f848a877	Send more data when loading the model to the ui	2025-02-23 12:49:54 -07:00
Jaret Burkett	ad87f72384	Start, stop, monitor jobs from ui working.	2025-02-21 09:49:28 -07:00
Jaret Burkett	adcf884c0f	Built out the ui trainer plugin with db comminication	2025-02-21 05:53:35 -07:00
Jaret Burkett	7679105d52	Added llm text encoder adapter	2025-02-13 08:28:32 -07:00
Jaret Burkett	0b8a32def7	merged in lumina2 branch	2025-02-12 09:33:03 -07:00
Jaret Burkett	787bb37e76	Small fixed for DFE, polar guidance, and other things	2025-02-12 09:27:44 -07:00
Jaret Burkett	d138f07365	Imitial lumina3 support	2025-02-08 10:59:53 -07:00
Jaret Burkett	ff3d54bb5b	Make the mean of the mask multiplier be 1.0 for a more balanced loss.	2025-02-06 10:57:06 +00:00
Jaret Burkett	15a57bc89f	Add new version of DFE. Kitchen sink	2025-01-31 11:42:27 -07:00
Jaret Burkett	5e663746b8	Working multi gpu training. Still need a lot of tweaks and testing.	2025-01-25 16:46:20 -07:00
Jaret Burkett	bbfba0c188	Added v2 of dfp	2025-01-22 16:32:13 -07:00
Jaret Burkett	04abe57c76	Added weighing to DFE	2025-01-22 08:50:57 -07:00
Jaret Burkett	29122b1a54	Added code to handle diffusion feature extraction loss	2025-01-21 14:21:34 -07:00