179 Commits

Author	SHA1	Message	Date
Jaret Burkett	bb6db3d635	Added support for caching text embeddings. This is just initial support and will probably fail for some models. Still needs to be ompimized	2025-08-07 10:27:55 -06:00
Jaret Burkett	8d9c47316a	Work on mean flow. Minor bug fixes. Omnigen improvements	2025-06-26 13:46:20 -06:00
Jaret Burkett	18513ec866	Merged in from main	2025-06-24 10:56:54 -06:00
Jaret Burkett	f3eb1dff42	Add a config flag to trigger fast image size db builder. Add config flag to set unconditional prompt for guidance loss	2025-06-24 08:51:29 -06:00
Jaret Burkett	ba1274d99e	Added a guidance burning loss. Modified DFE to work with new model. Bug fixes	2025-06-23 08:38:27 -06:00
Jaret Burkett	8602470952	Updated diffusion feature extractor	2025-06-19 15:36:10 -06:00
Jaret Burkett	1cc663a664	Performance optimizations for pre processing the batch	2025-06-17 07:37:41 -06:00
Jaret Burkett	1c2b7298dd	More work on mean flow loss. Moved it to an adapter. Still not functioning properly though.	2025-06-16 07:17:35 -06:00
Jaret Burkett	c0314ba325	Fixed some issues with training mean flow algo. Still testing WIP	2025-06-16 07:14:59 -06:00
Jaret Burkett	cbf04b8d53	Fixed some issues with training mean flow algo. Still testing WIP	2025-06-14 12:24:00 -06:00
Jaret Burkett	fc83eb7691	WIP on mean flow loss. Still a WIP.	2025-06-12 08:00:51 -06:00
Jaret Burkett	eefa93f16e	Various code to support experiments.	2025-06-09 11:19:21 -06:00
Jaret Burkett	22cdfadab6	Added new timestep weighing strategy	2025-06-04 01:16:02 -06:00
Jaret Burkett	adc31ec77d	Small updates and bug fixes for various things	2025-06-03 20:08:35 -06:00
Jaret Burkett	e5181d23cd	Added some experimental training techniques. Ignore for now. Still in testing.	2025-05-21 02:19:54 -06:00
Jaret Burkett	5890e67a46	Various bug fixes	2025-04-29 09:30:33 -06:00
Jaret Burkett	6fb44db6a0	Finished up first frame for i2v adapter	2025-04-12 17:13:04 -06:00
Jaret Burkett	cd37ccfc2e	Use gradient checkpointing on DFE models if set	2025-04-11 10:45:39 -06:00
Jaret Burkett	059155174a	Added mask diffirential mask dialation for flex2. Handle video for the i2v adapter	2025-04-10 11:50:01 -06:00
Jaret Burkett	a8680c75eb	Added initial support for finetuning wan i2v WIP	2025-04-07 20:34:38 -06:00
Jaret Burkett	a42c5a1de5	Adjust buckets for flex2	2025-04-02 06:47:41 -06:00
Jaret Burkett	c083a0e5ea	Allow DFE to not have a VAE	2025-03-30 09:23:01 -06:00
Jaret Burkett	5365200da1	Added ability to add models to finetune as plugins. Also added flux2 new arch via that method.	2025-03-27 16:07:00 -06:00
Jaret Burkett	ce4c5291a0	Added experimental wavelet loss	2025-03-26 18:11:23 -06:00
Jaret Burkett	45be82d5d6	Handle inpainting training for control_lora adapter	2025-03-24 13:17:47 -06:00
Jaret Burkett	f10937e6da	Handle multi control inputs for control lora training	2025-03-23 07:37:08 -06:00
Jaret Burkett	9a902c067f	Show the console log on the job overview in the ui.	2025-03-21 11:45:36 -06:00
Jaret Burkett	3a6b24f4c8	Added a way to secure the UI. Plus various bug fixes and quality of life updates	2025-03-20 08:07:09 -06:00
Jaret Burkett	3812957bc9	Added ability to train control loras. Other important bug fixes thrown in	2025-03-14 18:03:00 -06:00
Jaret Burkett	242c04a0b8	Fix error with training video models with batch greater than 1	2025-03-08 18:47:27 -07:00
Jaret Burkett	6f6fb90812	Added cogview4. Loss still needs work.	2025-03-04 18:43:52 -07:00
Jaret Burkett	60539c0b0f	Allow using prior loss with a custom adapter	2025-03-01 08:01:14 -07:00
Jaret Burkett	d360e76661	fixed issue with dop prompt replacement	2025-02-26 13:35:18 -07:00
Jaret Burkett	6ec23ed226	Fixed issue when doing inverted masked prior with flowmatching algos	2025-02-26 12:12:32 -07:00
Jaret Burkett	f6e16e582a	Added Differential Output Preservation Loss to trainer and ui	2025-02-25 20:12:36 -07:00
Jaret Burkett	440ba5fb3d	Spawn windows in an cmd terminal. Should be working now, but not sure on my system	2025-02-24 08:54:56 -07:00
Jaret Burkett	56d8d6bd81	Capture speed from the timer for the ui	2025-02-23 14:38:46 -07:00
Jaret Burkett	3e49337a58	Set step to the last step saved at when exiting	2025-02-23 13:21:22 -07:00
Jaret Burkett	60f848a877	Send more data when loading the model to the ui	2025-02-23 12:49:54 -07:00
Jaret Burkett	ad87f72384	Start, stop, monitor jobs from ui working.	2025-02-21 09:49:28 -07:00
Jaret Burkett	adcf884c0f	Built out the ui trainer plugin with db comminication	2025-02-21 05:53:35 -07:00
Jaret Burkett	7679105d52	Added llm text encoder adapter	2025-02-13 08:28:32 -07:00
Jaret Burkett	0b8a32def7	merged in lumina2 branch	2025-02-12 09:33:03 -07:00
Jaret Burkett	787bb37e76	Small fixed for DFE, polar guidance, and other things	2025-02-12 09:27:44 -07:00
Jaret Burkett	d138f07365	Imitial lumina3 support	2025-02-08 10:59:53 -07:00
Jaret Burkett	ff3d54bb5b	Make the mean of the mask multiplier be 1.0 for a more balanced loss.	2025-02-06 10:57:06 +00:00
Jaret Burkett	15a57bc89f	Add new version of DFE. Kitchen sink	2025-01-31 11:42:27 -07:00
Jaret Burkett	5e663746b8	Working multi gpu training. Still need a lot of tweaks and testing.	2025-01-25 16:46:20 -07:00
Jaret Burkett	bbfba0c188	Added v2 of dfp	2025-01-22 16:32:13 -07:00
Jaret Burkett	04abe57c76	Added weighing to DFE	2025-01-22 08:50:57 -07:00