698 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jaret Burkett	22cdfadab6	Added new timestep weighing strategy	2025-06-04 01:16:02 -06:00
Jaret Burkett	adc31ec77d	Small updates and bug fixes for various things	2025-06-03 20:08:35 -06:00
Jaret Burkett	b6d25fcd10	Improvements to vae trainer. Adjust denoise prediction of DFE v3	2025-05-30 12:06:47 -06:00
Jaret Burkett	ffaf2f154a	Fix issue with the way chroma handled gradient checkpointing.	2025-05-28 08:41:47 -06:00
Jaret Burkett	34f4c14cd6	Work on vae trainer	2025-05-28 07:42:48 -06:00
Jaret Burkett	79bb9be92b	Fix issue with saving chroma full finetune.	2025-05-28 07:42:30 -06:00
Jaret Burkett	79499fa795	Allow fine tuning pruned versions of chroma. Allow flash attention 2 for chroma if it is installed.	2025-05-21 07:02:50 -06:00
Jaret Burkett	48e11cf843	Fallback unwrapping logic if fails	2025-05-21 03:10:33 -06:00
Jaret Burkett	7045a01375	Fixed issue saving optimizer in some instances.	2025-05-21 02:27:55 -06:00
Jaret Burkett	fca7fd6c38	Merge branch 'main' of github.com:ostris/ai-toolkit	2025-05-21 02:20:06 -06:00
Jaret Burkett	e5181d23cd	Added some experimental training techniques. Ignore for now. Still in testing.	2025-05-21 02:19:54 -06:00
Jaret Burkett	4f896c0d8a	Fixed issue where sampling fails if doing a full finetune for some models	2025-05-17 19:37:55 +00:00
Jaret Burkett	01101be196	version bump	2025-05-17 05:50:12 -06:00
Jaret Burkett	6174ba474e	Fixed issue with chroma sampling	2025-05-10 18:30:23 +00:00
Jaret Burkett	66a41e49d9	Bump version	2025-05-08 17:37:28 -06:00
Jaret Burkett	1210050ead	Reworked control generator. It is now significantly faster. Also uses better pose model with better license.	2025-05-08 14:35:55 -06:00
Jaret Burkett	25e150b370	Added support for Flex.2 in the UI	2025-05-07 12:41:51 -06:00
Jaret Burkett	43cb5603ad	Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models	2025-05-07 12:06:30 -06:00
Jaret Burkett	d9700bdb99	Added initial support for f-lite model	2025-05-01 11:15:18 -06:00
Jaret Burkett	5890e67a46	Various bug fixes	2025-04-29 09:30:33 -06:00
Jaret Burkett	2b4c525489	Reworked automagic optimizer and did more testing. Starting to really like it. Working well.	2025-04-28 08:01:10 -06:00
Jaret Burkett	88b3fbae37	Various experiments and minor bug fixes for edge cases	2025-04-25 13:44:38 -06:00
Jaret Burkett	8ff85ba14f	Add Flex2 training example	2025-04-22 11:59:47 -06:00
Jaret Burkett	80f73ce9c0	Update README.md	2025-04-22 10:46:51 -06:00
Jaret Burkett	9f42944056	Update Sponsors	2025-04-22 09:44:56 -06:00
Jaret Burkett	add83df5cc	Fixed issue with training hidream when batch size is larger than 1	2025-04-21 17:26:29 +00:00
Jaret Burkett	12e3095d8a	Fixed issue with saving base model version	2025-04-19 14:34:01 -06:00
Jaret Burkett	77001ee77f	Upodate model tag on loras	2025-04-19 10:41:27 -06:00
Jaret Burkett	d455e76c4f	Cleanup	2025-04-18 11:44:49 -06:00
Jaret Burkett	1628884254	Remove submodule install from docker	2025-04-18 10:41:52 -06:00
Jaret Burkett	9c422ac14f	Bump version	2025-04-18 10:39:51 -06:00
Jaret Burkett	bfe29e2151	Removed all submodules. Submodule free now, yay.	2025-04-18 10:39:15 -06:00
Jaret Burkett	bd2de5b74e	Remove leco submodule	2025-04-18 10:08:09 -06:00
Jaret Burkett	970fac19a5	Remove batch annotator as submodule	2025-04-18 10:03:37 -06:00
Jaret Burkett	5f312cd46b	Remove ip adapter submodule	2025-04-18 09:59:42 -06:00
Jaret Burkett	c90615f8bb	Add model hooks to polarity loss	2025-04-17 09:00:10 -06:00
Jaret Burkett	5961ef6c9f	Fixed typo in linux install	2025-04-16 22:08:17 -06:00
Jaret Burkett	fd6026ab73	Merge pull request #278 from ostris/hidream ... Add Hidream support	2025-04-16 13:48:27 -06:00
Jaret Burkett	79c87701e7	Add hidream to the ui	2025-04-16 13:45:21 -06:00
Jaret Burkett	fecc64e646	Update hidream defaults, pass additional information to flow guidance	2025-04-16 13:03:04 -06:00
Jaret Burkett	d5a64006b5	Added example config to train hidream	2025-04-16 10:18:22 -06:00
Jaret Burkett	0f99fce004	Adjust hidream lora names to work with comfy	2025-04-16 09:24:23 -06:00
Jaret Burkett	c12036df95	Added ability to use short captions from json caption file	2025-04-16 08:32:28 -06:00
Jaret Burkett	68018c908e	Made a script to convert diffusers to comfy just the transformer	2025-04-15 10:22:05 -06:00
Jaret Burkett	524bd2edfc	Make flash attn optional. Handle larger batch sizes.	2025-04-14 14:34:46 +00:00
Jaret Burkett	89c0f688db	Merge branch 'main' into hidream	2025-04-13 21:16:07 -06:00
Jaret Burkett	1e0bff653c	Fix new bug I accidently introduced with lora	2025-04-13 21:15:07 -06:00
Jaret Burkett	3a5ea2c742	Remove some moe stuff for finetuning. Drastically reduces vram usage	2025-04-14 00:57:34 +00:00
Jaret Burkett	f80cf99f40	Hidream is training, but has a memory leak	2025-04-13 23:28:18 +00:00
Jaret Burkett	594e166ca3	Initial support for hidream. Still a WIP	2025-04-13 13:50:11 -06:00