Commit Graph

  • 82b90b902e Double tap torch install to force blackwell compatability Jaret Burkett 2025-06-02 20:22:22 -06:00
  • 85f4b47e79 Fix issue with setup tools requirements Jaret Burkett 2025-06-02 06:54:35 -06:00
  • e20a869dc1 Update docker install for blacwell Jaret Burkett 2025-06-01 19:06:53 -06:00
  • 12fa109910 Updated cuda arch list on docker build Jaret Burkett 2025-06-01 13:37:11 -06:00
  • 7d76165dcf Merge branch 'main' into dev Jaret Burkett 2025-06-01 13:33:40 -06:00
  • b6d25fcd10 Improvements to vae trainer. Adjust denoise prediction of DFE v3 Jaret Burkett 2025-05-30 12:06:47 -06:00
  • ffaf2f154a Fix issue with the way chroma handled gradient checkpointing. Jaret Burkett 2025-05-28 08:41:47 -06:00
  • 34f4c14cd6 Work on vae trainer Jaret Burkett 2025-05-28 07:42:48 -06:00
  • 79bb9be92b Fix issue with saving chroma full finetune. Jaret Burkett 2025-05-28 07:42:30 -06:00
  • 79499fa795 Allow fine tuning pruned versions of chroma. Allow flash attention 2 for chroma if it is installed. Jaret Burkett 2025-05-21 07:02:50 -06:00
  • 48e11cf843 Fallback unwrapping logic if fails Jaret Burkett 2025-05-21 03:10:33 -06:00
  • 7045a01375 Fixed issue saving optimizer in some instances. Jaret Burkett 2025-05-21 02:27:55 -06:00
  • fca7fd6c38 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2025-05-21 02:20:06 -06:00
  • e5181d23cd Added some experimental training techniques. Ignore for now. Still in testing. Jaret Burkett 2025-05-21 02:19:54 -06:00
  • 4f896c0d8a Fixed issue where sampling fails if doing a full finetune for some models Jaret Burkett 2025-05-17 19:37:55 +00:00
  • 01101be196 version bump Jaret Burkett 2025-05-17 05:50:12 -06:00
  • 6174ba474e Fixed issue with chroma sampling Jaret Burkett 2025-05-10 18:30:23 +00:00
  • 64130189ce Bumped torch and cuda to support blackwell arch Jaret Burkett 2025-05-09 11:17:58 -06:00
  • 66a41e49d9 Bump version Jaret Burkett 2025-05-08 17:37:28 -06:00
  • 1210050ead Reworked control generator. It is now significantly faster. Also uses better pose model with better license. Jaret Burkett 2025-05-08 14:35:55 -06:00
  • 25e150b370 Added support for Flex.2 in the UI Jaret Burkett 2025-05-07 12:41:51 -06:00
  • 43cb5603ad Added chroma model to the ui. Added logic to easily pull latest, use local, or use a specific version of chroma. Allow ustom name or path in the ui for custom models Jaret Burkett 2025-05-07 12:06:30 -06:00
  • d9700bdb99 Added initial support for f-lite model Jaret Burkett 2025-05-01 11:15:18 -06:00
  • 5890e67a46 Various bug fixes Jaret Burkett 2025-04-29 09:30:33 -06:00
  • 2b4c525489 Reworked automagic optimizer and did more testing. Starting to really like it. Working well. Jaret Burkett 2025-04-28 08:01:10 -06:00
  • 88b3fbae37 Various experiments and minor bug fixes for edge cases Jaret Burkett 2025-04-25 13:44:38 -06:00
  • 8ff85ba14f Add Flex2 training example Jaret Burkett 2025-04-22 11:59:47 -06:00
  • 80f73ce9c0 Update README.md Jaret Burkett 2025-04-22 10:46:51 -06:00
  • 9f42944056 Update Sponsors Jaret Burkett 2025-04-22 09:44:56 -06:00
  • add83df5cc Fixed issue with training hidream when batch size is larger than 1 Jaret Burkett 2025-04-21 17:26:29 +00:00
  • 12e3095d8a Fixed issue with saving base model version Jaret Burkett 2025-04-19 14:34:01 -06:00
  • 77001ee77f Upodate model tag on loras Jaret Burkett 2025-04-19 10:41:27 -06:00
  • d455e76c4f Cleanup Jaret Burkett 2025-04-18 11:44:49 -06:00
  • 1628884254 Remove submodule install from docker Jaret Burkett 2025-04-18 10:41:52 -06:00
  • 9c422ac14f Bump version Jaret Burkett 2025-04-18 10:39:51 -06:00
  • bfe29e2151 Removed all submodules. Submodule free now, yay. Jaret Burkett 2025-04-18 10:39:15 -06:00
  • bd2de5b74e Remove leco submodule Jaret Burkett 2025-04-18 10:08:09 -06:00
  • 970fac19a5 Remove batch annotator as submodule Jaret Burkett 2025-04-18 10:03:37 -06:00
  • 5f312cd46b Remove ip adapter submodule Jaret Burkett 2025-04-18 09:59:42 -06:00
  • c90615f8bb Add model hooks to polarity loss Jaret Burkett 2025-04-17 09:00:10 -06:00
  • 5961ef6c9f Fixed typo in linux install Jaret Burkett 2025-04-16 22:08:17 -06:00
  • fd6026ab73 Merge pull request #278 from ostris/hidream Jaret Burkett 2025-04-16 13:48:27 -06:00
  • 79c87701e7 Add hidream to the ui Jaret Burkett 2025-04-16 13:45:21 -06:00
  • fecc64e646 Update hidream defaults, pass additional information to flow guidance Jaret Burkett 2025-04-16 13:03:04 -06:00
  • d5a64006b5 Added example config to train hidream Jaret Burkett 2025-04-16 10:18:22 -06:00
  • 0f99fce004 Adjust hidream lora names to work with comfy Jaret Burkett 2025-04-16 09:24:23 -06:00
  • c12036df95 Added ability to use short captions from json caption file Jaret Burkett 2025-04-16 08:32:28 -06:00
  • 68018c908e Made a script to convert diffusers to comfy just the transformer Jaret Burkett 2025-04-15 10:22:05 -06:00
  • 524bd2edfc Make flash attn optional. Handle larger batch sizes. Jaret Burkett 2025-04-14 14:34:46 +00:00
  • 89c0f688db Merge branch 'main' into hidream Jaret Burkett 2025-04-13 21:16:07 -06:00
  • 1e0bff653c Fix new bug I accidently introduced with lora Jaret Burkett 2025-04-13 21:15:07 -06:00
  • 3a5ea2c742 Remove some moe stuff for finetuning. Drastically reduces vram usage Jaret Burkett 2025-04-14 00:57:34 +00:00
  • f80cf99f40 Hidream is training, but has a memory leak Jaret Burkett 2025-04-13 23:28:18 +00:00
  • 594e166ca3 Initial support for hidream. Still a WIP Jaret Burkett 2025-04-13 13:50:11 -06:00
  • ca3ce0f34c Make it easier to designate lora blocks for new models. Improve i2v adapter speed. Fix issue with i2v adapter where cached torch tensor was wrong range. Jaret Burkett 2025-04-13 13:49:13 -06:00
  • 6fb44db6a0 Finished up first frame for i2v adapter Jaret Burkett 2025-04-12 17:13:04 -06:00
  • cd37ccfc2e Use gradient checkpointing on DFE models if set Jaret Burkett 2025-04-11 10:45:39 -06:00
  • 4a43589666 Use a shuffled embedding as unconditional for i2v adapter Jaret Burkett 2025-04-11 10:44:43 -06:00
  • 059155174a Added mask diffirential mask dialation for flex2. Handle video for the i2v adapter Jaret Burkett 2025-04-10 11:50:01 -06:00
  • 9794416a5d Fixed bug when loading video datasets Jaret Burkett 2025-04-10 08:16:05 -06:00
  • d8bdc03256 Allow full control of caption extensions Jaret Burkett 2025-04-10 07:42:04 -06:00
  • 96ba2fd129 Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose. Jaret Burkett 2025-04-09 13:35:04 -06:00
  • 615b0d0e94 Added initial support for training i2v adapter WIP Jaret Burkett 2025-04-09 08:06:29 -06:00
  • a8680c75eb Added initial support for finetuning wan i2v WIP Jaret Burkett 2025-04-07 20:34:38 -06:00
  • 38ad5a4644 Fixed issue with video dataset sizing Jaret Burkett 2025-04-07 12:46:41 -06:00
  • 6c8b5ab606 Added some more useful error handeling and logging Jaret Burkett 2025-04-07 08:01:37 -06:00
  • 7c21eac1b3 Added support for Lodestone Rock's Chroma model Jaret Burkett 2025-04-05 13:21:36 -06:00
  • 2b901cca39 Small tweaks and bug fixes and future proofing Jaret Burkett 2025-04-05 12:39:45 -06:00
  • ead23cee88 Updated supporters Jaret Burkett 2025-04-05 12:35:01 -06:00
  • ab59ca5091 Updated comment on control path Jaret Burkett 2025-04-04 10:23:06 -06:00
  • eddd3c1611 Added finetuning/training example for redux Jaret Burkett 2025-04-04 10:05:41 -06:00
  • b0d0466efd Add better error messages if name exists when saving a job Jaret Burkett 2025-04-03 11:25:25 -06:00
  • ac1ee559c5 Added bluring to mask for flex2 Jaret Burkett 2025-04-02 07:55:51 -06:00
  • 77763a3e5c Update divisiblity of SD3 Jaret Burkett 2025-04-02 06:49:06 -06:00
  • a42c5a1de5 Adjust buckets for flex2 Jaret Burkett 2025-04-02 06:47:41 -06:00
  • 3d131fb27a Added a file signature check on the dataset size caching system to invalidate cached dimensions if the file changes. Jaret Burkett 2025-04-01 07:39:36 -06:00
  • 5ea19b6292 small bug fixes Jaret Burkett 2025-03-30 20:09:40 -06:00
  • 58861005a5 Version bump Jaret Burkett 2025-03-30 09:23:30 -06:00
  • c083a0e5ea Allow DFE to not have a VAE Jaret Burkett 2025-03-30 09:23:01 -06:00
  • 860d892214 Pixel shuffle adapter. Some bug fixes thrown in Jaret Burkett 2025-03-29 21:15:01 -06:00
  • b94d7aafea Have error boundary if simple job cannot be displayed due to the job being advanced Jaret Burkett 2025-03-27 19:55:40 -06:00
  • 3c95f87a90 Added some missing dependencies Jaret Burkett 2025-03-27 18:48:48 -06:00
  • 1d5f387f54 Fix docker command to work better with runpod Jaret Burkett 2025-03-27 17:44:46 -06:00
  • 5365200da1 Added ability to add models to finetune as plugins. Also added flux2 new arch via that method. Jaret Burkett 2025-03-27 16:07:00 -06:00
  • e9e30104d3 Merge pull request #271 from ostris/wavelet_loss Jaret Burkett 2025-03-26 19:12:09 -06:00
  • ce4c5291a0 Added experimental wavelet loss wavelet_loss Jaret Burkett 2025-03-26 18:11:23 -06:00
  • c101f07834 Version bump Jaret Burkett 2025-03-26 12:16:01 -06:00
  • e4526ad4a4 Updates to handle video in a dataset on ui Jaret Burkett 2025-03-26 12:15:28 -06:00
  • 4595965e06 Added an inpainting mask generator for training inpainting if inpaint mask is not provided Jaret Burkett 2025-03-25 12:16:10 -06:00
  • 41edc18750 Removed unnessary import Jaret Burkett 2025-03-25 11:54:42 -06:00
  • 6021a3dbc0 Change inpainting mask to zero out on latents instead of image for inpaint area. Jaret Burkett 2025-03-24 14:16:52 -06:00
  • 71d7a52146 Fixed issue with python being wrong on docker Jaret Burkett 2025-03-24 14:16:09 -06:00
  • 45be82d5d6 Handle inpainting training for control_lora adapter Jaret Burkett 2025-03-24 13:17:47 -06:00
  • f10937e6da Handle multi control inputs for control lora training Jaret Burkett 2025-03-23 07:37:08 -06:00
  • ccb66c748f Update readme install directions Jaret Burkett 2025-03-22 15:14:04 -06:00
  • 2aca2883e7 Update windows install directions for new version of torch Jaret Burkett 2025-03-22 15:12:51 -06:00
  • 1ad58c5816 Changed control lora to only have new weights and leave other input weights alone for more flexability of using multiple ones together. Jaret Burkett 2025-03-22 10:24:52 -06:00
  • 6dea41b9fc Version bump Jaret Burkett 2025-03-21 11:48:03 -06:00
  • 9a902c067f Show the console log on the job overview in the ui. Jaret Burkett 2025-03-21 11:45:36 -06:00
  • 0bbc69c135 Fix issue where the job would hang in the ui if it failed to start Jaret Burkett 2025-03-21 09:46:41 -06:00