Commit Graph

  • fecc64e646 Update hidream defaults, pass additional information to flow guidance Jaret Burkett 2025-04-16 13:03:04 -06:00
  • d5a64006b5 Added example config to train hidream Jaret Burkett 2025-04-16 10:18:22 -06:00
  • 0f99fce004 Adjust hidream lora names to work with comfy Jaret Burkett 2025-04-16 09:24:23 -06:00
  • c12036df95 Added ability to use short captions from json caption file Jaret Burkett 2025-04-16 08:32:28 -06:00
  • 68018c908e Made a script to convert diffusers to comfy just the transformer Jaret Burkett 2025-04-15 10:22:05 -06:00
  • 524bd2edfc Make flash attn optional. Handle larger batch sizes. Jaret Burkett 2025-04-14 14:34:46 +00:00
  • 89c0f688db Merge branch 'main' into hidream Jaret Burkett 2025-04-13 21:16:07 -06:00
  • 1e0bff653c Fix new bug I accidently introduced with lora Jaret Burkett 2025-04-13 21:15:07 -06:00
  • 3a5ea2c742 Remove some moe stuff for finetuning. Drastically reduces vram usage Jaret Burkett 2025-04-14 00:57:34 +00:00
  • f80cf99f40 Hidream is training, but has a memory leak Jaret Burkett 2025-04-13 23:28:18 +00:00
  • 594e166ca3 Initial support for hidream. Still a WIP Jaret Burkett 2025-04-13 13:50:11 -06:00
  • ca3ce0f34c Make it easier to designate lora blocks for new models. Improve i2v adapter speed. Fix issue with i2v adapter where cached torch tensor was wrong range. Jaret Burkett 2025-04-13 13:49:13 -06:00
  • 6fb44db6a0 Finished up first frame for i2v adapter Jaret Burkett 2025-04-12 17:13:04 -06:00
  • cd37ccfc2e Use gradient checkpointing on DFE models if set Jaret Burkett 2025-04-11 10:45:39 -06:00
  • 4a43589666 Use a shuffled embedding as unconditional for i2v adapter Jaret Burkett 2025-04-11 10:44:43 -06:00
  • 059155174a Added mask diffirential mask dialation for flex2. Handle video for the i2v adapter Jaret Burkett 2025-04-10 11:50:01 -06:00
  • 9794416a5d Fixed bug when loading video datasets Jaret Burkett 2025-04-10 08:16:05 -06:00
  • d8bdc03256 Allow full control of caption extensions Jaret Burkett 2025-04-10 07:42:04 -06:00
  • 96ba2fd129 Added methods to the dataloader to automatically generate controls for line, mask, inpainting, depth, and pose. Jaret Burkett 2025-04-09 13:35:04 -06:00
  • 615b0d0e94 Added initial support for training i2v adapter WIP Jaret Burkett 2025-04-09 08:06:29 -06:00
  • a8680c75eb Added initial support for finetuning wan i2v WIP Jaret Burkett 2025-04-07 20:34:38 -06:00
  • 38ad5a4644 Fixed issue with video dataset sizing Jaret Burkett 2025-04-07 12:46:41 -06:00
  • 6c8b5ab606 Added some more useful error handeling and logging Jaret Burkett 2025-04-07 08:01:37 -06:00
  • 7c21eac1b3 Added support for Lodestone Rock's Chroma model Jaret Burkett 2025-04-05 13:21:36 -06:00
  • 2b901cca39 Small tweaks and bug fixes and future proofing Jaret Burkett 2025-04-05 12:39:45 -06:00
  • ead23cee88 Updated supporters Jaret Burkett 2025-04-05 12:35:01 -06:00
  • ab59ca5091 Updated comment on control path Jaret Burkett 2025-04-04 10:23:06 -06:00
  • eddd3c1611 Added finetuning/training example for redux Jaret Burkett 2025-04-04 10:05:41 -06:00
  • b0d0466efd Add better error messages if name exists when saving a job Jaret Burkett 2025-04-03 11:25:25 -06:00
  • ac1ee559c5 Added bluring to mask for flex2 Jaret Burkett 2025-04-02 07:55:51 -06:00
  • 77763a3e5c Update divisiblity of SD3 Jaret Burkett 2025-04-02 06:49:06 -06:00
  • a42c5a1de5 Adjust buckets for flex2 Jaret Burkett 2025-04-02 06:47:41 -06:00
  • 3d131fb27a Added a file signature check on the dataset size caching system to invalidate cached dimensions if the file changes. Jaret Burkett 2025-04-01 07:39:36 -06:00
  • 5ea19b6292 small bug fixes Jaret Burkett 2025-03-30 20:09:40 -06:00
  • 58861005a5 Version bump Jaret Burkett 2025-03-30 09:23:30 -06:00
  • c083a0e5ea Allow DFE to not have a VAE Jaret Burkett 2025-03-30 09:23:01 -06:00
  • 860d892214 Pixel shuffle adapter. Some bug fixes thrown in Jaret Burkett 2025-03-29 21:15:01 -06:00
  • b94d7aafea Have error boundary if simple job cannot be displayed due to the job being advanced Jaret Burkett 2025-03-27 19:55:40 -06:00
  • 3c95f87a90 Added some missing dependencies Jaret Burkett 2025-03-27 18:48:48 -06:00
  • 1d5f387f54 Fix docker command to work better with runpod Jaret Burkett 2025-03-27 17:44:46 -06:00
  • 5365200da1 Added ability to add models to finetune as plugins. Also added flux2 new arch via that method. Jaret Burkett 2025-03-27 16:07:00 -06:00
  • e9e30104d3 Merge pull request #271 from ostris/wavelet_loss Jaret Burkett 2025-03-26 19:12:09 -06:00
  • ce4c5291a0 Added experimental wavelet loss wavelet_loss Jaret Burkett 2025-03-26 18:11:23 -06:00
  • c101f07834 Version bump Jaret Burkett 2025-03-26 12:16:01 -06:00
  • e4526ad4a4 Updates to handle video in a dataset on ui Jaret Burkett 2025-03-26 12:15:28 -06:00
  • 4595965e06 Added an inpainting mask generator for training inpainting if inpaint mask is not provided Jaret Burkett 2025-03-25 12:16:10 -06:00
  • 41edc18750 Removed unnessary import Jaret Burkett 2025-03-25 11:54:42 -06:00
  • 6021a3dbc0 Change inpainting mask to zero out on latents instead of image for inpaint area. Jaret Burkett 2025-03-24 14:16:52 -06:00
  • 71d7a52146 Fixed issue with python being wrong on docker Jaret Burkett 2025-03-24 14:16:09 -06:00
  • 45be82d5d6 Handle inpainting training for control_lora adapter Jaret Burkett 2025-03-24 13:17:47 -06:00
  • f10937e6da Handle multi control inputs for control lora training Jaret Burkett 2025-03-23 07:37:08 -06:00
  • ccb66c748f Update readme install directions Jaret Burkett 2025-03-22 15:14:04 -06:00
  • 2aca2883e7 Update windows install directions for new version of torch Jaret Burkett 2025-03-22 15:12:51 -06:00
  • 1ad58c5816 Changed control lora to only have new weights and leave other input weights alone for more flexability of using multiple ones together. Jaret Burkett 2025-03-22 10:24:52 -06:00
  • 6dea41b9fc Version bump Jaret Burkett 2025-03-21 11:48:03 -06:00
  • 9a902c067f Show the console log on the job overview in the ui. Jaret Burkett 2025-03-21 11:45:36 -06:00
  • 0bbc69c135 Fix issue where the job would hang in the ui if it failed to start Jaret Burkett 2025-03-21 09:46:41 -06:00
  • 6c5eb0cf87 Move pytorch install above cache bust to prevent reinstalling and reuploading it Jaret Burkett 2025-03-21 06:43:09 -06:00
  • e3373671b9 Fixed missing dependency Jaret Burkett 2025-03-21 06:25:30 -06:00
  • aceb3a0f25 Rework docker Jaret Burkett 2025-03-20 20:07:27 -06:00
  • c8049a483d Fix issue with auth token not on build time Jaret Burkett 2025-03-20 17:27:30 -06:00
  • f5aa4232fa Added ability to quantize with torchao Jaret Burkett 2025-03-20 16:28:54 -06:00
  • 3a6b24f4c8 Added a way to secure the UI. Plus various bug fixes and quality of life updates Jaret Burkett 2025-03-20 08:07:09 -06:00
  • bbfd6ef0fe Fixed bug that prevented using schnell training adapter Jaret Burkett 2025-03-19 10:25:12 -06:00
  • b829983b16 Added ability to load video datasets and train with them Jaret Burkett 2025-03-19 09:54:26 -06:00
  • fa187b1208 Added differential masking to targeted_flow_guidance to allow the model learn to clean up the targeted area a little more than unmasked was capable of Jaret Burkett 2025-03-17 13:25:01 -06:00
  • 5eb627dd9d Add targeted flow guidance training for flow based models Jaret Burkett 2025-03-17 09:21:23 -06:00
  • 604e76d34d Fix issue with full finetuning wan Jaret Burkett 2025-03-17 09:17:40 -06:00
  • 6cde96ae5f Adding files I forgot to stage to the last commit Jaret Burkett 2025-03-15 11:59:41 -06:00
  • 1be613ed06 Added advanced mode yaml editor to the ui Jaret Burkett 2025-03-15 11:58:59 -06:00
  • c52421aab7 Allow clip image to not have processor on dataloader for raw img Jaret Burkett 2025-03-15 08:27:54 -06:00
  • 3812957bc9 Added ability to train control loras. Other important bug fixes thrown in Jaret Burkett 2025-03-14 18:03:00 -06:00
  • 391329dbdc Fix issue with device placement on te Jaret Burkett 2025-03-13 20:48:12 -06:00
  • 3b45892b4f Update sponsors Jaret Burkett 2025-03-13 19:06:59 -06:00
  • cf4216e6b8 Add support for wan training in ui Jaret Burkett 2025-03-13 18:54:27 -06:00
  • 31e057d9a3 Fixed issue with device placement in some scenereos when doing low vram on wan Jaret Burkett 2025-03-13 10:30:27 -06:00
  • d507b44a7b Update sponsors Jaret Burkett 2025-03-08 22:28:20 -07:00
  • 242c04a0b8 Fix error with training video models with batch greater than 1 Jaret Burkett 2025-03-08 18:47:27 -07:00
  • 386e68a422 Fixed a bug that changes all samples to webp Jaret Burkett 2025-03-08 18:02:56 -07:00
  • 850b8da6e5 Added siglip 2 vision encoder for custom adapter Jaret Burkett 2025-03-09 00:14:44 +00:00
  • 51ad19b568 Add config file examples for training Wan LoRAs on 24GB cards. Jaret Burkett 2025-03-08 13:56:21 -07:00
  • e6739f7eb2 Convert wan lora weights on save to be something comfy can handle Jaret Burkett 2025-03-08 12:55:11 -07:00
  • 7e37918fbc Double tap module casting as it doesent seem to happen every time. Jaret Burkett 2025-03-07 22:15:24 -07:00
  • 4d88f8f218 Fixed cuda error when not all tensors have been moved to the correct device. Jaret Burkett 2025-03-07 22:04:35 -07:00
  • 25341c4613 Got wan 14b training to work on 24GB card. Jaret Burkett 2025-03-07 17:04:10 -07:00
  • 391cf80fea Added training for Wan2.1. Not finalized, wait. Jaret Burkett 2025-03-07 13:53:44 -07:00
  • 4e3bda7c70 Merge pull request #264 from ostris/cogview4 Jaret Burkett 2025-03-05 14:52:06 -07:00
  • 763128ea42 Note about cogview Jaret Burkett 2025-03-05 14:46:11 -07:00
  • 4fe33f51c1 Fix issue with picking layers for quantization, adjust layers fo better quantization of cogview4 Jaret Burkett 2025-03-05 13:44:40 -07:00
  • aa44828c0c WIP more work on cogview4 Jaret Burkett 2025-03-05 09:43:00 -07:00
  • 6f6fb90812 Added cogview4. Loss still needs work. Jaret Burkett 2025-03-04 18:43:52 -07:00
  • c57434ad7b Removed wan submodule stuff for now Jaret Burkett 2025-03-04 00:32:24 -07:00
  • 8bb47d1bfe Merge branch 'main' into wan21 Jaret Burkett 2025-03-04 00:31:57 -07:00
  • e7dbb20f68 Removed wan submodule for now Jaret Burkett 2025-03-04 00:29:19 -07:00
  • c5e0c2bbe2 Fixes to allow for redux assisted training Jaret Burkett 2025-03-03 16:27:19 -07:00
  • 1f3f45a48d Bugfixes Jaret Burkett 2025-03-03 08:22:15 -07:00
  • 3c8c84f156 Added supporters to readme and a script to update it Jaret Burkett 2025-03-02 10:25:27 -07:00
  • b001d77efb Added LoKr instructions to the readme Jaret Burkett 2025-03-02 08:55:56 -07:00
  • 7ae31c9ae9 Added LoKr to the ui Jaret Burkett 2025-03-02 08:49:01 -07:00
  • b16819f8e7 Added LoKr support Jaret Burkett 2025-03-02 06:57:50 -07:00