ostris/ai-toolkit
1
0
Fork 0
mirror of https://github.com/ostris/ai-toolkit.git synced 2026-02-02 20:07:53 +00:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 181f237a7b added flipping x and y for dataset loader Jaret Burkett 2023-09-17 08:42:54 -06:00
  • c698837241 Fixes to esrgan trainer. Moved logic for sd prompt embeddings out of diffusers pipeline so I can manipulate it Jaret Burkett 2023-09-16 17:41:07 -06:00
  • 27f343fc08 Added base setup for training t2i adapters. Currently untested, saw something else shiny i wanted to finish sirst. Added content_or_style to the training config. It defaults to balanced, which is standard uniform time step sampling. If style or content is passed, it will use cubic sampling for timesteps to favor timesteps that are beneficial for training them. for style, favor later timesteps. For content, favor earlier timesteps. Jaret Burkett 2023-09-16 08:30:38 -06:00
  • 3eb3535683 Merge pull request #12 from bendeguzvaradi/main Jaret Burkett 2023-09-14 15:31:09 -06:00
  • 17e4fe40d7 Prevent lycoris network moduels if not training that part of network. Skew timesteps to favor later steps. It performs better Jaret Burkett 2023-09-14 15:13:24 -06:00
  • 569d7464d5 implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar Jaret Burkett 2023-09-14 08:31:54 -06:00
  • 4e945917df added dropout to LoRA networks Jaret Burkett 2023-09-13 15:23:07 -06:00
  • ae70200d3c Bug fixes, speed improvements, compatability adjustments withdiffusers updates Jaret Burkett 2023-09-13 07:03:53 -06:00
  • d8d1e6fd1e big fixes Jaret Burkett 2023-09-12 18:48:39 -06:00
  • 257da9493d Dont load image if we are cachine latents Jaret Burkett 2023-09-12 18:39:41 -06:00
  • b5a2669b74 Fixed memory leak Jaret Burkett 2023-09-12 07:03:10 -06:00
  • d74dd636ee Memory optimizations. Default to using cudamalloc when torch 2.0 for mem allocation Jaret Burkett 2023-09-12 04:30:23 -06:00
  • e8583860ad Upgraded to dev for t2i on diffusers. Minor migrations to make it work. Jaret Burkett 2023-09-11 14:46:06 -06:00
  • 3d387103cd safety checker to None bendeguzvaradi 2023-09-11 17:05:55 +02:00
  • 083cefa78c Bugfixes for slider reference Jaret Burkett 2023-09-10 18:36:23 -06:00
  • b5ec8e4eb1 Improve reference slider memory and speed Jaret Burkett 2023-09-10 18:26:44 -06:00
  • 708b07adb7 Fixed issue with interleaving when doing cfg Jaret Burkett 2023-09-10 10:26:58 -06:00
  • a437aed45f bug fix Jaret Burkett 2023-09-10 09:52:14 -06:00
  • 34bfeba229 Massive speed increase. Added latent caching both to disk and to memory Jaret Burkett 2023-09-10 08:54:49 -06:00
  • 41a3f63b72 allow smaller images in buckets and bucket them Jaret Burkett 2023-09-10 03:43:02 -06:00
  • 626ed2939a bug fixes Jaret Burkett 2023-09-09 15:04:44 -06:00
  • 2128ac1e08 fixed issue with embed name, save whole config to dir instead of just process so it can be easily shared. Only make one config, no timesteps Jaret Burkett 2023-09-09 12:24:08 -06:00
  • be804c9cf5 Save embeddings as their trigger to match auto and comfy style loading. Also, FINALLY found why gradients were wonkey and fixed it. The root problem is dropping out of network state before backward pass. Jaret Burkett 2023-09-09 12:02:07 -06:00
  • 408c50ead1 actually got gradient checkpointing working, again, again, maybe Jaret Burkett 2023-09-09 11:27:42 -06:00
  • 4ed03a8d92 Fixed issue with buckets scaling. again Jaret Burkett 2023-09-08 16:32:14 -06:00
  • b01ab5d375 FINALLY fixed gradient checkpointing issue. Big batches baby. Jaret Burkett 2023-09-08 15:21:46 -06:00
  • cb91b0d6da Changed model download from HF to fp16 Jaret Burkett 2023-09-08 07:57:19 -06:00
  • ce4f9fe02a Bug fixes and improvements to token injection Jaret Burkett 2023-09-08 06:10:59 -06:00
  • 92a086d5a5 Fixed issue with token replacements Jaret Burkett 2023-09-07 13:42:39 -06:00
  • 3feb663a51 Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see Jaret Burkett 2023-09-07 13:06:18 -06:00
  • 436bf0c6a3 Added experimental concept replacer, replicate converter, bucket maker, and other goodies Jaret Burkett 2023-09-06 18:50:32 -06:00
  • f84500159c Fixed issue with lora layer check Jaret Burkett 2023-09-04 14:27:37 -06:00
  • 64a5441832 Fully tested and now supporting locon on sdxl. If you have the ram Jaret Burkett 2023-09-04 14:05:10 -06:00
  • a4c3507a62 Added LoCON from LyCORIS Jaret Burkett 2023-09-04 08:48:07 -06:00
  • fa8fc32c0a Corrected key saving and loading to better match kohya Jaret Burkett 2023-09-04 00:22:34 -06:00
  • 22ed539321 Allow special args for schedulers Jaret Burkett 2023-09-03 20:38:44 -06:00
  • 7cd6945082 Added my annotator/preprocessor and improved network jitter on reference trainer Jaret Burkett 2023-09-03 16:43:51 -06:00
  • 2a40937b4f reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl Jaret Burkett 2023-09-03 07:56:09 -06:00
  • 4ca819a05e Fixes for dataloader Jaret Burkett 2023-08-31 04:54:10 -06:00
  • addf024630 Fixed issue with omitting square pictures Jaret Burkett 2023-08-30 15:00:22 -06:00
  • 33267e117c Reworked bucket loader to scale buckets to pixels amounts not just minimum size. Makes the network more consistant Jaret Burkett 2023-08-30 14:52:12 -06:00
  • d401348c2e Make data loader resiliant to bad headers in meta Jaret Burkett 2023-08-29 18:56:06 -06:00
  • 836fee47a6 Fixed some mismatched weights by adjusting tolerance. The mismatch ironically made the models better lol Jaret Burkett 2023-08-29 15:20:03 -06:00
  • 14ff51ceb4 fixed issues with converting and saving models. Cleaned keys. Improved testing for cycle load saving. Jaret Burkett 2023-08-29 12:31:19 -06:00
  • 714854ee86 Hude rework to move the batch to a DTO to make it far more modular to the future ui Jaret Burkett 2023-08-29 10:22:19 -06:00
  • bd758ff203 Cleanup and small bug fixes Jaret Burkett 2023-08-29 05:45:49 -06:00
  • a008d9e63b Fixed issue with loadin models after resume function added. Added additional flush if not training text encoder to clear out vram before grad accum Jaret Burkett 2023-08-28 17:56:30 -06:00
  • b79ced3e10 Merge branch 'main' into development Jaret Burkett 2023-08-28 16:21:51 -06:00
  • bee0b6a235 Added converters for all stable diffusion models to convert back to ldm format from diffusers. Jaret Burkett 2023-08-28 16:12:32 -06:00
  • 2ecb5cf024 Merge branch 'main' into development Jaret Burkett 2023-08-28 14:01:44 -06:00
  • fab7c2b04a Fixed issue with key mapping from diffusers back to ldm Jaret Burkett 2023-08-28 14:01:26 -06:00
  • e866c75638 Built base interfaces for a DTO to handle batch infomation transports for the dataloader Jaret Burkett 2023-08-28 12:43:31 -06:00
  • 71da78c8af improved normalization for a network with varrying batch network weights Jaret Burkett 2023-08-28 12:42:57 -06:00
  • c446f768ea Huge memory optimizations, many big fixes Jaret Burkett 2023-08-27 17:48:02 -06:00
  • cc49786ee9 Dataloader bug fixes Jaret Burkett 2023-08-27 14:36:38 -06:00
  • 9b164a8688 Fixed issue with bucket dataloader corpping in too much. Added normalization capabilities to LoRA modules. Testing effects, but should prevent them from burning and also make them more compatable with stacking many LoRAs Jaret Burkett 2023-08-27 09:40:01 -06:00
  • 6bd3851058 Fixed issue with prompt token replace adding more than one replacement Jaret Burkett 2023-08-26 18:52:23 -06:00
  • fd338e67bb Fixed bug with dataloader not seperating mulitple datasets Jaret Burkett 2023-08-26 18:07:24 -06:00
  • 8105c05c12 Added bucketting capabilities to dataloader. Finally have full planned capability. noice Jaret Burkett 2023-08-26 16:36:32 -06:00
  • 2cb27c3f57 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2023-08-26 08:55:09 -06:00
  • 3367ab6b2c Moved SD batch processing to a shared method and added it for use in slider training. Still testing if it affects quality over sampling Jaret Burkett 2023-08-26 08:55:00 -06:00
  • 24f46ea7d6 Merge pull request #9 from FoundSol/patch-1 Jaret Burkett 2023-08-25 20:05:51 -06:00
  • 5bef2985b5 Update README.md Fundamentum 2023-08-25 21:13:24 -03:00
  • aeaca13d69 Fixed issue with shuffeling permutations Jaret Burkett 2023-08-23 22:02:00 -06:00
  • b408f9f3eb Fixed issue with timestep I broke for sliders Jaret Burkett 2023-08-23 16:15:30 -06:00
  • 7157c316af Added support for training lora, dreambooth, and fine tuning. Still need testing and docs Jaret Burkett 2023-08-23 15:37:00 -06:00
  • e2c547f6c2 Fixed typo Jaret Burkett 2023-08-23 13:33:48 -06:00
  • 7b770bc305 Merge pull request #7 from ostris/textual_inversion Jaret Burkett 2023-08-23 13:31:37 -06:00
  • f200cf36c5 Added train example to ti Jaret Burkett 2023-08-23 13:30:29 -06:00
  • d298240cec Tied in ant tested TI script Jaret Burkett 2023-08-23 13:26:28 -06:00
  • 2e6c55c720 WIP creating textual inversion training script Jaret Burkett 2023-08-22 21:02:38 -06:00
  • 36ba08d3fa Added a converter back to ldm from diffusers for sdxl. Can finally get to training it properly Jaret Burkett 2023-08-21 16:22:01 -06:00
  • e8667f856f Fix issue with there being an extra . on gene Jaret Burkett 2023-08-20 15:54:38 -06:00
  • bef5551ea5 Ultimate slider training built, still needs tuning Jaret Burkett 2023-08-19 18:54:34 -06:00
  • b77b9acc0b Added base for ultimate slider. WIP Jaret Burkett 2023-08-19 15:35:24 -06:00
  • c6675e2801 Added shuffeling to prompts Jaret Burkett 2023-08-19 07:57:30 -06:00
  • 90eedb78bf Added multiplier jitter, min_snr, ability to choose sdxl encoders to use, shuffle generator, and other fun Jaret Burkett 2023-08-19 05:54:22 -06:00
  • 80e2f4a2a4 Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2023-08-18 11:45:00 -06:00
  • d51c4ca704 Added ability to use two seperate folders for datasets when doing image reference sliders Jaret Burkett 2023-08-18 11:44:33 -06:00
  • c7ec132d5d third times a charm Jaret Burkett 2023-08-16 20:54:00 -06:00
  • ed9607e8da Update SliderTraining.ipynb Jaret Burkett 2023-08-16 20:49:09 -06:00
  • d44f8ac508 Update SliderTraining.ipynb Jaret Burkett 2023-08-16 20:47:56 -06:00
  • 8d09eb44ec Fixed an issue with CFG time embeds on SDXL Jaret Burkett 2023-08-15 18:02:14 -06:00
  • 1d2523b978 WIP porting to kohya-sdxl. So much to do. kohya-sdxl Jaret Burkett 2023-08-15 17:07:34 -06:00
  • 55a5fcc7d9 Added method to get specific keys from model Jaret Burkett 2023-08-15 14:51:04 -06:00
  • e96874241d Added slider colab to readme Jaret Burkett 2023-08-13 13:55:38 -06:00
  • e3be1a1758 Added WIP slider training colab Jaret Burkett 2023-08-13 13:52:38 -06:00
  • 1a92e97c6d Added missing deps Jaret Burkett 2023-08-13 13:15:04 -06:00
  • 355c80df07 Added ability to use civit ai url ar model name and built a model downloader and cache manager for it Jaret Burkett 2023-08-13 13:09:51 -06:00
  • 1487d13191 Moved the run job command Jaret Burkett 2023-08-13 10:25:56 -06:00
  • 383bad958d Added a way to run as a library by passing job dict Jaret Burkett 2023-08-13 09:54:39 -06:00
  • 196b693cf0 Worked on reference slider script. It is working well currently. Still going to tune it a bit before a writeup though Jaret Burkett 2023-08-12 17:59:24 -06:00
  • fd95e7b60c Merge branch 'main' of github.com:ostris/ai-toolkit Jaret Burkett 2023-08-12 05:59:58 -06:00
  • 379992d89e Various bug fixes and improvements Jaret Burkett 2023-08-12 05:59:50 -06:00
  • c7054d714f Finally muted the annoying safety checker notification Jaret Burkett 2023-08-12 01:38:18 -06:00
  • 67dfd9ced0 Added inbuild plugins and made one for image referenced. WIP Jaret Burkett 2023-08-10 16:20:38 -06:00
  • 1a7e346b41 Added inbuild plugins and made one for image referenced. WIP Jaret Burkett 2023-08-10 16:02:44 -06:00
  • df48f0a843 Moved some of the job config into base process so it will be easier to extend extensions Jaret Burkett 2023-08-10 12:14:05 -06:00
  • fbc8a87a05 Reworked the sd rescaler script Jaret Burkett 2023-08-09 08:57:27 -06:00
  • bf90740b59 Fixed numerous issues with traing ESRGAN Jaret Burkett 2023-08-08 20:03:19 -06:00