apolinário
f84bd6d7a6
Add Gradio UI for ai-toolkit ( #141 )
...
* Add Gradio UI for FLUX.1
* small text changes
* no flash-attn? no problem!
* bye flash-attn!
* fixes for windows
---------
Co-authored-by: multimodalart <joaopaulo.passos+multimodal@gmail.com >
2024-08-30 06:29:51 -06:00
martintomov
34db804c76
Modal cloud training support, fixed typo in toolkit/scheduler.py, Schnell training support for Colab, issue #92 , issue #114 ( #115 )
...
* issue #76 , load_checkpoint_and_dispatch() 'force_hooks'
https://github.com/ostris/ai-toolkit/issues/76
* RunPod cloud config
https://github.com/ostris/ai-toolkit/issues/90
* change 2x A40 to 1x A40 and price per hour
referring to https://github.com/ostris/ai-toolkit/issues/90#issuecomment-2294894929
* include missed FLUX.1-schnell setup guide in last commit
* huggingface-cli login required auth
* #92 peft, #114 colab, schnell training in colab
* modal cloud - run_modal.py and .yaml configs
* run_modal.py mount path example
* modal_examples renamed to modal
* Training in Modal README.md setup guide
* rename run command in title for consistency
2024-08-22 21:25:44 -06:00
martintomov
5603f9e004
issue #76 , and RunPod cloud training setup #90 ( #80 )
...
* issue #76 , load_checkpoint_and_dispatch() 'force_hooks'
https://github.com/ostris/ai-toolkit/issues/76
* RunPod cloud config
https://github.com/ostris/ai-toolkit/issues/90
* change 2x A40 to 1x A40 and price per hour
referring to https://github.com/ostris/ai-toolkit/issues/90#issuecomment-2294894929
* include missed FLUX.1-schnell setup guide in last commit
* huggingface-cli login required auth
2024-08-18 15:43:45 -06:00
Jaret Burkett
88acc28d7f
Prep for runpod docker
2024-08-03 12:41:06 -06:00
Jaret Burkett
de2da96a81
Updat4ed requirements
2024-08-03 09:50:18 -06:00
Jaret Burkett
acb06d6ff3
Bug fixes
2024-07-03 10:56:34 -06:00
Jaret Burkett
7165f2d25a
Work to omprove pixart training
2024-06-23 20:46:48 +00:00
Jaret Burkett
bd10d2d668
Some work on sd3 training. Not working
2024-06-13 12:19:16 -06:00
Jaret Burkett
3f3636b788
Bug fixes and little improvements here and there.
2024-06-08 06:24:20 -06:00
Jaret Burkett
5da3613e0b
Bug fixes and minor features
2024-04-25 06:14:31 -06:00
Jaret Burkett
89f4bcad2e
Lock diffusers to 0.26.3 until I can figure out why future versions break LoRA code
2024-03-18 10:17:55 -06:00
Jaret Burkett
0d5943af91
Update readme for torch requirements
2023-11-28 12:52:55 -07:00
Jaret Burkett
be815f9c47
updated requirements
2023-11-28 10:43:17 -07:00
Jaret Burkett
a899ec91c8
Added some split prompting started code, adamw8bit, replacements improving, learnable snr gos. A lot of good stuff.
2023-11-01 06:52:21 -06:00
Jaret Burkett
9636194c09
Added fuyu captioning
2023-10-25 14:14:53 -06:00
Jaret Burkett
34eb563d55
Added dataset tagging and management tools using llava
2023-10-24 10:11:47 -06:00
Jaret Burkett
8d9450ad7c
Compatability fixes
2023-09-29 14:07:37 -06:00
Jaret Burkett
27f343fc08
Added base setup for training t2i adapters. Currently untested, saw something else shiny i wanted to finish sirst. Added content_or_style to the training config. It defaults to balanced, which is standard uniform time step sampling. If style or content is passed, it will use cubic sampling for timesteps to favor timesteps that are beneficial for training them. for style, favor later timesteps. For content, favor earlier timesteps.
2023-09-16 08:30:38 -06:00
Jaret Burkett
e8583860ad
Upgraded to dev for t2i on diffusers. Minor migrations to make it work.
2023-09-11 14:46:06 -06:00
Jaret Burkett
3feb663a51
Switched to new bucket system that matched sdxl trained buckets. Fixed requirements. Updated embeddings to work with sdxl. Added method to train lora with an embedding at the trigger. Still testing but works amazingly well from what I can see
2023-09-07 13:06:18 -06:00
Jaret Burkett
2a40937b4f
reworked samplers. Trying to find what is wrong with diffusers sampling is sdxl
2023-09-03 07:56:09 -06:00
Jaret Burkett
1a92e97c6d
Added missing deps
2023-08-13 13:15:04 -06:00
Jaret Burkett
64fbd4c92a
Fix some windows dependency issues
2023-08-05 20:28:49 -06:00
Jaret Burkett
b865ac8b24
Various windows bug fixes
2023-08-04 05:51:58 -06:00
Jaret Burkett
2305e55c82
Moving over to a highly difussers flow for xl
2023-07-26 18:25:01 -06:00
Jaret Burkett
d3ad195b51
Added rescaling, locon, sdxl, all kinds of stuff. sdxl is still weird
2023-07-26 16:19:50 -06:00
Jaret Burkett
cb70c03273
SDXL should be working, but I broke something where it is not converging.
2023-07-25 13:50:59 -06:00
Jaret Burkett
ddcd9069e1
Base for loopback lora training setup, still working on proper sliders
2023-07-21 18:26:02 -06:00
Jaret Burkett
6ada328d8d
Fixed issues with vgg19 preprocessing. Added yaml support on config file
2023-07-19 06:12:57 -06:00
Jaret Burkett
439310e4dc
Made a very basic vae trainer.
2023-07-17 19:03:50 -06:00
Jaret Burkett
57f14e5ef2
WIP implementing training
2023-07-12 08:23:46 -06:00
Jaret Burkett
e4de8983c9
Initial commit
2023-07-05 16:44:58 -06:00
