ai-toolkit

data_transfer_object

Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.

2024-01-04 12:59:38 -07:00

keymaps

More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes

2023-12-15 06:02:10 -07:00

models

Adjustments to the clip preprocessor. Allow merging in new weights for ip adapters so you can change the arcitecture while maintaining as much data as possible

2024-01-06 11:56:53 -07:00

orig_configs

Added refiner fine tuning. Works, but needs some polish.

2023-11-05 17:15:03 -07:00

samplers

Added timestep modifications to lcm scheduler for more evenly spaced timesteps

2023-11-17 23:26:52 -07:00

__init__.py

Initial commit

2023-07-05 16:44:58 -06:00

basic.py

Added reference adapters, many bug fixes, more ip adapter work and customizability

2024-01-01 17:15:53 -07:00

buckets.py

Fixed issues with dataloader bucketing. Allow using standard base image for t2i adapters.

2023-09-24 05:19:57 -06:00

civitai.py

Added ability to use civit ai url ar model name and built a model downloader and cache manager for it

2023-08-13 13:09:51 -06:00

clip_vision_adapter.py

Added SDXL support for clip vision embedder trainer

2023-12-24 14:31:29 -07:00

config_modules.py

Initial training script for photomaker training. Needs a little more work.

2024-01-15 18:46:26 -07:00

config.py

Added dataset tagging and management tools using llava

2023-10-24 10:11:47 -06:00

cuda_malloc.py

Memory optimizations. Default to using cudamalloc when torch 2.0 for mem allocation

2023-09-12 04:30:23 -06:00

custom_adapter.py

Initial training script for photomaker training. Needs a little more work.

2024-01-15 18:46:26 -07:00

data_loader.py

Bug fixes with ip adapter training. Made a clip pre processor that can be trained with ip adapter to help augment the clip input to squeeze in more detail from a larget input. moved clip processing to the dataloader for speed.

2024-01-04 12:59:38 -07:00

dataloader_mixins.py

Added additional config options for custom plugins I needed

2024-01-15 08:31:09 -07:00

embedding.py

Varous bug fixes. Finalized targeted guidance algo

2023-11-10 12:18:08 -07:00

esrgan_utils.py

Added training for a custom version of ERSGAN arcitecture. Testing training now

2023-08-07 18:04:23 -06:00

extension.py

Added inbuild plugins and made one for image referenced. WIP

2023-08-10 16:02:44 -06:00

guidance.py

Added additional config options for custom plugins I needed

2024-01-15 08:31:09 -07:00

image_utils.py

Initial commit

2023-12-29 13:07:35 -07:00

inversion_utils.py

Various bug fixes, wip stuff, and tweaks

2023-11-02 18:19:20 -06:00

ip_adapter.py

Prepwork for ilora

2024-01-12 06:41:15 -07:00

job.py

Moved the run job command

2023-08-13 10:25:56 -06:00

kohya_model_util.py

Hotfix to handle latest transformers clip model missing key suddenly

2023-08-02 12:26:18 -06:00

layers.py

Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take

2023-08-05 18:46:08 -06:00

llvae.py

Bug fixes. Added some functionality to help with private extensions

2023-10-05 07:09:34 -06:00

lora_special.py

Added additional config options for custom plugins I needed

2024-01-15 08:31:09 -07:00

lorm.py

Added gradient accumulation finally

2023-10-28 13:14:29 -06:00

losses.py

Fixes to esrgan trainer. Moved logic for sd prompt embeddings out of diffusers pipeline so I can manipulate it

2023-09-16 17:41:07 -06:00

lycoris_special.py

Improved lorm extraction and training

2023-10-28 08:21:59 -06:00

lycoris_utils.py

Updated module names to be compatable with ney koyha unet

2023-07-31 13:16:29 -06:00

metadata.py

Bug fixes, negative prompting during training, hardened catching

2023-11-24 07:25:11 -07:00

network_mixins.py

More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes

2023-12-15 06:02:10 -07:00

optimizer.py

Added some split prompting started code, adamw8bit, replacements improving, learnable snr gos. A lot of good stuff.

2023-11-01 06:52:21 -06:00

paths.py

Added refiner fine tuning. Works, but needs some polish.

2023-11-05 17:15:03 -07:00

photomaker_pipeline.py

Initial training script for photomaker training. Needs a little more work.

2024-01-15 18:46:26 -07:00

photomaker.py

Initial training script for photomaker training. Needs a little more work.

2024-01-15 18:46:26 -07:00

pipelines.py

Initial commit

2023-12-29 13:07:35 -07:00

progress_bar.py

implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar

2023-09-14 08:31:54 -06:00

prompt_utils.py

Bug fixes, work on maing IP adapters more customizable.

2023-12-24 08:32:39 -07:00

reference_adapter.py

Added reference adapters, many bug fixes, more ip adapter work and customizability

2024-01-01 17:15:53 -07:00

resampler.py

Added a clip vision adapter trainer. Only works for sd15 for now

2023-12-24 13:26:04 -07:00

sampler.py

More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes

2023-12-15 06:02:10 -07:00

saving.py

Initial training script for photomaker training. Needs a little more work.

2024-01-15 18:46:26 -07:00

scheduler.py

Added doffusers schedulers

2023-10-29 12:39:50 -06:00

sd_device_states_presets.py

More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes

2023-12-15 06:02:10 -07:00

stable_diffusion_model.py

Initial training script for photomaker training. Needs a little more work.

2024-01-15 18:46:26 -07:00

style.py

Fixes to esrgan trainer. Moved logic for sd prompt embeddings out of diffusers pipeline so I can manipulate it

2023-09-16 17:41:07 -06:00

timer.py

Massive speed increases and ram optimizations

2023-10-10 06:07:55 -06:00

train_pipelines.py

Information trainer

2023-07-28 08:16:29 -06:00

train_tools.py

More guidance work. Improved LoRA module resolver for unet. Added vega mappings and LoRA training for it. Various other bigfixes and changes

2023-12-15 06:02:10 -07:00