ai-toolkit

data_transfer_object

Fixed the webp bug finally.

2024-09-25 13:56:00 -06:00

keymaps

Fixed issue with grad scaling

2024-07-20 08:21:57 -06:00

models

Normalize the image embeddings on vd adapter forward

2024-10-12 15:09:48 +00:00

orig_configs

Added refiner fine tuning. Works, but needs some polish.

2023-11-05 17:15:03 -07:00

samplers

Added a new experimental linear weighing technique

2024-09-02 09:22:13 -06:00

util

Added support for pixart sigma loras

2024-06-16 11:56:30 -06:00

__init__.py

Initial commit

2023-07-05 16:44:58 -06:00

assistant_lora.py

fixed huge flux training bug. Added ability to use an assistatn lora

2024-08-14 10:14:13 -06:00

basic.py

Added reference adapters, many bug fixes, more ip adapter work and customizability

2024-01-01 17:15:53 -07:00

buckets.py

A lot of pixart sigma training tweaks

2024-07-28 11:23:18 -06:00

civitai.py

Added ability to use civit ai url ar model name and built a model downloader and cache manager for it

2023-08-13 13:09:51 -06:00

clip_vision_adapter.py

Varous bug fixes

2024-07-10 15:20:04 -06:00

config_modules.py

Added some additional experimental things to the vision direct encoder

2024-10-10 19:42:26 +00:00

config.py

Added specialized scaler training to ip adapters

2024-04-05 08:17:09 -06:00

cuda_malloc.py

Memory optimizations. Default to using cudamalloc when torch 2.0 for mem allocation

2023-09-12 04:30:23 -06:00

custom_adapter.py

Remove norm on image embeds on custom adapter

2024-10-12 00:43:18 +00:00

data_loader.py

Handle errors in loading size database

2024-10-20 07:04:19 -06:00

dataloader_mixins.py

Added some additional experimental things to the vision direct encoder

2024-10-10 19:42:26 +00:00

ema.py

Adjustments to loading of flux. Added a feedback to ema

2024-08-07 13:17:26 -06:00

embedding.py

Work on ipadapters and custom adapters

2024-05-13 06:37:54 -06:00

esrgan_utils.py

Added training for a custom version of ERSGAN arcitecture. Testing training now

2023-08-07 18:04:23 -06:00

extension.py

Added inbuild plugins and made one for image referenced. WIP

2023-08-10 16:02:44 -06:00

guidance.py

Allow for a default caption file in the folder. Minor bug fixes.

2024-10-10 07:31:33 -06:00

image_utils.py

Change img multiplier math

2024-07-30 11:33:41 -06:00

inversion_utils.py

Various bug fixes, wip stuff, and tweaks

2023-11-02 18:19:20 -06:00

ip_adapter.py

Rework ip adapter and vision direct adapters to apply to the single transformer blocks even though they are not cross attn.

2024-09-01 10:40:42 -06:00

job.py

Moved the run job command

2023-08-13 10:25:56 -06:00

kohya_model_util.py

Hotfix to handle latest transformers clip model missing key suddenly

2023-08-02 12:26:18 -06:00

layers.py

Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take

2023-08-05 18:46:08 -06:00

llvae.py

Bug fixes. Added some functionality to help with private extensions

2023-10-05 07:09:34 -06:00

logging.py

Feat: Wandb logging (#95 )

2024-09-19 20:01:01 -06:00

lora_special.py

Check for contains only against clean name for lora, not the adjusted one

2024-08-31 07:44:13 -06:00

lorm.py

Added gradient accumulation finally

2023-10-28 13:14:29 -06:00

losses.py

Fixes to esrgan trainer. Moved logic for sd prompt embeddings out of diffusers pipeline so I can manipulate it

2023-09-16 17:41:07 -06:00

lycoris_special.py

Improved lorm extraction and training

2023-10-28 08:21:59 -06:00

lycoris_utils.py

Updated module names to be compatable with ney koyha unet

2023-07-31 13:16:29 -06:00

metadata.py

Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs

2024-01-28 08:20:03 -07:00

network_mixins.py

Fixes for training ilora on flux

2024-08-31 16:55:26 -06:00

optimizer.py

Added support for AdEMAMix8bit

2024-09-28 14:33:51 -06:00

paths.py

Added refiner fine tuning. Works, but needs some polish.

2023-11-05 17:15:03 -07:00

photomaker_pipeline.py

Initial training script for photomaker training. Needs a little more work.

2024-01-15 18:46:26 -07:00

photomaker.py

Added an experimental clip fusion model that is showing promise for embedding concepts

2024-01-17 13:13:04 -07:00

pipelines.py

Added flux training instructions

2024-08-10 14:10:02 -06:00

progress_bar.py

implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar

2023-09-14 08:31:54 -06:00

prompt_utils.py

Added training for pixart-a

2024-02-13 16:00:04 -07:00

reference_adapter.py

Some work on sd3 training. Not working

2024-06-13 12:19:16 -06:00

resampler.py

Added a clip vision adapter trainer. Only works for sd15 for now

2023-12-24 13:26:04 -07:00

sampler.py

New image generation img2img. various tweaks and fixes

2024-07-24 04:13:41 -06:00

saving.py

Added training for pixart-a

2024-02-13 16:00:04 -07:00

scheduler.py

Modal cloud training support, fixed typo in toolkit/scheduler.py, Schnell training support for Colab, issue #92 , issue #114 (#115 )

2024-08-22 21:25:44 -06:00

sd_device_states_presets.py

Added option to cache empty prompt or trigger and unload text encoders while training

2024-09-21 20:54:09 -06:00

stable_diffusion_model.py

Apply a mask to the embeds for SD if using T5 encoder

2024-10-04 10:55:20 -06:00

style.py

Bug fixes and little improvements here and there.

2024-06-08 06:24:20 -06:00

timer.py

Massive speed increases and ram optimizations

2023-10-10 06:07:55 -06:00

train_pipelines.py

Information trainer

2023-07-28 08:16:29 -06:00

train_tools.py

Added ability to do prompt attn masking for flux

2024-09-02 17:29:36 -06:00