Jaret Burkett 171535833a Add Mac OS support for Apple Silicon (#770) ...

* Made an install script and auto updates env for mac

* GPU sensors and initial training working for MAC. Still WIP.

* Switch dataloader to single threaded until I can work around some mac pickeling issues.

* Get quantization working on mac

* Fix mac exclusive imports so they don't break other builds.

* Add mac instructions to the UI

2026-03-30 09:37:47 -06:00

..

audio

Add LTX-2 Support (#644)

2026-01-13 04:55:30 -07:00

data_transfer_object

Add support for audo frame count so datasets can have varrying length videos. Varous ltx 2.3 VAE optimizations such as removing tiling articacts, and doing frame split encoding to reduce vram on encoding/decoding.

2026-03-24 12:20:09 -06:00

keymaps

Fixed issue with grad scaling

2024-07-20 08:21:57 -06:00

memory_management

Do not copy pin memory if it fails, just move

2025-11-17 18:04:00 +00:00

models

Add Mac OS support for Apple Silicon (#770)

2026-03-30 09:37:47 -06:00

optimizers

Added a basic torch profiler that can be used in config during development to find some obvious issues.

2025-06-17 13:03:39 -06:00

orig_configs

Added refiner fine tuning. Works, but needs some polish.

2023-11-05 17:15:03 -07:00

samplers

WIP on mean flow loss. Still a WIP.

2025-06-12 08:00:51 -06:00

timestep_weighing

Added new timestep weighing strategy

2025-06-04 01:16:02 -06:00

util

Add Mac OS support for Apple Silicon (#770)

2026-03-30 09:37:47 -06:00

__init__.py

Initial commit

2023-07-05 16:44:58 -06:00

accelerator.py

Fallback unwrapping logic if fails

2025-05-21 03:10:33 -06:00

assistant_lora.py

fixed huge flux training bug. Added ability to use an assistatn lora

2024-08-14 10:14:13 -06:00

basic.py

Add Mac OS support for Apple Silicon (#770)

2026-03-30 09:37:47 -06:00

buckets.py

Added ability to load video datasets and train with them

2025-03-19 09:54:26 -06:00

civitai.py

Added ability to use civit ai url ar model name and built a model downloader and cache manager for it

2023-08-13 13:09:51 -06:00

clip_vision_adapter.py

Varous bug fixes

2024-07-10 15:20:04 -06:00

config_modules.py

Add Mac OS support for Apple Silicon (#770)

2026-03-30 09:37:47 -06:00

config.py

Added specialized scaler training to ip adapters

2024-04-05 08:17:09 -06:00

control_generator.py

Remove easy-dwpose from the default requierments

2025-12-20 07:16:20 -07:00

cuda_malloc.py

Memory optimizations. Default to using cudamalloc when torch 2.0 for mem allocation

2023-09-12 04:30:23 -06:00

custom_adapter.py

More work on mean flow loss. Moved it to an adapter. Still not functioning properly though.

2025-06-16 07:17:35 -06:00

data_loader.py

Add Mac OS support for Apple Silicon (#770)

2026-03-30 09:37:47 -06:00

dataloader_mixins.py

Add support for audo frame count so datasets can have varrying length videos. Varous ltx 2.3 VAE optimizations such as removing tiling articacts, and doing frame split encoding to reduce vram on encoding/decoding.

2026-03-24 12:20:09 -06:00

dequantize.py

Improvements for full tuning flux. Added debugging launch config for vscode

2024-10-29 04:54:08 -06:00

ema.py

Increase ema feedback amount. Normalize the dfe 4 image embeds

2025-06-10 08:01:13 -06:00

embedding.py

Work on ipadapters and custom adapters

2024-05-13 06:37:54 -06:00

esrgan_utils.py

Added training for a custom version of ERSGAN arcitecture. Testing training now

2023-08-07 18:04:23 -06:00

extension.py

Added support for finetuning OmniGen2.

2025-06-25 13:58:16 -06:00

guidance.py

Add model hooks to polarity loss

2025-04-17 09:00:10 -06:00

image_utils.py

Adjust dataloader tester to handle videos to test them

2025-10-21 14:47:23 -06:00

inversion_utils.py

Various bug fixes, wip stuff, and tweaks

2023-11-02 18:19:20 -06:00

ip_adapter.py

Remove ip adapter submodule

2025-04-18 09:59:42 -06:00

job.py

Moved the run job command

2023-08-13 10:25:56 -06:00

kohya_lora.py

Removed all submodules. Submodule free now, yay.

2025-04-18 10:39:15 -06:00

kohya_model_util.py

Hotfix to handle latest transformers clip model missing key suddenly

2023-08-02 12:26:18 -06:00

layers.py

Complete reqork of how slider training works and optimized it to hell. Can run entire algorythm in 1 batch now with less VRAM consumption than a quarter of it used to take

2023-08-05 18:46:08 -06:00

llvae.py

Bug fixes. Added some functionality to help with private extensions

2023-10-05 07:09:34 -06:00

logging_aitk.py

Add loss graph to the ui

2025-12-18 10:08:59 -07:00

lora_special.py

Add LTX-2 Support (#644)

2026-01-13 04:55:30 -07:00

lorm.py

Various bug fixes and optimizations for quantized training. Added untested custom adam8bit optimizer. Did some work on LoRM (dont use)

2024-11-20 09:16:55 -07:00

losses.py

Small updates and bug fixes for various things

2025-06-03 20:08:35 -06:00

lycoris_special.py

Improved lorm extraction and training

2023-10-28 08:21:59 -06:00

lycoris_utils.py

Updated module names to be compatable with ney koyha unet

2023-07-31 13:16:29 -06:00

metadata.py

Many bug fixes. Ip adapter bug fixes. Added noise to unconditional, it works better. added an ilora adapter for 1 shotting LoRAs

2024-01-28 08:20:03 -07:00

network_mixins.py

Add method to do continuious lora merging in for low vram full finetuning.

2026-02-26 09:00:41 -07:00

optimizer.py

Fixed adafactor eps

2025-10-26 05:47:25 -06:00

paths.py

Switch to unified text encoder for wan models. Pred for 2.2 14b

2025-08-14 10:07:18 -06:00

photomaker_pipeline.py

Initial training script for photomaker training. Needs a little more work.

2024-01-15 18:46:26 -07:00

photomaker.py

Added an experimental clip fusion model that is showing promise for embedding concepts

2024-01-17 13:13:04 -07:00

pipelines.py

Change inpainting mask to zero out on latents instead of image for inpaint area.

2025-03-24 14:16:52 -06:00

pixel_shuffle_encoder.py

Pixel shuffle adapter. Some bug fixes thrown in

2025-03-29 21:15:01 -06:00

print.py

Fix issue where the job would hang in the ui if it failed to start

2025-03-21 09:46:41 -06:00

progress_bar.py

implemented device placement preset system more places. Vastly improved speed on setting network multiplier and activating network. Fixed timing issues on progress bar

2023-09-14 08:31:54 -06:00

prompt_utils.py

Fixed issue on z-image that prevented training at a larger batch size

2026-03-10 15:43:25 -06:00

reference_adapter.py

Removed all submodules. Submodule free now, yay.

2025-04-18 10:39:15 -06:00

resampler.py

Added a clip vision adapter trainer. Only works for sd15 for now

2023-12-24 13:26:04 -07:00

sampler.py

WIP on mean flow loss. Still a WIP.

2025-06-12 08:00:51 -06:00

saving.py

Added training for pixart-a

2024-02-13 16:00:04 -07:00

scheduler.py

Modal cloud training support, fixed typo in toolkit/scheduler.py, Schnell training support for Colab, issue #92 , issue #114 (#115)

2024-08-22 21:25:44 -06:00

sd_device_states_presets.py

Added training for an experimental decoratgor embedding. Allow for turning off guidance embedding on flux (for unreleased model). Various bug fixes and modifications

2024-12-15 08:59:27 -07:00

stable_diffusion_model.py

Add Mac OS support for Apple Silicon (#770)

2026-03-30 09:37:47 -06:00

style.py

Bug fixes and little improvements here and there.

2024-06-08 06:24:20 -06:00

timer.py

Show the console log on the job overview in the ui.

2025-03-21 11:45:36 -06:00

train_pipelines.py

Information trainer

2023-07-28 08:16:29 -06:00

train_tools.py

Added initial support for f-lite model

2025-05-01 11:15:18 -06:00

unloader.py

Fix issue where text encoder was not fully unloaded in some instances

2025-11-19 09:01:00 -07:00