39 Commits

Author SHA1 Message Date
altoiddealer
145a46907e Improve option handling (sd_model_checkpoint / forge_additional_modules) (#2181)
* Sort modules when checking for changes
* Compare consistent checkpoint values
2024-10-26 21:10:05 +01:00
altoiddealer
6dc71b7e1d prevent undoing refresh model load params (#2092)
Ensures `should_refresh_model_loading_params()` is called when needed. Improved code clarity.
2024-10-16 14:52:35 +01:00
DenOfEquity
9efa4eabfd prevent (Managed by Forge) settings from reverting to default (#2090)
* prevent (Managed by Forge) settings reverting to default
* save CLIP skip to config when changed, inconsistent / unpredictable saving behaviour otherwise
2024-10-16 14:10:26 +01:00
altoiddealer
2c543719e3 Improve options management (#2078)
- `/sdapi/v1/options` GET now calls `get_config()` from **sysinfo** module, instead of from its own version of the function.

- Defined a new, flexible and more robust `set_config()` function in **sysinfo** module, which:
  - obsoletes redundant code
  - skips updating values that are unchanged
  - has flexible args for both API and UI use

- `/sdapi/v1/options` POST and `override_settings` now use the new `set_config()` function.  `set_config()` could possibly obsolete additional functions, but I'm not going to get into that just yet.

- Options for `forge_additional_modules` can now be provided either as the file path, or just the module name.

- Most importantly, `refresh_model_loading_parameters()` is now only called ONCE per request, and **only** if necessary.

- It is now much easier to call `shared.opts.save()` as needed
2024-10-16 11:21:54 +01:00
altoiddealer
862c7a589e API Improvements: Modules Change AND Restore override_settings (#2027)
* Improve API modules change
* Restore override_settings and make it work
* Simplify some memory management
2024-10-13 12:29:02 +01:00
DenOfEquity
82eb756617 checks for GPU weights from Settings (#2019)
for the case when GPU has changed and saved settings are not possible anymore
2024-10-09 22:10:06 +01:00
layerdiffusion
4baf8ffb9c less prints 2024-10-03 21:23:56 -07:00
DenOfEquity
b1256b5fc9 More UI settings (#1903)
adds options for user-set defaults for Sampler and Scheduler to UI settings sd, xl, flux;
adds options for user-set defaults for GPU Weights to UI settings xl, flux;
necessitates change to .input event listener instead of .release for ui_forge_inference_memory, which may be more correct anyway.
2024-09-24 11:40:44 +01:00
DenOfEquity
a82d5d177c restore lora version filtering (#1885)
Added Flux to lora types in extra networks UI, so user can set.
Loras versioned first by user-set type, if any. Falls back to heuristics - these are much more reliable than the removed old A1111 tests and in case of no match default to Unknown (always displayed).
Filtering is done based on UI setting. 'all' setting does not filter. Filters lora lists on change.
Removed unused 'lora_hide_unknown_for_versions' setting.
2024-09-23 14:53:58 +01:00
DenOfEquity
95b54a27f1 Settings for UI defaults (#1890)
Three new settings pages, used by UI presets sd, xl, flux. Defaults unchanged.
2024-09-22 15:14:17 +01:00
DenOfEquity
cd244d29d7 add UI defaults for HiRes CFG (#1849) 2024-09-17 18:07:43 +01:00
DenOfEquity
cb412b290b CFG and Distilled CFG for hiresfix (#1810) 2024-09-13 15:01:40 +01:00
layerdiffusion
5a1c711e80 add info 2024-08-30 10:04:04 -07:00
Serick
11a2c0629a Apply settings in ui-config.json to "All" presets (#1541)
* Add preset to load settings from ui-config.json

* Remove added presets and apply ui-config.json to all
2024-08-28 09:15:07 -07:00
DenOfEquity
8c6b64e6e9 main_entry.py: add support for new text_encoder_dir cmd arg
copying method used for VAE
2024-08-25 15:01:30 +01:00
lllyasviel
f82029c5cf support more t5 quants (#1482)
lets hope this is the last time that people randomly invent new state dict key formats
2024-08-24 12:47:49 -07:00
layerdiffusion
56740824e2 add hints and reduce prints to only release slider 2024-08-20 19:02:30 -07:00
layerdiffusion
0252ad86be missing print 2024-08-20 08:47:06 -07:00
layerdiffusion
74aacc5d4b make "GPU weights" also available to SDXL 2024-08-20 08:19:44 -07:00
layerdiffusion
6f411a4940 fix loras on nf4 models when activate "loras in fp16" 2024-08-20 01:29:52 -07:00
layerdiffusion
d38e560e42 Implement some rethinking about LoRA system
1. Add an option to allow users to use UNet in fp8/gguf but lora in fp16.
2. All FP16 loras do not need patch. Others will only patch again when lora weight change.
3. FP8 unet + fp16 lora are available (somewhat only available) in Forge now. This also solves some “LoRA too subtle” problems.
4. Significantly speed up all gguf models (in Async mode) by using independent thread (CUDA stream) to compute and dequant at the same time, even when low-bit weights are already on GPU.
5. View “online lora” as a module similar to ControlLoRA so that it is moved to GPU together with model when sampling, achieving significant speedup and perfect low VRAM management simultaneously.
2024-08-19 04:31:59 -07:00
layerdiffusion
a5f3a50d3f Not all AUTOMATIC have beard 2024-08-15 01:25:47 -07:00
layerdiffusion
32fab6e30d use better name and change to dropdown list 2024-08-15 01:06:17 -07:00
layerdiffusion
df0fee9396 maybe solve --vae-path 2024-08-14 17:58:12 -07:00
lllyasviel
61f83dd610 support all flux models 2024-08-13 05:42:17 -07:00
layerdiffusion
b1f0d8c6d1 default img2img back to square 2024-08-11 18:20:18 -07:00
layerdiffusion
f10359989f fix 2024-08-10 19:40:56 -07:00
lllyasviel
cfa5242a75 forge 2.0.0
see also discussions
2024-08-10 19:24:19 -07:00
layerdiffusion
593455c4de global unload after env var change 2024-08-08 22:34:55 -07:00
layerdiffusion
3f3cb12f76 more tests 2024-08-08 22:12:14 -07:00
layerdiffusion
02ffb04649 revise stream 2024-08-08 19:23:23 -07:00
layerdiffusion
20e1ba4a82 fix 2024-08-08 15:08:20 -07:00
lllyasviel
6921420b3f Load Model only when click Generate
#964
2024-08-08 14:51:13 -07:00
lllyasviel
71c94799d1 diffusion in fp8 landed 2024-08-06 16:47:39 -07:00
layerdiffusion
dd8997ee2e use binder 2024-08-06 15:31:19 -07:00
layerdiffusion
b4ca5d7420 model load entry for all model loads from webui
including startup, checkpoint selection, and that HTML tab of some preview images
2024-08-06 14:38:40 -07:00
layerdiffusion
6d789653b9 better model load logic 2024-08-06 14:34:57 -07:00
layerdiffusion
1e8c0f3436 change name 2024-08-06 14:05:56 -07:00
lllyasviel
71eaa5ca12 rework UI so that the toolbar is managed by Forge 2024-08-06 13:54:06 -07:00