lllyasviel/stable-diffusion-webui-forge
1
0
Fork 0
mirror of https://github.com/lllyasviel/stable-diffusion-webui-forge.git synced 2026-03-13 17:09:49 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix repeated model loading bug on 4090

Browse Source
This commit is contained in:
lllyasviel
2024-02-06 08:02:03 -08:00
parent a578da074b
commit 402b7beb87
2 changed files with 2 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
README.md
View File

@@ -76,10 +76,7 @@ Forge backend removes all WebUI's codes related to resource management and rewor
Without any cmd flag, Forge can run SDXL with 4GB vram and SD1.5 with 2GB vram.
The only two flags that you may still need:
1. `--always-offload-from-vram` (This flag will make things slower). This option will let Forge always unload models from VRAM. This can be useful if you use multiple software together and want Forge to use less VRAM and give some vram to other software, or when you are using some old extensions that will compete vram with Forge, or (very rarely) when you get OOM.
2. `--always-gpu` (This flag will avoid model moving/offload). If you use GPU with lots of memory like 4090 24GB, you should use this flag to probably further speed up inference by avoiding moving models repeatedly.
**The only one flag that you may still need** is `--always-offload-from-vram` (This flag will make things **slower**). This option will let Forge always unload models from VRAM. This can be useful if you use multiple software together and want Forge to use less VRAM and give some vram to other software, or when you are using some old extensions that will compete vram with Forge, or (very rarely) when you get OOM.
If you really want to play with cmd flags, you can additionally control the GPU with:

2
modules_forge/forge_version.py
View File

@@ -1 +1 @@
version = '0.0.8'
version = '0.0.9'