lllyasviel/stable-diffusion-webui-forge
1
0
Fork 0
mirror of https://github.com/lllyasviel/stable-diffusion-webui-forge.git synced 2026-02-24 16:53:56 +00:00
Code Issues Packages Projects Releases Wiki Activity

update hints for 4090

Browse Source
This commit is contained in:
lllyasviel
2024-02-06 07:43:33 -08:00
parent 7359740f36
commit 4939cf18d8
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
README.md
View File

@@ -76,7 +76,10 @@ Forge backend removes all WebUI's codes related to resource management and rewor
Without any cmd flag, Forge can run SDXL with 4GB vram and SD1.5 with 2GB vram.
**The only one flag that you may still need** is `--always-offload-from-vram` (This flag will make things **slower**). This option will let Forge always unload models from VRAM. This can be useful if you use multiple software together and want Forge to use less VRAM and give some vram to other software, or when you are using some old extensions that will compete vram with Forge, or (very rarely) when you get OOM.
The only two flags that you may still need:
1. `--always-offload-from-vram` (This flag will make things slower). This option will let Forge always unload models from VRAM. This can be useful if you use multiple software together and want Forge to use less VRAM and give some vram to other software, or when you are using some old extensions that will compete vram with Forge, or (very rarely) when you get OOM.
2. `--always-gpu` (This flag will completely avoid model offload). If you use GPU with lots of memory like 4090 24GB, you should use this flag to probably further speed up inference by avoiding moving models repeatedly.
If you really want to play with cmd flags, you can additionally control the GPU with: