Commit Graph

8391 Commits

Author SHA1 Message Date
layerdiffusion
f22b80ef94 restrict baking to 16bits 2024-08-26 06:16:13 -07:00
layerdiffusion
7cd94babdd Revert "Update README.md"
This reverts commit 891e355fc8.
2024-08-26 04:52:46 -07:00
layerdiffusion
388b70134b fix offline loras 2024-08-25 20:28:40 -07:00
lllyasviel
891e355fc8 Update README.md 2024-08-25 17:38:54 -07:00
layerdiffusion
b25b62da96 fix T5 not baked 2024-08-25 17:31:50 -07:00
layerdiffusion
cae37a2725 fix dequant of unbaked parameters 2024-08-25 17:24:31 -07:00
layerdiffusion
82dfc2b15b Significantly speed up Q4_0, Q4_1, Q4_K
by precomputing all possible 4bit dequant into a lookup table and use pytorch indexing to get dequant, rather than really computing the bit operations.
This should give very similar performance to native CUDA kernels, while being LoRA friendly and more flexiable
2024-08-25 16:49:33 -07:00
layerdiffusion
e60bb1c96f Make Q4_K_S as fast as Q4_0
by baking the layer when model load
2024-08-25 15:02:54 -07:00
layerdiffusion
868f662eb6 fix 2024-08-25 14:44:01 -07:00
layerdiffusion
13d6f8ed90 revise GGUF by precomputing some parameters
rather than computing them in each diffusion iteration
2024-08-25 14:30:09 -07:00
Panchovix
ba01ad3711 Merge pull request #1489 from DenOfEquity/pnginfo
allow repeated drag-drop into PNGInfo tab
2024-08-25 16:27:39 -04:00
DenOfEquity
424baa110d Update dragdrop.js
remove unnecessary check for PNGInfo element
enables repeated drag-drop into PNG Info
fixes https://github.com/lllyasviel/stable-diffusion-webui-forge/issues/1485
2024-08-25 10:14:45 +01:00
Panchovix
59dd981fa7 Merge pull request #1484 from altoiddealer/api_get_extensions_commit_date
Correct commit_date type to 'int'
2024-08-24 22:43:26 -04:00
altoiddealer
7dde12e5cf Correct commit_date type to 'int' 2024-08-24 21:17:08 -04:00
lllyasviel
f82029c5cf support more t5 quants (#1482)
lets hope this is the last time that people randomly invent new state dict key formats
2024-08-24 12:47:49 -07:00
lllyasviel
0f3309eb3d Add doc 2024-08-24 02:07:13 -07:00
layerdiffusion
8ff0dc6fed add quick list 2024-08-23 11:43:34 -07:00
altoiddealer
86e3ccaa9d checkpoint change (#1427)
* checkpoint change

credit to @dermesut

https://github.com/lllyasviel/stable-diffusion-webui-forge/issues/1421

Enables `sd_model_checkpoint` parameter for API payloads

* Omit redundant .save()
2024-08-23 09:01:30 -07:00
layerdiffusion
f23ee63cb3 always set empty cache signal as long as any patch happens 2024-08-23 08:56:57 -07:00
layerdiffusion
df598c4df5 add "Diffusion in Low Bits" to info text 2024-08-22 23:23:14 -07:00
layerdiffusion
0bf68c5448 revise NGMS 2024-08-22 23:07:05 -07:00
Haoming
7b3b5fd0fd ngms (#1434) 2024-08-22 23:06:17 -07:00
Igor Aherne
4dc36268c2 bugfix: controlnet works in API - image no longer a dictionary (#1425)
Generating from browser works with controlnet.
Generating via API wasn't.
This is because from_dict() was making 'image' and 'mask_image' a dictionary.

In 'controlnet.py' function 'get_input_data' this would cause the following check to throw exception because used to be an incorrect type:

elif (unit_image < 5).all() and (unit_image_fg > 5).any():

Now, they are never a dictionary and check is fine
2024-08-22 21:50:33 -07:00
Will Cole
088be3af0e Possible partial fix for #952, #1235, #1343 (#1386) 2024-08-22 21:48:08 -07:00
twarrendewit
f7ab23b1cb Variable-Strength StyleAlign (#1387)
* adding efficiency

* adding variable strength

* Revert "adding efficiency"

This reverts commit 6d0ad98c06.

* updating with 0 and 1 cases

---------

Co-authored-by: T. Warren de Wit <tww0007@uah.edu>
2024-08-22 12:52:41 -07:00
altoiddealer
d169cd5881 Gets type (#1410) 2024-08-22 12:50:09 -07:00
layerdiffusion
2ab19f7f1c revise lora patching 2024-08-22 11:59:43 -07:00
DenOfEquity
28ad046447 add distilled cfg to xyz grid (#1413) 2024-08-22 10:53:32 -07:00
layerdiffusion
68bf7f85aa speed up nf4 lora in offline patching mode 2024-08-22 10:35:11 -07:00
layerdiffusion
95d04e5c8f fix 2024-08-22 10:08:21 -07:00
layerdiffusion
14eac6f2cf add a way to empty cuda cache on the fly 2024-08-22 10:06:39 -07:00
layerdiffusion
64b5ce49d1 revise space memory management subsystem 2024-08-22 08:57:21 -07:00
layerdiffusion
08f7487590 revise "send distilled_cfg_scale when generating hires conds" 2024-08-22 06:35:13 -07:00
DenOfEquity
bfd7fb1d9f send distilled_cfg_scale when generating hires conds (#1403) 2024-08-22 06:33:48 -07:00
Igor Aherne
852e88564c Update api.py (#1389)
get_sd_models now also returning config - fixes the following error:

fastapi.exceptions.ResponseValidationError: 1 validation errors:
  {'type': 'missing', 'loc': ('response', 0, 'config'), 'msg': 'Field required', 'input': {'title': 'realisticVisionV51_v51VAE.safetensors', 'model_name': 'realisticVisionV51_v51VAE', 'hash': None, 'sha256': None, 'filename': 'C:\\Users\\Igor\\Documents\\StableProjectorz\\stable-diffusion-webui-forge\\webui\\models\\Stable-diffusion\\realisticVisionV51_v51VAE.safetensors'}, 'url': 'https://errors.pydantic.dev/2.8/v/missing'}
2024-08-21 22:47:40 -07:00
layerdiffusion
01938f64f0 add items to readme quicklist 2024-08-21 22:44:25 -07:00
layerdiffusion
909ad6c734 fix prints 2024-08-21 22:24:54 -07:00
layerdiffusion
c1614e08c6 fix #1385 2024-08-21 22:08:07 -07:00
layerdiffusion
0d8eb4c5ba fix #1375 2024-08-21 11:01:59 -07:00
layerdiffusion
4e3c78178a [revised] change some dtype behaviors based on community feedbacks
only influence old devices like 1080/70/60/50.
please remove cmd flags if you are on 1080/70/60/50 and previously used many cmd flags to tune performance
2024-08-21 10:23:38 -07:00
layerdiffusion
1419ef29aa Revert "change some dtype behaviors based on community feedbacks"
This reverts commit 31bed671ac.
2024-08-21 10:10:49 -07:00
layerdiffusion
31bed671ac change some dtype behaviors based on community feedbacks
only influence old devices like 1080/70/60/50.
please remove cmd flags if you are on 1080/70/60/50 and previously used many cmd flags to tune performance
2024-08-21 08:46:52 -07:00
layerdiffusion
2b1e7366a7 Update requirements.txt 2024-08-21 03:31:24 -07:00
lllyasviel
c73ff3724c update some codes related to win32 2024-08-21 03:23:34 -07:00
layerdiffusion
3e253012b5 huggingface-hub==0.24.6 2024-08-20 23:44:30 -07:00
layerdiffusion
49435de094 add removal hint for space 2024-08-20 23:23:43 -07:00
layerdiffusion
579ff49225 revise space 2024-08-20 23:05:25 -07:00
layerdiffusion
389d011fee revise space 2024-08-20 23:01:34 -07:00
layerdiffusion
8b90bd88b5 fix #1367 2024-08-20 22:35:25 -07:00
layerdiffusion
7d99a193e9 space use better delete logics 2024-08-20 22:24:05 -07:00