[PR #50] Try to optimize sdvquant implementation a bit. #105

New issue

Open

opened 2026-10-26 22:20:25 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-26 22:20:25 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/Comfy-Org/comfy-kitchen/pull/50
Author: @comfyanonymous
Created: 6/23/2026
Status: 🔄 Open

Base: main ← Head: dev/optim_int4

📝 Commits (1)

cfcfd0c Try to optimize sdvquant implementation a bit.

📊 Changes

8 files changed (+1295 additions, -244 deletions)

View changed files

📝 comfy_kitchen/backends/cuda/__init__.py (+287 -49)
📝 comfy_kitchen/backends/cuda/dlpack_bindings.cpp (+58 -2)
📝 comfy_kitchen/backends/cuda/ops/awq_w4a16.cu (+86 -2)
📝 comfy_kitchen/backends/cuda/ops/scaled_mm_svdquant_w4a4.cu (+133 -97)
📝 comfy_kitchen/tensor/awq_w4a16.py (+57 -15)
📝 comfy_kitchen/tensor/svdquant_w4a4.py (+204 -79)
➕ tests/test_awq_w4a16.py (+235 -0)
📝 tests/test_svdquant_w4a4.py (+235 -0)

📄 Description

No description provided

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/Comfy-Org/comfy-kitchen/pull/50 **Author:** [@comfyanonymous](https://github.com/comfyanonymous) **Created:** 6/23/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `dev/optim_int4` --- ### 📝 Commits (1) - [`cfcfd0c`](https://github.com/Comfy-Org/comfy-kitchen/commit/cfcfd0c9d0e5af3c3398ed508233e208e29ba010) Try to optimize sdvquant implementation a bit. ### 📊 Changes **8 files changed** (+1295 additions, -244 deletions) <details> <summary>View changed files</summary> 📝 `comfy_kitchen/backends/cuda/__init__.py` (+287 -49) 📝 `comfy_kitchen/backends/cuda/dlpack_bindings.cpp` (+58 -2) 📝 `comfy_kitchen/backends/cuda/ops/awq_w4a16.cu` (+86 -2) 📝 `comfy_kitchen/backends/cuda/ops/scaled_mm_svdquant_w4a4.cu` (+133 -97) 📝 `comfy_kitchen/tensor/awq_w4a16.py` (+57 -15) 📝 `comfy_kitchen/tensor/svdquant_w4a4.py` (+204 -79) ➕ `tests/test_awq_w4a16.py` (+235 -0) 📝 `tests/test_svdquant_w4a4.py` (+235 -0) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi added the

pull-request

label

2026-10-26 22:20:25 +00:00

bsakaguchi referenced this issue

2026-10-26 22:20:51 +00:00

[PR #105] [MERGED] Document the actual PyTorch minimum (>=2.7.0) #146