[PR #59] [MERGED] Int8 optimizations. #111

New issue

Closed

opened 2026-10-26 22:20:30 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-26 22:20:30 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/Comfy-Org/comfy-kitchen/pull/59
Author: @comfyanonymous
Created: 6/29/2026
Status: ✅ Merged
Merged: 6/29/2026
Merged by: @comfyanonymous

Base: main ← Head: dev/optim_int8

📝 Commits (3)

89d3ce5 Cuda quant/dequant kernels for int8.
66acc42 More optimizations.
fc16ccf Ruff fix.

📊 Changes

8 files changed (+2593 additions, -219 deletions)

View changed files

📝 comfy_kitchen/backends/cuda/__init__.py (+431 -56)
📝 comfy_kitchen/backends/cuda/dlpack_bindings.cpp (+466 -0)
📝 comfy_kitchen/backends/cuda/ops/cutlass_gemm_int8.cu (+133 -0)
📝 comfy_kitchen/backends/cuda/ops/int8_linear.cu (+1304 -141)
📝 comfy_kitchen/backends/eager/__init__.py (+40 -0)
📝 comfy_kitchen/backends/eager/quantization.py (+92 -1)
📝 comfy_kitchen/tensor/int8.py (+32 -20)
📝 tests/test_int8.py (+95 -1)

📄 Description

No description provided

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/Comfy-Org/comfy-kitchen/pull/59 **Author:** [@comfyanonymous](https://github.com/comfyanonymous) **Created:** 6/29/2026 **Status:** ✅ Merged **Merged:** 6/29/2026 **Merged by:** [@comfyanonymous](https://github.com/comfyanonymous) **Base:** `main` ← **Head:** `dev/optim_int8` --- ### 📝 Commits (3) - [`89d3ce5`](https://github.com/Comfy-Org/comfy-kitchen/commit/89d3ce5df5de57d83cde02bf14e2c18c6b492375) Cuda quant/dequant kernels for int8. - [`66acc42`](https://github.com/Comfy-Org/comfy-kitchen/commit/66acc42863762201fc1cb2ba54fcb061d63d35f7) More optimizations. - [`fc16ccf`](https://github.com/Comfy-Org/comfy-kitchen/commit/fc16ccf72088b5a7861f988fe14a54c8be5a41ea) Ruff fix. ### 📊 Changes **8 files changed** (+2593 additions, -219 deletions) <details> <summary>View changed files</summary> 📝 `comfy_kitchen/backends/cuda/__init__.py` (+431 -56) 📝 `comfy_kitchen/backends/cuda/dlpack_bindings.cpp` (+466 -0) 📝 `comfy_kitchen/backends/cuda/ops/cutlass_gemm_int8.cu` (+133 -0) 📝 `comfy_kitchen/backends/cuda/ops/int8_linear.cu` (+1304 -141) 📝 `comfy_kitchen/backends/eager/__init__.py` (+40 -0) 📝 `comfy_kitchen/backends/eager/quantization.py` (+92 -1) 📝 `comfy_kitchen/tensor/int8.py` (+32 -20) 📝 `tests/test_int8.py` (+95 -1) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-26 22:20:30 +00:00