[PR #73] [MERGED] Faster turing int4 and int8. #121

New issue

Closed

opened 2026-10-26 22:20:35 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-26 22:20:35 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/Comfy-Org/comfy-kitchen/pull/73
Author: @comfyanonymous
Created: 7/13/2026
Status: ✅ Merged
Merged: 7/13/2026
Merged by: @comfyanonymous

Base: main ← Head: dev/turing

📝 Commits (2)

befed8c Faster turing int4 and int8.
67cf785 Fix turing int4 being skipped.

📊 Changes

10 files changed (+1146 additions, -21 deletions)

View changed files

📝 comfy_kitchen/backends/cuda/CMakeLists.txt (+2 -0)
📝 comfy_kitchen/backends/cuda/__init__.py (+128 -1)
📝 comfy_kitchen/backends/cuda/dlpack_bindings.cpp (+101 -0)
📝 comfy_kitchen/backends/cuda/ops/convrot_w4a4.cu (+9 -6)
📝 comfy_kitchen/backends/cuda/ops/cutlass_gemm_int8.cu (+42 -13)
➕ comfy_kitchen/backends/cuda/ops/turing_int4.cu (+305 -0)
➕ comfy_kitchen/backends/cuda/ops/turing_int8.cu (+368 -0)
📝 comfy_kitchen/tensor/convrot_w4a4.py (+1 -1)
📝 tests/test_convrot_w4a4.py (+113 -0)
📝 tests/test_int8.py (+77 -0)

📄 Description

No description provided

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/Comfy-Org/comfy-kitchen/pull/73 **Author:** [@comfyanonymous](https://github.com/comfyanonymous) **Created:** 7/13/2026 **Status:** ✅ Merged **Merged:** 7/13/2026 **Merged by:** [@comfyanonymous](https://github.com/comfyanonymous) **Base:** `main` ← **Head:** `dev/turing` --- ### 📝 Commits (2) - [`befed8c`](https://github.com/Comfy-Org/comfy-kitchen/commit/befed8c1f152f96870c2bb96304676f1a81217ee) Faster turing int4 and int8. - [`67cf785`](https://github.com/Comfy-Org/comfy-kitchen/commit/67cf785ee759f2666811ad0f09351c3d6d4a427d) Fix turing int4 being skipped. ### 📊 Changes **10 files changed** (+1146 additions, -21 deletions) <details> <summary>View changed files</summary> 📝 `comfy_kitchen/backends/cuda/CMakeLists.txt` (+2 -0) 📝 `comfy_kitchen/backends/cuda/__init__.py` (+128 -1) 📝 `comfy_kitchen/backends/cuda/dlpack_bindings.cpp` (+101 -0) 📝 `comfy_kitchen/backends/cuda/ops/convrot_w4a4.cu` (+9 -6) 📝 `comfy_kitchen/backends/cuda/ops/cutlass_gemm_int8.cu` (+42 -13) ➕ `comfy_kitchen/backends/cuda/ops/turing_int4.cu` (+305 -0) ➕ `comfy_kitchen/backends/cuda/ops/turing_int8.cu` (+368 -0) 📝 `comfy_kitchen/tensor/convrot_w4a4.py` (+1 -1) 📝 `tests/test_convrot_w4a4.py` (+113 -0) 📝 `tests/test_int8.py` (+77 -0) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-26 22:20:35 +00:00