[PR #263] [MERGED] Head dim 64 support in flash attention. #267

New issue

Closed

opened 2026-10-26 22:22:16 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-26 22:22:16 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/Comfy-Org/comfy-kitchen/pull/263
Author: @comfyanonymous
Created: 10/20/2026
Status: ✅ Merged
Merged: 10/20/2026
Merged by: @comfyanonymous

Base: main ← Head: dev/flash_64

📝 Commits (1)

2c4ec99 Head dim 64 support in flash attention.

📊 Changes

6 files changed (+91 additions, -37 deletions)

View changed files

📝 comfy_kitchen/backends/cuda/dlpack_bindings.cpp (+1 -1)
📝 comfy_kitchen/backends/cuda/ops/flash_decode.cu (+14 -5)
📝 comfy_kitchen/backends/hip/dlpack_bindings.cpp (+12 -10)
📝 comfy_kitchen/backends/hip/ops/flash_decode.hip (+22 -8)
📝 comfy_kitchen/flash_attention.py (+4 -2)
📝 tests/test_flash_attention.py (+38 -11)

📄 Description

No description provided

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/Comfy-Org/comfy-kitchen/pull/263 **Author:** [@comfyanonymous](https://github.com/comfyanonymous) **Created:** 10/20/2026 **Status:** ✅ Merged **Merged:** 10/20/2026 **Merged by:** [@comfyanonymous](https://github.com/comfyanonymous) **Base:** `main` ← **Head:** `dev/flash_64` --- ### 📝 Commits (1) - [`2c4ec99`](https://github.com/Comfy-Org/comfy-kitchen/commit/2c4ec99f561d239e7195dc82574e1db164271408) Head dim 64 support in flash attention. ### 📊 Changes **6 files changed** (+91 additions, -37 deletions) <details> <summary>View changed files</summary> 📝 `comfy_kitchen/backends/cuda/dlpack_bindings.cpp` (+1 -1) 📝 `comfy_kitchen/backends/cuda/ops/flash_decode.cu` (+14 -5) 📝 `comfy_kitchen/backends/hip/dlpack_bindings.cpp` (+12 -10) 📝 `comfy_kitchen/backends/hip/ops/flash_decode.hip` (+22 -8) 📝 `comfy_kitchen/flash_attention.py` (+4 -2) 📝 `tests/test_flash_attention.py` (+38 -11) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-26 22:22:16 +00:00