[PR #401] feat(native): add standalone CUDA core #419

Open
opened 2026-10-26 21:17:34 +00:00 by bsakaguchi · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/deepseek-ai/DeepGEMM/pull/401
Author: @yogurfrul
Created: 8/7/2026
Status: 🔄 Open

Base: main ← Head: main


📝 Commits (3)

📊 Changes

5 files changed (+436 additions, -14 deletions)

View changed files

📝 CMakeLists.txt (+44 -12)
➕ csrc/native_api.cpp (+317 -0)
➕ csrc/native_api.h (+49 -0)
📝 develop.sh (+3 -2)
📝 setup.py (+23 -0)

📄 Description

Edge deployment needs to link a runtime library without loading the Python wheel frontend, PyTorch, ATen, or pybind symbols.

  • split CMake configuration so the Python extension and native core build independently
  • expose a stable C ABI over opaque CUDA streams and row-major tensor views
  • implement the NN GEMM path with CUDA Runtime and cuBLASLt only
  • package the shared library and public header inside the wheel for build-time discovery and artifact copying
  • retain the existing Python extension path as the default build

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/deepseek-ai/DeepGEMM/pull/401 **Author:** [@yogurfrul](https://github.com/yogurfrul) **Created:** 8/7/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (3) - [`e35d445`](https://github.com/deepseek-ai/DeepGEMM/commit/e35d445cf8d734016977ee407d50a72aef7a3c71) feat(native): add standalone CUDA core - [`dc54fff`](https://github.com/deepseek-ai/DeepGEMM/commit/dc54fff09b5bb97a58577015f0c1f7355d1e8025) for review - [`f3dff8d`](https://github.com/deepseek-ai/DeepGEMM/commit/f3dff8dd8054698dc6d0d5c2e561715e555371b4) update ### 📊 Changes **5 files changed** (+436 additions, -14 deletions) <details> <summary>View changed files</summary> 📝 `CMakeLists.txt` (+44 -12) ➕ `csrc/native_api.cpp` (+317 -0) ➕ `csrc/native_api.h` (+49 -0) 📝 `develop.sh` (+3 -2) 📝 `setup.py` (+23 -0) </details> ### 📄 Description Edge deployment needs to link a runtime library without loading the Python wheel frontend, PyTorch, ATen, or pybind symbols. - split CMake configuration so the Python extension and native core build independently - expose a stable C ABI over opaque CUDA streams and row-major tensor views - implement the NN GEMM path with CUDA Runtime and cuBLASLt only - package the shared library and public header inside the wheel for build-time discovery and artifact copying - retain the existing Python extension path as the default build --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepGEMM#419
No description provided.