deepseek-ai/DeepEP
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepEP.git synced 2026-11-05 00:47:32 +00:00
Code Issues 308 Projects Packages Wiki Activity

[GH-ISSUE #476] Compilation failure with CUDA 13.0 #305

New issue
Closed
opened 2026-10-26 09:58:18 +00:00 by bsakaguchi · 1 comment
bsakaguchi commented 2026-10-26 09:58:18 +00:00
Owner
Copy link

Originally created by @alokprasad on GitHub (Oct 31, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/476

Using nvshmem 3.3.9
cuda 13.0

+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 580.95.05              Driver Version: 580.95.05      CUDA Version: 13.0     |
+-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA H200 NVL                Off |   00000000:E1:00.0 Off |                    0 |
| N/A   38C    P0             71W /  600W |      14MiB / 143771MiB |      0%      Default |
|                                         |                        |             Disabled |
+-----------------------------------------+------------------------+----------------------+
|   1  NVIDIA H200 NVL                Off |   00000000:F1:00.0 Off |                    0 |
| N/A   38C    P0             66W /  600W |      14MiB / 143771MiB |      0%      Default |
|                                         |                        |             Disabled |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|    0   N/A  N/A            5088      G   /usr/lib/xorg/Xorg                        4MiB |
|    1   N/A  N/A            5088      G   /usr/lib/xorg/Xorg                        4MiB |
+-----------------------------------------------------------------------------------------+

NVSHMEM_DIR=/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive python setup.py build
/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/_subclasses/functional_tensor.py:279: UserWarning: Failed to initialize NumPy: No module named 'numpy' (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:84.)
  cpu = _conversion_method_template(device=torch.device("cpu"))
Build summary:
 > Sources: ['csrc/deep_ep.cpp', 'csrc/kernels/runtime.cu', 'csrc/kernels/layout.cu', 'csrc/kernels/intranode.cu', 'csrc/kernels/internode.cu', 'csrc/kernels/internode_ll.cu']
 > Includes: ['csrc/', '/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include']
 > Libraries: ['/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/lib']
 > Compilation flags: {'cxx': ['-O3', '-Wno-deprecated-declarations', '-Wno-unused-variable', '-Wno-sign-compare', '-Wno-reorder', '-Wno-attributes', '-DDISABLE_AGGRESSIVE_PTX_INSTRS'], 'nvcc': ['-O3', '-Xcompiler', '-O3', '-rdc=true', '--ptxas-options=--register-usage-level=10', '-DDISABLE_AGGRESSIVE_PTX_INSTRS'], 'nvcc_dlink': ['-dlink', '-L/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/lib', '-lnvshmem_device']}
 > Link flags: ['-l:libnvshmem_host.so', '-l:libnvshmem_device.a', '-Wl,-rpath,/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/lib']
 > Arch list: 9.0
 > NVSHMEM path: /home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive

running build
running build_py
creating build/lib.linux-x86_64-cpython-312/deep_ep
copying deep_ep/__init__.py -> build/lib.linux-x86_64-cpython-312/deep_ep
copying deep_ep/buffer.py -> build/lib.linux-x86_64-cpython-312/deep_ep
copying deep_ep/utils.py -> build/lib.linux-x86_64-cpython-312/deep_ep
running build_ext
W1031 14:32:18.263000 13717 venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py:521] The detected CUDA version (12.0) has a minor version mismatch with the version that was used to compile PyTorch (12.8). Most likely this shouldn't be a problem.
W1031 14:32:18.264000 13717 venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py:531] There are no x86_64-linux-gnu-g++ version bounds defined for CUDA version 12.0
building 'deep_ep_cpp' extension
creating /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc
creating /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels
[1/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17
FAILED: /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o
/usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17
/home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu(575): error: identifier "CUDART_ZERO_BF16" is undefined

/home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu(576): error: identifier "CUDART_INF_BF16" is undefined

2 errors detected in the compilation of "/home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu".
[2/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/runtime.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/runtime.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/runtime.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17
[3/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/layout.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/layout.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/layout.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17
[4/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/intranode.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/intranode.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/intranode.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17

[5/7] c++ -MMD -MF /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/deep_ep.o.d -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O2 -Wall -fPIC -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/deep_ep.cpp -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/deep_ep.o -O3 -Wno-deprecated-declarations -Wno-unused-variable -Wno-sign-compare -Wno-reorder -Wno-attributes -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -std=c++17
[6/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/internode.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2597, in _run_ninja_build
    subprocess.run(
  File "/usr/lib/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/host/alok/deepep/DeepEP/setup.py", line 116, in <module>
    setuptools.setup(name='deep_ep',
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/__init__.py", line 115, in setup
    return distutils.core.setup(**attrs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
    return run_commands(dist)
           ^^^^^^^^^^^^^^^^^^
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
    dist.run_commands()
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
    self.run_command(cmd)
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/dist.py", line 1102, in run_command
    super().run_command(command)
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
    cmd_obj.run()
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 135, in run
    self.run_command(cmd_name)
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
    self.distribution.run_command(command)
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/dist.py", line 1102, in run_command
    super().run_command(command)
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
    cmd_obj.run()
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 96, in run
    _build_ext.run(self)
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
    self.build_extensions()
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 1082, in build_extensions
    build_ext.build_extensions(self)
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 484, in build_extensions
    self._build_extensions_serial()
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 510, in _build_extensions_serial
    self.build_extension(ext)
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 261, in build_extension
    _build_ext.build_extension(self, ext)
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 565, in build_extension
    objects = self.compiler.compile(
              ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 866, in unix_wrap_ninja_compile
    _write_ninja_file_and_compile_objects(
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2223, in _write_ninja_file_and_compile_objects
    _run_ninja_build(
  File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2614, in _run_ninja_build
    raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
Originally created by @alokprasad on GitHub (Oct 31, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/476 Using nvshmem 3.3.9 cuda 13.0 ``` +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 580.95.05 Driver Version: 580.95.05 CUDA Version: 13.0 | +-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA H200 NVL Off | 00000000:E1:00.0 Off | 0 | | N/A 38C P0 71W / 600W | 14MiB / 143771MiB | 0% Default | | | | Disabled | +-----------------------------------------+------------------------+----------------------+ | 1 NVIDIA H200 NVL Off | 00000000:F1:00.0 Off | 0 | | N/A 38C P0 66W / 600W | 14MiB / 143771MiB | 0% Default | | | | Disabled | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | 0 N/A N/A 5088 G /usr/lib/xorg/Xorg 4MiB | | 1 N/A N/A 5088 G /usr/lib/xorg/Xorg 4MiB | +-----------------------------------------------------------------------------------------+ ``` ``` NVSHMEM_DIR=/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive python setup.py build /home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/_subclasses/functional_tensor.py:279: UserWarning: Failed to initialize NumPy: No module named 'numpy' (Triggered internally at /pytorch/torch/csrc/utils/tensor_numpy.cpp:84.) cpu = _conversion_method_template(device=torch.device("cpu")) Build summary: > Sources: ['csrc/deep_ep.cpp', 'csrc/kernels/runtime.cu', 'csrc/kernels/layout.cu', 'csrc/kernels/intranode.cu', 'csrc/kernels/internode.cu', 'csrc/kernels/internode_ll.cu'] > Includes: ['csrc/', '/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include'] > Libraries: ['/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/lib'] > Compilation flags: {'cxx': ['-O3', '-Wno-deprecated-declarations', '-Wno-unused-variable', '-Wno-sign-compare', '-Wno-reorder', '-Wno-attributes', '-DDISABLE_AGGRESSIVE_PTX_INSTRS'], 'nvcc': ['-O3', '-Xcompiler', '-O3', '-rdc=true', '--ptxas-options=--register-usage-level=10', '-DDISABLE_AGGRESSIVE_PTX_INSTRS'], 'nvcc_dlink': ['-dlink', '-L/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/lib', '-lnvshmem_device']} > Link flags: ['-l:libnvshmem_host.so', '-l:libnvshmem_device.a', '-Wl,-rpath,/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/lib'] > Arch list: 9.0 > NVSHMEM path: /home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive running build running build_py creating build/lib.linux-x86_64-cpython-312/deep_ep copying deep_ep/__init__.py -> build/lib.linux-x86_64-cpython-312/deep_ep copying deep_ep/buffer.py -> build/lib.linux-x86_64-cpython-312/deep_ep copying deep_ep/utils.py -> build/lib.linux-x86_64-cpython-312/deep_ep running build_ext W1031 14:32:18.263000 13717 venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py:521] The detected CUDA version (12.0) has a minor version mismatch with the version that was used to compile PyTorch (12.8). Most likely this shouldn't be a problem. W1031 14:32:18.264000 13717 venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py:531] There are no x86_64-linux-gnu-g++ version bounds defined for CUDA version 12.0 building 'deep_ep_cpp' extension creating /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc creating /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels [1/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17 FAILED: /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17 /home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu(575): error: identifier "CUDART_ZERO_BF16" is undefined /home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu(576): error: identifier "CUDART_INF_BF16" is undefined 2 errors detected in the compilation of "/home/host/alok/deepep/DeepEP/csrc/kernels/internode_ll.cu". [2/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/runtime.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/runtime.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/runtime.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17 [3/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/layout.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/layout.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/layout.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17 [4/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/intranode.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/intranode.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/intranode.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17 [5/7] c++ -MMD -MF /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/deep_ep.o.d -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O2 -Wall -fPIC -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/deep_ep.cpp -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/deep_ep.o -O3 -Wno-deprecated-declarations -Wno-unused-variable -Wno-sign-compare -Wno-reorder -Wno-attributes -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -std=c++17 [6/7] /usr/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode.o.d -Icsrc/ -I/home/host/alok/deepep/libnvshmem-linux-x86_64-3.3.9_cuda12-archive/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include -I/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/home/host/alok/deepep/DeepEP/venv/include -I/usr/include/python3.12 -c -c /home/host/alok/deepep/DeepEP/csrc/kernels/internode.cu -o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -Xcompiler -O3 -rdc=true --ptxas-options=--register-usage-level=10 -DDISABLE_AGGRESSIVE_PTX_INSTRS -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=deep_ep_cpp -gencode=arch=compute_90,code=sm_90 -std=c++17 ninja: build stopped: subcommand failed. Traceback (most recent call last): File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2597, in _run_ninja_build subprocess.run( File "/usr/lib/python3.12/subprocess.py", line 571, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/host/alok/deepep/DeepEP/setup.py", line 116, in <module> setuptools.setup(name='deep_ep', File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/__init__.py", line 115, in setup return distutils.core.setup(**attrs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup return run_commands(dist) ^^^^^^^^^^^^^^^^^^ File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands dist.run_commands() File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands self.run_command(cmd) File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/dist.py", line 1102, in run_command super().run_command(command) File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command cmd_obj.run() File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 135, in run self.run_command(cmd_name) File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command self.distribution.run_command(command) File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/dist.py", line 1102, in run_command super().run_command(command) File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command cmd_obj.run() File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 96, in run _build_ext.run(self) File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run self.build_extensions() File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 1082, in build_extensions build_ext.build_extensions(self) File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 484, in build_extensions self._build_extensions_serial() File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 510, in _build_extensions_serial self.build_extension(ext) File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 261, in build_extension _build_ext.build_extension(self, ext) File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 565, in build_extension objects = self.compiler.compile( ^^^^^^^^^^^^^^^^^^^^^^ File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 866, in unix_wrap_ninja_compile _write_ninja_file_and_compile_objects( File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2223, in _write_ninja_file_and_compile_objects _run_ninja_build( File "/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 2614, in _run_ninja_build raise RuntimeError(message) from e RuntimeError: Error compiling objects for extension ```
bsakaguchi commented 2026-10-26 09:58:20 +00:00
Author
Owner
Copy link

@alokprasad commented on GitHub (Oct 31, 2025):

added in csrc/kernels/internode_ll.cu
+#define CUDART_INF_BF16 __ushort_as_bfloat16((unsigned short)0x7F80U)
+#define CUDART_ZERO_BF16 __ushort_as_bfloat16((unsigned short)0x0000U)
was able to compile

NVSHMEM_DIR=/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive python setup.py build
Build summary:
 > Sources: ['csrc/deep_ep.cpp', 'csrc/kernels/runtime.cu', 'csrc/kernels/layout.cu', 'csrc/kernels/intranode.cu', 'csrc/kernels/internode.cu', 'csrc/kernels/internode_ll.cu']
 > Includes: ['csrc/', '/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/include']
 > Libraries: ['/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib']
 > Compilation flags: {'cxx': ['-O3', '-Wno-deprecated-declarations', '-Wno-unused-variable', '-Wno-sign-compare', '-Wno-reorder', '-Wno-attributes', '-DDISABLE_AGGRESSIVE_PTX_INSTRS'], 'nvcc': ['-O3', '-Xcompiler', '-O3', '-rdc=true', '--ptxas-options=--register-usage-level=10', '-DDISABLE_AGGRESSIVE_PTX_INSTRS'], 'nvcc_dlink': ['-dlink', '-L/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib', '-lnvshmem_device']}
 > Link flags: ['-l:libnvshmem_host.so', '-l:libnvshmem_device.a', '-Wl,-rpath,/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib']
 > Arch list: 9.0
 > NVSHMEM path: /home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive

running build
running build_py
copying deep_ep/__init__.py -> build/lib.linux-x86_64-cpython-312/deep_ep
copying deep_ep/buffer.py -> build/lib.linux-x86_64-cpython-312/deep_ep
copying deep_ep/utils.py -> build/lib.linux-x86_64-cpython-312/deep_ep
running build_ext
W1031 15:11:15.252000 35601 venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py:521] The detected CUDA version (12.0) has a minor version mismatch with the version that was used to compile PyTorch (12.8). Most likely this shouldn't be a problem.
W1031 15:11:15.253000 35601 venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py:531] There are no x86_64-linux-gnu-g++ version bounds defined for CUDA version 12.0
building 'deep_ep_cpp' extension
ninja: no work to do.
x86_64-linux-gnu-g++ -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O2 -Wall -shared -Wl,-O1 -Wl,-Bsymbolic-functions /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/deep_ep.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/intranode.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/layout.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/runtime.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/dlink.o -L/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib -L/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/lib -L/usr/lib64 -L/usr/lib/x86_64-linux-gnu -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-cpython-312/deep_ep_cpp.cpython-312-x86_64-linux-gnu.so -l:libnvshmem_host.so -l:libnvshmem_device.a -Wl,-rpath,/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib

but running this cause issue

python tests/test_low_latency.py
Traceback (most recent call last):
  File "/home/host/alok/deepep/DeepEP/tests/test_low_latency.py", line 7, in <module>
    import deep_ep
ModuleNotFoundError: No module named 'deep_ep'

i can import deep_ep in python shell

<!-- gh-comment-id:3472149590 --> @alokprasad commented on GitHub (Oct 31, 2025): added in csrc/kernels/internode_ll.cu +#define CUDART_INF_BF16 __ushort_as_bfloat16((unsigned short)0x7F80U) +#define CUDART_ZERO_BF16 __ushort_as_bfloat16((unsigned short)0x0000U) was able to compile ``` NVSHMEM_DIR=/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive python setup.py build Build summary: > Sources: ['csrc/deep_ep.cpp', 'csrc/kernels/runtime.cu', 'csrc/kernels/layout.cu', 'csrc/kernels/intranode.cu', 'csrc/kernels/internode.cu', 'csrc/kernels/internode_ll.cu'] > Includes: ['csrc/', '/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/include'] > Libraries: ['/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib'] > Compilation flags: {'cxx': ['-O3', '-Wno-deprecated-declarations', '-Wno-unused-variable', '-Wno-sign-compare', '-Wno-reorder', '-Wno-attributes', '-DDISABLE_AGGRESSIVE_PTX_INSTRS'], 'nvcc': ['-O3', '-Xcompiler', '-O3', '-rdc=true', '--ptxas-options=--register-usage-level=10', '-DDISABLE_AGGRESSIVE_PTX_INSTRS'], 'nvcc_dlink': ['-dlink', '-L/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib', '-lnvshmem_device']} > Link flags: ['-l:libnvshmem_host.so', '-l:libnvshmem_device.a', '-Wl,-rpath,/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib'] > Arch list: 9.0 > NVSHMEM path: /home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive running build running build_py copying deep_ep/__init__.py -> build/lib.linux-x86_64-cpython-312/deep_ep copying deep_ep/buffer.py -> build/lib.linux-x86_64-cpython-312/deep_ep copying deep_ep/utils.py -> build/lib.linux-x86_64-cpython-312/deep_ep running build_ext W1031 15:11:15.252000 35601 venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py:521] The detected CUDA version (12.0) has a minor version mismatch with the version that was used to compile PyTorch (12.8). Most likely this shouldn't be a problem. W1031 15:11:15.253000 35601 venv/lib/python3.12/site-packages/torch/utils/cpp_extension.py:531] There are no x86_64-linux-gnu-g++ version bounds defined for CUDA version 12.0 building 'deep_ep_cpp' extension ninja: no work to do. x86_64-linux-gnu-g++ -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O2 -Wall -shared -Wl,-O1 -Wl,-Bsymbolic-functions /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/deep_ep.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/internode_ll.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/intranode.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/layout.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/kernels/runtime.o /home/host/alok/deepep/DeepEP/build/temp.linux-x86_64-cpython-312/csrc/dlink.o -L/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib -L/home/host/alok/deepep/DeepEP/venv/lib/python3.12/site-packages/torch/lib -L/usr/lib64 -L/usr/lib/x86_64-linux-gnu -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-cpython-312/deep_ep_cpp.cpython-312-x86_64-linux-gnu.so -l:libnvshmem_host.so -l:libnvshmem_device.a -Wl,-rpath,/home/host/alok/deepep/libnvshmem-linux-x86_64-3.4.5_cuda13-archive/lib ``` but running this cause issue ``` python tests/test_low_latency.py Traceback (most recent call last): File "/home/host/alok/deepep/DeepEP/tests/test_low_latency.py", line 7, in <module> import deep_ep ModuleNotFoundError: No module named 'deep_ep' ``` i can import deep_ep in python shell
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
hybrid-ep
chore/remove-clang-format-yapf
v2.5
nvDev
try-fix-cu128
mori-ep
antgroup-opt
compat-old-torch
add-linter
eager-rdma
v1.2.1
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepEP#305
No description provided.