[GH-ISSUE #1053] [Bug]subprocess.CalledProcessError #742

Open
opened 2026-10-29 14:43:51 +00:00 by bsakaguchi · 6 comments
Owner

Originally created by @YihaoG on GitHub (Apr 5, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1053

检查清单

  • 1. 我已经搜索过相关问题,但未能获得预期的帮助
  • 2. 该问题在最新版本中尚未修复
  • 3. 请注意,如果您提交的BUG相关 issue 缺少对应环境信息和最小可复现示例,我们将难以复现和定位问题,降低获得反馈的可能性
  • 4. 如果您提出的不是bug而是问题,请在讨论区发起讨论 https://github.com/kvcache-ai/ktransformers/discussions。否则该 issue 将被关闭
  • 5. 为方便社区交流,我将使用中文/英文或附上中文/英文翻译(如使用其他语言)。未附带翻译的非中文/英语内容可能会被关闭

问题描述

subprocess.CalledProcessError: Command '['cmake', '/home/gyh/ktrans/ktransformers/csrc/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/gyh/ktrans/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/gyh/anaconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.4.post1+cu126torch26fancy']' returned non-zero exit status 1.
error: subprocess-exited-with-error

× Building wheel for ktransformers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /home/gyh/anaconda3/envs/ktransformers/bin/python /home/gyh/anaconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmp8gqblbu0
cwd: /home/gyh/ktrans/ktransformers
Building wheel for ktransformers (pyproject.toml) ... error
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)

复现步骤

conda create --name ktransformers python=3.11
conda activate ktransformers
conda install -c conda-forge libstdcxx-ng
sudo apt install libtbb-dev libssl-dev libcurl4-openssl-dev libaio-dev libfmt-dev libgflags-dev zlib1g-dev patchelf
git clone https://github.com/kvcache-ai/ktransformers.git
cd ktransformers
git submodule update --init --recursive
USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh

环境信息

CUDA: 12.6
GCC: 11.4.0
CMAKE: 4.0.0
GPU: Nvidia GeForce RTX 3090
CPU: Intel® Xeon(R) Platinum 8454H × 128

Originally created by @YihaoG on GitHub (Apr 5, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1053 ### 检查清单 - [x] 1. 我已经搜索过相关问题,但未能获得预期的帮助 - [x] 2. 该问题在最新版本中尚未修复 - [x] 3. 请注意,如果您提交的BUG相关 issue 缺少对应环境信息和最小可复现示例,我们将难以复现和定位问题,降低获得反馈的可能性 - [x] 4. 如果您提出的不是bug而是问题,请在讨论区发起讨论 https://github.com/kvcache-ai/ktransformers/discussions。否则该 issue 将被关闭 - [x] 5. 为方便社区交流,我将使用中文/英文或附上中文/英文翻译(如使用其他语言)。未附带翻译的非中文/英语内容可能会被关闭 ### 问题描述 subprocess.CalledProcessError: Command '['cmake', '/home/gyh/ktrans/ktransformers/csrc/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/gyh/ktrans/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/gyh/anaconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.4.post1+cu126torch26fancy']' returned non-zero exit status 1. error: subprocess-exited-with-error × Building wheel for ktransformers (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. full command: /home/gyh/anaconda3/envs/ktransformers/bin/python /home/gyh/anaconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmp8gqblbu0 cwd: /home/gyh/ktrans/ktransformers Building wheel for ktransformers (pyproject.toml) ... error ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers) ### 复现步骤 conda create --name ktransformers python=3.11 conda activate ktransformers conda install -c conda-forge libstdcxx-ng sudo apt install libtbb-dev libssl-dev libcurl4-openssl-dev libaio-dev libfmt-dev libgflags-dev zlib1g-dev patchelf git clone https://github.com/kvcache-ai/ktransformers.git cd ktransformers git submodule update --init --recursive USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh ### 环境信息 CUDA: 12.6 GCC: 11.4.0 CMAKE: 4.0.0 GPU: Nvidia GeForce RTX 3090 CPU: Intel® Xeon(R) Platinum 8454H × 128
Author
Owner

@magikRUKKOLA commented on GitHub (Apr 5, 2025):

Have you tired to use --verbose? The last time I have tried to build the latest version of ktransformers, that helped:

https://forums.developer.nvidia.com/t/error-exception-specification-is-incompatible-for-cospi-sinpi-cospif-sinpif-with-glibc-2-41/323591/3

diff '--color=auto' -ur builds.orig/cuda_nvcc/targets/x86_64-linux/include/crt/math_functions.h builds/cuda_nvcc/targets/x86_64-linux/include/crt/math_functions.h
--- a/builds.orig/cuda_nvcc/targets/x86_64-linux/include/crt/math_functions.h	2024-08-23 00:25:39.000000000 +0200
+++ b/builds/cuda_nvcc/targets/x86_64-linux/include/crt/math_functions.h	2025-02-17 01:19:44.270292640 +0100
@@ -2547,7 +2547,7 @@
  *
  * \note_accuracy_double
  */
-extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ double                 sinpi(double x);
+extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ double                 sinpi(double x) noexcept (true);
 /**
  * \ingroup CUDA_MATH_SINGLE
  * \brief Calculate the sine of the input argument 
@@ -2570,7 +2570,7 @@
  *
  * \note_accuracy_single
  */
-extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ float                  sinpif(float x);
+extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ float                  sinpif(float x) noexcept (true);
 /**
  * \ingroup CUDA_MATH_DOUBLE
  * \brief Calculate the cosine of the input argument 
@@ -2592,7 +2592,7 @@
  *
  * \note_accuracy_double
  */
-extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ double                 cospi(double x);
+extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ double                 cospi(double x) noexcept (true);
 /**
  * \ingroup CUDA_MATH_SINGLE
  * \brief Calculate the cosine of the input argument 
@@ -2614,7 +2614,7 @@
  *
  * \note_accuracy_single
  */
-extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ float                  cospif(float x);
+extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ float                  cospif(float x) noexcept (true);
 /**
  * \ingroup CUDA_MATH_DOUBLE
  * \brief  Calculate the sine and cosine of the first input argument
<!-- gh-comment-id:2780659208 --> @magikRUKKOLA commented on GitHub (Apr 5, 2025): Have you tired to use --verbose? The last time I have tried to build the latest version of ktransformers, that helped: https://forums.developer.nvidia.com/t/error-exception-specification-is-incompatible-for-cospi-sinpi-cospif-sinpif-with-glibc-2-41/323591/3 ```diff diff '--color=auto' -ur builds.orig/cuda_nvcc/targets/x86_64-linux/include/crt/math_functions.h builds/cuda_nvcc/targets/x86_64-linux/include/crt/math_functions.h --- a/builds.orig/cuda_nvcc/targets/x86_64-linux/include/crt/math_functions.h 2024-08-23 00:25:39.000000000 +0200 +++ b/builds/cuda_nvcc/targets/x86_64-linux/include/crt/math_functions.h 2025-02-17 01:19:44.270292640 +0100 @@ -2547,7 +2547,7 @@ * * \note_accuracy_double */ -extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ double sinpi(double x); +extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ double sinpi(double x) noexcept (true); /** * \ingroup CUDA_MATH_SINGLE * \brief Calculate the sine of the input argument @@ -2570,7 +2570,7 @@ * * \note_accuracy_single */ -extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ float sinpif(float x); +extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ float sinpif(float x) noexcept (true); /** * \ingroup CUDA_MATH_DOUBLE * \brief Calculate the cosine of the input argument @@ -2592,7 +2592,7 @@ * * \note_accuracy_double */ -extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ double cospi(double x); +extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ double cospi(double x) noexcept (true); /** * \ingroup CUDA_MATH_SINGLE * \brief Calculate the cosine of the input argument @@ -2614,7 +2614,7 @@ * * \note_accuracy_single */ -extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ float cospif(float x); +extern __DEVICE_FUNCTIONS_DECL__ __device_builtin__ float cospif(float x) noexcept (true); /** * \ingroup CUDA_MATH_DOUBLE * \brief Calculate the sine and cosine of the first input argument ```
Author
Owner

@kite800 commented on GitHub (Apr 6, 2025):

I have the same issue:
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cmake', '/home/kite/ktransformers/csrc/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/kite/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/kite/anaconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.4.post1+cu128torch26avx2']' returned non-zero exit status 1.
error: subprocess-exited-with-error

× Building wheel for ktransformers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /home/kite/anaconda3/envs/ktransformers/bin/python /home/kite/anaconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmpnv50b2zb
cwd: /home/kite/ktransformers
Building wheel for ktransformers (pyproject.toml) ... error
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)

<!-- gh-comment-id:2781243723 --> @kite800 commented on GitHub (Apr 6, 2025): I have the same issue: raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['cmake', '/home/kite/ktransformers/csrc/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/kite/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/kite/anaconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.4.post1+cu128torch26avx2']' returned non-zero exit status 1. error: subprocess-exited-with-error × Building wheel for ktransformers (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. full command: /home/kite/anaconda3/envs/ktransformers/bin/python /home/kite/anaconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmpnv50b2zb cwd: /home/kite/ktransformers Building wheel for ktransformers (pyproject.toml) ... error ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)
Author
Owner

@qiyuxinlin commented on GitHub (Apr 7, 2025):

检查清单

  • 1. 我已经搜索过相关问题,但未能获得预期的帮助[x] 2. 该问题在最新版本中尚未修复[x] 3. 请注意,如果您提交的BUG相关 issue 缺少对应环境信息和最小可复现示例,我们将难以复现和定位问题,降低获得反馈的可能性[x] 4. 如果您提出的不是bug而是问题,请在讨论区发起讨论 https://github.com/kvcache-ai/ktransformers/discussions。否则该 issue 将被关闭[x] 5. 为方便社区交流,我将使用中文/英文或附上中文/英文翻译(如使用其他语言)。未附带翻译的非中文/英语内容可能会被关闭

问题描述

subprocess.CalledProcessError: Command '['cmake', '/home/gyh/ktrans/ktransformers/csrc/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/gyh/ktrans/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/gyh/anaconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.4.post1+cu126torch26fancy']' returned non-zero exit status 1. error: subprocess-exited-with-error

× Building wheel for ktransformers (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip. full command: /home/gyh/anaconda3/envs/ktransformers/bin/python /home/gyh/anaconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmp8gqblbu0 cwd: /home/gyh/ktrans/ktransformers Building wheel for ktransformers (pyproject.toml) ... error ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)

复现步骤

conda create --name ktransformers python=3.11 conda activate ktransformers conda install -c conda-forge libstdcxx-ng sudo apt install libtbb-dev libssl-dev libcurl4-openssl-dev libaio-dev libfmt-dev libgflags-dev zlib1g-dev patchelf git clone https://github.com/kvcache-ai/ktransformers.git cd ktransformers git submodule update --init --recursive USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh

环境信息

CUDA: 12.6 GCC: 11.4.0 CMAKE: 4.0.0 GPU: Nvidia GeForce RTX 3090 CPU: Intel® Xeon(R) Platinum 8454H × 128

cmake /home/gyh/ktrans/ktransformers/csrc/ktransformers_ext -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/gyh/ktrans/ktransformers/build/lib.linux-x86_64-cpython-311/ -DPYTHON_EXECUTABLE=/home/gyh/anaconda3/envs/ktransformers/bin/python -DCMAKE_BUILD_TYPE=Release -DKTRANSFORMERS_USE_CUDA=ON -DLLAMA_NATIVE=ON -DEXAMPLE_VERSION_INFO=0.2.4.post1+cu126torch26fancy

Hi @YihaoG , by executing this command you can see the specific errors.

<!-- gh-comment-id:2781863127 --> @qiyuxinlin commented on GitHub (Apr 7, 2025): > ### 检查清单 > * [x] 1. 我已经搜索过相关问题,但未能获得预期的帮助[x] 2. 该问题在最新版本中尚未修复[x] 3. 请注意,如果您提交的BUG相关 issue 缺少对应环境信息和最小可复现示例,我们将难以复现和定位问题,降低获得反馈的可能性[x] 4. 如果您提出的不是bug而是问题,请在讨论区发起讨论 [https://github.com/kvcache-ai/ktransformers/discussions。否则该](https://github.com/kvcache-ai/ktransformers/discussions%E3%80%82%E5%90%A6%E5%88%99%E8%AF%A5) issue 将被关闭[x] 5. 为方便社区交流,我将使用中文/英文或附上中文/英文翻译(如使用其他语言)。未附带翻译的非中文/英语内容可能会被关闭 > > ### 问题描述 > subprocess.CalledProcessError: Command '['cmake', '/home/gyh/ktrans/ktransformers/csrc/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/gyh/ktrans/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/gyh/anaconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.4.post1+cu126torch26fancy']' returned non-zero exit status 1. error: subprocess-exited-with-error > > × Building wheel for ktransformers (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> See above for output. > > note: This error originates from a subprocess, and is likely not a problem with pip. full command: /home/gyh/anaconda3/envs/ktransformers/bin/python /home/gyh/anaconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmp8gqblbu0 cwd: /home/gyh/ktrans/ktransformers Building wheel for ktransformers (pyproject.toml) ... error ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers) > > ### 复现步骤 > conda create --name ktransformers python=3.11 conda activate ktransformers conda install -c conda-forge libstdcxx-ng sudo apt install libtbb-dev libssl-dev libcurl4-openssl-dev libaio-dev libfmt-dev libgflags-dev zlib1g-dev patchelf git clone https://github.com/kvcache-ai/ktransformers.git cd ktransformers git submodule update --init --recursive USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh > > ### 环境信息 > CUDA: 12.6 GCC: 11.4.0 CMAKE: 4.0.0 GPU: Nvidia GeForce RTX 3090 CPU: Intel® Xeon(R) Platinum 8454H × 128 ``` cmake /home/gyh/ktrans/ktransformers/csrc/ktransformers_ext -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/gyh/ktrans/ktransformers/build/lib.linux-x86_64-cpython-311/ -DPYTHON_EXECUTABLE=/home/gyh/anaconda3/envs/ktransformers/bin/python -DCMAKE_BUILD_TYPE=Release -DKTRANSFORMERS_USE_CUDA=ON -DLLAMA_NATIVE=ON -DEXAMPLE_VERSION_INFO=0.2.4.post1+cu126torch26fancy ``` Hi @YihaoG , by executing this command you can see the specific errors.
Author
Owner

@qiyuxinlin commented on GitHub (Apr 7, 2025):

I have the same issue: raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['cmake', '/home/kite/ktransformers/csrc/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/kite/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/kite/anaconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.4.post1+cu128torch26avx2']' returned non-zero exit status 1. error: subprocess-exited-with-error

× Building wheel for ktransformers (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip. full command: /home/kite/anaconda3/envs/ktransformers/bin/python /home/kite/anaconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmpnv50b2zb cwd: /home/kite/ktransformers Building wheel for ktransformers (pyproject.toml) ... error ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (transformers)

cmake /home/kite/ktransformers/csrc/ktransformers_ext -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/kite/ktransformers/build/lib.linux-x86_64-cpython-311/ -DPYTHON_EXECUTABLE=/home/kite/anaconda3/envs/ktransformers/bin/python -DCMAKE_BUILD_TYPE=Release -DKTRANSFORMERS_USE_CUDA=ON -DLLAMA_NATIVE=ON -DEXAMPLE_VERSION_INFO=0.2.4.post1+cu128torch26avx2

Hi @kite800, by executing this command you can see the specific errors.

<!-- gh-comment-id:2781865915 --> @qiyuxinlin commented on GitHub (Apr 7, 2025): > I have the same issue: raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['cmake', '/home/kite/ktransformers/csrc/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/kite/ktransformers/build/lib.linux-x86_64-cpython-311/', '-DPYTHON_EXECUTABLE=/home/kite/anaconda3/envs/ktransformers/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.4.post1+cu128torch26avx2']' returned non-zero exit status 1. error: subprocess-exited-with-error > > × Building wheel for ktransformers (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> See above for output. > > note: This error originates from a subprocess, and is likely not a problem with pip. full command: /home/kite/anaconda3/envs/ktransformers/bin/python /home/kite/anaconda3/envs/ktransformers/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmpnv50b2zb cwd: /home/kite/ktransformers Building wheel for ktransformers (pyproject.toml) ... error ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (transformers) ``` cmake /home/kite/ktransformers/csrc/ktransformers_ext -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/kite/ktransformers/build/lib.linux-x86_64-cpython-311/ -DPYTHON_EXECUTABLE=/home/kite/anaconda3/envs/ktransformers/bin/python -DCMAKE_BUILD_TYPE=Release -DKTRANSFORMERS_USE_CUDA=ON -DLLAMA_NATIVE=ON -DEXAMPLE_VERSION_INFO=0.2.4.post1+cu128torch26avx2 ``` Hi @kite800, by executing this command you can see the specific errors.
Author
Owner

@kite800 commented on GitHub (Apr 7, 2025):

thanks to qiyuxinlin.
your command shows that CUDA compiler was not found. and I solved it by :

export PATH="$PATH:/usr/local/cuda-12.4/bin"
export LD_LIBRARY_PATH="/usr/local/cuda-12.4/lib64:$LD_LIBRARY_PATH"
export LIBRARY_PATH="/usr/local/cuda-12.4/lib64:$LIBRARY_PATH"
export CUDA_PATH="/usr/local/cuda-12.4"

<!-- gh-comment-id:2782776266 --> @kite800 commented on GitHub (Apr 7, 2025): thanks to qiyuxinlin. your command shows that CUDA compiler was not found. and I solved it by : export PATH="$PATH:/usr/local/cuda-12.4/bin" export LD_LIBRARY_PATH="/usr/local/cuda-12.4/lib64:$LD_LIBRARY_PATH" export LIBRARY_PATH="/usr/local/cuda-12.4/lib64:$LIBRARY_PATH" export CUDA_PATH="/usr/local/cuda-12.4"
Author
Owner

@AlbertG123 commented on GitHub (Apr 12, 2025):

cmake /home/kite/ktransformers/csrc/ktransformers_ext -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/kite/ktransformers/build/lib.linux-x86_64-cpython-311/ -DPYTHON_EXECUTABLE=/home/kite/anaconda3/envs/ktransformers/bin/python -DCMAKE_BUILD_TYPE=Release -DKTRANSFORMERS_USE_CUDA=ON -DLLAMA_NATIVE=ON -DEXAMPLE_VERSION_INFO=0.2.4.post1+cu128torch26avx2
能看到具体的报错,我的报错是因为 thirdparty/llama.cpp 和pybind11 两个文件夹是空的.
解决这两个问题,可以继续往下build 了. Cool

<!-- gh-comment-id:2798785638 --> @AlbertG123 commented on GitHub (Apr 12, 2025): cmake /home/kite/ktransformers/csrc/ktransformers_ext -DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/kite/ktransformers/build/lib.linux-x86_64-cpython-311/ -DPYTHON_EXECUTABLE=/home/kite/anaconda3/envs/ktransformers/bin/python -DCMAKE_BUILD_TYPE=Release -DKTRANSFORMERS_USE_CUDA=ON -DLLAMA_NATIVE=ON -DEXAMPLE_VERSION_INFO=0.2.4.post1+cu128torch26avx2 能看到具体的报错,我的报错是因为 thirdparty/llama.cpp 和pybind11 两个文件夹是空的. 解决这两个问题,可以继续往下build 了. Cool
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#742
No description provided.