mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #1004] 求大佬看下哪里问题？环境组件都安装好了，最后一步安装Kt总是这个报错，无法解决 #709
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#709
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @bboowx on GitHub (Mar 31, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/1004
(kt) wangjian@tufai:~/ktransformers$ sh ./install.sh
Installing python dependencies from requirements.txt
Defaulting to user installation because normal site-packages is not writeable
Requirement already satisfied: fire in /home/wangjian/.local/lib/python3.10/site-packages (from -r requirements-local_chat.txt (line 1)) (0.7.0)
Requirement already satisfied: transformers==4.43.2 in /home/wangjian/.local/lib/python3.10/site-packages (from -r requirements-local_chat.txt (line 2)) (4.43.2)
Requirement already satisfied: numpy in /home/wangjian/.local/lib/python3.10/site-packages (from -r requirements-local_chat.txt (line 3)) (2.2.4)
Requirement already satisfied: torch>=2.3.0 in /home/wangjian/.local/lib/python3.10/site-packages (from -r requirements-local_chat.txt (line 4)) (2.6.0)
Requirement already satisfied: packaging in /home/wangjian/.local/lib/python3.10/site-packages (from -r requirements-local_chat.txt (line 5)) (24.2)
Requirement already satisfied: cpufeature in /home/wangjian/.local/lib/python3.10/site-packages (from -r requirements-local_chat.txt (line 6)) (0.2.1)
Requirement already satisfied: protobuf in /usr/lib/python3/dist-packages (from -r requirements-local_chat.txt (line 7)) (3.12.4)
Requirement already satisfied: tiktoken in /home/wangjian/.local/lib/python3.10/site-packages (from -r requirements-local_chat.txt (line 8)) (0.9.0)
Requirement already satisfied: blobfile in /home/wangjian/.local/lib/python3.10/site-packages (from -r requirements-local_chat.txt (line 9)) (3.0.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in /home/wangjian/.local/lib/python3.10/site-packages (from transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (0.30.0)
Requirement already satisfied: tokenizers<0.20,>=0.19 in /home/wangjian/.local/lib/python3.10/site-packages (from transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (0.19.1)
Requirement already satisfied: tqdm>=4.27 in /home/wangjian/.local/lib/python3.10/site-packages (from transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (4.67.1)
Requirement already satisfied: requests in /home/wangjian/.local/lib/python3.10/site-packages (from transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (2.32.3)
Requirement already satisfied: pyyaml>=5.1 in /usr/lib/python3/dist-packages (from transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (5.4.1)
Requirement already satisfied: filelock in /home/wangjian/.local/lib/python3.10/site-packages (from transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (3.18.0)
Requirement already satisfied: safetensors>=0.4.1 in /home/wangjian/.local/lib/python3.10/site-packages (from transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (0.5.3)
Requirement already satisfied: regex!=2019.12.17 in /home/wangjian/.local/lib/python3.10/site-packages (from transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (2024.11.6)
Requirement already satisfied: termcolor in /home/wangjian/.local/lib/python3.10/site-packages (from fire->-r requirements-local_chat.txt (line 1)) (3.0.0)
Requirement already satisfied: jinja2 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (3.1.6)
Requirement already satisfied: nvidia-nvtx-cu12==12.4.127 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (12.4.127)
Requirement already satisfied: typing-extensions>=4.10.0 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (4.13.0)
Requirement already satisfied: nvidia-cufft-cu12==11.2.1.3 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (11.2.1.3)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.4.127 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (12.4.127)
Requirement already satisfied: nvidia-cusolver-cu12==11.6.1.9 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (11.6.1.9)
Requirement already satisfied: nvidia-cusparse-cu12==12.3.1.170 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (12.3.1.170)
Requirement already satisfied: nvidia-curand-cu12==10.3.5.147 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (10.3.5.147)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.4.127 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (12.4.127)
Requirement already satisfied: nvidia-nccl-cu12==2.21.5 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (2.21.5)
Requirement already satisfied: networkx in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (3.4.2)
Requirement already satisfied: triton==3.2.0 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (3.2.0)
Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (9.1.0.70)
Requirement already satisfied: nvidia-cublas-cu12==12.4.5.8 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (12.4.5.8)
Requirement already satisfied: fsspec in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (2025.3.1)
Requirement already satisfied: sympy==1.13.1 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (1.13.1)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.2 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (0.6.2)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.4.127 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (12.4.127)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.4.127 in /home/wangjian/.local/lib/python3.10/site-packages (from torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (12.4.127)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/wangjian/.local/lib/python3.10/site-packages (from sympy==1.13.1->torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (1.3.0)
Requirement already satisfied: lxml>=4.9 in /home/wangjian/.local/lib/python3.10/site-packages (from blobfile->-r requirements-local_chat.txt (line 9)) (5.3.1)
Requirement already satisfied: pycryptodomex>=3.8 in /home/wangjian/.local/lib/python3.10/site-packages (from blobfile->-r requirements-local_chat.txt (line 9)) (3.22.0)
Requirement already satisfied: urllib3<3,>=1.25.3 in /usr/lib/python3/dist-packages (from blobfile->-r requirements-local_chat.txt (line 9)) (1.26.5)
Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests->transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (3.3)
Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests->transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (2020.6.20)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/wangjian/.local/lib/python3.10/site-packages (from requests->transformers==4.43.2->-r requirements-local_chat.txt (line 2)) (3.4.1)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/lib/python3/dist-packages (from jinja2->torch>=2.3.0->-r requirements-local_chat.txt (line 4)) (2.0.1)
Installing ktransformers
Defaulting to user installation because normal site-packages is not writeable
Processing /home/wangjian/ktransformers
Preparing metadata (pyproject.toml) ... done
Building wheels for collected packages: ktransformers
Building wheel for ktransformers (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for ktransformers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [62 lines of output]
/usr/lib/python3/dist-packages/setuptools/dist.py:493: UserWarning: Normalizing '0.2.3post2+torch26avx2' to '0.2.3.post2+torch26avx2'
warnings.warn(tmpl.format(**locals()))
Using native cpu instruct
running bdist_wheel
running build
running build_ext
/home/wangjian/.local/lib/python3.10/site-packages/torch/utils/cpp_extension.py:458: UserWarning: There are no x86_64-linux-gnu-g++ version bounds defined for CUDA version 12.4
warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/wangjian/ktransformers/build/lib.linux-x86_64-3.10/', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON']
CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/wangjian/ktransformers/build/lib.linux-x86_64-3.10/', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.3.post2+torch26avx2', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/home/wangjian/.local/bin/ninja']
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in
main()
File "/usr/lib/python3/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
File "/usr/lib/python3/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 261, in build_wheel
return _build_backend().build_wheel(wheel_directory, config_settings,
File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 230, in build_wheel
return self._build_with_temp_dir(['bdist_wheel'], '.whl',
File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 215, in _build_with_temp_dir
self.run_setup()
File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 158, in run_setup
exec(compile(code, file, 'exec'), locals())
File "setup.py", line 443, in
setup(
File "/usr/lib/python3/dist-packages/setuptools/init.py", line 153, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.10/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.10/distutils/dist.py", line 966, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "setup.py", line 243, in run
super().run()
File "/usr/lib/python3/dist-packages/wheel/bdist_wheel.py", line 299, in run
self.run_command('build')
File "/usr/lib/python3.10/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/usr/lib/python3.10/distutils/command/build.py", line 135, in run
self.run_command(cmd_name)
File "/usr/lib/python3.10/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
cmd_obj.run()
File "/usr/lib/python3/dist-packages/setuptools/command/build_ext.py", line 79, in run
_build_ext.run(self)
File "/usr/lib/python3.10/distutils/command/build_ext.py", line 340, in run
self.build_extensions()
File "/home/wangjian/.local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 900, in build_extensions
build_ext.build_extensions(self)
File "/usr/lib/python3.10/distutils/command/build_ext.py", line 449, in build_extensions
self._build_extensions_serial()
File "/usr/lib/python3.10/distutils/command/build_ext.py", line 474, in _build_extensions_serial
self.build_extension(ext)
File "setup.py", line 392, in build_extension
result = subprocess.run(
File "/usr/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cmake', '/home/wangjian/ktransformers/ktransformers/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/wangjian/ktransformers/build/lib.linux-x86_64-3.10/', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.3.post2+torch26avx2', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/home/wangjian/.local/bin/ninja']' returned non-zero exit status 1.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
ERROR: Could not build wheels for ktransformers, which is required to install pyproject.toml-based projects
@maaaxinfinity commented on GitHub (Mar 31, 2025):
@Atream commented on GitHub (Apr 2, 2025):
build失败一般是third party没安装好，试一下git submodule update --init --recursive
@joker-charles commented on GitHub (Apr 3, 2025):
设置了CUDA_HOME并将/usr/local/cuda/bin加入到PATH目录了吗？
@xxxzsgxxx commented on GitHub (Apr 7, 2025):
碰到了同样的问题。
机器环境是一个老机器，Ubuntu 2204，cuda 12.4，gcc11.4,12都不行，cmake各种版本都试过不行；llama.cpp单独拉包回来也不行；从新重置conda环境也跑不通。其实之前曾经编译成功过，但是一回答问题就程序崩溃掉，回退之后各种不行了，不知道是不是新版本问题。
老老实实滚回llama.cpp了，每秒几个token玩玩算了。
整体感觉这个项目距离稳定还得有些时间，有空了再试。