kvcache-ai/ktransformers
1
0
Fork 0
mirror of https://github.com/kvcache-ai/ktransformers.git synced 2026-11-05 01:07:28 +00:00
Code Issues 469 Projects Packages Wiki Activity

[GH-ISSUE #766] [Bug] bash install.sh subprocess.CalledProcessError #554

New issue
Open
opened 2026-10-29 14:41:08 +00:00 by bsakaguchi · 3 comments
bsakaguchi commented 2026-10-29 14:41:08 +00:00
Owner
Copy link

Originally created by @zijin-zj on GitHub (Mar 2, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/766

Originally assigned to: @Azure-Tang on GitHub.

Checklist

  • 1. I have searched related issues but cannot get the expected help.
  • 2. The bug has not been fixed in the latest version.
  • 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
  • 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed.
  • 5. To help the community, I will use Chinese/English or attach an Chinese/English translation if using another language. Non-Chinese/English content without translation may be closed.

Describe the bug

【软件环境】
python 3.12.9
cuda 12.4
pytorch 2.5.1+cu124
gcc 11.4.0
cmake 3.31.6
【硬件环境】
4090 内存1T 硬盘1T

【执行步骤】
下载ktransformers压缩包到本地，然后上传到显卡服务器，到 /ktransformers 目录执行 bash install.sh，在 Building wheel for ktransformers (pyproject.toml) 步骤，发生异常

【异常日志】
Requirement already satisfied: jsonpointer>=1.9 in /root/miniconda3/lib/python3.12/site-packages (from jsonpatch<2.0,>=1.33->langchain-core<1.0.0,>=0.3.35->langchain>=0.2.0->ktransformers==0.2.1+cu124torch25fancy) (2.1)
Building wheels for collected packages: ktransformers
Building wheel for ktransformers (pyproject.toml) ... error
error: subprocess-exited-with-error

× Building wheel for ktransformers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [1848 lines of output]
Using native cpu instruct
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-312/ktransformers
copying ktransformers/init.py -> build/lib.linux-x86_64-cpython-312/ktransformers
copying ktransformers/local_chat.py -> build/lib.linux-x86_64-cpython-312/ktransformers
running egg_info
creating ktransformers.egg-info
writing ktransformers.egg-info/PKG-INFO
writing dependency_links to ktransformers.egg-info/dependency_links.txt
writing entry points to ktransformers.egg-info/entry_points.txt
writing requirements to ktransformers.egg-info/requires.txt
writing top-level names to ktransformers.egg-info/top_level.txt
writing manifest file 'ktransformers.egg-info/SOURCES.txt'
reading manifest file 'ktransformers.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no directories found matching 'local_chat.py'
no previously-included directories found matching 'ktransformers/logs'
no previously-included directories found matching 'third_party/llama.cpp/models'
warning: no directories found matching 'ktransformers/website/dist'
warning: no previously-included files matching 'pycache' found anywhere in distribution
warning: no files found matching 'KTransformersOps.*.so'
adding license file 'LICENSE'
writing manifest file 'ktransformers.egg-info/SOURCES.txt'
/root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.configs' is absent from the packages configuration.
!!

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'ktransformers.configs' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.
  
          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'ktransformers.configs' is explicitly added
          to the `packages` configuration field.
  
          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).
  
          You can read more about "package discovery" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
  
          If you don't want 'ktransformers.configs' to be distributed and are
          already explicitly excluding 'ktransformers.configs' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.
  
          You can read more about "package data files" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html
  
  
          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************
  
  !!
    check.warn(importable)
  /root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.ktransformers_ext' is absent from the `packages` configuration.
  !!
  
          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'ktransformers.ktransformers_ext' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.
  
          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'ktransformers.ktransformers_ext' is explicitly added
          to the `packages` configuration field.
  
          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).
  
          You can read more about "package discovery" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
  
          If you don't want 'ktransformers.ktransformers_ext' to be distributed and are
          already explicitly excluding 'ktransformers.ktransformers_ext' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.
  
          You can read more about "package data files" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html
  
  
          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

  
  !!
    check.warn(importable)
  /root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.utils' is absent from the `packages` configuration.
  !!
  
          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'ktransformers.server.utils' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.
  
          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'ktransformers.server.utils' is explicitly added
          to the `packages` configuration field.
  
          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).
  
          You can read more about "package discovery" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
  
          If you don't want 'ktransformers.server.utils' to be distributed and are
          already explicitly excluding 'ktransformers.server.utils' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.
  
          You can read more about "package data files" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html
  
  
          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************
  
  !!
    check.warn(importable)
  /root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.tests' is absent from the `packages` configuration.
  !!
  
          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'ktransformers.tests' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.
  
          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'ktransformers.tests' is explicitly added
          to the `packages` configuration field.
  
          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).
  
          You can read more about "package discovery" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
  
          If you don't want 'ktransformers.tests' to be distributed and are
          already explicitly excluding 'ktransformers.tests' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.
  
          You can read more about "package data files" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html
  
  
          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************
  
  !!
    check.warn(importable)
  /root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.util' is absent from the `packages` configuration.
  !!
  
          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'ktransformers.util' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.
  
          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'ktransformers.util' is explicitly added
          to the `packages` configuration field.
  
          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).
  
          You can read more about "package discovery" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html
  
          If you don't want 'ktransformers.util' to be distributed and are
          already explicitly excluding 'ktransformers.util' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.
  
          You can read more about "package data files" on setuptools documentation page:
  
          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html
  
  
          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************
  
  !!
    check.warn(importable)
  creating build/lib.linux-x86_64-cpython-312/ktransformers/configs
  copying ktransformers/configs/config.yaml -> build/lib.linux-x86_64-cpython-312/ktransformers/configs
  copying ktransformers/configs/log_config.ini -> build/lib.linux-x86_64-cpython-312/ktransformers/configs
  creating build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext
  copying ktransformers/ktransformers_ext/CMakeLists.txt -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext
  copying ktransformers/ktransformers_ext/ext_bindings.cpp -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext
  creating build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench
  copying ktransformers/ktransformers_ext/bench/bench_attention.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench
  copying ktransformers/ktransformers_ext/bench/bench_attention_torch.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench
  copying ktransformers/ktransformers_ext/bench/bench_linear.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench
  copying ktransformers/ktransformers_ext/bench/bench_linear_torch.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench
  copying ktransformers/ktransformers_ext/bench/bench_mlp.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench
  copying ktransformers/ktransformers_ext/bench/bench_mlp_torch.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench
  copying ktransformers/ktransformers_ext/bench/bench_moe.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench
  copying ktransformers/ktransformers_ext/bench/bench_moe_torch.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench
  creating build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cmake
  copying ktransformers/ktransformers_ext/cmake/FindSIMD.cmake -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cmake
  creating build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cpu_backend
  copying ktransformers/ktransformers_ext/cpu_backend/backend.cpp -> build/lib.linux-x86_64-cpython-312/ktransformers/
  copying ktransformers/ktransformers_ext/operators/llamafile/moe.h -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/operators/llamafile
  copying ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.cpp -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/operators/llamafile
  copying ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.h -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/operators/llamafile
  creating build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/__init__.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/configuration_deepseek.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/configuration_deepseek_v3.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/configuration_llama.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/custom_cache.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/modeling_deepseek.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/modeling_deepseek_v3.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/modeling_llama.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/modeling_mixtral.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  copying ktransformers/models/modeling_qwen2_moe.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models
  creating build/lib.linux-x86_64-cpython-312/ktransformers/operators
  copying ktransformers/operators/RoPE.py -> build/lib.linux-x86_64-cpython-312/ktransformers/operators
  copying ktransformers/operators/__init__.py -> build/lib.linux-x86_64-cpython-312/ktransformers/operators
  copying ktransformers/operators/attention.py -> build/lib.linux-x86_64-cpython-312/ktransformers/operators
  copying ktransformers/server/schemas/legacy/completions.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/schemas/legacy
  creating build/lib.linux-x86_64-cpython-312/ktransformers/server/utils
  copying ktransformers/server/utils/__init__.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/utils
  copying ktransformers/server/utils/create_interface.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/utils
  copying ktransformers/server/utils/multi_timer.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/utils
  copying ktransformers/server/utils/sql_utils.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/utils
  creating build/lib.linux-x86_64-cpython-312/ktransformers/tests
  copying ktransformers/tests/dequant_gpu.py -> build/lib.linux-x86_64-cpython-312/ktransformers/tests
  copying ktransformers/tests/dequant_gpu_t.py -> build/lib.linux-x86_64-cpython-312/ktransformers/tests
  copying ktransformers/tests/mmlu_pro_test.py -> build/lib.linux-x86_64-cpython-312/ktransformers/tests
  copying ktransformers/tests/mmlu_test.py -> build/lib.linux-x86_64-cpython-312/ktransformers/tests
  creating build/lib.linux-x86_64-cpython-312/ktransformers/util
  copying ktransformers/util/cuda_graph_runner.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
  copying ktransformers/util/custom_gguf.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
  copying ktransformers/util/modeling_rope_utils.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
  copying ktransformers/util/textstream.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
  copying ktransformers/util/utils.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util
  running build_ext
  /root/miniconda3/lib/python3.12/site-packages/torch/utils/cpp_extension.py:426: UserWarning: There are no /root/miniconda3/bin/x86_64-conda-linux-gnu-c++ version bounds defined for CUDA version 12.4
    warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
  CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/user/ktransformers/build/lib.linux-x86_64-cpython-312/', '-DPYTHON_EXECUTABLE=/root/miniconda3/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DCMAKE_AR=/root/miniconda3/bin/x86_64-conda-linux-gnu-ar', '-DCMAKE_RANLIB=/root/miniconda3/bin/x86_64-conda-linux-gnu-ranlib', '-DCMAKE_LINKER=/root/miniconda3/bin/x86_64-conda-linux-gnu-ld', '-DCMAKE_STRIP=/root/miniconda3/bin/x86_64-conda-linux-gnu-strip', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1+cu124torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/root/miniconda3/bin/ninja']
  Traceback (most recent call last):
    File "/root/miniconda3/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
      main()
    File "/root/miniconda3/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
      json_out["return_val"] = hook(**hook_input["kwargs"])
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/root/miniconda3/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel
      return _build_backend().build_wheel(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/build_meta.py", line 438, in build_wheel
      return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/build_meta.py", line 426, in _build
      return self._build_with_temp_dir(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir
      self.run_setup()
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/build_meta.py", line 320, in run_setup
      exec(code, locals())
    File "<string>", line 295, in <module>
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup
      return distutils.core.setup(**attrs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
      dist.run_commands()
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 983, in run_commands
      self.run_command(cmd)
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/dist.py", line 999, in run_command
      super().run_command(command)
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command
      cmd_obj.run()
    File "<string>", line 153, in run
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 369, in run
      self.run_command("build")
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command
      self.distribution.run_command(command)
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/dist.py", line 999, in run_command
      super().run_command(command)
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command
      cmd_obj.run()
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 136, in run
      self.run_command(cmd_name)
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command
      self.distribution.run_command(command)
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/dist.py", line 999, in run_command
      super().run_command(command)
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command
      cmd_obj.run()
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
      _build_ext.run(self)
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 365, in run
      self.build_extensions()
    File "/root/miniconda3/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 868, in build_extensions
      build_ext.build_extensions(self)
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 481, in build_extensions
      self._build_extensions_serial()
    File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 507, in _build_extensions_serial
      self.build_extension(ext)
    File "<string>", line 285, in build_extension
    File "/root/miniconda3/lib/python3.12/subprocess.py", line 573, in run
      raise CalledProcessError(retcode, process.args,
  subprocess.CalledProcessError: Command '['cmake', '/home/user/ktransformers/ktransformers/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/user/ktransformers/build/lib.linux-x86_64-cpython-312/', '-DPYTHON_EXECUTABLE=/root/miniconda3/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DCMAKE_AR=/root/miniconda3/bin/x86_64-conda-linux-gnu-ar', '-DCMAKE_RANLIB=/root/miniconda3/bin/x86_64-conda-linux-gnu-ranlib', '-DCMAKE_LINKER=/root/miniconda3/bin/x86_64-conda-linux-gnu-ld', '-DCMAKE_STRIP=/root/miniconda3/bin/x86_64-conda-linux-gnu-strip', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1+cu124torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/root/miniconda3/bin/ninja']' returned non-zero exit status 1.
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)

Reproduction

bash install.sh

Environment

【软件环境】
python 3.12.9
cuda 12.4
pytorch 2.5.1+cu124
gcc 11.4.0
cmake 3.31.6

【硬件环境】
4090 内存1T 硬盘1T

Originally created by @zijin-zj on GitHub (Mar 2, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/766 Originally assigned to: @Azure-Tang on GitHub. ### Checklist - [x] 1. I have searched related issues but cannot get the expected help. - [x] 2. The bug has not been fixed in the latest version. - [x] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback. - [x] 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed. - [x] 5. To help the community, I will use Chinese/English or attach an Chinese/English translation if using another language. Non-Chinese/English content without translation may be closed. ### Describe the bug 【软件环境】 python 3.12.9 cuda 12.4 pytorch 2.5.1+cu124 gcc 11.4.0 cmake 3.31.6 【硬件环境】 4090 内存1T 硬盘1T 【执行步骤】 下载ktransformers压缩包到本地，然后上传到显卡服务器，到 /ktransformers 目录执行 bash install.sh，在 Building wheel for ktransformers (pyproject.toml) 步骤，发生异常 【异常日志】 Requirement already satisfied: jsonpointer>=1.9 in /root/miniconda3/lib/python3.12/site-packages (from jsonpatch<2.0,>=1.33->langchain-core<1.0.0,>=0.3.35->langchain>=0.2.0->ktransformers==0.2.1+cu124torch25fancy) (2.1) Building wheels for collected packages: ktransformers Building wheel for ktransformers (pyproject.toml) ... error error: subprocess-exited-with-error × Building wheel for ktransformers (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [1848 lines of output] Using native cpu instruct running bdist_wheel running build running build_py creating build/lib.linux-x86_64-cpython-312/ktransformers copying ktransformers/__init__.py -> build/lib.linux-x86_64-cpython-312/ktransformers copying ktransformers/local_chat.py -> build/lib.linux-x86_64-cpython-312/ktransformers running egg_info creating ktransformers.egg-info writing ktransformers.egg-info/PKG-INFO writing dependency_links to ktransformers.egg-info/dependency_links.txt writing entry points to ktransformers.egg-info/entry_points.txt writing requirements to ktransformers.egg-info/requires.txt writing top-level names to ktransformers.egg-info/top_level.txt writing manifest file 'ktransformers.egg-info/SOURCES.txt' reading manifest file 'ktransformers.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no directories found matching 'local_chat.py' no previously-included directories found matching 'ktransformers/logs' no previously-included directories found matching 'third_party/llama.cpp/models' warning: no directories found matching 'ktransformers/website/dist' warning: no previously-included files matching '__pycache__' found anywhere in distribution warning: no files found matching 'KTransformersOps.*.so' adding license file 'LICENSE' writing manifest file 'ktransformers.egg-info/SOURCES.txt' /root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.configs' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.configs' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.configs' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.configs' to be distributed and are already explicitly excluding 'ktransformers.configs' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.ktransformers_ext' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.ktransformers_ext' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.ktransformers_ext' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.ktransformers_ext' to be distributed and are already explicitly excluding 'ktransformers.ktransformers_ext' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.server.utils' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.server.utils' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.server.utils' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.server.utils' to be distributed and are already explicitly excluding 'ktransformers.server.utils' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.tests' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.tests' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.tests' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.tests' to be distributed and are already explicitly excluding 'ktransformers.tests' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) /root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_py.py:212: _Warning: Package 'ktransformers.util' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'ktransformers.util' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'ktransformers.util' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'ktransformers.util' to be distributed and are already explicitly excluding 'ktransformers.util' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) creating build/lib.linux-x86_64-cpython-312/ktransformers/configs copying ktransformers/configs/config.yaml -> build/lib.linux-x86_64-cpython-312/ktransformers/configs copying ktransformers/configs/log_config.ini -> build/lib.linux-x86_64-cpython-312/ktransformers/configs creating build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext copying ktransformers/ktransformers_ext/CMakeLists.txt -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext copying ktransformers/ktransformers_ext/ext_bindings.cpp -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext creating build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_attention.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_attention_torch.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_linear.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_linear_torch.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_mlp.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_mlp_torch.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_moe.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench copying ktransformers/ktransformers_ext/bench/bench_moe_torch.py -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/bench creating build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cmake copying ktransformers/ktransformers_ext/cmake/FindSIMD.cmake -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cmake creating build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/cpu_backend copying ktransformers/ktransformers_ext/cpu_backend/backend.cpp -> build/lib.linux-x86_64-cpython-312/ktransformers/ copying ktransformers/ktransformers_ext/operators/llamafile/moe.h -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.cpp -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/operators/llamafile copying ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.h -> build/lib.linux-x86_64-cpython-312/ktransformers/ktransformers_ext/operators/llamafile creating build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/__init__.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/configuration_deepseek.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/configuration_deepseek_v3.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/configuration_llama.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/custom_cache.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/modeling_deepseek.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/modeling_deepseek_v3.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/modeling_llama.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/modeling_mixtral.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models copying ktransformers/models/modeling_qwen2_moe.py -> build/lib.linux-x86_64-cpython-312/ktransformers/models creating build/lib.linux-x86_64-cpython-312/ktransformers/operators copying ktransformers/operators/RoPE.py -> build/lib.linux-x86_64-cpython-312/ktransformers/operators copying ktransformers/operators/__init__.py -> build/lib.linux-x86_64-cpython-312/ktransformers/operators copying ktransformers/operators/attention.py -> build/lib.linux-x86_64-cpython-312/ktransformers/operators copying ktransformers/server/schemas/legacy/completions.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/schemas/legacy creating build/lib.linux-x86_64-cpython-312/ktransformers/server/utils copying ktransformers/server/utils/__init__.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/utils copying ktransformers/server/utils/create_interface.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/utils copying ktransformers/server/utils/multi_timer.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/utils copying ktransformers/server/utils/sql_utils.py -> build/lib.linux-x86_64-cpython-312/ktransformers/server/utils creating build/lib.linux-x86_64-cpython-312/ktransformers/tests copying ktransformers/tests/dequant_gpu.py -> build/lib.linux-x86_64-cpython-312/ktransformers/tests copying ktransformers/tests/dequant_gpu_t.py -> build/lib.linux-x86_64-cpython-312/ktransformers/tests copying ktransformers/tests/mmlu_pro_test.py -> build/lib.linux-x86_64-cpython-312/ktransformers/tests copying ktransformers/tests/mmlu_test.py -> build/lib.linux-x86_64-cpython-312/ktransformers/tests creating build/lib.linux-x86_64-cpython-312/ktransformers/util copying ktransformers/util/cuda_graph_runner.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util copying ktransformers/util/custom_gguf.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util copying ktransformers/util/modeling_rope_utils.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util copying ktransformers/util/textstream.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util copying ktransformers/util/utils.py -> build/lib.linux-x86_64-cpython-312/ktransformers/util running build_ext /root/miniconda3/lib/python3.12/site-packages/torch/utils/cpp_extension.py:426: UserWarning: There are no /root/miniconda3/bin/x86_64-conda-linux-gnu-c++ version bounds defined for CUDA version 12.4 warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}') CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/user/ktransformers/build/lib.linux-x86_64-cpython-312/', '-DPYTHON_EXECUTABLE=/root/miniconda3/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DCMAKE_AR=/root/miniconda3/bin/x86_64-conda-linux-gnu-ar', '-DCMAKE_RANLIB=/root/miniconda3/bin/x86_64-conda-linux-gnu-ranlib', '-DCMAKE_LINKER=/root/miniconda3/bin/x86_64-conda-linux-gnu-ld', '-DCMAKE_STRIP=/root/miniconda3/bin/x86_64-conda-linux-gnu-strip', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1+cu124torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/root/miniconda3/bin/ninja'] Traceback (most recent call last): File "/root/miniconda3/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module> main() File "/root/miniconda3/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main json_out["return_val"] = hook(**hook_input["kwargs"]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 280, in build_wheel return _build_backend().build_wheel( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/lib/python3.12/site-packages/setuptools/build_meta.py", line 438, in build_wheel return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/lib/python3.12/site-packages/setuptools/build_meta.py", line 426, in _build return self._build_with_temp_dir( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/lib/python3.12/site-packages/setuptools/build_meta.py", line 407, in _build_with_temp_dir self.run_setup() File "/root/miniconda3/lib/python3.12/site-packages/setuptools/build_meta.py", line 320, in run_setup exec(code, locals()) File "<string>", line 295, in <module> File "/root/miniconda3/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup return distutils.core.setup(**attrs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup return run_commands(dist) ^^^^^^^^^^^^^^^^^^ File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands dist.run_commands() File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 983, in run_commands self.run_command(cmd) File "/root/miniconda3/lib/python3.12/site-packages/setuptools/dist.py", line 999, in run_command super().run_command(command) File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command cmd_obj.run() File "<string>", line 153, in run File "/root/miniconda3/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 369, in run self.run_command("build") File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command self.distribution.run_command(command) File "/root/miniconda3/lib/python3.12/site-packages/setuptools/dist.py", line 999, in run_command super().run_command(command) File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command cmd_obj.run() File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 136, in run self.run_command(cmd_name) File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 339, in run_command self.distribution.run_command(command) File "/root/miniconda3/lib/python3.12/site-packages/setuptools/dist.py", line 999, in run_command super().run_command(command) File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_command cmd_obj.run() File "/root/miniconda3/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run _build_ext.run(self) File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 365, in run self.build_extensions() File "/root/miniconda3/lib/python3.12/site-packages/torch/utils/cpp_extension.py", line 868, in build_extensions build_ext.build_extensions(self) File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 481, in build_extensions self._build_extensions_serial() File "/root/miniconda3/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 507, in _build_extensions_serial self.build_extension(ext) File "<string>", line 285, in build_extension File "/root/miniconda3/lib/python3.12/subprocess.py", line 573, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['cmake', '/home/user/ktransformers/ktransformers/ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=/home/user/ktransformers/build/lib.linux-x86_64-cpython-312/', '-DPYTHON_EXECUTABLE=/root/miniconda3/bin/python', '-DCMAKE_BUILD_TYPE=Release', '-DCMAKE_AR=/root/miniconda3/bin/x86_64-conda-linux-gnu-ar', '-DCMAKE_RANLIB=/root/miniconda3/bin/x86_64-conda-linux-gnu-ranlib', '-DCMAKE_LINKER=/root/miniconda3/bin/x86_64-conda-linux-gnu-ld', '-DCMAKE_STRIP=/root/miniconda3/bin/x86_64-conda-linux-gnu-strip', '-DCMAKE_BUILD_TYPE=Release', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1+cu124torch25fancy', '-GNinja', '-DCMAKE_MAKE_PROGRAM:FILEPATH=/root/miniconda3/bin/ninja']' returned non-zero exit status 1. [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers) ### Reproduction bash install.sh ### Environment 【软件环境】 python 3.12.9 cuda 12.4 pytorch 2.5.1+cu124 gcc 11.4.0 cmake 3.31.6 【硬件环境】 4090 内存1T 硬盘1T
bsakaguchi commented 2026-10-29 14:41:09 +00:00
Author
Owner
Copy link

@twd123-a commented on GitHub (Mar 6, 2025):

请问解决了吗

<!-- gh-comment-id:2703260669 --> @twd123-a commented on GitHub (Mar 6, 2025): 请问解决了吗
bsakaguchi commented 2026-10-29 14:41:10 +00:00
Author
Owner
Copy link

@twd123-a commented on GitHub (Mar 6, 2025):

我也遇到同样的问题

<!-- gh-comment-id:2703261127 --> @twd123-a commented on GitHub (Mar 6, 2025): 我也遇到同样的问题
bsakaguchi commented 2026-10-29 14:41:10 +00:00
Author
Owner
Copy link

@yeruimin commented on GitHub (Mar 11, 2025):

遇到同样问题，卡住了

<!-- gh-comment-id:2712478880 --> @yeruimin commented on GitHub (Mar 11, 2025): 遇到同样问题，卡住了
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
auto/sync-sglang
gh-pages
docs/kt-ft-figure2-single-column-20261010
perf/bf16-grad-norm-20261010
docs/kt-ft-paper-20261008
release/20260911-carrier-repair
release/20260911-ci-python
release/20260911-pypi
ci/four-main-pypi-release
ci/model-e2e-acceptance
release/0.7.0.post3-frozen-pypi
fix/glm53-index-share-sync
release/0.7.0.post2-frozen-pypi
hotfix/0.7.0.post2-pypi-runtime
fix/avx2-wheel-feature-isolation
fix/release-self-hosted-runner
release/automate-kt-sft-pypi
support-glm5-next-djw
docs/deepseek-v4-flash-docker
ovowei-patch-3
support-glm52-djw
doc-reorg-entrypoints-support-matrix
bump-sglang-pr31
docs-v061-refresh
fp4-moe-amx
flatten-ktransformers-shim
archive-kt-sft
kt-kernel-torch-range-v061
sft-whl
sft
docs/gosim-2026-and-roadmap-link
ovowei-patch-2
ovowei-patch-1
revert-1918-fix/rocm-cpuinfer-stream-bridge
chore/kt-layerwise-prefill-main
chore/kt-layerwise-prefill-label
sft-rel
support-glm51-djw
release/v0.5.3
chore/kt-run-numa-nodes-unified
mtp
ksft-sglang
avx2
fix/sglang-kt-detection
layerwise-prefill-opt
feat/mistral-loader-support
fix-docker-build
minimax-m2.5
qwen3.5
add-maintainers
oql-doc
cli-dev-ljq
ljq-cli-dev-new
JimmyPeilinLi-patch-2
kimi_k2.5
oql-dev
experts_sched
JimmyPeilinLi-patch-1
ErvinXie-patch-1
ksft-llama
glm47_fp8
debug_llama
refactor_sft
ljq-cli-dev
refactor_sft_int4_debug
lut-nvfp4
fix-import
fix-deploy-djw
cpu-fix
ljq-dev-1
route-moe
sosp25-ae
v0.7.2
paper-ktft-v1.1
paper-ktft-v1
v0.7.1
v0.7.0.post4
v0.7.0.post1
v0.7.0
v0.6.4
v0.6.3.post1
v0.6.3
v0.6.2.post3
v0.6.2.post2
v0.6.2.post1
v0.6.2
v0.6.1
v0.6.1.post1
v0.5.3
v0.5.2.post1
v0.5.1
v0.5.0.post1
v0.5.0
v0.4.4
v0.4.3
v0.4.2
v0.4.1
v0.3.2
v0.3.1
v0.3
v0.2.4post1
v0.2.4
v0.2.3post2
v0.2.3post1
v0.2.3
v0.2.2
v0.2.2rc2
v0.2.2rc1
v0.2.1.post1
v0.2.1
v0.2.0
v0.1.4
v0.1.3
v0.1.2
v0.1.1
v0.1.0
Labels
Clear labels   
bug

   
duplicate

   
enhancement

   
good first issue

   
help wanted

   
pull-request
Mirrored from GitHub Pull Request

  
stale
No labels
bug
duplicate
enhancement
good first issue
help wanted
pull-request
stale
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#554
No description provided.