[GH-ISSUE #602] Windows,Turing架构的显卡部署有问题 #442

Closed
opened 2026-10-29 14:39:45 +00:00 by bsakaguchi · 5 comments
Owner

Originally created by @zhizi42 on GitHub (Feb 22, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/602

使用预编译好的whl包能安装,但是使用命令启动时报错,翻阅issue发现疑似本来不支持我的Turing的2070s,看到解决方案为改代码自己编译,遂尝试自己编译,但遇到以下报错,翻阅Google和本项目issue无法战胜。不知道为什么会中文乱码,试了chcp 65001和改各种编码都没用。

               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1049,52): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1049,52): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1059,31): error C2039: "high_resolution_clock": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1059,31): error C3083: 鈥渉igh_resolution_clock鈥\x9d:鈥\x9c::鈥濆乏渚х殑绗﹀彿蹇呴』鏄\xaf涓\x80绉嶇被鍨\x8b [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1059,54): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1059,54): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1103,29): error C2039: "high_resolution_clock": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1103,29): error C3083: 鈥渉igh_resolution_clock鈥\x9d:鈥\x9c::鈥濆乏渚х殑绗﹀彿蹇呴』鏄\xaf涓\x80绉嶇被鍨\x8b [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1103,52): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1103,52): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1110,31): error C2039: "high_resolution_clock": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1110,31): error C3083: 鈥渉igh_resolution_clock鈥\x9d:鈥\x9c::鈥濆乏渚х殑绗﹀彿蹇呴』鏄\xaf涓\x80绉嶇被鍨\x8b [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1110,54): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1110,54): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1123,29): error C2039: "high_resolution_clock": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1123,29): error C3083: 鈥渉igh_resolution_clock鈥\x9d:鈥\x9c::鈥濆乏渚х殑绗﹀彿蹇呴』鏄\xaf涓\x80绉嶇被鍨\x8b [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1123,52): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]
               C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1123,52): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj]

          236 涓\xaa璀﹀憡
          251 涓\xaa閿欒\xaf\xaf

      宸茬敤鏃堕棿 00:02:03.82
      CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=C:\\Code\\Python\\ktransformers\\build\\lib.win-amd64-cpython-311\\', '-DPYTHON_EXECUTABLE=C:\\Program Files\\Python311\\python.exe', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1.post1+cu124torch24avx2', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY_RELEASE=C:\\Code\\Python\\ktransformers\\build\\lib.win-amd64-cpython-311']
      Standard output: b'-- Building for: Visual Studio 17 2022\n-- Selecting Windows SDK version 10.0.22000.0 to target Windows 10.0.22631.\n-- The C compiler identification is MSVC 19.43.34808.0\n-- The CXX compiler identification is MSVC 19.43.34808.0\n-- Detecting C compiler ABI info\n-- Detecting C compiler ABI info - done\n-- Check for working C compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.43.34808/bin/Hostx64/x64/cl.exe - skipped\n-- Detecting C compile features\n-- Detecting C compile features - done\n-- Detecting CXX compiler ABI info\n-- Detecting CXX compiler ABI info - done\n-- Check for working CXX compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.43.34808/bin/Hostx64/x64/cl.exe - skipped\n-- Detecting CXX compile features\n-- Detecting CXX compile features - done\n-- CMAKE_SYSTEM_PROCESSOR: AMD64\n-- CMAKE_GENERATOR_PLATFORM: \n-- x86 detected\n-- Performing Test HAS_AVX_1\n-- Performing Test HAS_AVX_1 - Success\n-- Performing Test HAS_AVX2_1\n-- Performing Test HAS_AVX2_1 - Success\n-- Performing Test HAS_FMA_1\n-- Performing Test HAS_FMA_1 - Success\n-- Performing Test HAS_AVX512_1\n-- Performing Test HAS_AVX512_1 - Failed\n-- Performing Test HAS_AVX512_2\n-- Performing Test HAS_AVX512_2 - Failed\n-- pybind11 v2.14.0 dev1\n-- Found PythonInterp: C:/Program Files/Python311/python.exe (found suitable version "3.11.2", minimum required is "3.7") \n-- Found PythonLibs: C:/Program Files/Python311/libs/python311.lib\n-- Performing Test HAS_MSVC_GL_LTCG\n-- Performing Test HAS_MSVC_GL_LTCG - Failed\n-- Found Git: C:/Program Files/Git/cmd/git.exe (found version "2.47.1.windows.1") \n-- Performing Test CMAKE_HAVE_LIBC_PTHREAD\n-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed\n-- Looking for pthread_create in pthreads\n-- Looking for pthread_create in pthreads - not found\n-- Looking for pthread_create in pthread\n-- Looking for pthread_create in pthread - not found\n-- Found Threads: TRUE  \n-- Found OpenMP_C: -openmp (found version "2.0") \n-- Found OpenMP_CXX: -openmp (found version "2.0") \n-- Found OpenMP: TRUE (found version "2.0")  \n-- OpenMP found\n-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with LLAMA_CCACHE=OFF\n-- CMAKE_SYSTEM_PROCESSOR: AMD64\n-- CMAKE_GENERATOR_PLATFORM: \n-- x86 detected\n-- ALL_SOURCES: C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/ext_bindings.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/cpu_backend/backend.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/cpu_backend/task_queue.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/llamafile/linear.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/llamafile/mlp.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/llamafile/moe.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/flags.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/iqk_mul_mat_amd_avx2.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/iqk_mul_mat_amd_zen4.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/iqk_mul_mat_arm82.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/sgemm.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avx.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avx2.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avx512f.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avxvnni.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_fma.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_zen4.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_arm80.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_arm82.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avx.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avx2.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avx512f.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avxvnni.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_fma.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_zen4.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_arm80.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_arm82.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_unsupported.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/kvcache/kvcache_attn.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/kvcache/kvcache_load_dump.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/kvcache/kvcache_read_write.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/kvcache/kvcache_utils.cpp\n-- NUMA support is disabled\n-- NUMA library not found or user not set USE_NUMA - disabling NUMA support\n-- Configuring done (12.1s)\n-- Generating done (0.1s)\n-- Build files have been written to: C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/build\n'
      Standard error: b'CMake Warning:\n  Manually-specified variables were not used by the project:\n\n    EXAMPLE_VERSION_INFO\n\n\n'
      Traceback (most recent call last):
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\fancy_getopt.py", line 247, in getopt
          opts, args = getopt.getopt(args, short_opts, self.long_opts)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\getopt.py", line 93, in getopt
          opts, args = do_longs(opts, args[0][2:], longopts, args[1:])
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\getopt.py", line 157, in do_longs
          has_arg, opt = long_has_args(opt, longopts)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\getopt.py", line 174, in long_has_args
          raise GetoptError(_('option --%s not recognized') % opt, opt)
      getopt.GetoptError: option --dist-info-dir not recognized

      During handling of the above exception, another exception occurred:

      Traceback (most recent call last):
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\core.py", line 173, in setup
          ok = dist.parse_command_line()
               ^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 483, in parse_command_line
          args = self._parse_command_opts(parser, args)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\dist.py", line 900, in _parse_command_opts
          nargs = _Distribution._parse_command_opts(self, parser, args)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 587, in _parse_command_opts
          (args, opts) = parser.getopt(args[1:])
                         ^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\fancy_getopt.py", line 249, in getopt
          raise DistutilsArgError(msg)
      distutils.errors.DistutilsArgError: option --dist-info-dir not recognized

      During handling of the above exception, another exception occurred:

      Traceback (most recent call last):
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 438, in build_wheel
          return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 426, in _build
          return self._build_with_temp_dir(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 407, in _build_with_temp_dir
          self.run_setup()
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 320, in run_setup
          exec(code, locals())
        File "<string>", line 372, in <module>
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\__init__.py", line 117, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\core.py", line 175, in setup
          raise SystemExit(gen_usage(dist.script_name) + f"\nerror: {msg}")
      SystemExit: usage: _in_process.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
         or: _in_process.py --help [cmd1 cmd2 ...]
         or: _in_process.py --help-commands
         or: _in_process.py cmd --help

      error: option --dist-info-dir not recognized

      During handling of the above exception, another exception occurred:

      Traceback (most recent call last):
        File "C:\Users\zhizi42\AppData\Roaming\Python\Python311\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 389, in <module>
          main()
        File "C:\Users\zhizi42\AppData\Roaming\Python\Python311\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 373, in main
          json_out["return_val"] = hook(**hook_input["kwargs"])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Users\zhizi42\AppData\Roaming\Python\Python311\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 280, in build_wheel
          return _build_backend().build_wheel(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 444, in build_wheel
          return _build(['bdist_wheel'])
                 ^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 426, in _build
          return self._build_with_temp_dir(
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 407, in _build_with_temp_dir
          self.run_setup()
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 320, in run_setup
          exec(code, locals())
        File "<string>", line 372, in <module>
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\__init__.py", line 117, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\core.py", line 186, in setup
          return run_commands(dist)
                 ^^^^^^^^^^^^^^^^^^
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\core.py", line 202, in run_commands
          dist.run_commands()
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 983, in run_commands
          self.run_command(cmd)
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\dist.py", line 999, in run_command
          super().run_command(command)
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 1002, in run_command
          cmd_obj.run()
        File "<string>", line 177, in run
        File "C:\Program Files\Python311\Lib\site-packages\wheel\bdist_wheel.py", line 325, in run
          self.run_command("build")
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\cmd.py", line 339, in run_command
          self.distribution.run_command(command)
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\dist.py", line 999, in run_command
          super().run_command(command)
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 1002, in run_command
          cmd_obj.run()
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\command\build.py", line 136, in run
          self.run_command(cmd_name)
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\cmd.py", line 339, in run_command
          self.distribution.run_command(command)
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\dist.py", line 999, in run_command
          super().run_command(command)
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 1002, in run_command
          cmd_obj.run()
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\command\build_ext.py", line 99, in run
          _build_ext.run(self)
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\command\build_ext.py", line 365, in run
          self.build_extensions()
        File "C:\Users\zhizi42\AppData\Roaming\Python\Python311\site-packages\torch\utils\cpp_extension.py", line 866, in build_extensions
          build_ext.build_extensions(self)
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\command\build_ext.py", line 481, in build_extensions
          self._build_extensions_serial()
        File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\command\build_ext.py", line 507, in _build_extensions_serial
          self.build_extension(ext)
        File "<string>", line 327, in build_extension
        File "C:\Program Files\Python311\Lib\subprocess.py", line 571, in run
          raise CalledProcessError(retcode, process.args,
      subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--verbose', '--config', 'Release', '--parallel=24']' returned non-zero exit status 1.
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)
Installation completed successfully```
另开了个纯净Windows配环境后也是报错(不过好像不太一样)
环境是Windows11,cuda12.4,python3.11.2,pytorch2.4.1+cu124,gcc9.2.0。
希望有巨佬能给出解决方法,先谢谢大家了。另外希望作者官方支持老显卡(
Originally created by @zhizi42 on GitHub (Feb 22, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/602 使用预编译好的whl包能安装,但是使用命令启动时报错,翻阅issue发现疑似本来不支持我的Turing的2070s,看到解决方案为改代码自己编译,遂尝试自己编译,但遇到以下报错,翻阅Google和本项目issue无法战胜。不知道为什么会中文乱码,试了chcp 65001和改各种编码都没用。 ```C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1049,29): error C3083: 鈥渉igh_resolution_clock鈥\x9d:鈥\x9c::鈥濆乏渚х殑绗﹀彿蹇呴』鏄\xaf涓\x80绉嶇被鍨\x8b [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1049,52): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1049,52): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1059,31): error C2039: "high_resolution_clock": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1059,31): error C3083: 鈥渉igh_resolution_clock鈥\x9d:鈥\x9c::鈥濆乏渚х殑绗﹀彿蹇呴』鏄\xaf涓\x80绉嶇被鍨\x8b [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1059,54): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1059,54): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1103,29): error C2039: "high_resolution_clock": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1103,29): error C3083: 鈥渉igh_resolution_clock鈥\x9d:鈥\x9c::鈥濆乏渚х殑绗﹀彿蹇呴』鏄\xaf涓\x80绉嶇被鍨\x8b [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1103,52): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1103,52): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1110,31): error C2039: "high_resolution_clock": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1110,31): error C3083: 鈥渉igh_resolution_clock鈥\x9d:鈥\x9c::鈥濆乏渚х殑绗﹀彿蹇呴』鏄\xaf涓\x80绉嶇被鍨\x8b [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1110,54): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1110,54): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1123,29): error C2039: "high_resolution_clock": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1123,29): error C3083: 鈥渉igh_resolution_clock鈥\x9d:鈥\x9c::鈥濆乏渚х殑绗﹀彿蹇呴』鏄\xaf涓\x80绉嶇被鍨\x8b [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1123,52): error C2039: "now": 涓嶆槸 "std::chrono" 鐨勬垚鍛\x98 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\operators\kvcache\kvcache_utils.cpp(1123,52): error C3861: 鈥渘ow鈥\x9d: 鎵句笉鍒版爣璇嗙\xac\xa6 [C:\Code\Python\ktransformers\ktransformers\ktransformers_ext\build\cpuinfer_ext.vcxproj] 236 涓\xaa璀﹀憡 251 涓\xaa閿欒\xaf\xaf 宸茬敤鏃堕棿 00:02:03.82 CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=C:\\Code\\Python\\ktransformers\\build\\lib.win-amd64-cpython-311\\', '-DPYTHON_EXECUTABLE=C:\\Program Files\\Python311\\python.exe', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.1.post1+cu124torch24avx2', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY_RELEASE=C:\\Code\\Python\\ktransformers\\build\\lib.win-amd64-cpython-311'] Standard output: b'-- Building for: Visual Studio 17 2022\n-- Selecting Windows SDK version 10.0.22000.0 to target Windows 10.0.22631.\n-- The C compiler identification is MSVC 19.43.34808.0\n-- The CXX compiler identification is MSVC 19.43.34808.0\n-- Detecting C compiler ABI info\n-- Detecting C compiler ABI info - done\n-- Check for working C compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.43.34808/bin/Hostx64/x64/cl.exe - skipped\n-- Detecting C compile features\n-- Detecting C compile features - done\n-- Detecting CXX compiler ABI info\n-- Detecting CXX compiler ABI info - done\n-- Check for working CXX compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.43.34808/bin/Hostx64/x64/cl.exe - skipped\n-- Detecting CXX compile features\n-- Detecting CXX compile features - done\n-- CMAKE_SYSTEM_PROCESSOR: AMD64\n-- CMAKE_GENERATOR_PLATFORM: \n-- x86 detected\n-- Performing Test HAS_AVX_1\n-- Performing Test HAS_AVX_1 - Success\n-- Performing Test HAS_AVX2_1\n-- Performing Test HAS_AVX2_1 - Success\n-- Performing Test HAS_FMA_1\n-- Performing Test HAS_FMA_1 - Success\n-- Performing Test HAS_AVX512_1\n-- Performing Test HAS_AVX512_1 - Failed\n-- Performing Test HAS_AVX512_2\n-- Performing Test HAS_AVX512_2 - Failed\n-- pybind11 v2.14.0 dev1\n-- Found PythonInterp: C:/Program Files/Python311/python.exe (found suitable version "3.11.2", minimum required is "3.7") \n-- Found PythonLibs: C:/Program Files/Python311/libs/python311.lib\n-- Performing Test HAS_MSVC_GL_LTCG\n-- Performing Test HAS_MSVC_GL_LTCG - Failed\n-- Found Git: C:/Program Files/Git/cmd/git.exe (found version "2.47.1.windows.1") \n-- Performing Test CMAKE_HAVE_LIBC_PTHREAD\n-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed\n-- Looking for pthread_create in pthreads\n-- Looking for pthread_create in pthreads - not found\n-- Looking for pthread_create in pthread\n-- Looking for pthread_create in pthread - not found\n-- Found Threads: TRUE \n-- Found OpenMP_C: -openmp (found version "2.0") \n-- Found OpenMP_CXX: -openmp (found version "2.0") \n-- Found OpenMP: TRUE (found version "2.0") \n-- OpenMP found\n-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with LLAMA_CCACHE=OFF\n-- CMAKE_SYSTEM_PROCESSOR: AMD64\n-- CMAKE_GENERATOR_PLATFORM: \n-- x86 detected\n-- ALL_SOURCES: C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/ext_bindings.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/cpu_backend/backend.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/cpu_backend/task_queue.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/llamafile/linear.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/llamafile/mlp.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/llamafile/moe.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/llamafile/shared_mem_buffer.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/flags.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/iqk_mul_mat_amd_avx2.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/iqk_mul_mat_amd_zen4.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/iqk_mul_mat_arm82.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/sgemm.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avx.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avx2.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avx512f.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_avxvnni.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_fma.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_amd_zen4.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_arm80.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_mixmul_arm82.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avx.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avx2.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avx512f.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_avxvnni.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_fma.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_amd_zen4.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_arm80.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_sgemm_arm82.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/../../third_party/llamafile/tinyblas_cpu_unsupported.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/kvcache/kvcache_attn.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/kvcache/kvcache_load_dump.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/kvcache/kvcache_read_write.cpp;C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/operators/kvcache/kvcache_utils.cpp\n-- NUMA support is disabled\n-- NUMA library not found or user not set USE_NUMA - disabling NUMA support\n-- Configuring done (12.1s)\n-- Generating done (0.1s)\n-- Build files have been written to: C:/Code/Python/ktransformers/ktransformers/ktransformers_ext/build\n' Standard error: b'CMake Warning:\n Manually-specified variables were not used by the project:\n\n EXAMPLE_VERSION_INFO\n\n\n' Traceback (most recent call last): File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\fancy_getopt.py", line 247, in getopt opts, args = getopt.getopt(args, short_opts, self.long_opts) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\getopt.py", line 93, in getopt opts, args = do_longs(opts, args[0][2:], longopts, args[1:]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\getopt.py", line 157, in do_longs has_arg, opt = long_has_args(opt, longopts) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\getopt.py", line 174, in long_has_args raise GetoptError(_('option --%s not recognized') % opt, opt) getopt.GetoptError: option --dist-info-dir not recognized During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\core.py", line 173, in setup ok = dist.parse_command_line() ^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 483, in parse_command_line args = self._parse_command_opts(parser, args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\dist.py", line 900, in _parse_command_opts nargs = _Distribution._parse_command_opts(self, parser, args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 587, in _parse_command_opts (args, opts) = parser.getopt(args[1:]) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\fancy_getopt.py", line 249, in getopt raise DistutilsArgError(msg) distutils.errors.DistutilsArgError: option --dist-info-dir not recognized During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 438, in build_wheel return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 426, in _build return self._build_with_temp_dir( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 407, in _build_with_temp_dir self.run_setup() File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 320, in run_setup exec(code, locals()) File "<string>", line 372, in <module> File "C:\Program Files\Python311\Lib\site-packages\setuptools\__init__.py", line 117, in setup return distutils.core.setup(**attrs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\core.py", line 175, in setup raise SystemExit(gen_usage(dist.script_name) + f"\nerror: {msg}") SystemExit: usage: _in_process.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...] or: _in_process.py --help [cmd1 cmd2 ...] or: _in_process.py --help-commands or: _in_process.py cmd --help error: option --dist-info-dir not recognized During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\zhizi42\AppData\Roaming\Python\Python311\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 389, in <module> main() File "C:\Users\zhizi42\AppData\Roaming\Python\Python311\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 373, in main json_out["return_val"] = hook(**hook_input["kwargs"]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\zhizi42\AppData\Roaming\Python\Python311\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 280, in build_wheel return _build_backend().build_wheel( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 444, in build_wheel return _build(['bdist_wheel']) ^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 426, in _build return self._build_with_temp_dir( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 407, in _build_with_temp_dir self.run_setup() File "C:\Program Files\Python311\Lib\site-packages\setuptools\build_meta.py", line 320, in run_setup exec(code, locals()) File "<string>", line 372, in <module> File "C:\Program Files\Python311\Lib\site-packages\setuptools\__init__.py", line 117, in setup return distutils.core.setup(**attrs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\core.py", line 186, in setup return run_commands(dist) ^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\core.py", line 202, in run_commands dist.run_commands() File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 983, in run_commands self.run_command(cmd) File "C:\Program Files\Python311\Lib\site-packages\setuptools\dist.py", line 999, in run_command super().run_command(command) File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 1002, in run_command cmd_obj.run() File "<string>", line 177, in run File "C:\Program Files\Python311\Lib\site-packages\wheel\bdist_wheel.py", line 325, in run self.run_command("build") File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\cmd.py", line 339, in run_command self.distribution.run_command(command) File "C:\Program Files\Python311\Lib\site-packages\setuptools\dist.py", line 999, in run_command super().run_command(command) File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 1002, in run_command cmd_obj.run() File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\command\build.py", line 136, in run self.run_command(cmd_name) File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\cmd.py", line 339, in run_command self.distribution.run_command(command) File "C:\Program Files\Python311\Lib\site-packages\setuptools\dist.py", line 999, in run_command super().run_command(command) File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\dist.py", line 1002, in run_command cmd_obj.run() File "C:\Program Files\Python311\Lib\site-packages\setuptools\command\build_ext.py", line 99, in run _build_ext.run(self) File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\command\build_ext.py", line 365, in run self.build_extensions() File "C:\Users\zhizi42\AppData\Roaming\Python\Python311\site-packages\torch\utils\cpp_extension.py", line 866, in build_extensions build_ext.build_extensions(self) File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\command\build_ext.py", line 481, in build_extensions self._build_extensions_serial() File "C:\Program Files\Python311\Lib\site-packages\setuptools\_distutils\command\build_ext.py", line 507, in _build_extensions_serial self.build_extension(ext) File "<string>", line 327, in build_extension File "C:\Program Files\Python311\Lib\subprocess.py", line 571, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--verbose', '--config', 'Release', '--parallel=24']' returned non-zero exit status 1. [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for ktransformers Failed to build ktransformers ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers) Installation completed successfully``` 另开了个纯净Windows配环境后也是报错(不过好像不太一样) 环境是Windows11,cuda12.4,python3.11.2,pytorch2.4.1+cu124,gcc9.2.0。 希望有巨佬能给出解决方法,先谢谢大家了。另外希望作者官方支持老显卡(
bsakaguchi 2026-10-29 14:39:45 +00:00
  • closed this issue
  • added the
    stale
    label
Author
Owner

@LemonFan-maker commented on GitHub (Feb 22, 2025):

试过WSL2了没有?别用windows环境跑,用wsl2的22.04跑一下试试?

<!-- gh-comment-id:2676296230 --> @LemonFan-maker commented on GitHub (Feb 22, 2025): 试过WSL2了没有?别用windows环境跑,用wsl2的22.04跑一下试试?
Author
Owner

@ubergarm commented on GitHub (Feb 22, 2025):

@zhizi42

  1. RTX 2070 Super 仅配备 8GB 显存,而 R1 模型最低需求约为 14GB(建议至少 16GB)。对于较小模型或手动配置
    --optimize_config_path ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat.yaml
    的情况,暂不确定是否可行(但这一步骤需在成功编译安装后才有意义)。

  2. 我完全同意 @LemonFan-maker 的建议:强烈推荐尝试 WSL2 环境,并参考
    此构建指南。该指南不仅提供最新的预编译 .whl
    文件,还附有完整操作说明。


@zhizi42

  1. The RTX 2070 Super only has 8GB VRAM and at least for R1 the minimum is around 14GB though I suggest at least 16GB. I am not sure for smaller models or if you manually configure the --optimize_config_path ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat.yaml however this only matters after you get it to compile and install.
  2. I totally agree with @LemonFan-maker and suggest you try WSL2 and follow this build guide which provides the latest binary whl file as well as full instructions.
<!-- gh-comment-id:2676335710 --> @ubergarm commented on GitHub (Feb 22, 2025): @zhizi42 1. **RTX 2070 Super 仅配备 8GB 显存**,而 R1 模型最低需求约为 14GB(建议至少 16GB)。对于较小模型或手动配置 `--optimize_config_path ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat.yaml` 的情况,暂不确定是否可行(但这一步骤需在成功编译安装后才有意义)。 2. **我完全同意 @LemonFan-maker 的建议**:强烈推荐尝试 **WSL2** 环境,并参考 [此构建指南](https://github.com/ubergarm/r1-ktransformers-guide/blob/main/README.zh.md)。该指南不仅提供最新的预编译 `.whl` 文件,还附有完整操作说明。 --- @zhizi42 1. The `RTX 2070 Super` only has 8GB VRAM and at least for R1 the minimum is around 14GB though I suggest at least 16GB. I am not sure for smaller models or if you manually configure the `--optimize_config_path ktransformers/optimize/optimize_rules/DeepSeek-V3-Chat.yaml` however this only matters after you get it to compile and install. 2. I totally agree with @LemonFan-maker and suggest you try WSL2 and follow [this build guide](https://github.com/ubergarm/r1-ktransformers-guide/blob/main/README.zh.md) which provides the latest binary whl file as well as full instructions.
Author
Owner

@c00jsw00 commented on GitHub (Feb 25, 2025):

請使用WSL 在win上安裝LINUX (在安裝ktransformers)
https://bayareanotes.com/wsl-installation/

<!-- gh-comment-id:2683465690 --> @c00jsw00 commented on GitHub (Feb 25, 2025): 請使用WSL 在win上安裝LINUX (在安裝ktransformers) https://bayareanotes.com/wsl-installation/
Author
Owner

@knilink commented on GitHub (Mar 3, 2025):

chrono头文件问题,应该已经修复https://github.com/kvcache-ai/ktransformers/pull/622

<!-- gh-comment-id:2693621599 --> @knilink commented on GitHub (Mar 3, 2025): chrono头文件问题,应该已经修复https://github.com/kvcache-ai/ktransformers/pull/622
Author
Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!


此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献!

<!-- gh-comment-id:3639967943 --> @ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。 如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。 感谢您对 KTransformers 的贡献!
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#442
No description provided.