[GH-ISSUE #714] Build with MooreThreads GPU and Hygon CPU #524

Open
opened 2026-10-29 14:40:49 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @yeungtuzi on GitHub (Feb 27, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/714

$ls /usr/local/musa -ld
lrwxrwxrwx 1 root root 10 Nov 2 14:11 /usr/local/musa -> musa-3.1.0

$pip show nvidia-cuda-runtime-cu12
Name: nvidia-cuda-runtime-cu12
Version: 12.4.127
Summary: CUDA Runtime native Libraries

$export MUSA_HOME=/usr/local/musa
$ make dev_install

...

Obtaining file:///home/torch_musa/ktransformers
Running command Checking if build backend supports build_editable
Checking if build backend supports build_editable ... done
Running command Preparing editable metadata (pyproject.toml)
Warning: unsupported CPU Vendor for cpufeature.
Unsupported architecture
Traceback (most recent call last):
File "/opt/conda/envs/kt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in
main()
File "/opt/conda/envs/kt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
json_out["return_val"] = hook(**hook_input["kwargs"])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/kt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 209, in prepare_metadata_for_build_editable
return hook(metadata_directory, config_settings)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/kt/lib/python3.11/site-packages/setuptools/build_meta.py", line 488, in prepare_metadata_for_build_editable
return self.prepare_metadata_for_build_wheel(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/kt/lib/python3.11/site-packages/setuptools/build_meta.py", line 377, in prepare_metadata_for_build_wheel
self.run_setup()
File "/opt/conda/envs/kt/lib/python3.11/site-packages/setuptools/build_meta.py", line 320, in run_setup
exec(code, locals())
File "", line 371, in
ValueError: Unsupported backend: CUDA_HOME and MUSA_HOME are not set.
error: subprocess-exited-with-error

× Preparing editable metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
full command: /opt/conda/envs/kt/bin/python /opt/conda/envs/kt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_editable /tmp/tmpdwbmuzj1
cwd: /home/torch_musa/ktransformers
Preparing editable metadata (pyproject.toml) ... error
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
make: *** [Makefile:17: dev_install] Error 1

Originally created by @yeungtuzi on GitHub (Feb 27, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/714 $ls /usr/local/musa -ld lrwxrwxrwx 1 root root 10 Nov 2 14:11 /usr/local/musa -> musa-3.1.0 $pip show nvidia-cuda-runtime-cu12 Name: nvidia-cuda-runtime-cu12 Version: 12.4.127 Summary: CUDA Runtime native Libraries $export MUSA_HOME=/usr/local/musa $ make dev_install ... Obtaining file:///home/torch_musa/ktransformers Running command Checking if build backend supports build_editable Checking if build backend supports build_editable ... done Running command Preparing editable metadata (pyproject.toml) Warning: unsupported CPU Vendor for `cpufeature`. Unsupported architecture Traceback (most recent call last): File "/opt/conda/envs/kt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module> main() File "/opt/conda/envs/kt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main json_out["return_val"] = hook(**hook_input["kwargs"]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/kt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 209, in prepare_metadata_for_build_editable return hook(metadata_directory, config_settings) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/kt/lib/python3.11/site-packages/setuptools/build_meta.py", line 488, in prepare_metadata_for_build_editable return self.prepare_metadata_for_build_wheel( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/conda/envs/kt/lib/python3.11/site-packages/setuptools/build_meta.py", line 377, in prepare_metadata_for_build_wheel self.run_setup() File "/opt/conda/envs/kt/lib/python3.11/site-packages/setuptools/build_meta.py", line 320, in run_setup exec(code, locals()) File "<string>", line 371, in <module> ValueError: Unsupported backend: CUDA_HOME and MUSA_HOME are not set. error: subprocess-exited-with-error × Preparing editable metadata (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip. full command: /opt/conda/envs/kt/bin/python /opt/conda/envs/kt/lib/python3.11/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_editable /tmp/tmpdwbmuzj1 cwd: /home/torch_musa/ktransformers Preparing editable metadata (pyproject.toml) ... error error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. make: *** [Makefile:17: dev_install] Error 1
Author
Owner

@yeungtuzi commented on GitHub (Mar 14, 2025):

看起来是海光cpu不支持cpufeature,是否可以增加一个编译开关(环境变量),让用户可以指定使用avx2指令集

<!-- gh-comment-id:2722960481 --> @yeungtuzi commented on GitHub (Mar 14, 2025): 看起来是海光cpu不支持cpufeature,是否可以增加一个编译开关(环境变量),让用户可以指定使用avx2指令集
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#524
No description provided.