mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-11-05 01:07:28 +00:00
[GH-ISSUE #862] [Bug] unsloth transformer版本冲突 #620
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
kvcache-ai/ktransformers#620
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @justaswell on GitHub (Mar 11, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/862
检查清单
问题描述
running build_ext
CMake args: ['-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=D:\csz\ktransformers\build\lib.win-amd64-cpython-310\', '-DPYTHON_EXECUTABLE=D:\tools\aconada\envs\ds\python.exe', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.2rc1+cu124torch24avx2', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY_RELEASE=D:\csz\ktransformers\build\lib.win-amd64-cpython-310']
Traceback (most recent call last):
File "D:\tools\aconada\envs\ds\lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 389, in
main()
File "D:\tools\aconada\envs\ds\lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 373, in main
json_out["return_val"] = hook(**hook_input["kwargs"])
File "D:\tools\aconada\envs\ds\lib\site-packages\pip_vendor\pyproject_hooks_in_process_in_process.py", line 280, in build_wheel
return _build_backend().build_wheel(
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools\build_meta.py", line 438, in build_wheel
return _build(['bdist_wheel', '--dist-info-dir', str(metadata_directory)])
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools\build_meta.py", line 426, in _build
return self._build_with_temp_dir(
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools\build_meta.py", line 407, in build_with_temp_dir
self.run_setup()
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools\build_meta.py", line 320, in run_setup
exec(code, locals())
File "", line 373, in
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_init.py", line 117, in setup
return distutils.core.setup(**attrs)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\core.py", line 186, in setup
return run_commands(dist)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\core.py", line 202, in run_commands
dist.run_commands()
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\dist.py", line 983, in run_commands
self.run_command(cmd)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools\dist.py", line 999, in run_command
super().run_command(command)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\dist.py", line 1002, in run_command
cmd_obj.run()
File "", line 177, in run
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools\command\bdist_wheel.py", line 369, in run
self.run_command("build")
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools\dist.py", line 999, in run_command
super().run_command(command)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\dist.py", line 1002, in run_command
cmd_obj.run()
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\command\build.py", line 136, in run
self.run_command(cmd_name)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\cmd.py", line 339, in run_command
self.distribution.run_command(command)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools\dist.py", line 999, in run_command
super().run_command(command)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\dist.py", line 1002, in run_command
cmd_obj.run()
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools\command\build_ext.py", line 99, in run
_build_ext.run(self)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\command\build_ext.py", line 365, in run
self.build_extensions()
File "D:\tools\aconada\envs\ds\lib\site-packages\torch\utils\cpp_extension.py", line 866, in build_extensions
build_ext.build_extensions(self)
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\command\build_ext.py", line 481, in build_extensions
self._build_extensions_serial()
File "D:\tools\aconada\envs\ds\lib\site-packages\setuptools_distutils\command\build_ext.py", line 507, in _build_extensions_serial
self.build_extension(ext)
File "", line 322, in build_extension
File "D:\tools\aconada\envs\ds\lib\subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['cmake', 'D:\csz\ktransformers\ktransformers\ktransformers_ext', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY=D:\csz\ktransformers\build\lib.win-amd64-cpython-310\', '-DPYTHON_EXECUTABLE=D:\tools\aconada\envs\ds\python.exe', '-DCMAKE_BUILD_TYPE=Release', '-DKTRANSFORMERS_USE_CUDA=ON', '-DLLAMA_NATIVE=ON', '-DEXAMPLE_VERSION_INFO=0.2.2rc1+cu124torch24avx2', '-DCMAKE_LIBRARY_OUTPUT_DIRECTORY_RELEASE=D:\csz\ktransformers\build\lib.win-amd64-cpython-310']' returned non-zero exit status 1.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for ktransformers
Failed to build ktransformers
ERROR: Failed to build installable wheels for some pyproject.toml based projects (ktransformers)
Installation completed successfully
我想知道为什么transformer版本必须是4.43.0，我想要在4.49.0的版本下安装使用ktransformers，配合unsloth微调使用，我的unsloth版本是最新的，所需的transformer版本是4.49.0
复现步骤
win10+cuda12.4+torch2.4.1
运行install.bat，与unsloth所需的transformer（4.49.0）版本冲突
环境信息
transformer==4.49.0
@yeungtuzi commented on GitHub (Mar 11, 2025):
好像开发者指定的transformer就是这个版本，据说改版本动静很大
@justaswell commented on GitHub (Mar 11, 2025):
大版本没改啊，会有很大的改动吗？
那我试试先装kt然后再回退transformer版本
@yeungtuzi commented on GitHub (Mar 12, 2025):
你安装后改transformers版本也会破坏依赖，强烈建议你使用一个新的conda venv
发件人: CSZ @.>
发送时间: 2025年3月11日 17:05
收件人: kvcache-ai/ktransformers @.>
抄送: yeungtuzi @.>; Comment @.>
主题: Re: [kvcache-ai/ktransformers] [Bug] unsloth transformer版本冲突 (Issue #862)
好像开发者指定的transformer就是这个版本，据说改版本动静很大
大版本没改啊，会有很大的改动吗？
那我试试先装kt然后再回退transformer版本
―
Reply to this email directly, view it on GitHubhttps://github.com/kvcache-ai/ktransformers/issues/862#issuecomment-2713237738, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADLPPAEXU2YLNKYJFUKHM532T2RO7AVCNFSM6AAAAABYYCDUR6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMJTGIZTONZTHA.
You are receiving this because you commented.Message ID: @.***>
[justaswell]justaswell left a comment (kvcache-ai/ktransformers#862)https://github.com/kvcache-ai/ktransformers/issues/862#issuecomment-2713237738
好像开发者指定的transformer就是这个版本，据说改版本动静很大
大版本没改啊，会有很大的改动吗？
那我试试先装kt然后再回退transformer版本
―
Reply to this email directly, view it on GitHubhttps://github.com/kvcache-ai/ktransformers/issues/862#issuecomment-2713237738, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADLPPAEXU2YLNKYJFUKHM532T2RO7AVCNFSM6AAAAABYYCDUR6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDOMJTGIZTONZTHA.
You are receiving this because you commented.Message ID: @.***>