[GH-ISSUE #137] 希望上传最新的pypi包和docker镜像 #76

Closed
opened 2026-10-29 14:33:40 +00:00 by bsakaguchi · 6 comments
Owner

Originally created by @zhyim0712 on GitHub (Feb 11, 2025).
Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/137

本地打包镜像报错
62.95 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
62.95 Successfully installed einops-0.8.1 flash-attn-2.7.4.post1
63.37 Using pip 24.0 from /opt/conda/lib/python3.10/site-packages/pip (python 3.10)
63.42 Processing /workspace/ktransformers
63.42 Preparing metadata (pyproject.toml): started
63.42 Running command Preparing metadata (pyproject.toml)
65.20 error: subprocess-exited-with-error
65.20
65.20 × Preparing metadata (pyproject.toml) did not run successfully.
65.20 │ exit code: -8
65.20 ╰─> See above for output.
65.20
65.20 note: This error originates from a subprocess, and is likely not a problem with pip.
65.20 full command: /opt/conda/bin/python /opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_wheel /tmp/tmp401kn4_o
65.20 cwd: /workspace/ktransformers
65.20 Preparing metadata (pyproject.toml): finished with status 'error'
65.20 error: metadata-generation-failed
65.20
65.20 × Encountered error while generating package metadata.
65.20 ╰─> See above for output.
65.20
65.20 note: This is an issue with the package mentioned above, not pip.
65.20 hint: See above for details.

3 warnings found (use docker --debug to expand):

  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1)
  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13)
  • LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15)
    Dockerfile:17

16 | COPY --from=web_compile /home/ktransformers /workspace/ktransformers
17 | >>> RUN <<EOF
18 | >>> apt update -y && apt install -y --no-install-recommends
19 | >>> git
20 | >>> wget
21 | >>> vim
22 | >>> gcc
23 | >>> g++
24 | >>> cmake &&
25 | >>> rm -rf /var/lib/apt/lists/* &&
26 | >>> cd ktransformers &&
27 | >>> git submodule init &&
28 | >>> git submodule update &&
29 | >>> pip install ninja pyproject numpy cpufeature &&
30 | >>> pip install flash-attn &&
31 | >>> CPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose &&
32 | >>> pip cache purge
33 | >>> EOF
34 |

ERROR: failed to solve: process "/bin/sh -c apt update -y && apt install -y --no-install-recommends \\n git \\n wget \\n vim \\n gcc \\n g++ \\n cmake && \nrm -rf /var/lib/apt/lists/* &&\ncd ktransformers &&\ngit submodule init &&\ngit submodule update &&\npip install ninja pyproject numpy cpufeature &&\npip install flash-attn &&\nCPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose &&\npip cache purge\n" did not complete successfully: exit code: 1

Originally created by @zhyim0712 on GitHub (Feb 11, 2025). Original GitHub issue: https://github.com/kvcache-ai/ktransformers/issues/137 本地打包镜像报错 62.95 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv 62.95 Successfully installed einops-0.8.1 flash-attn-2.7.4.post1 63.37 Using pip 24.0 from /opt/conda/lib/python3.10/site-packages/pip (python 3.10) 63.42 Processing /workspace/ktransformers 63.42 Preparing metadata (pyproject.toml): started 63.42 Running command Preparing metadata (pyproject.toml) 65.20 error: subprocess-exited-with-error 65.20 65.20 × Preparing metadata (pyproject.toml) did not run successfully. 65.20 │ exit code: -8 65.20 ╰─> See above for output. 65.20 65.20 note: This error originates from a subprocess, and is likely not a problem with pip. 65.20 full command: /opt/conda/bin/python /opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_wheel /tmp/tmp401kn4_o 65.20 cwd: /workspace/ktransformers 65.20 Preparing metadata (pyproject.toml): finished with status 'error' 65.20 error: metadata-generation-failed 65.20 65.20 × Encountered error while generating package metadata. 65.20 ╰─> See above for output. 65.20 65.20 note: This is an issue with the package mentioned above, not pip. 65.20 hint: See above for details. ------ 3 warnings found (use docker --debug to expand): - FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1) - FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13) - LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15) Dockerfile:17 -------------------- 16 | COPY --from=web_compile /home/ktransformers /workspace/ktransformers 17 | >>> RUN <<EOF 18 | >>> apt update -y && apt install -y --no-install-recommends \ 19 | >>> git \ 20 | >>> wget \ 21 | >>> vim \ 22 | >>> gcc \ 23 | >>> g++ \ 24 | >>> cmake && 25 | >>> rm -rf /var/lib/apt/lists/* && 26 | >>> cd ktransformers && 27 | >>> git submodule init && 28 | >>> git submodule update && 29 | >>> pip install ninja pyproject numpy cpufeature && 30 | >>> pip install flash-attn && 31 | >>> CPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose && 32 | >>> pip cache purge 33 | >>> EOF 34 | -------------------- ERROR: failed to solve: process "/bin/sh -c apt update -y && apt install -y --no-install-recommends \\\n git \\\n wget \\\n vim \\\n gcc \\\n g++ \\\n cmake && \nrm -rf /var/lib/apt/lists/* &&\ncd ktransformers &&\ngit submodule init &&\ngit submodule update &&\npip install ninja pyproject numpy cpufeature &&\npip install flash-attn &&\nCPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST=\"8.0;8.6;8.7;8.9;9.0+PTX\" pip install . --no-build-isolation --verbose &&\npip cache purge\n" did not complete successfully: exit code: 1
bsakaguchi 2026-10-29 14:33:40 +00:00
  • closed this issue
  • added the
    stale
    label
Author
Owner

@KMSorSMS commented on GitHub (Feb 11, 2025):

能给我你的详细命令吗?隐藏掉隐私信息即可

<!-- gh-comment-id:2650350884 --> @KMSorSMS commented on GitHub (Feb 11, 2025): 能给我你的详细命令吗?隐藏掉隐私信息即可
Author
Owner

@zhyim0712 commented on GitHub (Feb 11, 2025):

我打包的命令是docker build -t ktransformers:0.2.0 . --platform linux/amd64,我的M1的Mac,我的服务器连不了外网,我打算本地打包好上传到服务器,完整的日志如下:
[+] Building 63.3s (11/11) FINISHED docker:orbstack
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 1.01kB 0.0s
=> WARN: FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1) 0.0s
=> WARN: FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13) 0.0s
=> WARN: LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15) 0.0s
=> [internal] load metadata for docker.io/pytorch/pytorch:2.3.1-cuda12.1-cudnn8-devel 0.0s
=> [internal] load metadata for docker.io/library/node:20.16.0 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [web_compile 1/3] FROM docker.io/library/node:20.16.0 0.0s
=> [compile_server 1/4] FROM docker.io/pytorch/pytorch:2.3.1-cuda12.1-cudnn8-devel 0.0s
=> CACHED [compile_server 2/4] WORKDIR /workspace 0.0s
=> CACHED [web_compile 2/3] WORKDIR /home 0.0s
=> CACHED [web_compile 3/3] RUN <<EOF (git clone https://github.com/kvcache-ai/ktransformers.git &&...) 0.0s
=> CACHED [compile_server 3/4] COPY --from=web_compile /home/ktransformers /workspace/ktransformers 0.0s
=> ERROR [compile_server 4/4] RUN <<EOF (apt update -y && apt install -y --no-install-recommends ...) 63.2s

[compile_server 4/4] RUN <<EOF (apt update -y && apt install -y --no-install-recommends ...):
0.182
0.182 WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
0.183
0.558 Get:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 InRelease [1581 B]
0.898 Get:2 http://archive.ubuntu.com/ubuntu jammy InRelease [270 kB]
0.898 Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB]
1.126 Get:4 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 Packages [1311 kB]
1.995 Get:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB]
2.298 Get:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB]
2.513 Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [3606 kB]
3.228 Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 Packages [1792 kB]
3.756 Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2606 kB]
3.863 Get:10 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [45.2 kB]
3.867 Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1230 kB]
4.072 Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 Packages [17.5 MB]
5.056 Get:13 http://archive.ubuntu.com/ubuntu jammy/multiverse amd64 Packages [266 kB]
5.064 Get:14 http://archive.ubuntu.com/ubuntu jammy/restricted amd64 Packages [164 kB]
5.294 Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2911 kB]
5.383 Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1526 kB]
5.496 Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [53.3 kB]
5.505 Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [3748 kB]
6.009 Get:19 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [81.4 kB]
6.252 Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [35.2 kB]
6.745 Fetched 37.5 MB in 6s (5816 kB/s)
6.745 Reading package lists...
7.587 Building dependency tree...
7.742 Reading state information...
7.756 64 packages can be upgraded. Run 'apt list --upgradable' to see them.
7.782
7.783 WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
7.783
7.877 Reading package lists...
8.614 Building dependency tree...
8.800 Reading state information...
9.013 g++ is already the newest version (4:11.2.0-1ubuntu1).
9.013 g++ set to manually installed.
9.013 gcc is already the newest version (4:11.2.0-1ubuntu1).
9.013 gcc set to manually installed.
9.013 The following additional packages will be installed:
9.013 cmake-data dh-elpa-helper emacsen-common git-man libarchive13 libbrotli1
9.013 libcurl3-gnutls libcurl4 liberror-perl libexpat1 libgpm2 libicu70
9.013 libjsoncpp25 libmpdec3 libnghttp2-14 libpsl5 libpython3.10
9.013 libpython3.10-minimal libpython3.10-stdlib librhash0 librtmp1 libsodium23
9.013 libssh-4 libuv1 libxml2 media-types vim-common vim-runtime xxd
9.014 Suggested packages:
9.014 cmake-doc ninja-build cmake-format gettext-base git-daemon-run
9.014 | git-daemon-sysvinit git-doc git-email git-gui gitk gitweb git-cvs
9.015 git-mediawiki git-svn lrzip gpm ctags vim-doc vim-scripts
9.015 Recommended packages:
9.015 less ssh-client publicsuffix
9.118 The following NEW packages will be installed:
9.119 cmake cmake-data dh-elpa-helper emacsen-common git git-man libarchive13
9.119 libbrotli1 libcurl3-gnutls libcurl4 liberror-perl libexpat1 libgpm2 libicu70
9.119 libjsoncpp25 libmpdec3 libnghttp2-14 libpsl5 libpython3.10
9.119 libpython3.10-minimal libpython3.10-stdlib librhash0 librtmp1 libsodium23
9.120 libssh-4 libuv1 libxml2 media-types vim vim-common vim-runtime wget xxd
9.667 0 upgraded, 33 newly installed, 0 to remove and 64 not upgraded.
9.667 Need to get 38.4 MB of archives.
9.667 After this operation, 155 MB of additional disk space will be used.
9.667 Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libexpat1 amd64 2.4.7-1ubuntu0.5 [91.5 kB]
10.46 Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu70 amd64 70.1-2 [10.6 MB]
11.93 Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmpdec3 amd64 2.5.1-2build2 [86.8 kB]
11.94 Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-minimal amd64 3.10.12-122.04.8 [815 kB]
11.96 Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 media-types all 7.0.0 [25.5 kB]
11.96 Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-stdlib amd64 3.10.12-1
22.04.8 [1850 kB]
12.05 Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxml2 amd64 2.9.13+dfsg-1ubuntu0.5 [763 kB]
12.09 Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 xxd amd64 2:8.2.3995-1ubuntu2.23 [51.7 kB]
12.10 Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim-common all 2:8.2.3995-1ubuntu2.23 [81.5 kB]
12.10 Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnghttp2-14 amd64 1.43.0-1ubuntu0.2 [76.9 kB]
12.10 Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libpsl5 amd64 0.21.0-1.2build2 [58.4 kB]
12.17 Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuv1 amd64 1.43.0-1ubuntu0.1 [92.7 kB]
12.18 Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wget amd64 1.21.2-2ubuntu1.1 [339 kB]
12.20 Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libarchive13 amd64 3.6.0-1ubuntu1.3 [369 kB]
12.21 Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbrotli1 amd64 1.0.9-2build6 [315 kB]
12.28 Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d.1-2build4 [58.2 kB]
12.35 Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssh-4 amd64 0.9.6-2ubuntu0.22.04.3 [186 kB]
12.35 Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl4 amd64 7.81.0-1ubuntu1.20 [289 kB]
12.36 Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjsoncpp25 amd64 1.9.5-3 [80.0 kB]
12.36 Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 librhash0 amd64 1.4.2-1ubuntu1 [125 kB]
12.36 Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 dh-elpa-helper all 2.0.9ubuntu1 [7610 B]
12.41 Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 emacsen-common all 3.0.4 [14.9 kB]
12.43 Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 cmake-data all 3.22.1-1ubuntu1.22.04.2 [1913 kB]
12.48 Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 cmake amd64 3.22.1-1ubuntu1.22.04.2 [5010 kB]
12.88 Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl3-gnutls amd64 7.81.0-1ubuntu1.20 [284 kB]
12.88 Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liberror-perl all 0.17029-1 [26.5 kB]
12.89 Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git-man all 1:2.34.1-1ubuntu1.12 [955 kB]
12.91 Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git amd64 1:2.34.1-1ubuntu1.12 [3165 kB]
13.08 Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgpm2 amd64 1.20.7-10build1 [15.3 kB]
13.08 Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10 amd64 3.10.12-122.04.8 [1949 kB]
13.33 Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsodium23 amd64 1.0.18-1build2 [164 kB]
13.33 Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim-runtime all 2:8.2.3995-1ubuntu2.23 [6833 kB]
13.70 Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim amd64 2:8.2.3995-1ubuntu2.23 [1732 kB]
14.05 debconf: delaying package configuration, since apt-utils is not installed
14.10 Fetched 38.4 MB in 5s (8264 kB/s)
14.21 Selecting previously unselected package libexpat1:amd64.
(Reading database ... 14428 files and directories currently installed.)
14.23 Preparing to unpack .../00-libexpat1_2.4.7-1ubuntu0.5_amd64.deb ...
14.27 Unpacking libexpat1:amd64 (2.4.7-1ubuntu0.5) ...
14.39 Selecting previously unselected package libicu70:amd64.
14.39 Preparing to unpack .../01-libicu70_70.1-2_amd64.deb ...
14.39 Unpacking libicu70:amd64 (70.1-2) ...
14.63 Selecting previously unselected package libmpdec3:amd64.
14.64 Preparing to unpack .../02-libmpdec3_2.5.1-2build2_amd64.deb ...
14.64 Unpacking libmpdec3:amd64 (2.5.1-2build2) ...
14.74 Selecting previously unselected package libpython3.10-minimal:amd64.
14.74 Preparing to unpack .../03-libpython3.10-minimal_3.10.12-1
22.04.8_amd64.deb ...
14.75 Unpacking libpython3.10-minimal:amd64 (3.10.12-122.04.8) ...
14.89 Selecting previously unselected package media-types.
14.90 Preparing to unpack .../04-media-types_7.0.0_all.deb ...
14.90 Unpacking media-types (7.0.0) ...
15.01 Selecting previously unselected package libpython3.10-stdlib:amd64.
15.01 Preparing to unpack .../05-libpython3.10-stdlib_3.10.12-1
22.04.8_amd64.deb ...
15.01 Unpacking libpython3.10-stdlib:amd64 (3.10.12-122.04.8) ...
15.17 Selecting previously unselected package libxml2:amd64.
15.17 Preparing to unpack .../06-libxml2_2.9.13+dfsg-1ubuntu0.5_amd64.deb ...
15.18 Unpacking libxml2:amd64 (2.9.13+dfsg-1ubuntu0.5) ...
15.29 Selecting previously unselected package xxd.
15.29 Preparing to unpack .../07-xxd_2%3a8.2.3995-1ubuntu2.23_amd64.deb ...
15.29 Unpacking xxd (2:8.2.3995-1ubuntu2.23) ...
15.41 Selecting previously unselected package vim-common.
15.41 Preparing to unpack .../08-vim-common_2%3a8.2.3995-1ubuntu2.23_all.deb ...
15.47 Unpacking vim-common (2:8.2.3995-1ubuntu2.23) ...
15.59 Selecting previously unselected package libnghttp2-14:amd64.
15.59 Preparing to unpack .../09-libnghttp2-14_1.43.0-1ubuntu0.2_amd64.deb ...
15.59 Unpacking libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ...
15.70 Selecting previously unselected package libpsl5:amd64.
15.70 Preparing to unpack .../10-libpsl5_0.21.0-1.2build2_amd64.deb ...
15.70 Unpacking libpsl5:amd64 (0.21.0-1.2build2) ...
15.81 Selecting previously unselected package libuv1:amd64.
15.81 Preparing to unpack .../11-libuv1_1.43.0-1ubuntu0.1_amd64.deb ...
15.81 Unpacking libuv1:amd64 (1.43.0-1ubuntu0.1) ...
15.92 Selecting previously unselected package wget.
15.92 Preparing to unpack .../12-wget_1.21.2-2ubuntu1.1_amd64.deb ...
15.93 Unpacking wget (1.21.2-2ubuntu1.1) ...
16.04 Selecting previously unselected package libarchive13:amd64.
16.04 Preparing to unpack .../13-libarchive13_3.6.0-1ubuntu1.3_amd64.deb ...
16.04 Unpacking libarchive13:amd64 (3.6.0-1ubuntu1.3) ...
16.16 Selecting previously unselected package libbrotli1:amd64.
16.16 Preparing to unpack .../14-libbrotli1_1.0.9-2build6_amd64.deb ...
16.16 Unpacking libbrotli1:amd64 (1.0.9-2build6) ...
16.28 Selecting previously unselected package librtmp1:amd64.
16.28 Preparing to unpack .../15-librtmp1_2.4+20151223.gitfa8646d.1-2build4_amd64.deb ...
16.28 Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ...
16.39 Selecting previously unselected package libssh-4:amd64.
16.39 Preparing to unpack .../16-libssh-4_0.9.6-2ubuntu0.22.04.3_amd64.deb ...
16.39 Unpacking libssh-4:amd64 (0.9.6-2ubuntu0.22.04.3) ...
16.51 Selecting previously unselected package libcurl4:amd64.
16.51 Preparing to unpack .../17-libcurl4_7.81.0-1ubuntu1.20_amd64.deb ...
16.51 Unpacking libcurl4:amd64 (7.81.0-1ubuntu1.20) ...
16.62 Selecting previously unselected package libjsoncpp25:amd64.
16.62 Preparing to unpack .../18-libjsoncpp25_1.9.5-3_amd64.deb ...
16.62 Unpacking libjsoncpp25:amd64 (1.9.5-3) ...
16.73 Selecting previously unselected package librhash0:amd64.
16.73 Preparing to unpack .../19-librhash0_1.4.2-1ubuntu1_amd64.deb ...
16.73 Unpacking librhash0:amd64 (1.4.2-1ubuntu1) ...
16.84 Selecting previously unselected package dh-elpa-helper.
16.84 Preparing to unpack .../20-dh-elpa-helper_2.0.9ubuntu1_all.deb ...
16.84 Unpacking dh-elpa-helper (2.0.9ubuntu1) ...
16.95 Selecting previously unselected package emacsen-common.
16.95 Preparing to unpack .../21-emacsen-common_3.0.4_all.deb ...
17.06 Unpacking emacsen-common (3.0.4) ...
17.18 Selecting previously unselected package cmake-data.
17.18 Preparing to unpack .../22-cmake-data_3.22.1-1ubuntu1.22.04.2_all.deb ...
17.24 Unpacking cmake-data (3.22.1-1ubuntu1.22.04.2) ...
17.49 Selecting previously unselected package cmake.
17.49 Preparing to unpack .../23-cmake_3.22.1-1ubuntu1.22.04.2_amd64.deb ...
17.50 Unpacking cmake (3.22.1-1ubuntu1.22.04.2) ...
17.70 Selecting previously unselected package libcurl3-gnutls:amd64.
17.70 Preparing to unpack .../24-libcurl3-gnutls_7.81.0-1ubuntu1.20_amd64.deb ...
17.70 Unpacking libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.20) ...
17.81 Selecting previously unselected package liberror-perl.
17.81 Preparing to unpack .../25-liberror-perl_0.17029-1_all.deb ...
17.81 Unpacking liberror-perl (0.17029-1) ...
17.92 Selecting previously unselected package git-man.
17.92 Preparing to unpack .../26-git-man_1%3a2.34.1-1ubuntu1.12_all.deb ...
17.92 Unpacking git-man (1:2.34.1-1ubuntu1.12) ...
18.04 Selecting previously unselected package git.
18.04 Preparing to unpack .../27-git_1%3a2.34.1-1ubuntu1.12_amd64.deb ...
18.11 Unpacking git (1:2.34.1-1ubuntu1.12) ...
18.27 Selecting previously unselected package libgpm2:amd64.
18.27 Preparing to unpack .../28-libgpm2_1.20.7-10build1_amd64.deb ...
18.28 Unpacking libgpm2:amd64 (1.20.7-10build1) ...
18.38 Selecting previously unselected package libpython3.10:amd64.
18.38 Preparing to unpack .../29-libpython3.10_3.10.12-1
22.04.8_amd64.deb ...
18.38 Unpacking libpython3.10:amd64 (3.10.12-122.04.8) ...
18.52 Selecting previously unselected package libsodium23:amd64.
18.52 Preparing to unpack .../30-libsodium23_1.0.18-1build2_amd64.deb ...
18.52 Unpacking libsodium23:amd64 (1.0.18-1build2) ...
18.63 Selecting previously unselected package vim-runtime.
18.63 Preparing to unpack .../31-vim-runtime_2%3a8.2.3995-1ubuntu2.23_all.deb ...
18.69 Adding 'diversion of /usr/share/vim/vim82/doc/help.txt to /usr/share/vim/vim82/doc/help.txt.vim-tiny by vim-runtime'
18.71 Adding 'diversion of /usr/share/vim/vim82/doc/tags to /usr/share/vim/vim82/doc/tags.vim-tiny by vim-runtime'
18.72 Unpacking vim-runtime (2:8.2.3995-1ubuntu2.23) ...
19.04 Selecting previously unselected package vim.
19.04 Preparing to unpack .../32-vim_2%3a8.2.3995-1ubuntu2.23_amd64.deb ...
19.11 Unpacking vim (2:8.2.3995-1ubuntu2.23) ...
19.21 Setting up libexpat1:amd64 (2.4.7-1ubuntu0.5) ...
19.23 Setting up media-types (7.0.0) ...
19.25 Setting up libpsl5:amd64 (0.21.0-1.2build2) ...
19.26 Setting up libsodium23:amd64 (1.0.18-1build2) ...
19.26 Setting up libgpm2:amd64 (1.20.7-10build1) ...
19.27 Setting up wget (1.21.2-2ubuntu1.1) ...
19.28 Setting up libbrotli1:amd64 (1.0.9-2build6) ...
19.28 Setting up libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ...
19.29 Setting up xxd (2:8.2.3995-1ubuntu2.23) ...
19.29 Setting up liberror-perl (0.17029-1) ...
19.30 Setting up libuv1:amd64 (1.43.0-1ubuntu0.1) ...
19.30 Setting up vim-common (2:8.2.3995-1ubuntu2.23) ...
19.37 Setting up emacsen-common (3.0.4) ...
19.63 Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ...
19.64 Setting up dh-elpa-helper (2.0.9ubuntu1) ...
19.65 Setting up libpython3.10-minimal:amd64 (3.10.12-1
22.04.8) ...
19.67 Setting up libjsoncpp25:amd64 (1.9.5-3) ...
19.68 Setting up libssh-4:amd64 (0.9.6-2ubuntu0.22.04.3) ...
19.69 Setting up librhash0:amd64 (1.4.2-1ubuntu1) ...
19.69 Setting up libmpdec3:amd64 (2.5.1-2build2) ...
19.70 Setting up libcurl4:amd64 (7.81.0-1ubuntu1.20) ...
19.70 Setting up git-man (1:2.34.1-1ubuntu1.12) ...
19.71 Setting up cmake-data (3.22.1-1ubuntu1.22.04.2) ...
19.95 Setting up vim-runtime (2:8.2.3995-1ubuntu2.23) ...
20.54 Setting up libicu70:amd64 (70.1-2) ...
20.55 Setting up libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.20) ...
20.56 Setting up libpython3.10-stdlib:amd64 (3.10.12-122.04.8) ...
20.57 Setting up git (1:2.34.1-1ubuntu1.12) ...
20.63 Setting up libxml2:amd64 (2.9.13+dfsg-1ubuntu0.5) ...
20.64 Setting up libpython3.10:amd64 (3.10.12-1
22.04.8) ...
20.65 Setting up vim (2:8.2.3995-1ubuntu2.23) ...
20.68 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vim (vim) in auto mode
20.70 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vimdiff (vimdiff) in auto mode
20.72 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/rvim (rvim) in auto mode
20.74 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/rview (rview) in auto mode
20.76 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vi (vi) in auto mode
20.76 update-alternatives: warning: skip creation of /usr/share/man/da/man1/vi.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/de/man1/vi.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/vi.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/it/man1/vi.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/vi.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/vi.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/vi.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/man1/vi.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group vi) doesn't exist
20.78 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/view (view) in auto mode
20.78 update-alternatives: warning: skip creation of /usr/share/man/da/man1/view.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/de/man1/view.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/view.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/it/man1/view.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/view.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/view.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/view.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/man1/view.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group view) doesn't exist
20.80 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/ex (ex) in auto mode
20.80 update-alternatives: warning: skip creation of /usr/share/man/da/man1/ex.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/de/man1/ex.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/ex.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/it/man1/ex.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/ex.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/ex.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/ex.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/man1/ex.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group ex) doesn't exist
20.82 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/editor (editor) in auto mode
20.82 update-alternatives: warning: skip creation of /usr/share/man/da/man1/editor.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/de/man1/editor.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/editor.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/it/man1/editor.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/editor.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/editor.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/editor.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/man1/editor.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group editor) doesn't exist
20.87 Setting up libarchive13:amd64 (3.6.0-1ubuntu1.3) ...
20.88 Setting up cmake (3.22.1-1ubuntu1.22.04.2) ...
20.89 Processing triggers for libc-bin (2.35-0ubuntu3.4) ...
21.39 Submodule 'third_party/llama.cpp' (https://github.com/ggerganov/llama.cpp.git) registered for path 'third_party/llama.cpp'
21.39 Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11'
21.75 Cloning into '/workspace/ktransformers/third_party/llama.cpp'...
35.59 Cloning into '/workspace/ktransformers/third_party/pybind11'...
39.25 Submodule path 'third_party/llama.cpp': checked out 'a94e6ff8774b7c9f950d9545baf0ce35e8d1ed2f'
39.46 Submodule path 'third_party/pybind11': checked out 'bb05e0810b87e74709d9f4c4545f1f57a1b386f5'
40.10 Collecting ninja
40.25 Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (5.3 kB)
40.58 Collecting pyproject
40.63 Downloading pyproject-1.3.1.tar.gz (7.9 kB)
40.66 Preparing metadata (setup.py): started
40.91 Preparing metadata (setup.py): finished with status 'done'
40.91 Requirement already satisfied: numpy in /opt/conda/lib/python3.10/site-packages (1.26.4)
40.98 Collecting cpufeature
41.03 Downloading cpufeature-0.2.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.4 kB)
41.04 Requirement already satisfied: Jinja2 in /opt/conda/lib/python3.10/site-packages (from pyproject) (3.1.4)
41.04 Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from Jinja2->pyproject) (2.1.3)
41.09 Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (422 kB)
41.27 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 422.9/422.9 kB 2.7 MB/s eta 0:00:00
41.32 Downloading cpufeature-0.2.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
41.36 Building wheels for collected packages: pyproject
41.36 Building wheel for pyproject (setup.py): started
41.66 Building wheel for pyproject (setup.py): finished with status 'done'
41.66 Created wheel for pyproject: filename=pyproject-1.3.1-py3-none-any.whl size=10995 sha256=0f31e87acb4ae8e740c221a2d7ab37a8cba3e3819b4225f4a8106b3efd1ba78a
41.66 Stored in directory: /root/.cache/pip/wheels/cb/2b/08/d805f476ee6c6e5cbfdca7ef80ab540d7eb75471e3b2c9065b
41.66 Successfully built pyproject
42.00 Installing collected packages: cpufeature, ninja, pyproject
42.06 Successfully installed cpufeature-0.2.1 ninja-1.11.1.3 pyproject-1.3.1
42.06 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
42.93 Collecting flash-attn
43.09 Downloading flash_attn-2.7.4.post1.tar.gz (6.0 MB)
43.49 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.0/6.0 MB 16.7 MB/s eta 0:00:00
44.48 Preparing metadata (setup.py): started
47.69 Preparing metadata (setup.py): finished with status 'done'
47.70 Requirement already satisfied: torch in /opt/conda/lib/python3.10/site-packages (from flash-attn) (2.3.1)
47.77 Collecting einops (from flash-attn)
47.82 Downloading einops-0.8.1-py3-none-any.whl.metadata (13 kB)
47.84 Requirement already satisfied: filelock in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.13.1)
47.84 Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (4.11.0)
47.84 Requirement already satisfied: sympy in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (1.12.1)
47.84 Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.2.1)
47.84 Requirement already satisfied: jinja2 in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.1.4)
47.84 Requirement already satisfied: fsspec in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (2024.6.0)
47.91 Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from jinja2->torch->flash-attn) (2.1.3)
47.93 Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy->torch->flash-attn) (1.3.0)
47.98 Downloading einops-0.8.1-py3-none-any.whl (64 kB)
47.99 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.4/64.4 kB 5.2 MB/s eta 0:00:00
48.00 Building wheels for collected packages: flash-attn
48.00 Building wheel for flash-attn (setup.py): started
56.33 Building wheel for flash-attn (setup.py): finished with status 'done'
56.84 Created wheel for flash-attn: filename=flash_attn-2.7.4.post1-cp310-cp310-linux_x86_64.whl size=187765791 sha256=b0caacfaca0dcb2684ef7f11a362afa695e69ace6cbb1feea69a097de7a46f58
56.85 Stored in directory: /root/.cache/pip/wheels/59/ce/d5/08ea07bfc16ba218dc65a3a7ef9b6a270530bcbd2cea2ee1ca
56.85 Successfully built flash-attn
57.11 Installing collected packages: einops, flash-attn
60.49 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
60.49 Successfully installed einops-0.8.1 flash-attn-2.7.4.post1
60.97 Using pip 24.0 from /opt/conda/lib/python3.10/site-packages/pip (python 3.10)
61.02 Processing /workspace/ktransformers
61.02 Preparing metadata (pyproject.toml): started
61.02 Running command Preparing metadata (pyproject.toml)
62.76 error: subprocess-exited-with-error
62.76
62.76 × Preparing metadata (pyproject.toml) did not run successfully.
62.76 │ exit code: -8
62.76 ╰─> See above for output.
62.76
62.76 note: This error originates from a subprocess, and is likely not a problem with pip.
62.76 full command: /opt/conda/bin/python /opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_wheel /tmp/tmpobqgwukl
62.76 cwd: /workspace/ktransformers
62.76 Preparing metadata (pyproject.toml): finished with status 'error'
62.76 error: metadata-generation-failed
62.76
62.76 × Encountered error while generating package metadata.
62.76 ╰─> See above for output.
62.76
62.76 note: This is an issue with the package mentioned above, not pip.
62.76 hint: See above for details.


3 warnings found (use docker --debug to expand):

  • LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15)
  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1)
  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13)
    Dockerfile:17

16 | COPY --from=web_compile /home/ktransformers /workspace/ktransformers
17 | >>> RUN <<EOF
18 | >>> apt update -y && apt install -y --no-install-recommends
19 | >>> git
20 | >>> wget
21 | >>> vim
22 | >>> gcc
23 | >>> g++
24 | >>> cmake &&
25 | >>> rm -rf /var/lib/apt/lists/* &&
26 | >>> cd ktransformers &&
27 | >>> git submodule init &&
28 | >>> git submodule update &&
29 | >>> pip install ninja pyproject numpy cpufeature &&
30 | >>> pip install flash-attn &&
31 | >>> CPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose &&
32 | >>> pip cache purge
33 | >>> EOF
34 |

ERROR: failed to solve: process "/bin/sh -c apt update -y && apt install -y --no-install-recommends \\n git \\n wget \\n vim \\n gcc \\n g++ \\n cmake && \nrm -rf /var/lib/apt/lists/* &&\ncd ktransformers &&\ngit submodule init &&\ngit submodule update &&\npip install ninja pyproject numpy cpufeature &&\npip install flash-attn &&\nCPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose &&\npip cache purge\n" did not complete successfully: exit code: 1

<!-- gh-comment-id:2650358377 --> @zhyim0712 commented on GitHub (Feb 11, 2025): 我打包的命令是docker build -t ktransformers:0.2.0 . --platform linux/amd64,我的M1的Mac,我的服务器连不了外网,我打算本地打包好上传到服务器,完整的日志如下: [+] Building 63.3s (11/11) FINISHED docker:orbstack => [internal] load build definition from Dockerfile 0.0s => => transferring dockerfile: 1.01kB 0.0s => WARN: FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1) 0.0s => WARN: FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13) 0.0s => WARN: LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15) 0.0s => [internal] load metadata for docker.io/pytorch/pytorch:2.3.1-cuda12.1-cudnn8-devel 0.0s => [internal] load metadata for docker.io/library/node:20.16.0 0.0s => [internal] load .dockerignore 0.0s => => transferring context: 2B 0.0s => [web_compile 1/3] FROM docker.io/library/node:20.16.0 0.0s => [compile_server 1/4] FROM docker.io/pytorch/pytorch:2.3.1-cuda12.1-cudnn8-devel 0.0s => CACHED [compile_server 2/4] WORKDIR /workspace 0.0s => CACHED [web_compile 2/3] WORKDIR /home 0.0s => CACHED [web_compile 3/3] RUN <<EOF (git clone https://github.com/kvcache-ai/ktransformers.git &&...) 0.0s => CACHED [compile_server 3/4] COPY --from=web_compile /home/ktransformers /workspace/ktransformers 0.0s => ERROR [compile_server 4/4] RUN <<EOF (apt update -y && apt install -y --no-install-recommends ...) 63.2s ------ > [compile_server 4/4] RUN <<EOF (apt update -y && apt install -y --no-install-recommends ...): 0.182 0.182 WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 0.183 0.558 Get:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 InRelease [1581 B] 0.898 Get:2 http://archive.ubuntu.com/ubuntu jammy InRelease [270 kB] 0.898 Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 1.126 Get:4 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 Packages [1311 kB] 1.995 Get:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2.298 Get:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2.513 Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [3606 kB] 3.228 Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 Packages [1792 kB] 3.756 Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2606 kB] 3.863 Get:10 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [45.2 kB] 3.867 Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1230 kB] 4.072 Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 Packages [17.5 MB] 5.056 Get:13 http://archive.ubuntu.com/ubuntu jammy/multiverse amd64 Packages [266 kB] 5.064 Get:14 http://archive.ubuntu.com/ubuntu jammy/restricted amd64 Packages [164 kB] 5.294 Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2911 kB] 5.383 Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1526 kB] 5.496 Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [53.3 kB] 5.505 Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [3748 kB] 6.009 Get:19 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [81.4 kB] 6.252 Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [35.2 kB] 6.745 Fetched 37.5 MB in 6s (5816 kB/s) 6.745 Reading package lists... 7.587 Building dependency tree... 7.742 Reading state information... 7.756 64 packages can be upgraded. Run 'apt list --upgradable' to see them. 7.782 7.783 WARNING: apt does not have a stable CLI interface. Use with caution in scripts. 7.783 7.877 Reading package lists... 8.614 Building dependency tree... 8.800 Reading state information... 9.013 g++ is already the newest version (4:11.2.0-1ubuntu1). 9.013 g++ set to manually installed. 9.013 gcc is already the newest version (4:11.2.0-1ubuntu1). 9.013 gcc set to manually installed. 9.013 The following additional packages will be installed: 9.013 cmake-data dh-elpa-helper emacsen-common git-man libarchive13 libbrotli1 9.013 libcurl3-gnutls libcurl4 liberror-perl libexpat1 libgpm2 libicu70 9.013 libjsoncpp25 libmpdec3 libnghttp2-14 libpsl5 libpython3.10 9.013 libpython3.10-minimal libpython3.10-stdlib librhash0 librtmp1 libsodium23 9.013 libssh-4 libuv1 libxml2 media-types vim-common vim-runtime xxd 9.014 Suggested packages: 9.014 cmake-doc ninja-build cmake-format gettext-base git-daemon-run 9.014 | git-daemon-sysvinit git-doc git-email git-gui gitk gitweb git-cvs 9.015 git-mediawiki git-svn lrzip gpm ctags vim-doc vim-scripts 9.015 Recommended packages: 9.015 less ssh-client publicsuffix 9.118 The following NEW packages will be installed: 9.119 cmake cmake-data dh-elpa-helper emacsen-common git git-man libarchive13 9.119 libbrotli1 libcurl3-gnutls libcurl4 liberror-perl libexpat1 libgpm2 libicu70 9.119 libjsoncpp25 libmpdec3 libnghttp2-14 libpsl5 libpython3.10 9.119 libpython3.10-minimal libpython3.10-stdlib librhash0 librtmp1 libsodium23 9.120 libssh-4 libuv1 libxml2 media-types vim vim-common vim-runtime wget xxd 9.667 0 upgraded, 33 newly installed, 0 to remove and 64 not upgraded. 9.667 Need to get 38.4 MB of archives. 9.667 After this operation, 155 MB of additional disk space will be used. 9.667 Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libexpat1 amd64 2.4.7-1ubuntu0.5 [91.5 kB] 10.46 Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu70 amd64 70.1-2 [10.6 MB] 11.93 Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmpdec3 amd64 2.5.1-2build2 [86.8 kB] 11.94 Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-minimal amd64 3.10.12-1~22.04.8 [815 kB] 11.96 Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 media-types all 7.0.0 [25.5 kB] 11.96 Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-stdlib amd64 3.10.12-1~22.04.8 [1850 kB] 12.05 Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxml2 amd64 2.9.13+dfsg-1ubuntu0.5 [763 kB] 12.09 Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 xxd amd64 2:8.2.3995-1ubuntu2.23 [51.7 kB] 12.10 Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim-common all 2:8.2.3995-1ubuntu2.23 [81.5 kB] 12.10 Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnghttp2-14 amd64 1.43.0-1ubuntu0.2 [76.9 kB] 12.10 Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libpsl5 amd64 0.21.0-1.2build2 [58.4 kB] 12.17 Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuv1 amd64 1.43.0-1ubuntu0.1 [92.7 kB] 12.18 Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wget amd64 1.21.2-2ubuntu1.1 [339 kB] 12.20 Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libarchive13 amd64 3.6.0-1ubuntu1.3 [369 kB] 12.21 Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbrotli1 amd64 1.0.9-2build6 [315 kB] 12.28 Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d.1-2build4 [58.2 kB] 12.35 Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssh-4 amd64 0.9.6-2ubuntu0.22.04.3 [186 kB] 12.35 Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl4 amd64 7.81.0-1ubuntu1.20 [289 kB] 12.36 Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjsoncpp25 amd64 1.9.5-3 [80.0 kB] 12.36 Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 librhash0 amd64 1.4.2-1ubuntu1 [125 kB] 12.36 Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 dh-elpa-helper all 2.0.9ubuntu1 [7610 B] 12.41 Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 emacsen-common all 3.0.4 [14.9 kB] 12.43 Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 cmake-data all 3.22.1-1ubuntu1.22.04.2 [1913 kB] 12.48 Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 cmake amd64 3.22.1-1ubuntu1.22.04.2 [5010 kB] 12.88 Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl3-gnutls amd64 7.81.0-1ubuntu1.20 [284 kB] 12.88 Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liberror-perl all 0.17029-1 [26.5 kB] 12.89 Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git-man all 1:2.34.1-1ubuntu1.12 [955 kB] 12.91 Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git amd64 1:2.34.1-1ubuntu1.12 [3165 kB] 13.08 Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgpm2 amd64 1.20.7-10build1 [15.3 kB] 13.08 Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10 amd64 3.10.12-1~22.04.8 [1949 kB] 13.33 Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsodium23 amd64 1.0.18-1build2 [164 kB] 13.33 Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim-runtime all 2:8.2.3995-1ubuntu2.23 [6833 kB] 13.70 Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim amd64 2:8.2.3995-1ubuntu2.23 [1732 kB] 14.05 debconf: delaying package configuration, since apt-utils is not installed 14.10 Fetched 38.4 MB in 5s (8264 kB/s) 14.21 Selecting previously unselected package libexpat1:amd64. (Reading database ... 14428 files and directories currently installed.) 14.23 Preparing to unpack .../00-libexpat1_2.4.7-1ubuntu0.5_amd64.deb ... 14.27 Unpacking libexpat1:amd64 (2.4.7-1ubuntu0.5) ... 14.39 Selecting previously unselected package libicu70:amd64. 14.39 Preparing to unpack .../01-libicu70_70.1-2_amd64.deb ... 14.39 Unpacking libicu70:amd64 (70.1-2) ... 14.63 Selecting previously unselected package libmpdec3:amd64. 14.64 Preparing to unpack .../02-libmpdec3_2.5.1-2build2_amd64.deb ... 14.64 Unpacking libmpdec3:amd64 (2.5.1-2build2) ... 14.74 Selecting previously unselected package libpython3.10-minimal:amd64. 14.74 Preparing to unpack .../03-libpython3.10-minimal_3.10.12-1~22.04.8_amd64.deb ... 14.75 Unpacking libpython3.10-minimal:amd64 (3.10.12-1~22.04.8) ... 14.89 Selecting previously unselected package media-types. 14.90 Preparing to unpack .../04-media-types_7.0.0_all.deb ... 14.90 Unpacking media-types (7.0.0) ... 15.01 Selecting previously unselected package libpython3.10-stdlib:amd64. 15.01 Preparing to unpack .../05-libpython3.10-stdlib_3.10.12-1~22.04.8_amd64.deb ... 15.01 Unpacking libpython3.10-stdlib:amd64 (3.10.12-1~22.04.8) ... 15.17 Selecting previously unselected package libxml2:amd64. 15.17 Preparing to unpack .../06-libxml2_2.9.13+dfsg-1ubuntu0.5_amd64.deb ... 15.18 Unpacking libxml2:amd64 (2.9.13+dfsg-1ubuntu0.5) ... 15.29 Selecting previously unselected package xxd. 15.29 Preparing to unpack .../07-xxd_2%3a8.2.3995-1ubuntu2.23_amd64.deb ... 15.29 Unpacking xxd (2:8.2.3995-1ubuntu2.23) ... 15.41 Selecting previously unselected package vim-common. 15.41 Preparing to unpack .../08-vim-common_2%3a8.2.3995-1ubuntu2.23_all.deb ... 15.47 Unpacking vim-common (2:8.2.3995-1ubuntu2.23) ... 15.59 Selecting previously unselected package libnghttp2-14:amd64. 15.59 Preparing to unpack .../09-libnghttp2-14_1.43.0-1ubuntu0.2_amd64.deb ... 15.59 Unpacking libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ... 15.70 Selecting previously unselected package libpsl5:amd64. 15.70 Preparing to unpack .../10-libpsl5_0.21.0-1.2build2_amd64.deb ... 15.70 Unpacking libpsl5:amd64 (0.21.0-1.2build2) ... 15.81 Selecting previously unselected package libuv1:amd64. 15.81 Preparing to unpack .../11-libuv1_1.43.0-1ubuntu0.1_amd64.deb ... 15.81 Unpacking libuv1:amd64 (1.43.0-1ubuntu0.1) ... 15.92 Selecting previously unselected package wget. 15.92 Preparing to unpack .../12-wget_1.21.2-2ubuntu1.1_amd64.deb ... 15.93 Unpacking wget (1.21.2-2ubuntu1.1) ... 16.04 Selecting previously unselected package libarchive13:amd64. 16.04 Preparing to unpack .../13-libarchive13_3.6.0-1ubuntu1.3_amd64.deb ... 16.04 Unpacking libarchive13:amd64 (3.6.0-1ubuntu1.3) ... 16.16 Selecting previously unselected package libbrotli1:amd64. 16.16 Preparing to unpack .../14-libbrotli1_1.0.9-2build6_amd64.deb ... 16.16 Unpacking libbrotli1:amd64 (1.0.9-2build6) ... 16.28 Selecting previously unselected package librtmp1:amd64. 16.28 Preparing to unpack .../15-librtmp1_2.4+20151223.gitfa8646d.1-2build4_amd64.deb ... 16.28 Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ... 16.39 Selecting previously unselected package libssh-4:amd64. 16.39 Preparing to unpack .../16-libssh-4_0.9.6-2ubuntu0.22.04.3_amd64.deb ... 16.39 Unpacking libssh-4:amd64 (0.9.6-2ubuntu0.22.04.3) ... 16.51 Selecting previously unselected package libcurl4:amd64. 16.51 Preparing to unpack .../17-libcurl4_7.81.0-1ubuntu1.20_amd64.deb ... 16.51 Unpacking libcurl4:amd64 (7.81.0-1ubuntu1.20) ... 16.62 Selecting previously unselected package libjsoncpp25:amd64. 16.62 Preparing to unpack .../18-libjsoncpp25_1.9.5-3_amd64.deb ... 16.62 Unpacking libjsoncpp25:amd64 (1.9.5-3) ... 16.73 Selecting previously unselected package librhash0:amd64. 16.73 Preparing to unpack .../19-librhash0_1.4.2-1ubuntu1_amd64.deb ... 16.73 Unpacking librhash0:amd64 (1.4.2-1ubuntu1) ... 16.84 Selecting previously unselected package dh-elpa-helper. 16.84 Preparing to unpack .../20-dh-elpa-helper_2.0.9ubuntu1_all.deb ... 16.84 Unpacking dh-elpa-helper (2.0.9ubuntu1) ... 16.95 Selecting previously unselected package emacsen-common. 16.95 Preparing to unpack .../21-emacsen-common_3.0.4_all.deb ... 17.06 Unpacking emacsen-common (3.0.4) ... 17.18 Selecting previously unselected package cmake-data. 17.18 Preparing to unpack .../22-cmake-data_3.22.1-1ubuntu1.22.04.2_all.deb ... 17.24 Unpacking cmake-data (3.22.1-1ubuntu1.22.04.2) ... 17.49 Selecting previously unselected package cmake. 17.49 Preparing to unpack .../23-cmake_3.22.1-1ubuntu1.22.04.2_amd64.deb ... 17.50 Unpacking cmake (3.22.1-1ubuntu1.22.04.2) ... 17.70 Selecting previously unselected package libcurl3-gnutls:amd64. 17.70 Preparing to unpack .../24-libcurl3-gnutls_7.81.0-1ubuntu1.20_amd64.deb ... 17.70 Unpacking libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.20) ... 17.81 Selecting previously unselected package liberror-perl. 17.81 Preparing to unpack .../25-liberror-perl_0.17029-1_all.deb ... 17.81 Unpacking liberror-perl (0.17029-1) ... 17.92 Selecting previously unselected package git-man. 17.92 Preparing to unpack .../26-git-man_1%3a2.34.1-1ubuntu1.12_all.deb ... 17.92 Unpacking git-man (1:2.34.1-1ubuntu1.12) ... 18.04 Selecting previously unselected package git. 18.04 Preparing to unpack .../27-git_1%3a2.34.1-1ubuntu1.12_amd64.deb ... 18.11 Unpacking git (1:2.34.1-1ubuntu1.12) ... 18.27 Selecting previously unselected package libgpm2:amd64. 18.27 Preparing to unpack .../28-libgpm2_1.20.7-10build1_amd64.deb ... 18.28 Unpacking libgpm2:amd64 (1.20.7-10build1) ... 18.38 Selecting previously unselected package libpython3.10:amd64. 18.38 Preparing to unpack .../29-libpython3.10_3.10.12-1~22.04.8_amd64.deb ... 18.38 Unpacking libpython3.10:amd64 (3.10.12-1~22.04.8) ... 18.52 Selecting previously unselected package libsodium23:amd64. 18.52 Preparing to unpack .../30-libsodium23_1.0.18-1build2_amd64.deb ... 18.52 Unpacking libsodium23:amd64 (1.0.18-1build2) ... 18.63 Selecting previously unselected package vim-runtime. 18.63 Preparing to unpack .../31-vim-runtime_2%3a8.2.3995-1ubuntu2.23_all.deb ... 18.69 Adding 'diversion of /usr/share/vim/vim82/doc/help.txt to /usr/share/vim/vim82/doc/help.txt.vim-tiny by vim-runtime' 18.71 Adding 'diversion of /usr/share/vim/vim82/doc/tags to /usr/share/vim/vim82/doc/tags.vim-tiny by vim-runtime' 18.72 Unpacking vim-runtime (2:8.2.3995-1ubuntu2.23) ... 19.04 Selecting previously unselected package vim. 19.04 Preparing to unpack .../32-vim_2%3a8.2.3995-1ubuntu2.23_amd64.deb ... 19.11 Unpacking vim (2:8.2.3995-1ubuntu2.23) ... 19.21 Setting up libexpat1:amd64 (2.4.7-1ubuntu0.5) ... 19.23 Setting up media-types (7.0.0) ... 19.25 Setting up libpsl5:amd64 (0.21.0-1.2build2) ... 19.26 Setting up libsodium23:amd64 (1.0.18-1build2) ... 19.26 Setting up libgpm2:amd64 (1.20.7-10build1) ... 19.27 Setting up wget (1.21.2-2ubuntu1.1) ... 19.28 Setting up libbrotli1:amd64 (1.0.9-2build6) ... 19.28 Setting up libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ... 19.29 Setting up xxd (2:8.2.3995-1ubuntu2.23) ... 19.29 Setting up liberror-perl (0.17029-1) ... 19.30 Setting up libuv1:amd64 (1.43.0-1ubuntu0.1) ... 19.30 Setting up vim-common (2:8.2.3995-1ubuntu2.23) ... 19.37 Setting up emacsen-common (3.0.4) ... 19.63 Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ... 19.64 Setting up dh-elpa-helper (2.0.9ubuntu1) ... 19.65 Setting up libpython3.10-minimal:amd64 (3.10.12-1~22.04.8) ... 19.67 Setting up libjsoncpp25:amd64 (1.9.5-3) ... 19.68 Setting up libssh-4:amd64 (0.9.6-2ubuntu0.22.04.3) ... 19.69 Setting up librhash0:amd64 (1.4.2-1ubuntu1) ... 19.69 Setting up libmpdec3:amd64 (2.5.1-2build2) ... 19.70 Setting up libcurl4:amd64 (7.81.0-1ubuntu1.20) ... 19.70 Setting up git-man (1:2.34.1-1ubuntu1.12) ... 19.71 Setting up cmake-data (3.22.1-1ubuntu1.22.04.2) ... 19.95 Setting up vim-runtime (2:8.2.3995-1ubuntu2.23) ... 20.54 Setting up libicu70:amd64 (70.1-2) ... 20.55 Setting up libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.20) ... 20.56 Setting up libpython3.10-stdlib:amd64 (3.10.12-1~22.04.8) ... 20.57 Setting up git (1:2.34.1-1ubuntu1.12) ... 20.63 Setting up libxml2:amd64 (2.9.13+dfsg-1ubuntu0.5) ... 20.64 Setting up libpython3.10:amd64 (3.10.12-1~22.04.8) ... 20.65 Setting up vim (2:8.2.3995-1ubuntu2.23) ... 20.68 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vim (vim) in auto mode 20.70 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vimdiff (vimdiff) in auto mode 20.72 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/rvim (rvim) in auto mode 20.74 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/rview (rview) in auto mode 20.76 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vi (vi) in auto mode 20.76 update-alternatives: warning: skip creation of /usr/share/man/da/man1/vi.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group vi) doesn't exist 20.76 update-alternatives: warning: skip creation of /usr/share/man/de/man1/vi.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group vi) doesn't exist 20.76 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/vi.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group vi) doesn't exist 20.76 update-alternatives: warning: skip creation of /usr/share/man/it/man1/vi.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group vi) doesn't exist 20.76 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/vi.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group vi) doesn't exist 20.76 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/vi.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group vi) doesn't exist 20.76 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/vi.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group vi) doesn't exist 20.76 update-alternatives: warning: skip creation of /usr/share/man/man1/vi.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group vi) doesn't exist 20.78 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/view (view) in auto mode 20.78 update-alternatives: warning: skip creation of /usr/share/man/da/man1/view.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group view) doesn't exist 20.78 update-alternatives: warning: skip creation of /usr/share/man/de/man1/view.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group view) doesn't exist 20.78 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/view.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group view) doesn't exist 20.78 update-alternatives: warning: skip creation of /usr/share/man/it/man1/view.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group view) doesn't exist 20.78 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/view.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group view) doesn't exist 20.78 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/view.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group view) doesn't exist 20.78 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/view.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group view) doesn't exist 20.78 update-alternatives: warning: skip creation of /usr/share/man/man1/view.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group view) doesn't exist 20.80 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/ex (ex) in auto mode 20.80 update-alternatives: warning: skip creation of /usr/share/man/da/man1/ex.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group ex) doesn't exist 20.80 update-alternatives: warning: skip creation of /usr/share/man/de/man1/ex.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group ex) doesn't exist 20.80 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/ex.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group ex) doesn't exist 20.80 update-alternatives: warning: skip creation of /usr/share/man/it/man1/ex.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group ex) doesn't exist 20.80 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/ex.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group ex) doesn't exist 20.80 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/ex.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group ex) doesn't exist 20.80 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/ex.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group ex) doesn't exist 20.80 update-alternatives: warning: skip creation of /usr/share/man/man1/ex.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group ex) doesn't exist 20.82 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/editor (editor) in auto mode 20.82 update-alternatives: warning: skip creation of /usr/share/man/da/man1/editor.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group editor) doesn't exist 20.82 update-alternatives: warning: skip creation of /usr/share/man/de/man1/editor.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group editor) doesn't exist 20.82 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/editor.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group editor) doesn't exist 20.82 update-alternatives: warning: skip creation of /usr/share/man/it/man1/editor.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group editor) doesn't exist 20.82 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/editor.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group editor) doesn't exist 20.82 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/editor.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group editor) doesn't exist 20.82 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/editor.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group editor) doesn't exist 20.82 update-alternatives: warning: skip creation of /usr/share/man/man1/editor.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group editor) doesn't exist 20.87 Setting up libarchive13:amd64 (3.6.0-1ubuntu1.3) ... 20.88 Setting up cmake (3.22.1-1ubuntu1.22.04.2) ... 20.89 Processing triggers for libc-bin (2.35-0ubuntu3.4) ... 21.39 Submodule 'third_party/llama.cpp' (https://github.com/ggerganov/llama.cpp.git) registered for path 'third_party/llama.cpp' 21.39 Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' 21.75 Cloning into '/workspace/ktransformers/third_party/llama.cpp'... 35.59 Cloning into '/workspace/ktransformers/third_party/pybind11'... 39.25 Submodule path 'third_party/llama.cpp': checked out 'a94e6ff8774b7c9f950d9545baf0ce35e8d1ed2f' 39.46 Submodule path 'third_party/pybind11': checked out 'bb05e0810b87e74709d9f4c4545f1f57a1b386f5' 40.10 Collecting ninja 40.25 Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (5.3 kB) 40.58 Collecting pyproject 40.63 Downloading pyproject-1.3.1.tar.gz (7.9 kB) 40.66 Preparing metadata (setup.py): started 40.91 Preparing metadata (setup.py): finished with status 'done' 40.91 Requirement already satisfied: numpy in /opt/conda/lib/python3.10/site-packages (1.26.4) 40.98 Collecting cpufeature 41.03 Downloading cpufeature-0.2.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.4 kB) 41.04 Requirement already satisfied: Jinja2 in /opt/conda/lib/python3.10/site-packages (from pyproject) (3.1.4) 41.04 Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from Jinja2->pyproject) (2.1.3) 41.09 Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (422 kB) 41.27 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 422.9/422.9 kB 2.7 MB/s eta 0:00:00 41.32 Downloading cpufeature-0.2.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB) 41.36 Building wheels for collected packages: pyproject 41.36 Building wheel for pyproject (setup.py): started 41.66 Building wheel for pyproject (setup.py): finished with status 'done' 41.66 Created wheel for pyproject: filename=pyproject-1.3.1-py3-none-any.whl size=10995 sha256=0f31e87acb4ae8e740c221a2d7ab37a8cba3e3819b4225f4a8106b3efd1ba78a 41.66 Stored in directory: /root/.cache/pip/wheels/cb/2b/08/d805f476ee6c6e5cbfdca7ef80ab540d7eb75471e3b2c9065b 41.66 Successfully built pyproject 42.00 Installing collected packages: cpufeature, ninja, pyproject 42.06 Successfully installed cpufeature-0.2.1 ninja-1.11.1.3 pyproject-1.3.1 42.06 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv 42.93 Collecting flash-attn 43.09 Downloading flash_attn-2.7.4.post1.tar.gz (6.0 MB) 43.49 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.0/6.0 MB 16.7 MB/s eta 0:00:00 44.48 Preparing metadata (setup.py): started 47.69 Preparing metadata (setup.py): finished with status 'done' 47.70 Requirement already satisfied: torch in /opt/conda/lib/python3.10/site-packages (from flash-attn) (2.3.1) 47.77 Collecting einops (from flash-attn) 47.82 Downloading einops-0.8.1-py3-none-any.whl.metadata (13 kB) 47.84 Requirement already satisfied: filelock in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.13.1) 47.84 Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (4.11.0) 47.84 Requirement already satisfied: sympy in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (1.12.1) 47.84 Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.2.1) 47.84 Requirement already satisfied: jinja2 in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.1.4) 47.84 Requirement already satisfied: fsspec in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (2024.6.0) 47.91 Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from jinja2->torch->flash-attn) (2.1.3) 47.93 Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy->torch->flash-attn) (1.3.0) 47.98 Downloading einops-0.8.1-py3-none-any.whl (64 kB) 47.99 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.4/64.4 kB 5.2 MB/s eta 0:00:00 48.00 Building wheels for collected packages: flash-attn 48.00 Building wheel for flash-attn (setup.py): started 56.33 Building wheel for flash-attn (setup.py): finished with status 'done' 56.84 Created wheel for flash-attn: filename=flash_attn-2.7.4.post1-cp310-cp310-linux_x86_64.whl size=187765791 sha256=b0caacfaca0dcb2684ef7f11a362afa695e69ace6cbb1feea69a097de7a46f58 56.85 Stored in directory: /root/.cache/pip/wheels/59/ce/d5/08ea07bfc16ba218dc65a3a7ef9b6a270530bcbd2cea2ee1ca 56.85 Successfully built flash-attn 57.11 Installing collected packages: einops, flash-attn 60.49 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv 60.49 Successfully installed einops-0.8.1 flash-attn-2.7.4.post1 60.97 Using pip 24.0 from /opt/conda/lib/python3.10/site-packages/pip (python 3.10) 61.02 Processing /workspace/ktransformers 61.02 Preparing metadata (pyproject.toml): started 61.02 Running command Preparing metadata (pyproject.toml) 62.76 error: subprocess-exited-with-error 62.76 62.76 × Preparing metadata (pyproject.toml) did not run successfully. 62.76 │ exit code: -8 62.76 ╰─> See above for output. 62.76 62.76 note: This error originates from a subprocess, and is likely not a problem with pip. 62.76 full command: /opt/conda/bin/python /opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_wheel /tmp/tmpobqgwukl 62.76 cwd: /workspace/ktransformers 62.76 Preparing metadata (pyproject.toml): finished with status 'error' 62.76 error: metadata-generation-failed 62.76 62.76 × Encountered error while generating package metadata. 62.76 ╰─> See above for output. 62.76 62.76 note: This is an issue with the package mentioned above, not pip. 62.76 hint: See above for details. ------ 3 warnings found (use docker --debug to expand): - LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15) - FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1) - FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13) Dockerfile:17 -------------------- 16 | COPY --from=web_compile /home/ktransformers /workspace/ktransformers 17 | >>> RUN <<EOF 18 | >>> apt update -y && apt install -y --no-install-recommends \ 19 | >>> git \ 20 | >>> wget \ 21 | >>> vim \ 22 | >>> gcc \ 23 | >>> g++ \ 24 | >>> cmake && 25 | >>> rm -rf /var/lib/apt/lists/* && 26 | >>> cd ktransformers && 27 | >>> git submodule init && 28 | >>> git submodule update && 29 | >>> pip install ninja pyproject numpy cpufeature && 30 | >>> pip install flash-attn && 31 | >>> CPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose && 32 | >>> pip cache purge 33 | >>> EOF 34 | -------------------- ERROR: failed to solve: process "/bin/sh -c apt update -y && apt install -y --no-install-recommends \\\n git \\\n wget \\\n vim \\\n gcc \\\n g++ \\\n cmake && \nrm -rf /var/lib/apt/lists/* &&\ncd ktransformers &&\ngit submodule init &&\ngit submodule update &&\npip install ninja pyproject numpy cpufeature &&\npip install flash-attn &&\nCPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST=\"8.0;8.6;8.7;8.9;9.0+PTX\" pip install . --no-build-isolation --verbose &&\npip cache purge\n" did not complete successfully: exit code: 1
Author
Owner

@KMSorSMS commented on GitHub (Feb 11, 2025):

我打包的命令是docker build -t ktransformers:0.2.0 . --platform linux/amd64,我的M1的Mac,我的服务器连不了外网,我打算本地打包好上传到服务器,完整的日志如下:

[+] Building 63.3s (11/11) FINISHED docker:orbstack
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 1.01kB 0.0s
=> WARN: FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1) 0.0s
=> WARN: FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13) 0.0s
=> WARN: LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15) 0.0s
=> [internal] load metadata for docker.io/pytorch/pytorch:2.3.1-cuda12.1-cudnn8-devel 0.0s
=> [internal] load metadata for docker.io/library/node:20.16.0 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [web_compile 1/3] FROM docker.io/library/node:20.16.0 0.0s
=> [compile_server 1/4] FROM docker.io/pytorch/pytorch:2.3.1-cuda12.1-cudnn8-devel 0.0s
=> CACHED [compile_server 2/4] WORKDIR /workspace 0.0s
=> CACHED [web_compile 2/3] WORKDIR /home 0.0s
=> CACHED [web_compile 3/3] RUN <<EOF (git clone https://github.com/kvcache-ai/ktransformers.git &&...) 0.0s
=> CACHED [compile_server 3/4] COPY --from=web_compile /home/ktransformers /workspace/ktransformers 0.0s
=> ERROR [compile_server 4/4] RUN <<EOF (apt update -y && apt install -y --no-install-recommends ...) 63.2s

[compile_server 4/4] RUN <<EOF (apt update -y && apt install -y --no-install-recommends ...):
0.182
0.182 WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
0.183
0.558 Get:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 InRelease [1581 B]
0.898 Get:2 http://archive.ubuntu.com/ubuntu jammy InRelease [270 kB]
0.898 Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB]
1.126 Get:4 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 Packages [1311 kB]
1.995 Get:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB]
2.298 Get:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB]
2.513 Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [3606 kB]
3.228 Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 Packages [1792 kB]
3.756 Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2606 kB]
3.863 Get:10 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [45.2 kB]
3.867 Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1230 kB]
4.072 Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 Packages [17.5 MB]
5.056 Get:13 http://archive.ubuntu.com/ubuntu jammy/multiverse amd64 Packages [266 kB]
5.064 Get:14 http://archive.ubuntu.com/ubuntu jammy/restricted amd64 Packages [164 kB]
5.294 Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2911 kB]
5.383 Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1526 kB]
5.496 Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [53.3 kB]
5.505 Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [3748 kB]
6.009 Get:19 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [81.4 kB]
6.252 Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [35.2 kB]
6.745 Fetched 37.5 MB in 6s (5816 kB/s)
6.745 Reading package lists...
7.587 Building dependency tree...
7.742 Reading state information...
7.756 64 packages can be upgraded. Run 'apt list --upgradable' to see them.
7.782
7.783 WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
7.783
7.877 Reading package lists...
8.614 Building dependency tree...
8.800 Reading state information...
9.013 g++ is already the newest version (4:11.2.0-1ubuntu1).
9.013 g++ set to manually installed.
9.013 gcc is already the newest version (4:11.2.0-1ubuntu1).
9.013 gcc set to manually installed.
9.013 The following additional packages will be installed:
9.013 cmake-data dh-elpa-helper emacsen-common git-man libarchive13 libbrotli1
9.013 libcurl3-gnutls libcurl4 liberror-perl libexpat1 libgpm2 libicu70
9.013 libjsoncpp25 libmpdec3 libnghttp2-14 libpsl5 libpython3.10
9.013 libpython3.10-minimal libpython3.10-stdlib librhash0 librtmp1 libsodium23
9.013 libssh-4 libuv1 libxml2 media-types vim-common vim-runtime xxd
9.014 Suggested packages:
9.014 cmake-doc ninja-build cmake-format gettext-base git-daemon-run
9.014 | git-daemon-sysvinit git-doc git-email git-gui gitk gitweb git-cvs
9.015 git-mediawiki git-svn lrzip gpm ctags vim-doc vim-scripts
9.015 Recommended packages:
9.015 less ssh-client publicsuffix
9.118 The following NEW packages will be installed:
9.119 cmake cmake-data dh-elpa-helper emacsen-common git git-man libarchive13
9.119 libbrotli1 libcurl3-gnutls libcurl4 liberror-perl libexpat1 libgpm2 libicu70
9.119 libjsoncpp25 libmpdec3 libnghttp2-14 libpsl5 libpython3.10
9.119 libpython3.10-minimal libpython3.10-stdlib librhash0 librtmp1 libsodium23
9.120 libssh-4 libuv1 libxml2 media-types vim vim-common vim-runtime wget xxd
9.667 0 upgraded, 33 newly installed, 0 to remove and 64 not upgraded.
9.667 Need to get 38.4 MB of archives.
9.667 After this operation, 155 MB of additional disk space will be used.
9.667 Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libexpat1 amd64 2.4.7-1ubuntu0.5 [91.5 kB]
10.46 Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu70 amd64 70.1-2 [10.6 MB]
11.93 Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmpdec3 amd64 2.5.1-2build2 [86.8 kB]
11.94 Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-minimal amd64 3.10.12-122.04.8 [815 kB]
11.96 Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 media-types all 7.0.0 [25.5 kB]
11.96 Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-stdlib amd64 3.10.12-1
22.04.8 [1850 kB]
12.05 Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxml2 amd64 2.9.13+dfsg-1ubuntu0.5 [763 kB]
12.09 Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 xxd amd64 2:8.2.3995-1ubuntu2.23 [51.7 kB]
12.10 Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim-common all 2:8.2.3995-1ubuntu2.23 [81.5 kB]
12.10 Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnghttp2-14 amd64 1.43.0-1ubuntu0.2 [76.9 kB]
12.10 Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libpsl5 amd64 0.21.0-1.2build2 [58.4 kB]
12.17 Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuv1 amd64 1.43.0-1ubuntu0.1 [92.7 kB]
12.18 Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wget amd64 1.21.2-2ubuntu1.1 [339 kB]
12.20 Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libarchive13 amd64 3.6.0-1ubuntu1.3 [369 kB]
12.21 Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbrotli1 amd64 1.0.9-2build6 [315 kB]
12.28 Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d.1-2build4 [58.2 kB]
12.35 Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssh-4 amd64 0.9.6-2ubuntu0.22.04.3 [186 kB]
12.35 Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl4 amd64 7.81.0-1ubuntu1.20 [289 kB]
12.36 Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjsoncpp25 amd64 1.9.5-3 [80.0 kB]
12.36 Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 librhash0 amd64 1.4.2-1ubuntu1 [125 kB]
12.36 Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 dh-elpa-helper all 2.0.9ubuntu1 [7610 B]
12.41 Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 emacsen-common all 3.0.4 [14.9 kB]
12.43 Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 cmake-data all 3.22.1-1ubuntu1.22.04.2 [1913 kB]
12.48 Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 cmake amd64 3.22.1-1ubuntu1.22.04.2 [5010 kB]
12.88 Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl3-gnutls amd64 7.81.0-1ubuntu1.20 [284 kB]
12.88 Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liberror-perl all 0.17029-1 [26.5 kB]
12.89 Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git-man all 1:2.34.1-1ubuntu1.12 [955 kB]
12.91 Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git amd64 1:2.34.1-1ubuntu1.12 [3165 kB]
13.08 Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgpm2 amd64 1.20.7-10build1 [15.3 kB]
13.08 Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10 amd64 3.10.12-122.04.8 [1949 kB]
13.33 Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsodium23 amd64 1.0.18-1build2 [164 kB]
13.33 Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim-runtime all 2:8.2.3995-1ubuntu2.23 [6833 kB]
13.70 Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim amd64 2:8.2.3995-1ubuntu2.23 [1732 kB]
14.05 debconf: delaying package configuration, since apt-utils is not installed
14.10 Fetched 38.4 MB in 5s (8264 kB/s)
14.21 Selecting previously unselected package libexpat1:amd64.
(Reading database ... 14428 files and directories currently installed.)
14.23 Preparing to unpack .../00-libexpat1_2.4.7-1ubuntu0.5_amd64.deb ...
14.27 Unpacking libexpat1:amd64 (2.4.7-1ubuntu0.5) ...
14.39 Selecting previously unselected package libicu70:amd64.
14.39 Preparing to unpack .../01-libicu70_70.1-2_amd64.deb ...
14.39 Unpacking libicu70:amd64 (70.1-2) ...
14.63 Selecting previously unselected package libmpdec3:amd64.
14.64 Preparing to unpack .../02-libmpdec3_2.5.1-2build2_amd64.deb ...
14.64 Unpacking libmpdec3:amd64 (2.5.1-2build2) ...
14.74 Selecting previously unselected package libpython3.10-minimal:amd64.
14.74 Preparing to unpack .../03-libpython3.10-minimal_3.10.12-1
22.04.8_amd64.deb ...
14.75 Unpacking libpython3.10-minimal:amd64 (3.10.12-122.04.8) ...
14.89 Selecting previously unselected package media-types.
14.90 Preparing to unpack .../04-media-types_7.0.0_all.deb ...
14.90 Unpacking media-types (7.0.0) ...
15.01 Selecting previously unselected package libpython3.10-stdlib:amd64.
15.01 Preparing to unpack .../05-libpython3.10-stdlib_3.10.12-1
22.04.8_amd64.deb ...
15.01 Unpacking libpython3.10-stdlib:amd64 (3.10.12-122.04.8) ...
15.17 Selecting previously unselected package libxml2:amd64.
15.17 Preparing to unpack .../06-libxml2_2.9.13+dfsg-1ubuntu0.5_amd64.deb ...
15.18 Unpacking libxml2:amd64 (2.9.13+dfsg-1ubuntu0.5) ...
15.29 Selecting previously unselected package xxd.
15.29 Preparing to unpack .../07-xxd_2%3a8.2.3995-1ubuntu2.23_amd64.deb ...
15.29 Unpacking xxd (2:8.2.3995-1ubuntu2.23) ...
15.41 Selecting previously unselected package vim-common.
15.41 Preparing to unpack .../08-vim-common_2%3a8.2.3995-1ubuntu2.23_all.deb ...
15.47 Unpacking vim-common (2:8.2.3995-1ubuntu2.23) ...
15.59 Selecting previously unselected package libnghttp2-14:amd64.
15.59 Preparing to unpack .../09-libnghttp2-14_1.43.0-1ubuntu0.2_amd64.deb ...
15.59 Unpacking libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ...
15.70 Selecting previously unselected package libpsl5:amd64.
15.70 Preparing to unpack .../10-libpsl5_0.21.0-1.2build2_amd64.deb ...
15.70 Unpacking libpsl5:amd64 (0.21.0-1.2build2) ...
15.81 Selecting previously unselected package libuv1:amd64.
15.81 Preparing to unpack .../11-libuv1_1.43.0-1ubuntu0.1_amd64.deb ...
15.81 Unpacking libuv1:amd64 (1.43.0-1ubuntu0.1) ...
15.92 Selecting previously unselected package wget.
15.92 Preparing to unpack .../12-wget_1.21.2-2ubuntu1.1_amd64.deb ...
15.93 Unpacking wget (1.21.2-2ubuntu1.1) ...
16.04 Selecting previously unselected package libarchive13:amd64.
16.04 Preparing to unpack .../13-libarchive13_3.6.0-1ubuntu1.3_amd64.deb ...
16.04 Unpacking libarchive13:amd64 (3.6.0-1ubuntu1.3) ...
16.16 Selecting previously unselected package libbrotli1:amd64.
16.16 Preparing to unpack .../14-libbrotli1_1.0.9-2build6_amd64.deb ...
16.16 Unpacking libbrotli1:amd64 (1.0.9-2build6) ...
16.28 Selecting previously unselected package librtmp1:amd64.
16.28 Preparing to unpack .../15-librtmp1_2.4+20151223.gitfa8646d.1-2build4_amd64.deb ...
16.28 Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ...
16.39 Selecting previously unselected package libssh-4:amd64.
16.39 Preparing to unpack .../16-libssh-4_0.9.6-2ubuntu0.22.04.3_amd64.deb ...
16.39 Unpacking libssh-4:amd64 (0.9.6-2ubuntu0.22.04.3) ...
16.51 Selecting previously unselected package libcurl4:amd64.
16.51 Preparing to unpack .../17-libcurl4_7.81.0-1ubuntu1.20_amd64.deb ...
16.51 Unpacking libcurl4:amd64 (7.81.0-1ubuntu1.20) ...
16.62 Selecting previously unselected package libjsoncpp25:amd64.
16.62 Preparing to unpack .../18-libjsoncpp25_1.9.5-3_amd64.deb ...
16.62 Unpacking libjsoncpp25:amd64 (1.9.5-3) ...
16.73 Selecting previously unselected package librhash0:amd64.
16.73 Preparing to unpack .../19-librhash0_1.4.2-1ubuntu1_amd64.deb ...
16.73 Unpacking librhash0:amd64 (1.4.2-1ubuntu1) ...
16.84 Selecting previously unselected package dh-elpa-helper.
16.84 Preparing to unpack .../20-dh-elpa-helper_2.0.9ubuntu1_all.deb ...
16.84 Unpacking dh-elpa-helper (2.0.9ubuntu1) ...
16.95 Selecting previously unselected package emacsen-common.
16.95 Preparing to unpack .../21-emacsen-common_3.0.4_all.deb ...
17.06 Unpacking emacsen-common (3.0.4) ...
17.18 Selecting previously unselected package cmake-data.
17.18 Preparing to unpack .../22-cmake-data_3.22.1-1ubuntu1.22.04.2_all.deb ...
17.24 Unpacking cmake-data (3.22.1-1ubuntu1.22.04.2) ...
17.49 Selecting previously unselected package cmake.
17.49 Preparing to unpack .../23-cmake_3.22.1-1ubuntu1.22.04.2_amd64.deb ...
17.50 Unpacking cmake (3.22.1-1ubuntu1.22.04.2) ...
17.70 Selecting previously unselected package libcurl3-gnutls:amd64.
17.70 Preparing to unpack .../24-libcurl3-gnutls_7.81.0-1ubuntu1.20_amd64.deb ...
17.70 Unpacking libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.20) ...
17.81 Selecting previously unselected package liberror-perl.
17.81 Preparing to unpack .../25-liberror-perl_0.17029-1_all.deb ...
17.81 Unpacking liberror-perl (0.17029-1) ...
17.92 Selecting previously unselected package git-man.
17.92 Preparing to unpack .../26-git-man_1%3a2.34.1-1ubuntu1.12_all.deb ...
17.92 Unpacking git-man (1:2.34.1-1ubuntu1.12) ...
18.04 Selecting previously unselected package git.
18.04 Preparing to unpack .../27-git_1%3a2.34.1-1ubuntu1.12_amd64.deb ...
18.11 Unpacking git (1:2.34.1-1ubuntu1.12) ...
18.27 Selecting previously unselected package libgpm2:amd64.
18.27 Preparing to unpack .../28-libgpm2_1.20.7-10build1_amd64.deb ...
18.28 Unpacking libgpm2:amd64 (1.20.7-10build1) ...
18.38 Selecting previously unselected package libpython3.10:amd64.
18.38 Preparing to unpack .../29-libpython3.10_3.10.12-1
22.04.8_amd64.deb ...
18.38 Unpacking libpython3.10:amd64 (3.10.12-122.04.8) ...
18.52 Selecting previously unselected package libsodium23:amd64.
18.52 Preparing to unpack .../30-libsodium23_1.0.18-1build2_amd64.deb ...
18.52 Unpacking libsodium23:amd64 (1.0.18-1build2) ...
18.63 Selecting previously unselected package vim-runtime.
18.63 Preparing to unpack .../31-vim-runtime_2%3a8.2.3995-1ubuntu2.23_all.deb ...
18.69 Adding 'diversion of /usr/share/vim/vim82/doc/help.txt to /usr/share/vim/vim82/doc/help.txt.vim-tiny by vim-runtime'
18.71 Adding 'diversion of /usr/share/vim/vim82/doc/tags to /usr/share/vim/vim82/doc/tags.vim-tiny by vim-runtime'
18.72 Unpacking vim-runtime (2:8.2.3995-1ubuntu2.23) ...
19.04 Selecting previously unselected package vim.
19.04 Preparing to unpack .../32-vim_2%3a8.2.3995-1ubuntu2.23_amd64.deb ...
19.11 Unpacking vim (2:8.2.3995-1ubuntu2.23) ...
19.21 Setting up libexpat1:amd64 (2.4.7-1ubuntu0.5) ...
19.23 Setting up media-types (7.0.0) ...
19.25 Setting up libpsl5:amd64 (0.21.0-1.2build2) ...
19.26 Setting up libsodium23:amd64 (1.0.18-1build2) ...
19.26 Setting up libgpm2:amd64 (1.20.7-10build1) ...
19.27 Setting up wget (1.21.2-2ubuntu1.1) ...
19.28 Setting up libbrotli1:amd64 (1.0.9-2build6) ...
19.28 Setting up libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ...
19.29 Setting up xxd (2:8.2.3995-1ubuntu2.23) ...
19.29 Setting up liberror-perl (0.17029-1) ...
19.30 Setting up libuv1:amd64 (1.43.0-1ubuntu0.1) ...
19.30 Setting up vim-common (2:8.2.3995-1ubuntu2.23) ...
19.37 Setting up emacsen-common (3.0.4) ...
19.63 Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ...
19.64 Setting up dh-elpa-helper (2.0.9ubuntu1) ...
19.65 Setting up libpython3.10-minimal:amd64 (3.10.12-1
22.04.8) ...
19.67 Setting up libjsoncpp25:amd64 (1.9.5-3) ...
19.68 Setting up libssh-4:amd64 (0.9.6-2ubuntu0.22.04.3) ...
19.69 Setting up librhash0:amd64 (1.4.2-1ubuntu1) ...
19.69 Setting up libmpdec3:amd64 (2.5.1-2build2) ...
19.70 Setting up libcurl4:amd64 (7.81.0-1ubuntu1.20) ...
19.70 Setting up git-man (1:2.34.1-1ubuntu1.12) ...
19.71 Setting up cmake-data (3.22.1-1ubuntu1.22.04.2) ...
19.95 Setting up vim-runtime (2:8.2.3995-1ubuntu2.23) ...
20.54 Setting up libicu70:amd64 (70.1-2) ...
20.55 Setting up libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.20) ...
20.56 Setting up libpython3.10-stdlib:amd64 (3.10.12-122.04.8) ...
20.57 Setting up git (1:2.34.1-1ubuntu1.12) ...
20.63 Setting up libxml2:amd64 (2.9.13+dfsg-1ubuntu0.5) ...
20.64 Setting up libpython3.10:amd64 (3.10.12-1
22.04.8) ...
20.65 Setting up vim (2:8.2.3995-1ubuntu2.23) ...
20.68 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vim (vim) in auto mode
20.70 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vimdiff (vimdiff) in auto mode
20.72 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/rvim (rvim) in auto mode
20.74 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/rview (rview) in auto mode
20.76 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vi (vi) in auto mode
20.76 update-alternatives: warning: skip creation of /usr/share/man/da/man1/vi.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/de/man1/vi.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/vi.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/it/man1/vi.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/vi.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/vi.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/vi.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group vi) doesn't exist
20.76 update-alternatives: warning: skip creation of /usr/share/man/man1/vi.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group vi) doesn't exist
20.78 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/view (view) in auto mode
20.78 update-alternatives: warning: skip creation of /usr/share/man/da/man1/view.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/de/man1/view.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/view.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/it/man1/view.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/view.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/view.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/view.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group view) doesn't exist
20.78 update-alternatives: warning: skip creation of /usr/share/man/man1/view.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group view) doesn't exist
20.80 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/ex (ex) in auto mode
20.80 update-alternatives: warning: skip creation of /usr/share/man/da/man1/ex.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/de/man1/ex.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/ex.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/it/man1/ex.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/ex.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/ex.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/ex.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group ex) doesn't exist
20.80 update-alternatives: warning: skip creation of /usr/share/man/man1/ex.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group ex) doesn't exist
20.82 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/editor (editor) in auto mode
20.82 update-alternatives: warning: skip creation of /usr/share/man/da/man1/editor.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/de/man1/editor.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/editor.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/it/man1/editor.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/editor.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/editor.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/editor.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group editor) doesn't exist
20.82 update-alternatives: warning: skip creation of /usr/share/man/man1/editor.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group editor) doesn't exist
20.87 Setting up libarchive13:amd64 (3.6.0-1ubuntu1.3) ...
20.88 Setting up cmake (3.22.1-1ubuntu1.22.04.2) ...
20.89 Processing triggers for libc-bin (2.35-0ubuntu3.4) ...
21.39 Submodule 'third_party/llama.cpp' (https://github.com/ggerganov/llama.cpp.git) registered for path 'third_party/llama.cpp'
21.39 Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11'
21.75 Cloning into '/workspace/ktransformers/third_party/llama.cpp'...
35.59 Cloning into '/workspace/ktransformers/third_party/pybind11'...
39.25 Submodule path 'third_party/llama.cpp': checked out 'a94e6ff8774b7c9f950d9545baf0ce35e8d1ed2f'
39.46 Submodule path 'third_party/pybind11': checked out 'bb05e0810b87e74709d9f4c4545f1f57a1b386f5'
40.10 Collecting ninja
40.25 Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (5.3 kB)
40.58 Collecting pyproject
40.63 Downloading pyproject-1.3.1.tar.gz (7.9 kB)
40.66 Preparing metadata (setup.py): started
40.91 Preparing metadata (setup.py): finished with status 'done'
40.91 Requirement already satisfied: numpy in /opt/conda/lib/python3.10/site-packages (1.26.4)
40.98 Collecting cpufeature
41.03 Downloading cpufeature-0.2.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.4 kB)
41.04 Requirement already satisfied: Jinja2 in /opt/conda/lib/python3.10/site-packages (from pyproject) (3.1.4)
41.04 Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from Jinja2->pyproject) (2.1.3)
41.09 Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (422 kB)
41.27 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 422.9/422.9 kB 2.7 MB/s eta 0:00:00
41.32 Downloading cpufeature-0.2.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
41.36 Building wheels for collected packages: pyproject
41.36 Building wheel for pyproject (setup.py): started
41.66 Building wheel for pyproject (setup.py): finished with status 'done'
41.66 Created wheel for pyproject: filename=pyproject-1.3.1-py3-none-any.whl size=10995 sha256=0f31e87acb4ae8e740c221a2d7ab37a8cba3e3819b4225f4a8106b3efd1ba78a
41.66 Stored in directory: /root/.cache/pip/wheels/cb/2b/08/d805f476ee6c6e5cbfdca7ef80ab540d7eb75471e3b2c9065b
41.66 Successfully built pyproject
42.00 Installing collected packages: cpufeature, ninja, pyproject
42.06 Successfully installed cpufeature-0.2.1 ninja-1.11.1.3 pyproject-1.3.1
42.06 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
42.93 Collecting flash-attn
43.09 Downloading flash_attn-2.7.4.post1.tar.gz (6.0 MB)
43.49 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.0/6.0 MB 16.7 MB/s eta 0:00:00
44.48 Preparing metadata (setup.py): started
47.69 Preparing metadata (setup.py): finished with status 'done'
47.70 Requirement already satisfied: torch in /opt/conda/lib/python3.10/site-packages (from flash-attn) (2.3.1)
47.77 Collecting einops (from flash-attn)
47.82 Downloading einops-0.8.1-py3-none-any.whl.metadata (13 kB)
47.84 Requirement already satisfied: filelock in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.13.1)
47.84 Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (4.11.0)
47.84 Requirement already satisfied: sympy in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (1.12.1)
47.84 Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.2.1)
47.84 Requirement already satisfied: jinja2 in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.1.4)
47.84 Requirement already satisfied: fsspec in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (2024.6.0)
47.91 Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from jinja2->torch->flash-attn) (2.1.3)
47.93 Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy->torch->flash-attn) (1.3.0)
47.98 Downloading einops-0.8.1-py3-none-any.whl (64 kB)
47.99 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.4/64.4 kB 5.2 MB/s eta 0:00:00
48.00 Building wheels for collected packages: flash-attn
48.00 Building wheel for flash-attn (setup.py): started
56.33 Building wheel for flash-attn (setup.py): finished with status 'done'
56.84 Created wheel for flash-attn: filename=flash_attn-2.7.4.post1-cp310-cp310-linux_x86_64.whl size=187765791 sha256=b0caacfaca0dcb2684ef7f11a362afa695e69ace6cbb1feea69a097de7a46f58
56.85 Stored in directory: /root/.cache/pip/wheels/59/ce/d5/08ea07bfc16ba218dc65a3a7ef9b6a270530bcbd2cea2ee1ca
56.85 Successfully built flash-attn
57.11 Installing collected packages: einops, flash-attn
60.49 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
60.49 Successfully installed einops-0.8.1 flash-attn-2.7.4.post1
60.97 Using pip 24.0 from /opt/conda/lib/python3.10/site-packages/pip (python 3.10)
61.02 Processing /workspace/ktransformers
61.02 Preparing metadata (pyproject.toml): started
61.02 Running command Preparing metadata (pyproject.toml)
62.76 error: subprocess-exited-with-error
62.76
62.76 × Preparing metadata (pyproject.toml) did not run successfully.
62.76 │ exit code: -8
62.76 ╰─> See above for output.
62.76
62.76 note: This error originates from a subprocess, and is likely not a problem with pip.
62.76 full command: /opt/conda/bin/python /opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_wheel /tmp/tmpobqgwukl
62.76 cwd: /workspace/ktransformers
62.76 Preparing metadata (pyproject.toml): finished with status 'error'
62.76 error: metadata-generation-failed
62.76
62.76 × Encountered error while generating package metadata.
62.76 ╰─> See above for output.
62.76
62.76 note: This is an issue with the package mentioned above, not pip.
62.76 hint: See above for details.

3 warnings found (use docker --debug to expand):

  • LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15)
  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1)
  • FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13)
    Dockerfile:17

16 | COPY --from=web_compile /home/ktransformers /workspace/ktransformers

17 | >>> RUN <<EOF
18 | >>> apt update -y && apt install -y --no-install-recommends
19 | >>> git
20 | >>> wget
21 | >>> vim
22 | >>> gcc
23 | >>> g++
24 | >>> cmake &&
25 | >>> rm -rf /var/lib/apt/lists/* &&
26 | >>> cd ktransformers &&
27 | >>> git submodule init &&
28 | >>> git submodule update &&
29 | >>> pip install ninja pyproject numpy cpufeature &&
30 | >>> pip install flash-attn &&
31 | >>> CPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose &&
32 | >>> pip cache purge
33 | >>> EOF
34 |
ERROR: failed to solve: process "/bin/sh -c apt update -y && apt install -y --no-install-recommends \n git \n wget \n vim \n gcc \n g++ \n cmake && \nrm -rf /var/lib/apt/lists/* &&\ncd ktransformers &&\ngit submodule init &&\ngit submodule update &&\npip install ninja pyproject numpy cpufeature &&\npip install flash-attn &&\nCPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose &&\npip cache purge\n" did not complete successfully: exit code: 1

之前我们dockerfile没有验证支持,可能需要改改,我们尽快支持

<!-- gh-comment-id:2650367245 --> @KMSorSMS commented on GitHub (Feb 11, 2025): > ## 我打包的命令是docker build -t ktransformers:0.2.0 . --platform linux/amd64,我的M1的Mac,我的服务器连不了外网,我打算本地打包好上传到服务器,完整的日志如下: > [+] Building 63.3s (11/11) FINISHED docker:orbstack > => [internal] load build definition from Dockerfile 0.0s > => => transferring dockerfile: 1.01kB 0.0s > => WARN: FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1) 0.0s > => WARN: FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13) 0.0s > => WARN: LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15) 0.0s > => [internal] load metadata for docker.io/pytorch/pytorch:2.3.1-cuda12.1-cudnn8-devel 0.0s > => [internal] load metadata for docker.io/library/node:20.16.0 0.0s > => [internal] load .dockerignore 0.0s > => => transferring context: 2B 0.0s > => [web_compile 1/3] FROM docker.io/library/node:20.16.0 0.0s > => [compile_server 1/4] FROM docker.io/pytorch/pytorch:2.3.1-cuda12.1-cudnn8-devel 0.0s > => CACHED [compile_server 2/4] WORKDIR /workspace 0.0s > => CACHED [web_compile 2/3] WORKDIR /home 0.0s > => CACHED [web_compile 3/3] RUN <<EOF (git clone https://github.com/kvcache-ai/ktransformers.git &&...) 0.0s > => CACHED [compile_server 3/4] COPY --from=web_compile /home/ktransformers /workspace/ktransformers 0.0s > => ERROR [compile_server 4/4] RUN <<EOF (apt update -y && apt install -y --no-install-recommends ...) 63.2s > > [compile_server 4/4] RUN <<EOF (apt update -y && apt install -y --no-install-recommends ...): > > 0.182 > > 0.182 WARNING: apt does not have a stable CLI interface. Use with caution in scripts. > > 0.183 > > 0.558 Get:1 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 InRelease [1581 B] > > 0.898 Get:2 http://archive.ubuntu.com/ubuntu jammy InRelease [270 kB] > > 0.898 Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] > > 1.126 Get:4 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64 Packages [1311 kB] > > 1.995 Get:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] > > 2.298 Get:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] > > 2.513 Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [3606 kB] > > 3.228 Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 Packages [1792 kB] > > 3.756 Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2606 kB] > > 3.863 Get:10 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [45.2 kB] > > 3.867 Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1230 kB] > > 4.072 Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 Packages [17.5 MB] > > 5.056 Get:13 http://archive.ubuntu.com/ubuntu jammy/multiverse amd64 Packages [266 kB] > > 5.064 Get:14 http://archive.ubuntu.com/ubuntu jammy/restricted amd64 Packages [164 kB] > > 5.294 Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2911 kB] > > 5.383 Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1526 kB] > > 5.496 Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [53.3 kB] > > 5.505 Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [3748 kB] > > 6.009 Get:19 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [81.4 kB] > > 6.252 Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [35.2 kB] > > 6.745 Fetched 37.5 MB in 6s (5816 kB/s) > > 6.745 Reading package lists... > > 7.587 Building dependency tree... > > 7.742 Reading state information... > > 7.756 64 packages can be upgraded. Run 'apt list --upgradable' to see them. > > 7.782 > > 7.783 WARNING: apt does not have a stable CLI interface. Use with caution in scripts. > > 7.783 > > 7.877 Reading package lists... > > 8.614 Building dependency tree... > > 8.800 Reading state information... > > 9.013 g++ is already the newest version (4:11.2.0-1ubuntu1). > > 9.013 g++ set to manually installed. > > 9.013 gcc is already the newest version (4:11.2.0-1ubuntu1). > > 9.013 gcc set to manually installed. > > 9.013 The following additional packages will be installed: > > 9.013 cmake-data dh-elpa-helper emacsen-common git-man libarchive13 libbrotli1 > > 9.013 libcurl3-gnutls libcurl4 liberror-perl libexpat1 libgpm2 libicu70 > > 9.013 libjsoncpp25 libmpdec3 libnghttp2-14 libpsl5 libpython3.10 > > 9.013 libpython3.10-minimal libpython3.10-stdlib librhash0 librtmp1 libsodium23 > > 9.013 libssh-4 libuv1 libxml2 media-types vim-common vim-runtime xxd > > 9.014 Suggested packages: > > 9.014 cmake-doc ninja-build cmake-format gettext-base git-daemon-run > > 9.014 | git-daemon-sysvinit git-doc git-email git-gui gitk gitweb git-cvs > > 9.015 git-mediawiki git-svn lrzip gpm ctags vim-doc vim-scripts > > 9.015 Recommended packages: > > 9.015 less ssh-client publicsuffix > > 9.118 The following NEW packages will be installed: > > 9.119 cmake cmake-data dh-elpa-helper emacsen-common git git-man libarchive13 > > 9.119 libbrotli1 libcurl3-gnutls libcurl4 liberror-perl libexpat1 libgpm2 libicu70 > > 9.119 libjsoncpp25 libmpdec3 libnghttp2-14 libpsl5 libpython3.10 > > 9.119 libpython3.10-minimal libpython3.10-stdlib librhash0 librtmp1 libsodium23 > > 9.120 libssh-4 libuv1 libxml2 media-types vim vim-common vim-runtime wget xxd > > 9.667 0 upgraded, 33 newly installed, 0 to remove and 64 not upgraded. > > 9.667 Need to get 38.4 MB of archives. > > 9.667 After this operation, 155 MB of additional disk space will be used. > > 9.667 Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libexpat1 amd64 2.4.7-1ubuntu0.5 [91.5 kB] > > 10.46 Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu70 amd64 70.1-2 [10.6 MB] > > 11.93 Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmpdec3 amd64 2.5.1-2build2 [86.8 kB] > > 11.94 Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-minimal amd64 3.10.12-1~22.04.8 [815 kB] > > 11.96 Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 media-types all 7.0.0 [25.5 kB] > > 11.96 Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-stdlib amd64 3.10.12-1~22.04.8 [1850 kB] > > 12.05 Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxml2 amd64 2.9.13+dfsg-1ubuntu0.5 [763 kB] > > 12.09 Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 xxd amd64 2:8.2.3995-1ubuntu2.23 [51.7 kB] > > 12.10 Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim-common all 2:8.2.3995-1ubuntu2.23 [81.5 kB] > > 12.10 Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnghttp2-14 amd64 1.43.0-1ubuntu0.2 [76.9 kB] > > 12.10 Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libpsl5 amd64 0.21.0-1.2build2 [58.4 kB] > > 12.17 Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuv1 amd64 1.43.0-1ubuntu0.1 [92.7 kB] > > 12.18 Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wget amd64 1.21.2-2ubuntu1.1 [339 kB] > > 12.20 Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libarchive13 amd64 3.6.0-1ubuntu1.3 [369 kB] > > 12.21 Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbrotli1 amd64 1.0.9-2build6 [315 kB] > > 12.28 Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d.1-2build4 [58.2 kB] > > 12.35 Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssh-4 amd64 0.9.6-2ubuntu0.22.04.3 [186 kB] > > 12.35 Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl4 amd64 7.81.0-1ubuntu1.20 [289 kB] > > 12.36 Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjsoncpp25 amd64 1.9.5-3 [80.0 kB] > > 12.36 Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 librhash0 amd64 1.4.2-1ubuntu1 [125 kB] > > 12.36 Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 dh-elpa-helper all 2.0.9ubuntu1 [7610 B] > > 12.41 Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 emacsen-common all 3.0.4 [14.9 kB] > > 12.43 Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 cmake-data all 3.22.1-1ubuntu1.22.04.2 [1913 kB] > > 12.48 Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 cmake amd64 3.22.1-1ubuntu1.22.04.2 [5010 kB] > > 12.88 Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl3-gnutls amd64 7.81.0-1ubuntu1.20 [284 kB] > > 12.88 Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liberror-perl all 0.17029-1 [26.5 kB] > > 12.89 Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git-man all 1:2.34.1-1ubuntu1.12 [955 kB] > > 12.91 Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 git amd64 1:2.34.1-1ubuntu1.12 [3165 kB] > > 13.08 Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgpm2 amd64 1.20.7-10build1 [15.3 kB] > > 13.08 Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10 amd64 3.10.12-1~22.04.8 [1949 kB] > > 13.33 Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsodium23 amd64 1.0.18-1build2 [164 kB] > > 13.33 Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim-runtime all 2:8.2.3995-1ubuntu2.23 [6833 kB] > > 13.70 Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 vim amd64 2:8.2.3995-1ubuntu2.23 [1732 kB] > > 14.05 debconf: delaying package configuration, since apt-utils is not installed > > 14.10 Fetched 38.4 MB in 5s (8264 kB/s) > > 14.21 Selecting previously unselected package libexpat1:amd64. > > (Reading database ... 14428 files and directories currently installed.) > > 14.23 Preparing to unpack .../00-libexpat1_2.4.7-1ubuntu0.5_amd64.deb ... > > 14.27 Unpacking libexpat1:amd64 (2.4.7-1ubuntu0.5) ... > > 14.39 Selecting previously unselected package libicu70:amd64. > > 14.39 Preparing to unpack .../01-libicu70_70.1-2_amd64.deb ... > > 14.39 Unpacking libicu70:amd64 (70.1-2) ... > > 14.63 Selecting previously unselected package libmpdec3:amd64. > > 14.64 Preparing to unpack .../02-libmpdec3_2.5.1-2build2_amd64.deb ... > > 14.64 Unpacking libmpdec3:amd64 (2.5.1-2build2) ... > > 14.74 Selecting previously unselected package libpython3.10-minimal:amd64. > > 14.74 Preparing to unpack .../03-libpython3.10-minimal_3.10.12-1~22.04.8_amd64.deb ... > > 14.75 Unpacking libpython3.10-minimal:amd64 (3.10.12-1~22.04.8) ... > > 14.89 Selecting previously unselected package media-types. > > 14.90 Preparing to unpack .../04-media-types_7.0.0_all.deb ... > > 14.90 Unpacking media-types (7.0.0) ... > > 15.01 Selecting previously unselected package libpython3.10-stdlib:amd64. > > 15.01 Preparing to unpack .../05-libpython3.10-stdlib_3.10.12-1~22.04.8_amd64.deb ... > > 15.01 Unpacking libpython3.10-stdlib:amd64 (3.10.12-1~22.04.8) ... > > 15.17 Selecting previously unselected package libxml2:amd64. > > 15.17 Preparing to unpack .../06-libxml2_2.9.13+dfsg-1ubuntu0.5_amd64.deb ... > > 15.18 Unpacking libxml2:amd64 (2.9.13+dfsg-1ubuntu0.5) ... > > 15.29 Selecting previously unselected package xxd. > > 15.29 Preparing to unpack .../07-xxd_2%3a8.2.3995-1ubuntu2.23_amd64.deb ... > > 15.29 Unpacking xxd (2:8.2.3995-1ubuntu2.23) ... > > 15.41 Selecting previously unselected package vim-common. > > 15.41 Preparing to unpack .../08-vim-common_2%3a8.2.3995-1ubuntu2.23_all.deb ... > > 15.47 Unpacking vim-common (2:8.2.3995-1ubuntu2.23) ... > > 15.59 Selecting previously unselected package libnghttp2-14:amd64. > > 15.59 Preparing to unpack .../09-libnghttp2-14_1.43.0-1ubuntu0.2_amd64.deb ... > > 15.59 Unpacking libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ... > > 15.70 Selecting previously unselected package libpsl5:amd64. > > 15.70 Preparing to unpack .../10-libpsl5_0.21.0-1.2build2_amd64.deb ... > > 15.70 Unpacking libpsl5:amd64 (0.21.0-1.2build2) ... > > 15.81 Selecting previously unselected package libuv1:amd64. > > 15.81 Preparing to unpack .../11-libuv1_1.43.0-1ubuntu0.1_amd64.deb ... > > 15.81 Unpacking libuv1:amd64 (1.43.0-1ubuntu0.1) ... > > 15.92 Selecting previously unselected package wget. > > 15.92 Preparing to unpack .../12-wget_1.21.2-2ubuntu1.1_amd64.deb ... > > 15.93 Unpacking wget (1.21.2-2ubuntu1.1) ... > > 16.04 Selecting previously unselected package libarchive13:amd64. > > 16.04 Preparing to unpack .../13-libarchive13_3.6.0-1ubuntu1.3_amd64.deb ... > > 16.04 Unpacking libarchive13:amd64 (3.6.0-1ubuntu1.3) ... > > 16.16 Selecting previously unselected package libbrotli1:amd64. > > 16.16 Preparing to unpack .../14-libbrotli1_1.0.9-2build6_amd64.deb ... > > 16.16 Unpacking libbrotli1:amd64 (1.0.9-2build6) ... > > 16.28 Selecting previously unselected package librtmp1:amd64. > > 16.28 Preparing to unpack .../15-librtmp1_2.4+20151223.gitfa8646d.1-2build4_amd64.deb ... > > 16.28 Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ... > > 16.39 Selecting previously unselected package libssh-4:amd64. > > 16.39 Preparing to unpack .../16-libssh-4_0.9.6-2ubuntu0.22.04.3_amd64.deb ... > > 16.39 Unpacking libssh-4:amd64 (0.9.6-2ubuntu0.22.04.3) ... > > 16.51 Selecting previously unselected package libcurl4:amd64. > > 16.51 Preparing to unpack .../17-libcurl4_7.81.0-1ubuntu1.20_amd64.deb ... > > 16.51 Unpacking libcurl4:amd64 (7.81.0-1ubuntu1.20) ... > > 16.62 Selecting previously unselected package libjsoncpp25:amd64. > > 16.62 Preparing to unpack .../18-libjsoncpp25_1.9.5-3_amd64.deb ... > > 16.62 Unpacking libjsoncpp25:amd64 (1.9.5-3) ... > > 16.73 Selecting previously unselected package librhash0:amd64. > > 16.73 Preparing to unpack .../19-librhash0_1.4.2-1ubuntu1_amd64.deb ... > > 16.73 Unpacking librhash0:amd64 (1.4.2-1ubuntu1) ... > > 16.84 Selecting previously unselected package dh-elpa-helper. > > 16.84 Preparing to unpack .../20-dh-elpa-helper_2.0.9ubuntu1_all.deb ... > > 16.84 Unpacking dh-elpa-helper (2.0.9ubuntu1) ... > > 16.95 Selecting previously unselected package emacsen-common. > > 16.95 Preparing to unpack .../21-emacsen-common_3.0.4_all.deb ... > > 17.06 Unpacking emacsen-common (3.0.4) ... > > 17.18 Selecting previously unselected package cmake-data. > > 17.18 Preparing to unpack .../22-cmake-data_3.22.1-1ubuntu1.22.04.2_all.deb ... > > 17.24 Unpacking cmake-data (3.22.1-1ubuntu1.22.04.2) ... > > 17.49 Selecting previously unselected package cmake. > > 17.49 Preparing to unpack .../23-cmake_3.22.1-1ubuntu1.22.04.2_amd64.deb ... > > 17.50 Unpacking cmake (3.22.1-1ubuntu1.22.04.2) ... > > 17.70 Selecting previously unselected package libcurl3-gnutls:amd64. > > 17.70 Preparing to unpack .../24-libcurl3-gnutls_7.81.0-1ubuntu1.20_amd64.deb ... > > 17.70 Unpacking libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.20) ... > > 17.81 Selecting previously unselected package liberror-perl. > > 17.81 Preparing to unpack .../25-liberror-perl_0.17029-1_all.deb ... > > 17.81 Unpacking liberror-perl (0.17029-1) ... > > 17.92 Selecting previously unselected package git-man. > > 17.92 Preparing to unpack .../26-git-man_1%3a2.34.1-1ubuntu1.12_all.deb ... > > 17.92 Unpacking git-man (1:2.34.1-1ubuntu1.12) ... > > 18.04 Selecting previously unselected package git. > > 18.04 Preparing to unpack .../27-git_1%3a2.34.1-1ubuntu1.12_amd64.deb ... > > 18.11 Unpacking git (1:2.34.1-1ubuntu1.12) ... > > 18.27 Selecting previously unselected package libgpm2:amd64. > > 18.27 Preparing to unpack .../28-libgpm2_1.20.7-10build1_amd64.deb ... > > 18.28 Unpacking libgpm2:amd64 (1.20.7-10build1) ... > > 18.38 Selecting previously unselected package libpython3.10:amd64. > > 18.38 Preparing to unpack .../29-libpython3.10_3.10.12-1~22.04.8_amd64.deb ... > > 18.38 Unpacking libpython3.10:amd64 (3.10.12-1~22.04.8) ... > > 18.52 Selecting previously unselected package libsodium23:amd64. > > 18.52 Preparing to unpack .../30-libsodium23_1.0.18-1build2_amd64.deb ... > > 18.52 Unpacking libsodium23:amd64 (1.0.18-1build2) ... > > 18.63 Selecting previously unselected package vim-runtime. > > 18.63 Preparing to unpack .../31-vim-runtime_2%3a8.2.3995-1ubuntu2.23_all.deb ... > > 18.69 Adding 'diversion of /usr/share/vim/vim82/doc/help.txt to /usr/share/vim/vim82/doc/help.txt.vim-tiny by vim-runtime' > > 18.71 Adding 'diversion of /usr/share/vim/vim82/doc/tags to /usr/share/vim/vim82/doc/tags.vim-tiny by vim-runtime' > > 18.72 Unpacking vim-runtime (2:8.2.3995-1ubuntu2.23) ... > > 19.04 Selecting previously unselected package vim. > > 19.04 Preparing to unpack .../32-vim_2%3a8.2.3995-1ubuntu2.23_amd64.deb ... > > 19.11 Unpacking vim (2:8.2.3995-1ubuntu2.23) ... > > 19.21 Setting up libexpat1:amd64 (2.4.7-1ubuntu0.5) ... > > 19.23 Setting up media-types (7.0.0) ... > > 19.25 Setting up libpsl5:amd64 (0.21.0-1.2build2) ... > > 19.26 Setting up libsodium23:amd64 (1.0.18-1build2) ... > > 19.26 Setting up libgpm2:amd64 (1.20.7-10build1) ... > > 19.27 Setting up wget (1.21.2-2ubuntu1.1) ... > > 19.28 Setting up libbrotli1:amd64 (1.0.9-2build6) ... > > 19.28 Setting up libnghttp2-14:amd64 (1.43.0-1ubuntu0.2) ... > > 19.29 Setting up xxd (2:8.2.3995-1ubuntu2.23) ... > > 19.29 Setting up liberror-perl (0.17029-1) ... > > 19.30 Setting up libuv1:amd64 (1.43.0-1ubuntu0.1) ... > > 19.30 Setting up vim-common (2:8.2.3995-1ubuntu2.23) ... > > 19.37 Setting up emacsen-common (3.0.4) ... > > 19.63 Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d.1-2build4) ... > > 19.64 Setting up dh-elpa-helper (2.0.9ubuntu1) ... > > 19.65 Setting up libpython3.10-minimal:amd64 (3.10.12-1~22.04.8) ... > > 19.67 Setting up libjsoncpp25:amd64 (1.9.5-3) ... > > 19.68 Setting up libssh-4:amd64 (0.9.6-2ubuntu0.22.04.3) ... > > 19.69 Setting up librhash0:amd64 (1.4.2-1ubuntu1) ... > > 19.69 Setting up libmpdec3:amd64 (2.5.1-2build2) ... > > 19.70 Setting up libcurl4:amd64 (7.81.0-1ubuntu1.20) ... > > 19.70 Setting up git-man (1:2.34.1-1ubuntu1.12) ... > > 19.71 Setting up cmake-data (3.22.1-1ubuntu1.22.04.2) ... > > 19.95 Setting up vim-runtime (2:8.2.3995-1ubuntu2.23) ... > > 20.54 Setting up libicu70:amd64 (70.1-2) ... > > 20.55 Setting up libcurl3-gnutls:amd64 (7.81.0-1ubuntu1.20) ... > > 20.56 Setting up libpython3.10-stdlib:amd64 (3.10.12-1~22.04.8) ... > > 20.57 Setting up git (1:2.34.1-1ubuntu1.12) ... > > 20.63 Setting up libxml2:amd64 (2.9.13+dfsg-1ubuntu0.5) ... > > 20.64 Setting up libpython3.10:amd64 (3.10.12-1~22.04.8) ... > > 20.65 Setting up vim (2:8.2.3995-1ubuntu2.23) ... > > 20.68 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vim (vim) in auto mode > > 20.70 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vimdiff (vimdiff) in auto mode > > 20.72 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/rvim (rvim) in auto mode > > 20.74 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/rview (rview) in auto mode > > 20.76 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/vi (vi) in auto mode > > 20.76 update-alternatives: warning: skip creation of /usr/share/man/da/man1/vi.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group vi) doesn't exist > > 20.76 update-alternatives: warning: skip creation of /usr/share/man/de/man1/vi.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group vi) doesn't exist > > 20.76 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/vi.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group vi) doesn't exist > > 20.76 update-alternatives: warning: skip creation of /usr/share/man/it/man1/vi.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group vi) doesn't exist > > 20.76 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/vi.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group vi) doesn't exist > > 20.76 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/vi.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group vi) doesn't exist > > 20.76 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/vi.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group vi) doesn't exist > > 20.76 update-alternatives: warning: skip creation of /usr/share/man/man1/vi.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group vi) doesn't exist > > 20.78 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/view (view) in auto mode > > 20.78 update-alternatives: warning: skip creation of /usr/share/man/da/man1/view.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group view) doesn't exist > > 20.78 update-alternatives: warning: skip creation of /usr/share/man/de/man1/view.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group view) doesn't exist > > 20.78 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/view.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group view) doesn't exist > > 20.78 update-alternatives: warning: skip creation of /usr/share/man/it/man1/view.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group view) doesn't exist > > 20.78 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/view.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group view) doesn't exist > > 20.78 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/view.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group view) doesn't exist > > 20.78 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/view.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group view) doesn't exist > > 20.78 update-alternatives: warning: skip creation of /usr/share/man/man1/view.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group view) doesn't exist > > 20.80 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/ex (ex) in auto mode > > 20.80 update-alternatives: warning: skip creation of /usr/share/man/da/man1/ex.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group ex) doesn't exist > > 20.80 update-alternatives: warning: skip creation of /usr/share/man/de/man1/ex.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group ex) doesn't exist > > 20.80 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/ex.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group ex) doesn't exist > > 20.80 update-alternatives: warning: skip creation of /usr/share/man/it/man1/ex.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group ex) doesn't exist > > 20.80 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/ex.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group ex) doesn't exist > > 20.80 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/ex.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group ex) doesn't exist > > 20.80 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/ex.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group ex) doesn't exist > > 20.80 update-alternatives: warning: skip creation of /usr/share/man/man1/ex.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group ex) doesn't exist > > 20.82 update-alternatives: using /usr/bin/vim.basic to provide /usr/bin/editor (editor) in auto mode > > 20.82 update-alternatives: warning: skip creation of /usr/share/man/da/man1/editor.1.gz because associated file /usr/share/man/da/man1/vim.1.gz (of link group editor) doesn't exist > > 20.82 update-alternatives: warning: skip creation of /usr/share/man/de/man1/editor.1.gz because associated file /usr/share/man/de/man1/vim.1.gz (of link group editor) doesn't exist > > 20.82 update-alternatives: warning: skip creation of /usr/share/man/fr/man1/editor.1.gz because associated file /usr/share/man/fr/man1/vim.1.gz (of link group editor) doesn't exist > > 20.82 update-alternatives: warning: skip creation of /usr/share/man/it/man1/editor.1.gz because associated file /usr/share/man/it/man1/vim.1.gz (of link group editor) doesn't exist > > 20.82 update-alternatives: warning: skip creation of /usr/share/man/ja/man1/editor.1.gz because associated file /usr/share/man/ja/man1/vim.1.gz (of link group editor) doesn't exist > > 20.82 update-alternatives: warning: skip creation of /usr/share/man/pl/man1/editor.1.gz because associated file /usr/share/man/pl/man1/vim.1.gz (of link group editor) doesn't exist > > 20.82 update-alternatives: warning: skip creation of /usr/share/man/ru/man1/editor.1.gz because associated file /usr/share/man/ru/man1/vim.1.gz (of link group editor) doesn't exist > > 20.82 update-alternatives: warning: skip creation of /usr/share/man/man1/editor.1.gz because associated file /usr/share/man/man1/vim.1.gz (of link group editor) doesn't exist > > 20.87 Setting up libarchive13:amd64 (3.6.0-1ubuntu1.3) ... > > 20.88 Setting up cmake (3.22.1-1ubuntu1.22.04.2) ... > > 20.89 Processing triggers for libc-bin (2.35-0ubuntu3.4) ... > > 21.39 Submodule 'third_party/llama.cpp' (https://github.com/ggerganov/llama.cpp.git) registered for path 'third_party/llama.cpp' > > 21.39 Submodule 'third_party/pybind11' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind11' > > 21.75 Cloning into '/workspace/ktransformers/third_party/llama.cpp'... > > 35.59 Cloning into '/workspace/ktransformers/third_party/pybind11'... > > 39.25 Submodule path 'third_party/llama.cpp': checked out 'a94e6ff8774b7c9f950d9545baf0ce35e8d1ed2f' > > 39.46 Submodule path 'third_party/pybind11': checked out 'bb05e0810b87e74709d9f4c4545f1f57a1b386f5' > > 40.10 Collecting ninja > > 40.25 Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (5.3 kB) > > 40.58 Collecting pyproject > > 40.63 Downloading pyproject-1.3.1.tar.gz (7.9 kB) > > 40.66 Preparing metadata (setup.py): started > > 40.91 Preparing metadata (setup.py): finished with status 'done' > > 40.91 Requirement already satisfied: numpy in /opt/conda/lib/python3.10/site-packages (1.26.4) > > 40.98 Collecting cpufeature > > 41.03 Downloading cpufeature-0.2.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.4 kB) > > 41.04 Requirement already satisfied: Jinja2 in /opt/conda/lib/python3.10/site-packages (from pyproject) (3.1.4) > > 41.04 Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from Jinja2->pyproject) (2.1.3) > > 41.09 Downloading ninja-1.11.1.3-py3-none-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (422 kB) > > 41.27 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 422.9/422.9 kB 2.7 MB/s eta 0:00:00 > > 41.32 Downloading cpufeature-0.2.1-cp310-cp310-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB) > > 41.36 Building wheels for collected packages: pyproject > > 41.36 Building wheel for pyproject (setup.py): started > > 41.66 Building wheel for pyproject (setup.py): finished with status 'done' > > 41.66 Created wheel for pyproject: filename=pyproject-1.3.1-py3-none-any.whl size=10995 sha256=0f31e87acb4ae8e740c221a2d7ab37a8cba3e3819b4225f4a8106b3efd1ba78a > > 41.66 Stored in directory: /root/.cache/pip/wheels/cb/2b/08/d805f476ee6c6e5cbfdca7ef80ab540d7eb75471e3b2c9065b > > 41.66 Successfully built pyproject > > 42.00 Installing collected packages: cpufeature, ninja, pyproject > > 42.06 Successfully installed cpufeature-0.2.1 ninja-1.11.1.3 pyproject-1.3.1 > > 42.06 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv > > 42.93 Collecting flash-attn > > 43.09 Downloading flash_attn-2.7.4.post1.tar.gz (6.0 MB) > > 43.49 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.0/6.0 MB 16.7 MB/s eta 0:00:00 > > 44.48 Preparing metadata (setup.py): started > > 47.69 Preparing metadata (setup.py): finished with status 'done' > > 47.70 Requirement already satisfied: torch in /opt/conda/lib/python3.10/site-packages (from flash-attn) (2.3.1) > > 47.77 Collecting einops (from flash-attn) > > 47.82 Downloading einops-0.8.1-py3-none-any.whl.metadata (13 kB) > > 47.84 Requirement already satisfied: filelock in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.13.1) > > 47.84 Requirement already satisfied: typing-extensions>=4.8.0 in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (4.11.0) > > 47.84 Requirement already satisfied: sympy in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (1.12.1) > > 47.84 Requirement already satisfied: networkx in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.2.1) > > 47.84 Requirement already satisfied: jinja2 in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (3.1.4) > > 47.84 Requirement already satisfied: fsspec in /opt/conda/lib/python3.10/site-packages (from torch->flash-attn) (2024.6.0) > > 47.91 Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/lib/python3.10/site-packages (from jinja2->torch->flash-attn) (2.1.3) > > 47.93 Requirement already satisfied: mpmath<1.4.0,>=1.1.0 in /opt/conda/lib/python3.10/site-packages (from sympy->torch->flash-attn) (1.3.0) > > 47.98 Downloading einops-0.8.1-py3-none-any.whl (64 kB) > > 47.99 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.4/64.4 kB 5.2 MB/s eta 0:00:00 > > 48.00 Building wheels for collected packages: flash-attn > > 48.00 Building wheel for flash-attn (setup.py): started > > 56.33 Building wheel for flash-attn (setup.py): finished with status 'done' > > 56.84 Created wheel for flash-attn: filename=flash_attn-2.7.4.post1-cp310-cp310-linux_x86_64.whl size=187765791 sha256=b0caacfaca0dcb2684ef7f11a362afa695e69ace6cbb1feea69a097de7a46f58 > > 56.85 Stored in directory: /root/.cache/pip/wheels/59/ce/d5/08ea07bfc16ba218dc65a3a7ef9b6a270530bcbd2cea2ee1ca > > 56.85 Successfully built flash-attn > > 57.11 Installing collected packages: einops, flash-attn > > 60.49 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv > > 60.49 Successfully installed einops-0.8.1 flash-attn-2.7.4.post1 > > 60.97 Using pip 24.0 from /opt/conda/lib/python3.10/site-packages/pip (python 3.10) > > 61.02 Processing /workspace/ktransformers > > 61.02 Preparing metadata (pyproject.toml): started > > 61.02 Running command Preparing metadata (pyproject.toml) > > 62.76 error: subprocess-exited-with-error > > 62.76 > > 62.76 × Preparing metadata (pyproject.toml) did not run successfully. > > 62.76 │ exit code: -8 > > 62.76 ╰─> See above for output. > > 62.76 > > 62.76 note: This error originates from a subprocess, and is likely not a problem with pip. > > 62.76 full command: /opt/conda/bin/python /opt/conda/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py prepare_metadata_for_build_wheel /tmp/tmpobqgwukl > > 62.76 cwd: /workspace/ktransformers > > 62.76 Preparing metadata (pyproject.toml): finished with status 'error' > > 62.76 error: metadata-generation-failed > > 62.76 > > 62.76 × Encountered error while generating package metadata. > > 62.76 ╰─> See above for output. > > 62.76 > > 62.76 note: This is an issue with the package mentioned above, not pip. > > 62.76 hint: See above for details. > > 3 warnings found (use docker --debug to expand): > > * LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 15) > * FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 1) > * FromAsCasing: 'as' and 'FROM' keywords' casing do not match (line 13) > Dockerfile:17 > > ## 16 | COPY --from=web_compile /home/ktransformers /workspace/ktransformers > 17 | >>> RUN <<EOF > 18 | >>> apt update -y && apt install -y --no-install-recommends > 19 | >>> git > 20 | >>> wget > 21 | >>> vim > 22 | >>> gcc > 23 | >>> g++ > 24 | >>> cmake && > 25 | >>> rm -rf /var/lib/apt/lists/* && > 26 | >>> cd ktransformers && > 27 | >>> git submodule init && > 28 | >>> git submodule update && > 29 | >>> pip install ninja pyproject numpy cpufeature && > 30 | >>> pip install flash-attn && > 31 | >>> CPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose && > 32 | >>> pip cache purge > 33 | >>> EOF > 34 | > ERROR: failed to solve: process "/bin/sh -c apt update -y && apt install -y --no-install-recommends \\n git \\n wget \\n vim \\n gcc \\n g++ \\n cmake && \nrm -rf /var/lib/apt/lists/* &&\ncd ktransformers &&\ngit submodule init &&\ngit submodule update &&\npip install ninja pyproject numpy cpufeature &&\npip install flash-attn &&\nCPU_INSTRUCT=NATIVE KTRANSFORMERS_FORCE_BUILD=TRUE TORCH_CUDA_ARCH_LIST="8.0;8.6;8.7;8.9;9.0+PTX" pip install . --no-build-isolation --verbose &&\npip cache purge\n" did not complete successfully: exit code: 1 之前我们dockerfile没有验证支持,可能需要改改,我们尽快支持
Author
Owner

@zhyim0712 commented on GitHub (Feb 11, 2025):

好的好的,非常感谢

<!-- gh-comment-id:2650371817 --> @zhyim0712 commented on GitHub (Feb 11, 2025): 好的好的,非常感谢
Author
Owner

@ruifenggong commented on GitHub (Feb 12, 2025):

+1 ,求一个最新的docker镜像,自己pypi装了好久都不成功哦……

<!-- gh-comment-id:2652814432 --> @ruifenggong commented on GitHub (Feb 12, 2025): +1 ,求一个最新的docker镜像,自己pypi装了好久都不成功哦……
Author
Owner

@ErvinXie commented on GitHub (Dec 11, 2025):

This issue has been automatically closed due to inactivity for 60 days.

If you believe this issue is still relevant, please feel free to reopen it with additional information or context.

Thank you for your contribution to KTransformers!


此 issue 因超过 60 天无活动而被自动关闭。

如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。

感谢您对 KTransformers 的贡献!

<!-- gh-comment-id:3639882373 --> @ErvinXie commented on GitHub (Dec 11, 2025): This issue has been automatically closed due to inactivity for 60 days. If you believe this issue is still relevant, please feel free to reopen it with additional information or context. Thank you for your contribution to KTransformers! --- 此 issue 因超过 60 天无活动而被自动关闭。 如果您认为此问题仍然存在,请随时重新打开并提供更多信息或上下文。 感谢您对 KTransformers 的贡献!
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/ktransformers#76
No description provided.