[GH-ISSUE #54] build failed on ubuntu 22.04 #32

Closed
opened 2026-10-26 09:43:48 +00:00 by bsakaguchi · 11 comments
Owner

Originally created by @clicx on GitHub (Mar 3, 2025).
Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/54

[ 25%] Completed 'apache-arrow-cpp'
[ 25%] Built target apache-arrow-cpp
gmake: *** [Makefile:146: all] Error 2

Originally created by @clicx on GitHub (Mar 3, 2025). Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/54 [ 25%] Completed 'apache-arrow-cpp' [ 25%] Built target apache-arrow-cpp gmake: *** [Makefile:146: all] Error 2
Author
Owner

@daimashusheng commented on GitHub (Mar 3, 2025):

make sure the version of liburing on your machine is >= 2.3, if it isn't, please upgrade it and then retry
https://github.com/axboe/liburing/tree/liburing-2.5

<!-- gh-comment-id:2693513693 --> @daimashusheng commented on GitHub (Mar 3, 2025): make sure the version of liburing on your machine is >= 2.3, if it isn't, please upgrade it and then retry https://github.com/axboe/liburing/tree/liburing-2.5
Author
Owner

@huww98 commented on GitHub (Mar 3, 2025):

See https://github.com/deepseek-ai/3FS/issues/33#issuecomment-2692843447, Maybe you need more RAM, or limit the number of jobs for arrow

<!-- gh-comment-id:2693536130 --> @huww98 commented on GitHub (Mar 3, 2025): See https://github.com/deepseek-ai/3FS/issues/33#issuecomment-2692843447, Maybe you need more RAM, or limit the number of jobs for arrow
Author
Owner

@clicx commented on GitHub (Mar 3, 2025):

same issue after make install liburing, PS: make install seems installed same version as existing-> 2.10
same issue after applied #33, and ram is 64G, shouldn't be the RAM problem.
Is there any way to output more debug information?

<!-- gh-comment-id:2693595291 --> @clicx commented on GitHub (Mar 3, 2025): same issue after make install liburing, PS: make install seems installed same version as existing-> 2.10 same issue after applied #33, and ram is 64G, shouldn't be the RAM problem. Is there any way to output more debug information?
Author
Owner

@szukeymaker commented on GitHub (Mar 3, 2025):

buiding in docker ? add --privileged and try again

<!-- gh-comment-id:2693722383 --> @szukeymaker commented on GitHub (Mar 3, 2025): buiding in docker ? add --privileged and try again
Author
Owner

@diabloneo commented on GitHub (Mar 4, 2025):

Building in docker does not require using --privileged argument.

I have made a docker image for the building process and I have tested it:

https://hub.docker.com/repository/docker/diabloneo/3fs-build/general

<!-- gh-comment-id:2695962205 --> @diabloneo commented on GitHub (Mar 4, 2025): Building in docker does not require using `--privileged` argument. I have made a docker image for the building process and I have tested it: https://hub.docker.com/repository/docker/diabloneo/3fs-build/general
Author
Owner

@shuiyihang commented on GitHub (Mar 4, 2025):

Building in docker does not require using --privileged argument.

I have made a docker image for the building process and I have tested it:

https://hub.docker.com/repository/docker/diabloneo/3fs-build/general

Have you tried running /opt/3fs/bin/monitor_collector_main --cfg /opt/3fs/etc/monitor_collector_main.toml

Are there any problems?

Image

<!-- gh-comment-id:2696398072 --> @shuiyihang commented on GitHub (Mar 4, 2025): > Building in docker does not require using `--privileged` argument. > > I have made a docker image for the building process and I have tested it: > > https://hub.docker.com/repository/docker/diabloneo/3fs-build/general Have you tried running `/opt/3fs/bin/monitor_collector_main --cfg /opt/3fs/etc/monitor_collector_main.toml` Are there any problems? ![Image](https://github.com/user-attachments/assets/40bdbdd0-6ed8-4119-9053-0798cfaa0ae6)
Author
Owner

@cat0dog commented on GitHub (Mar 4, 2025):

I meet the same problem

[ 51%] Completed 'apache-arrow-cpp'
[ 51%] Built target apache-arrow-cpp
gmake: *** [Makefile:146: all] Error 2
root@localhost:~/3fs# vim cmake/ApacheArrow.cmake
root@localhost:~/3fs# free -mh
               total        used        free      shared  buff/cache   available
Mem:           251Gi       3.2Gi       238Gi       3.0Mi         9Gi       246Gi
Swap:          8.0Gi          0B       8.0Gi
root@localhost:~/3fs# cat /etc/os-release
PRETTY_NAME="Ubuntu 22.04.3 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.3 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy
root@localhost:~/3fs# git log
commit fc90de11107ad37512e2e0f3885be077341cb46f (HEAD -> main, origin/main, origin/HEAD)
Author: SF-Zhou <sfzhou.scut@gmail.com>
Date:   Tue Mar 4 13:28:01 2025 +0800

    Fix build parallel for arrow (#70)

    Co-authored-by: dev <noreply@deepseek.com>
<!-- gh-comment-id:2696631846 --> @cat0dog commented on GitHub (Mar 4, 2025): I meet the same problem ```bash [ 51%] Completed 'apache-arrow-cpp' [ 51%] Built target apache-arrow-cpp gmake: *** [Makefile:146: all] Error 2 root@localhost:~/3fs# vim cmake/ApacheArrow.cmake root@localhost:~/3fs# free -mh total used free shared buff/cache available Mem: 251Gi 3.2Gi 238Gi 3.0Mi 9Gi 246Gi Swap: 8.0Gi 0B 8.0Gi root@localhost:~/3fs# cat /etc/os-release PRETTY_NAME="Ubuntu 22.04.3 LTS" NAME="Ubuntu" VERSION_ID="22.04" VERSION="22.04.3 LTS (Jammy Jellyfish)" VERSION_CODENAME=jammy ID=ubuntu ID_LIKE=debian HOME_URL="https://www.ubuntu.com/" SUPPORT_URL="https://help.ubuntu.com/" BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" UBUNTU_CODENAME=jammy root@localhost:~/3fs# git log commit fc90de11107ad37512e2e0f3885be077341cb46f (HEAD -> main, origin/main, origin/HEAD) Author: SF-Zhou <sfzhou.scut@gmail.com> Date: Tue Mar 4 13:28:01 2025 +0800 Fix build parallel for arrow (#70) Co-authored-by: dev <noreply@deepseek.com> ```
Author
Owner

@baijing0818 commented on GitHub (Mar 4, 2025):

这都是网络问题,我在本地(带科学上网的)机器上编译以及打包到docker都正常,但是,在云上开机器,有IB网络的,准备测试,就遇到了问题,建议在有科学上网的地址下打包编译,在云上运行

<!-- gh-comment-id:2696685196 --> @baijing0818 commented on GitHub (Mar 4, 2025): 这都是网络问题,我在本地(带科学上网的)机器上编译以及打包到docker都正常,但是,在云上开机器,有IB网络的,准备测试,就遇到了问题,建议在有科学上网的地址下打包编译,在云上运行
Author
Owner

@cat0dog commented on GitHub (Mar 4, 2025):

I meet the same problem

[ 51%] Completed 'apache-arrow-cpp'
[ 51%] Built target apache-arrow-cpp
gmake: *** [Makefile:146: all] Error 2
root@localhost:/3fs# vim cmake/ApacheArrow.cmake
root@localhost:
/3fs# free -mh
total used free shared buff/cache available
Mem: 251Gi 3.2Gi 238Gi 3.0Mi 9Gi 246Gi
Swap: 8.0Gi 0B 8.0Gi
root@localhost:/3fs# cat /etc/os-release
PRETTY_NAME="Ubuntu 22.04.3 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.3 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy
root@localhost:
/3fs# git log
commit fc90de1110 (HEAD -> main, origin/main, origin/HEAD)
Author: SF-Zhou sfzhou.scut@gmail.com
Date: Tue Mar 4 13:28:01 2025 +0800

Fix build parallel for arrow (#70)

Co-authored-by: dev <noreply@deepseek.com>

Resolved.
use cmake --build build -j 1 to see the real problem.
In my case, i forget to source rust env

<!-- gh-comment-id:2696709261 --> @cat0dog commented on GitHub (Mar 4, 2025): > I meet the same problem > > [ 51%] Completed 'apache-arrow-cpp' > [ 51%] Built target apache-arrow-cpp > gmake: *** [Makefile:146: all] Error 2 > root@localhost:~/3fs# vim cmake/ApacheArrow.cmake > root@localhost:~/3fs# free -mh > total used free shared buff/cache available > Mem: 251Gi 3.2Gi 238Gi 3.0Mi 9Gi 246Gi > Swap: 8.0Gi 0B 8.0Gi > root@localhost:~/3fs# cat /etc/os-release > PRETTY_NAME="Ubuntu 22.04.3 LTS" > NAME="Ubuntu" > VERSION_ID="22.04" > VERSION="22.04.3 LTS (Jammy Jellyfish)" > VERSION_CODENAME=jammy > ID=ubuntu > ID_LIKE=debian > HOME_URL="https://www.ubuntu.com/" > SUPPORT_URL="https://help.ubuntu.com/" > BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" > PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" > UBUNTU_CODENAME=jammy > root@localhost:~/3fs# git log > commit fc90de11107ad37512e2e0f3885be077341cb46f (HEAD -> main, origin/main, origin/HEAD) > Author: SF-Zhou <sfzhou.scut@gmail.com> > Date: Tue Mar 4 13:28:01 2025 +0800 > > Fix build parallel for arrow (#70) > > Co-authored-by: dev <noreply@deepseek.com> Resolved. use `cmake --build build -j 1` to see the real problem. In my case, i forget to source rust env
Author
Owner

@6607changchun commented on GitHub (Mar 5, 2025):

[ 25%] Completed 'apache-arrow-cpp' [ 25%] Built target apache-arrow-cpp gmake: *** [Makefile:146: all] Error 2

It seems that the error occurs far away from the output and you may scroll up to find it.

<!-- gh-comment-id:2699448961 --> @6607changchun commented on GitHub (Mar 5, 2025): > [ 25%] Completed 'apache-arrow-cpp' [ 25%] Built target apache-arrow-cpp gmake: *** [Makefile:146: all] Error 2 It seems that the error occurs far away from the output and you may scroll up to find it.
Author
Owner

@clicx commented on GitHub (Mar 5, 2025):

Resolved, reason is just lack some tool of the system, use -j 1 can see what's exactly the problem it is.

<!-- gh-comment-id:2700091266 --> @clicx commented on GitHub (Mar 5, 2025): Resolved, reason is just lack some tool of the system, use -j 1 can see what's exactly the problem it is.
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/3FS#32
No description provided.