deepseek-ai/3FS
1
0
Fork 0
mirror of https://github.com/deepseek-ai/3FS.git synced 2026-11-05 00:47:47 +00:00
Code Issues 166 Projects Packages Wiki Activity

[GH-ISSUE #100] Failed to list nodes by admin_cli #56

New issue
Open
opened 2026-10-26 09:44:16 +00:00 by bsakaguchi · 2 comments
bsakaguchi commented 2026-10-26 09:44:16 +00:00
Owner
Copy link

Originally created by @divinerapier on GitHub (Mar 5, 2025).
Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/100

Got an error after step 4.

sudo /opt/3fs/bin/admin_cli -cfg /opt/3fs/etc/admin_cli.toml --config.mgmtd_client.mgmtd_server_addresses '["RDMA://10.250.11.103:8000"]' "list-nodes"

*** Aborted at 1741162986 (Unix time, try 'date -d @1741162986') ***
*** Signal 6 (SIGABRT) (0x71ea5) received by PID 466597 (pthread TID 0x7fe6ab3f6700) (linux TID 466597) (maybe from PID 466597, UID 0) (code: -6), stack trace: ***
    @ 0000000001fe530f _ZN5folly10symbolizer12_GLOBAL__N_113signalHandlerEiP9siginfo_tPv
                       /mnt/code/3fs/third_party/folly/folly/experimental/symbolizer/SignalHandler.cpp:449
    @ 000000000004251f (unknown)
    @ 00000000000969fc pthread_kill
    @ 0000000000042475 raise
    @ 00000000000287f2 abort
    @ 000000000204c8b0 _ZNK5folly11LogCategory12admitMessageERKNS_10LogMessageE
                       /mnt/code/3fs/third_party/folly/folly/logging/LogCategory.cpp:71
    @ 000000000204bd66 _ZN5folly18LogStreamProcessor6logNowEv
                       /mnt/code/3fs/third_party/folly/folly/logging/LogStreamProcessor.cpp:190
    @ 000000000204bfb9 _ZN5folly16LogStreamVoidifyILb1EEanERSo
                       /mnt/code/3fs/third_party/folly/folly/logging/LogStreamProcessor.cpp:222
    @ 0000000002a2da97 _ZZZ4mainENK4$_12clEvENKUlvE_clEv
                       /mnt/code/3fs/src/client/bin/admin_cli.cc:107
    @ 0000000002a2d50b _ZZZ4mainENK4$_18clEvENKUlvE_clEv
                       /mnt/code/3fs/src/client/bin/admin_cli.cc:105
    @ 0000000002a42d34 _ZZZ4mainENK4$_19clEvENKUlvE_clEv
                       /mnt/code/3fs/src/client/bin/admin_cli.cc:118
    @ 0000000002a42601 _ZNSt17_Function_handlerIFSt10shared_ptrIN5hf3fs6client20IMgmtdClientForAdminEEvEZ4mainE3$_3E9_M_invokeERKSt9_Any_data
                       /mnt/code/3fs/src/client/bin/admin_cli.cc:127
    @ 0000000001888e87 _ZN5hf3fs6client3cli12_GLOBAL__N_115handleListNodesERNS1_4IEnvERKN8argparse14ArgumentParserERKSt6vectorINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaISF_EE.resume
                       /usr/bin/../lib/gcc/x86_64-linux-gnu/12/../../../../include/c++/12/bits/std_function.h:591
                       -> /mnt/code/3fs/src/client/cli/admin/ListNodes.cc
    @ 00000000020707c3 _ZN5folly36resumeCoroutineWithNewAsyncStackRootENSt7__n486116coroutine_handleIvEERNS_15AsyncStackFrameE
                       /usr/bin/../lib/gcc/x86_64-linux-gnu/12/../../../../include/c++/12/coroutine:135
                       -> /mnt/code/3fs/third_party/folly/folly/tracing/AsyncStack.cpp
    @ 0000000002a2c496 _ZN5folly6detail8function14FunctionTraitsIFvvEE9callSmallIZNOS_4coro6detail16BlockingWaitTaskIRNS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEE6getViaEPNS_16DrivableExecutorERNS_15AsyncStackFrameEEUlvE_EEvRNS1_4DataE
                       /mnt/code/3fs/third_party/folly/folly/tracing/AsyncStack-inl.h:88
                       -> /mnt/code/3fs/src/client/bin/admin_cli.cc
    @ 0000000002a2b70d _ZZN5folly4coro6detail20BlockingWaitExecutor5driveEvENKUlvE_clEv
                       /mnt/code/3fs/third_party/folly/folly/Function.h:375
                       -> /mnt/code/3fs/src/client/bin/admin_cli.cc
    @ 0000000002a2b073 _ZN5folly4coro6detail20BlockingWaitExecutor5driveEv
                       /mnt/code/3fs/third_party/folly/folly/fibers/FiberManagerInternal-inl.h:639
                       -> /mnt/code/3fs/src/client/bin/admin_cli.cc
    @ 0000000002a2c2c2 _ZNO5folly4coro6detail16BlockingWaitTaskIRNS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEE6getViaEPNS_16DrivableExecutorERNS_15AsyncStackFrameE
                       /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:235
                       -> /mnt/code/3fs/src/client/bin/admin_cli.cc
    @ 0000000002a2c13d _ZNK5folly4coro16blocking_wait_fnclINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEEEEENS0_6detail22decay_rvalue_referenceINS0_12await_resultIDTclL_ZNS0_11folly_cpo__13co_viaIfAsyncEEclL_ZSt7declvalINS_8Executor9KeepAliveISF_EEEDTcl9__declvalIT_ELi0EEEvEEclsr3stdE7declvalISI_EEEEvE4typeEE4typeEOSI_PNS_16DrivableExecutorE
                       /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:415
                       -> /mnt/code/3fs/src/client/bin/admin_cli.cc
    @ 000000000295fbb5 _ZNK5folly4coro16blocking_wait_fnclINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEEELi0EEENS0_6detail22decay_rvalue_referenceINS0_12await_resultIDTclL_ZNS0_11folly_cpo__13co_viaIfAsyncEEclL_ZSt7declvalINS_8Executor9KeepAliveISF_EEEDTcl9__declvalIT_ELi0EEEvEEclsr3stdE7declvalISI_EEEEvE4typeEE4typeEOSI_
                       /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:427
                       -> /mnt/code/3fs/src/client/bin/admin_cli.cc
    @ 000000000295d9ff main
                       /mnt/code/3fs/src/client/bin/admin_cli.cc:214
    @ 0000000000029d8f (unknown)
    @ 0000000000029e3f __libc_start_main
    @ 0000000001596f64 _start

*** Check failure async stack trace: ***
*** First async stack root: 0x7ffe08272c88, normal stack frame pointer holding async stack root: 0x7ffe08272cc0, return address: 0x5616e238f497 ***
*** First async stack frame pointer: 0x56171a110b28, return address: 0x5616e145ba52, async stack trace: ***
    @ 0000000001af8a52 _ZNK5hf3fs6client3cli10Dispatcher3runERNS1_4IEnvERKSt6vectorINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaISB_EE.resume
                       /mnt/code/3fs/src/client/cli/common/Dispatcher.cc:0
    @ 0000000001af97c4 _ZN5hf3fs6client3cli12_GLOBAL__N_17runLineB5cxx11ERNS1_4IEnvERNS1_10DispatcherESt17basic_string_viewIcSt11char_traitsIcEE.resume
                       /mnt/code/3fs/src/client/cli/common/Dispatcher.cc:0
    @ 0000000001afa9e6 _ZN5hf3fs6client3cli10Dispatcher3runERNS1_4IEnvERKSt8functionIFNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEvEESt17basic_string_viewIcS9_Ebbb.resume
                       /mnt/code/3fs/src/client/cli/common/Dispatcher.cc:0
    @ 0000000002a4a1d5 _ZZ4mainENK3$_8clEv.resume
                       /mnt/code/3fs/src/client/bin/admin_cli.cc:0
    @ 0000000002a49acd _ZN5folly4coro6detail23makeRefBlockingWaitTaskINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEE7AwaiterES8_Li0EEENS1_16BlockingWaitTaskINSt20add_lvalue_referenceIT0_E4typeEEEOT_.resume
                       /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:296
                       -> /mnt/code/3fs/src/client/bin/admin_cli.cc
    @ 0000000002a2c13e _ZNK5folly4coro16blocking_wait_fnclINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEEEEENS0_6detail22decay_rvalue_referenceINS0_12await_resultIDTclL_ZNS0_11folly_cpo__13co_viaIfAsyncEEclL_ZSt7declvalINS_8Executor9KeepAliveISF_EEEDTcl9__declvalIT_ELi0EEEvEEclsr3stdE7declvalISI_EEEEvE4typeEE4typeEOSI_PNS_16DrivableExecutorE
                       /mnt/code/3fs/third_party/folly/folly/Expected.h:366
                       -> /mnt/code/3fs/src/client/bin/admin_cli.cc
    @ 000000000295fbb6 _ZNK5folly4coro16blocking_wait_fnclINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEEELi0EEENS0_6detail22decay_rvalue_referenceINS0_12await_resultIDTclL_ZNS0_11folly_cpo__13co_viaIfAsyncEEclL_ZSt7declvalINS_8Executor9KeepAliveISF_EEEDTcl9__declvalIT_ELi0EEEvEEclsr3stdE7declvalISI_EEEEvE4typeEE4typeEOSI_
                       /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:301
                       -> /mnt/code/3fs/src/client/bin/admin_cli.cc
    @ 00007ffe082730b0 (not found)
Aborted
Originally created by @divinerapier on GitHub (Mar 5, 2025). Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/100 Got an error after [step 4](https://github.com/deepseek-ai/3FS/blob/main/deploy/README.md#step-4-mgmtd-service). ``` bash sudo /opt/3fs/bin/admin_cli -cfg /opt/3fs/etc/admin_cli.toml --config.mgmtd_client.mgmtd_server_addresses '["RDMA://10.250.11.103:8000"]' "list-nodes" ``` ``` log *** Aborted at 1741162986 (Unix time, try 'date -d @1741162986') *** *** Signal 6 (SIGABRT) (0x71ea5) received by PID 466597 (pthread TID 0x7fe6ab3f6700) (linux TID 466597) (maybe from PID 466597, UID 0) (code: -6), stack trace: *** @ 0000000001fe530f _ZN5folly10symbolizer12_GLOBAL__N_113signalHandlerEiP9siginfo_tPv /mnt/code/3fs/third_party/folly/folly/experimental/symbolizer/SignalHandler.cpp:449 @ 000000000004251f (unknown) @ 00000000000969fc pthread_kill @ 0000000000042475 raise @ 00000000000287f2 abort @ 000000000204c8b0 _ZNK5folly11LogCategory12admitMessageERKNS_10LogMessageE /mnt/code/3fs/third_party/folly/folly/logging/LogCategory.cpp:71 @ 000000000204bd66 _ZN5folly18LogStreamProcessor6logNowEv /mnt/code/3fs/third_party/folly/folly/logging/LogStreamProcessor.cpp:190 @ 000000000204bfb9 _ZN5folly16LogStreamVoidifyILb1EEanERSo /mnt/code/3fs/third_party/folly/folly/logging/LogStreamProcessor.cpp:222 @ 0000000002a2da97 _ZZZ4mainENK4$_12clEvENKUlvE_clEv /mnt/code/3fs/src/client/bin/admin_cli.cc:107 @ 0000000002a2d50b _ZZZ4mainENK4$_18clEvENKUlvE_clEv /mnt/code/3fs/src/client/bin/admin_cli.cc:105 @ 0000000002a42d34 _ZZZ4mainENK4$_19clEvENKUlvE_clEv /mnt/code/3fs/src/client/bin/admin_cli.cc:118 @ 0000000002a42601 _ZNSt17_Function_handlerIFSt10shared_ptrIN5hf3fs6client20IMgmtdClientForAdminEEvEZ4mainE3$_3E9_M_invokeERKSt9_Any_data /mnt/code/3fs/src/client/bin/admin_cli.cc:127 @ 0000000001888e87 _ZN5hf3fs6client3cli12_GLOBAL__N_115handleListNodesERNS1_4IEnvERKN8argparse14ArgumentParserERKSt6vectorINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaISF_EE.resume /usr/bin/../lib/gcc/x86_64-linux-gnu/12/../../../../include/c++/12/bits/std_function.h:591 -> /mnt/code/3fs/src/client/cli/admin/ListNodes.cc @ 00000000020707c3 _ZN5folly36resumeCoroutineWithNewAsyncStackRootENSt7__n486116coroutine_handleIvEERNS_15AsyncStackFrameE /usr/bin/../lib/gcc/x86_64-linux-gnu/12/../../../../include/c++/12/coroutine:135 -> /mnt/code/3fs/third_party/folly/folly/tracing/AsyncStack.cpp @ 0000000002a2c496 _ZN5folly6detail8function14FunctionTraitsIFvvEE9callSmallIZNOS_4coro6detail16BlockingWaitTaskIRNS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEE6getViaEPNS_16DrivableExecutorERNS_15AsyncStackFrameEEUlvE_EEvRNS1_4DataE /mnt/code/3fs/third_party/folly/folly/tracing/AsyncStack-inl.h:88 -> /mnt/code/3fs/src/client/bin/admin_cli.cc @ 0000000002a2b70d _ZZN5folly4coro6detail20BlockingWaitExecutor5driveEvENKUlvE_clEv /mnt/code/3fs/third_party/folly/folly/Function.h:375 -> /mnt/code/3fs/src/client/bin/admin_cli.cc @ 0000000002a2b073 _ZN5folly4coro6detail20BlockingWaitExecutor5driveEv /mnt/code/3fs/third_party/folly/folly/fibers/FiberManagerInternal-inl.h:639 -> /mnt/code/3fs/src/client/bin/admin_cli.cc @ 0000000002a2c2c2 _ZNO5folly4coro6detail16BlockingWaitTaskIRNS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEE6getViaEPNS_16DrivableExecutorERNS_15AsyncStackFrameE /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:235 -> /mnt/code/3fs/src/client/bin/admin_cli.cc @ 0000000002a2c13d _ZNK5folly4coro16blocking_wait_fnclINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEEEEENS0_6detail22decay_rvalue_referenceINS0_12await_resultIDTclL_ZNS0_11folly_cpo__13co_viaIfAsyncEEclL_ZSt7declvalINS_8Executor9KeepAliveISF_EEEDTcl9__declvalIT_ELi0EEEvEEclsr3stdE7declvalISI_EEEEvE4typeEE4typeEOSI_PNS_16DrivableExecutorE /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:415 -> /mnt/code/3fs/src/client/bin/admin_cli.cc @ 000000000295fbb5 _ZNK5folly4coro16blocking_wait_fnclINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEEELi0EEENS0_6detail22decay_rvalue_referenceINS0_12await_resultIDTclL_ZNS0_11folly_cpo__13co_viaIfAsyncEEclL_ZSt7declvalINS_8Executor9KeepAliveISF_EEEDTcl9__declvalIT_ELi0EEEvEEclsr3stdE7declvalISI_EEEEvE4typeEE4typeEOSI_ /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:427 -> /mnt/code/3fs/src/client/bin/admin_cli.cc @ 000000000295d9ff main /mnt/code/3fs/src/client/bin/admin_cli.cc:214 @ 0000000000029d8f (unknown) @ 0000000000029e3f __libc_start_main @ 0000000001596f64 _start *** Check failure async stack trace: *** *** First async stack root: 0x7ffe08272c88, normal stack frame pointer holding async stack root: 0x7ffe08272cc0, return address: 0x5616e238f497 *** *** First async stack frame pointer: 0x56171a110b28, return address: 0x5616e145ba52, async stack trace: *** @ 0000000001af8a52 _ZNK5hf3fs6client3cli10Dispatcher3runERNS1_4IEnvERKSt6vectorINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaISB_EE.resume /mnt/code/3fs/src/client/cli/common/Dispatcher.cc:0 @ 0000000001af97c4 _ZN5hf3fs6client3cli12_GLOBAL__N_17runLineB5cxx11ERNS1_4IEnvERNS1_10DispatcherESt17basic_string_viewIcSt11char_traitsIcEE.resume /mnt/code/3fs/src/client/cli/common/Dispatcher.cc:0 @ 0000000001afa9e6 _ZN5hf3fs6client3cli10Dispatcher3runERNS1_4IEnvERKSt8functionIFNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEvEESt17basic_string_viewIcS9_Ebbb.resume /mnt/code/3fs/src/client/cli/common/Dispatcher.cc:0 @ 0000000002a4a1d5 _ZZ4mainENK3$_8clEv.resume /mnt/code/3fs/src/client/bin/admin_cli.cc:0 @ 0000000002a49acd _ZN5folly4coro6detail23makeRefBlockingWaitTaskINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEE7AwaiterES8_Li0EEENS1_16BlockingWaitTaskINSt20add_lvalue_referenceIT0_E4typeEEEOT_.resume /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:296 -> /mnt/code/3fs/src/client/bin/admin_cli.cc @ 0000000002a2c13e _ZNK5folly4coro16blocking_wait_fnclINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEEEEENS0_6detail22decay_rvalue_referenceINS0_12await_resultIDTclL_ZNS0_11folly_cpo__13co_viaIfAsyncEEclL_ZSt7declvalINS_8Executor9KeepAliveISF_EEEDTcl9__declvalIT_ELi0EEEvEEclsr3stdE7declvalISI_EEEEvE4typeEE4typeEOSI_PNS_16DrivableExecutorE /mnt/code/3fs/third_party/folly/folly/Expected.h:366 -> /mnt/code/3fs/src/client/bin/admin_cli.cc @ 000000000295fbb6 _ZNK5folly4coro16blocking_wait_fnclINS0_4TaskINS_8ExpectedINS_4UnitEN5hf3fs6StatusEEEEELi0EEENS0_6detail22decay_rvalue_referenceINS0_12await_resultIDTclL_ZNS0_11folly_cpo__13co_viaIfAsyncEEclL_ZSt7declvalINS_8Executor9KeepAliveISF_EEEDTcl9__declvalIT_ELi0EEEvEEclsr3stdE7declvalISI_EEEEvE4typeEE4typeEOSI_ /mnt/code/3fs/third_party/folly/folly/experimental/coro/BlockingWait.h:301 -> /mnt/code/3fs/src/client/bin/admin_cli.cc @ 00007ffe082730b0 (not found) Aborted ```
bsakaguchi commented 2026-10-26 09:44:17 +00:00
Author
Owner
Copy link

@Funny-Boy-Max commented on GitHub (Mar 30, 2025):

我这里在部署client也遇到这个问题，不知道为什么，请问你有解决么

<!-- gh-comment-id:2764643604 --> @Funny-Boy-Max commented on GitHub (Mar 30, 2025): 我这里在部署client也遇到这个问题，不知道为什么，请问你有解决么
bsakaguchi commented 2026-10-26 09:44:17 +00:00
Author
Owner
Copy link

@divinerapier commented on GitHub (Apr 2, 2025):

我这里在部署client也遇到这个问题，不知道为什么，请问你有解决么

还没有 😫

<!-- gh-comment-id:2771053326 --> @divinerapier commented on GitHub (Apr 2, 2025): > 我这里在部署client也遇到这个问题，不知道为什么，请问你有解决么 还没有 😫
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
SF-Zhou-patch-1
No results found.
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/3FS#56
No description provided.