mirror of
https://github.com/deepseek-ai/3FS.git
synced 2026-11-05 00:47:47 +00:00
[GH-ISSUE #168] 起storage_main.service服务时报错failed to send first msg #99
Labels
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
deepseek-ai/3FS#99
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @izxl007 on GitHub (Mar 13, 2025).
Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/168
journalctl日志如下：
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.219808539+00:00 launcherEL0: 7340 IBSocket.cc:430 ERROR] IBSocket RDMA://host-192-168-32 -176/mlx5_bond_0:1/3231 failed to send first msg, WC {WR: [WRType::RECV, bufIndex 0], error: Work Request Flushed Error, vendor_error: 245}, port {mlx5_bo nd_0:1, ifaddrs [], zones [UNKNOWN], ETHERNET, ACTIVE}, closed true
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.221081259+00:00 CliBG0: 7336 MgmtdClient.cc:509 ERROR] MgmtdClient: probePrimary NodeId( 0) failed: RPC::Timeout(2005)
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.221098477+00:00 CliBG0: 7336 MgmtdClient.cc:162 INFO] MgmtdClient: mark node as Skipped NodeId(0) ["RDMA://10.234.5.197:8000"]
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.221111763+00:00 CliBG0: 7336 MgmtdClient.cc:434 WARNING] MgmtdClient: primary not found
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.221123559+00:00 CliBG0: 7336 MgmtdClient.cc:390 ERROR] [MgmtdClientOp RefreshRoutingInfo force=false No.20] failed: MgmtdClient::PrimaryMgmtdNotFound(6000) ./src/client/mgmtd/MgmtdClient.cc:173, '_result' has error. latency: 0ns
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.221161909+00:00 storage_main: 7256 MgmtdClient.cc:271 INFO] MgmtdClient: wait for stop
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.221173951+00:00 CliBG0: 7336 MgmtdClient.cc:381 INFO] MgmtdClient: receive ExitItem
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.221197739+00:00 storage_main: 7256 MgmtdClient.cc:277 INFO] MgmtdClient: stopped
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.221212359+00:00 storage_main: 7256 Utils.cc:254 CRITICAL] Load AppInfo from launcher fai led: MgmtdClient::PrimaryMgmtdNotFound(6000) ./src/client/mgmtd/MgmtdClient.cc:173, '_result' has error
Mar 13 09:06:01 host-194 storage_main[7256]: [2025-03-13T09:06:01.221212359+00:00 storage_main: 7256 Utils.cc:254 CRITICAL] retryCount: 19
Mar 13 09:06:02 host-194 storage_main[7256]: [2025-03-13T09:06:02.221289739+00:00 storage_main: 7256 Utils.cc:258 FATAL] Load AppInfo from launcher failed , stop retrying
Mar 13 09:06:02 host-194 storage_main[7256]: *** Aborted at 1741856762 (Unix time, try 'date -d @1741856762') ***
Mar 13 09:06:02 host-194 storage_main[7256]: *** Signal 6 (SIGABRT) (0x1c58) received by PID 7256 (pthread TID 0x7f495b864b80) (linux TID 7256) (maybe fro m PID 7256, UID 0) (code: -6), stack trace: ***
Mar 13 09:06:02 host-194 storage_main[7256]: @ 00000000011f5b0f _ZN5folly10symbolizer12_GLOBAL__N_113signalHandlerEiP9siginfo_tPv
看大家是否有遇到
@haohaiwei commented on GitHub (Mar 14, 2025):
这个是mgmtd 服务无主 failed: MgmtdClient::PrimaryMgmtdNotFound(6000)
@izxl007 commented on GitHub (Mar 14, 2025):
这情况怎么解决呢
@Icedroid commented on GitHub (Mar 15, 2025):
我也遇到这个，如何解决的呢？是mgmtd没有启动成功？但我的端口是正常监听的
@haohaiwei commented on GitHub (Mar 19, 2025):
看下mgmt的日志排查这块
@daimashusheng commented on GitHub (Sep 25, 2025):
请问这个错误接下来是怎么解决的