[GH-ISSUE #218] 启动storage服务的时候报错init io uring failed: -38, maxEvents 512 #130

New issue

Closed

opened 2026-10-26 09:45:41 +00:00 by bsakaguchi · 2 comments

bsakaguchi commented 2026-10-26 09:45:41 +00:00

Owner

Copy link

Originally created by @lavyw on GitHub (Mar 27, 2025).
Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/218

[2025-03-27T13:55:53.148370204+08:00 storage_main:616144 Semaphore.h:27 INFO] usableTokens: 64, maxTokens: 4096, availableTokens: 64
[2025-03-27T13:55:53.149410141+08:00 storage_main:616465 EventLoop.cc:116 INFO] EventLoop::loop() started.
[2025-03-27T13:55:53.149434796+08:00 storage_main:616144 Components.cc:49 INFO] Start messenger finished
[2025-03-27T13:55:53.149441358+08:00 storage_main:616144 Components.cc:50 INFO] Start reliableForwarding ...
[2025-03-27T13:55:53.149443382+08:00 storage_main:616144 Components.cc:50 INFO] Start reliableForwarding finished
[2025-03-27T13:55:53.149445447+08:00 storage_main:616144 Components.cc:51 INFO] Start storageTargets ...
[2025-03-27T13:55:53.277479182+08:00 storage_main:616144 Components.cc:51 INFO] Start storageTargets finished
[2025-03-27T13:55:53.277495085+08:00 storage_main:616144 Components.cc:54 INFO] Start aioReadWorker ...
[2025-03-27T13:55:53.277594922+08:00 storage_main:616144 AioReadWorker.cc:45 INFO] Waiting for AioReadWorker@0x5602f507f900::run start...
[2025-03-27T13:55:53.277948409+08:00 AioRead21:616283 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277978556+08:00 AioRead30:616292 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277983871+08:00 AioRead26:616288 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277979141+08:00 AioRead27:616289 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277981315+08:00 AioRead25:616287 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278008585+08:00 AioRead30:616292 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278002913+08:00 AioRead8:616270 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277996528+08:00 AioRead21:616283 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278015674+08:00 AioRead27:616289 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278007966+08:00 AioRead13:616275 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278004096+08:00 AioRead15:616277 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277980178+08:00 AioRead29:616291 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277994595+08:00 AioRead20:616282 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277999198+08:00 AioRead14:616276 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278008657+08:00 AioRead17:616279 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278022885+08:00 AioRead26:616288 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278078269+08:00 AioRead20:616282 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278005730+08:00 AioRead6:616268 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278018491+08:00 AioRead12:616274 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278020696+08:00 AioRead10:616272 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277989518+08:00 AioRead31:616293 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278080877+08:00 AioRead5:616267 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278081545+08:00 AioRead19:616281 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278018099+08:00 AioRead0:616262 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278072444+08:00 AioRead13:616275 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278099432+08:00 AioRead10:616272 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278082798+08:00 AioRead4:616266 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278020661+08:00 AioRead9:616271 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278029561+08:00 AioRead25:616287 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277993870+08:00 AioRead7:616269 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278004614+08:00 AioRead1:616263 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278008532+08:00 AioRead22:616284 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278113814+08:00 AioRead17:616279 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.277998843+08:00 AioRead2:616264 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278015535+08:00 AioRead3:616265 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278084453+08:00 AioRead28:616290 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278086919+08:00 AioRead11:616273 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278123474+08:00 AioRead9:616271 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278093732+08:00 AioRead8:616270 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512
[2025-03-27T13:55:53.278019497+08:00 AioRead16:616278 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512

Originally created by @lavyw on GitHub (Mar 27, 2025). Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/218 [2025-03-27T13:55:53.148370204+08:00 storage_main:616144 Semaphore.h:27 INFO] usableTokens: 64, maxTokens: 4096, availableTokens: 64 [2025-03-27T13:55:53.149410141+08:00 storage_main:616465 EventLoop.cc:116 INFO] EventLoop::loop() started. [2025-03-27T13:55:53.149434796+08:00 storage_main:616144 Components.cc:49 INFO] Start messenger finished [2025-03-27T13:55:53.149441358+08:00 storage_main:616144 Components.cc:50 INFO] Start reliableForwarding ... [2025-03-27T13:55:53.149443382+08:00 storage_main:616144 Components.cc:50 INFO] Start reliableForwarding finished [2025-03-27T13:55:53.149445447+08:00 storage_main:616144 Components.cc:51 INFO] Start storageTargets ... [2025-03-27T13:55:53.277479182+08:00 storage_main:616144 Components.cc:51 INFO] Start storageTargets finished [2025-03-27T13:55:53.277495085+08:00 storage_main:616144 Components.cc:54 INFO] Start aioReadWorker ... [2025-03-27T13:55:53.277594922+08:00 storage_main:616144 AioReadWorker.cc:45 INFO] Waiting for AioReadWorker@0x5602f507f900::run start... [2025-03-27T13:55:53.277948409+08:00 AioRead21:616283 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277978556+08:00 AioRead30:616292 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277983871+08:00 AioRead26:616288 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277979141+08:00 AioRead27:616289 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277981315+08:00 AioRead25:616287 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278008585+08:00 AioRead30:616292 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278002913+08:00 AioRead8:616270 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277996528+08:00 AioRead21:616283 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278015674+08:00 AioRead27:616289 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278007966+08:00 AioRead13:616275 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278004096+08:00 AioRead15:616277 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277980178+08:00 AioRead29:616291 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277994595+08:00 AioRead20:616282 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277999198+08:00 AioRead14:616276 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278008657+08:00 AioRead17:616279 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278022885+08:00 AioRead26:616288 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278078269+08:00 AioRead20:616282 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278005730+08:00 AioRead6:616268 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278018491+08:00 AioRead12:616274 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278020696+08:00 AioRead10:616272 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277989518+08:00 AioRead31:616293 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278080877+08:00 AioRead5:616267 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278081545+08:00 AioRead19:616281 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278018099+08:00 AioRead0:616262 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278072444+08:00 AioRead13:616275 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278099432+08:00 AioRead10:616272 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278082798+08:00 AioRead4:616266 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278020661+08:00 AioRead9:616271 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278029561+08:00 AioRead25:616287 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277993870+08:00 AioRead7:616269 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278004614+08:00 AioRead1:616263 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278008532+08:00 AioRead22:616284 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278113814+08:00 AioRead17:616279 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.277998843+08:00 AioRead2:616264 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278015535+08:00 AioRead3:616265 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278084453+08:00 AioRead28:616290 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278086919+08:00 AioRead11:616273 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278123474+08:00 AioRead9:616271 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278093732+08:00 AioRead8:616270 AioReadWorker.cc:35 ERROR] io uring status init failed: InvalidConfig(4) init io uring failed: -38, maxEvents 512 [2025-03-27T13:55:53.278019497+08:00 AioRead16:616278 AioStatus.cc:189 ERROR] init io uring failed: -38, maxEvents 512

bsakaguchi closed this issue 2026-10-26 09:45:42 +00:00

bsakaguchi commented 2026-10-26 09:45:42 +00:00

Author

Owner

Copy link

@lavyw commented on GitHub (Mar 27, 2025):

配置文件同仓库差异如下

不知道那里的问题，看报错里面有InvalidConfig(4)，是配置文件有错误吗，

<!-- gh-comment-id:2756817974 --> @lavyw commented on GitHub (Mar 27, 2025): 配置文件同仓库差异如下  不知道那里的问题，看报错里面有InvalidConfig(4)，是配置文件有错误吗，

bsakaguchi commented 2026-10-26 09:45:43 +00:00

Author

Owner

Copy link

@lavyw commented on GitHub (Mar 27, 2025):

已经解决了，参照https://github.com/deepseek-ai/3FS/issues/50，最开始时候也是修改了这个值，但是依然不行，原因是此时需要在每个存储节点上更新配置文件到集群中，/opt/3fs/bin/admin_cli -cfg /opt/3fs/etc/admin_cli.toml --config.mgmtd_client.mgmtd_server_addresses '["RDMA://192.168.200.4:8000"]' "set-config --type STORAGE --file /opt/3fs/etc/storage_main.toml"，

<!-- gh-comment-id:2756860664 --> @lavyw commented on GitHub (Mar 27, 2025): 已经解决了，参照https://github.com/deepseek-ai/3FS/issues/50，最开始时候也是修改了这个值，但是依然不行，原因是此时需要在每个存储节点上更新配置文件到集群中，/opt/3fs/bin/admin_cli -cfg /opt/3fs/etc/admin_cli.toml --config.mgmtd_client.mgmtd_server_addresses '["RDMA://192.168.200.4:8000"]' "set-config --type STORAGE --file /opt/3fs/etc/storage_main.toml"，

bsakaguchi referenced this issue 2026-10-26 09:48:27 +00:00

[PR #130] [MERGED] Deprecate usage of some functions in boost #301

Sign in to join this conversation.

No Branch/Tag specified

Branches Tags

main

SF-Zhou-patch-1

No results found.

Labels

Clear labels   

pull-request

Mirrored from GitHub Pull Request

No labels

pull-request

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

deepseek-ai/3FS#130

No description provided.