[GH-ISSUE #214] 通过fio usrbio进行测试时报错ioring create failed: hf3fs_iorwrap failed -2 #132

Open
opened 2026-10-26 09:45:42 +00:00 by bsakaguchi · 5 comments
Owner

Originally created by @kaede11 on GitHub (Mar 26, 2025).
Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/214

执行fio时,开启了debug mode,输出信息如下:
[2025-03-26T19:31:53.143514601+08:00 fio:836233 UsrbIo.cc:472 ERROR] ioring create failed: hf3fs_iorwrap failed -2
fio: io engine hf3fs_usrbio init failed. Perhaps try reducing io depth?
fio: pid=836233, err=-2/
file 836233 close files
[2025-03-26T19:31:53.143547087+08:00 fio:836233 UsrbIo.cc:196 ERROR] cannot iovfree() an iov created by iovwrap()
io 836233 close ioengine hf3fs_usrbio
io 836233 free ioengine hf3fs_usrbio
parse 836233 free options
io 836233 dlclose ioengine hf3fs_usrbio
process 836233 pid=836233: runstate RUNNING -> EXITED
process 836167 pid=836233: runstate EXITED -> REAPED
process 836167 terminate group_id=-1
process 836167 setting terminate on 2depth_128file_4M_direct_read_bw1/836233
diskutil 836167 update io ticks
diskutil 836232 update io ticks
helperthread 836232 next_log: 500, msec_to_next_event: 249
process 836232 pid=836233: runstate REAPED -> FINISHING
process 836232 pid=836233: runstate FINISHING -> REAPED

执行的fio命令如下:
fio --debug=all -ioengine=external:hf3fs_usrbio.so -numjobs=1 -fallocate=none -iodepth=32 -iodepth_batch_submit=1024 -iodepth_batch_complete_min=1024 -iodepth_batch_complete_max=1024 -direct=1 -rw=randread -bs=4k --group_reporting -size=100M -time_based -runtime=300 -name=2depth_128file_4M_direct_read_bw1 -mountpoint=/var/www/html/apt-repo

看源码发现,是在
cqeSem的readlink时,由于link不存在报错,想问下,这个link是在什么时候创建的,以及这个问题需要如何解决?
auto link = fmt::format("{}/3fs-virt/iovs/submit-ios{}", std::string(hf3fs_mount_point), prio == 0 ? "" : prio < 0 ? ".ph" : ".pl");

Originally created by @kaede11 on GitHub (Mar 26, 2025). Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/214 执行fio时,开启了debug mode,输出信息如下: [2025-03-26T19:31:53.143514601+08:00 fio:836233 UsrbIo.cc:472 ERROR] ioring create failed: hf3fs_iorwrap failed -2 fio: io engine hf3fs_usrbio init failed. Perhaps try reducing io depth? fio: pid=836233, err=-2/ file 836233 close files [2025-03-26T19:31:53.143547087+08:00 fio:836233 UsrbIo.cc:196 ERROR] cannot iovfree() an iov created by iovwrap() io 836233 close ioengine hf3fs_usrbio io 836233 free ioengine hf3fs_usrbio parse 836233 free options io 836233 dlclose ioengine hf3fs_usrbio process 836233 pid=836233: runstate RUNNING -> EXITED process 836167 pid=836233: runstate EXITED -> REAPED process 836167 terminate group_id=-1 process 836167 setting terminate on 2depth_128file_4M_direct_read_bw1/836233 diskutil 836167 update io ticks diskutil 836232 update io ticks helperthread 836232 next_log: 500, msec_to_next_event: 249 process 836232 pid=836233: runstate REAPED -> FINISHING process 836232 pid=836233: runstate FINISHING -> REAPED 执行的fio命令如下: fio --debug=all -ioengine=external:hf3fs_usrbio.so -numjobs=1 -fallocate=none -iodepth=32 -iodepth_batch_submit=1024 -iodepth_batch_complete_min=1024 -iodepth_batch_complete_max=1024 -direct=1 -rw=randread -bs=4k --group_reporting -size=100M -time_based -runtime=300 -name=2depth_128file_4M_direct_read_bw1 -mountpoint=/var/www/html/apt-repo 看源码发现,是在 cqeSem的readlink时,由于link不存在报错,想问下,这个link是在什么时候创建的,以及这个问题需要如何解决? ` auto link = fmt::format("{}/3fs-virt/iovs/submit-ios{}", std::string(hf3fs_mount_point), prio == 0 ? "" : prio < 0 ? ".ph" : ".pl");`
Author
Owner

@Icedroid commented on GitHub (Apr 11, 2025):

请问fio 哪个版本支持external引擎的?

<!-- gh-comment-id:2796147977 --> @Icedroid commented on GitHub (Apr 11, 2025): 请问fio 哪个版本支持external引擎的?
Author
Owner

@Funny-Boy-Max commented on GitHub (May 23, 2025):

兄弟,请问问题解决了么,我这边以一直遇到这个问题。

Image Image
<!-- gh-comment-id:2904293036 --> @Funny-Boy-Max commented on GitHub (May 23, 2025): 兄弟,请问问题解决了么,我这边以一直遇到这个问题。 <img width="759" alt="Image" src="https://github.com/user-attachments/assets/cd32d5ae-8579-47b2-835a-86da837e2db9" /> <img width="475" alt="Image" src="https://github.com/user-attachments/assets/ed2108be-b6cc-4089-8a61-aaae7e304c93" />
Author
Owner

@strahe commented on GitHub (Jun 10, 2025):

我也遇到这个问题:

fio: io engine hf3fs_usrbio init failed.
fio: pid=102256, err=-22/
[2025-06-10T16:57:01.381765574+08:00 fio:102256 UsrbIo.cc:196 ERROR] cannot iovfree() an iov created by iovwrap()
<!-- gh-comment-id:2958286901 --> @strahe commented on GitHub (Jun 10, 2025): 我也遇到这个问题: ``` fio: io engine hf3fs_usrbio init failed. fio: pid=102256, err=-22/ [2025-06-10T16:57:01.381765574+08:00 fio:102256 UsrbIo.cc:196 ERROR] cannot iovfree() an iov created by iovwrap() ```
Author
Owner

@Funny-Boy-Max commented on GitHub (Jun 11, 2025):

我也遇到这个问题:

fio: io engine hf3fs_usrbio init failed.
fio: pid=102256, err=-22/
[2025-06-10T16:57:01.381765574+08:00 fio:102256 UsrbIo.cc:196 ERROR] cannot iovfree() an iov created by iovwrap()

需要指明mountpoint路径,如下图所示:

Image
<!-- gh-comment-id:2960990904 --> @Funny-Boy-Max commented on GitHub (Jun 11, 2025): > 我也遇到这个问题: > > ``` > fio: io engine hf3fs_usrbio init failed. > fio: pid=102256, err=-22/ > [2025-06-10T16:57:01.381765574+08:00 fio:102256 UsrbIo.cc:196 ERROR] cannot iovfree() an iov created by iovwrap() > ``` 需要指明mountpoint路径,如下图所示: <img width="543" alt="Image" src="https://github.com/user-attachments/assets/6a9b1714-b2e2-48b7-bc2c-585e683f830c" />
Author
Owner

@strahe commented on GitHub (Jun 11, 2025):

@Funny-Boy-Max 多谢,是我大意了

<!-- gh-comment-id:2961061301 --> @strahe commented on GitHub (Jun 11, 2025): @Funny-Boy-Max 多谢,是我大意了
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/3FS#132
No description provided.