[GH-ISSUE #40] Share more about the file system design tailored to the characteristics of LLM tasks #25

Open
opened 2026-10-26 09:43:42 +00:00 by bsakaguchi · 1 comment
Owner

Originally created by @zhitaoli-6 on GitHub (Mar 2, 2025).
Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/40

Dear community,

Firstly thanks for your contribution to the open source.

The Fire-Flyer File System (3FS) is a high-performance distributed file system designed to address the challenges of AI training and inference workloads.

I understand 3FS is mainly designed for AI or LLM workloads and it has high performance by leveraging modern SSDs and RDMA networks. However, from the README and design notes, I can't see the design dedicated to AI workloads clearly.

I can see some parts as following:

Image

Image

Could you share more about the difference between your file system design compared with a general distributed file system?

Originally created by @zhitaoli-6 on GitHub (Mar 2, 2025). Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/40 Dear community, Firstly thanks for your contribution to the open source. > The Fire-Flyer File System (3FS) is a high-performance distributed file system designed to address the challenges of AI training and inference workloads. I understand 3FS is mainly designed for AI or LLM workloads and it has high performance by leveraging modern SSDs and RDMA networks. However, from the README and [design notes](https://github.com/deepseek-ai/3FS/blob/main/docs/design_notes.md), I can't see the design dedicated to AI workloads clearly. I can see some parts as following: ![Image](https://github.com/user-attachments/assets/afebc140-ba48-44b5-b40a-ddd1b6a4382b) ![Image](https://github.com/user-attachments/assets/8e835b33-50ab-4e41-98e9-ec4fe5d839b8) Could you share more about the difference between your file system design compared with a general distributed file system?
Author
Owner

@Deeperfinder commented on GitHub (Mar 3, 2025):

+1, don't know how to use it with LLM reasoning framework, maybe write a quick start?

<!-- gh-comment-id:2693077963 --> @Deeperfinder commented on GitHub (Mar 3, 2025): +1, don't know how to use it with LLM reasoning framework, maybe write a quick start?
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/3FS#25
No description provided.