deepseek-ai/3FS
1
0
Fork 0
mirror of https://github.com/deepseek-ai/3FS.git synced 2026-11-05 00:47:47 +00:00
Code Issues 166 Projects Packages Wiki Activity

[GH-ISSUE #112] stripeSize概念疑问 #66

New issue
Closed
opened 2026-10-26 09:44:27 +00:00 by bsakaguchi · 1 comment
bsakaguchi commented 2026-10-26 09:44:27 +00:00
Owner
Copy link

Originally created by @hmy1229 on GitHub (Mar 6, 2025).
Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/112

每个chunk直接对chainTable中的chainNum直接取余即可得到chain：
chain = chains[chunkIndex % chainsNum]
而且这样能将文件打的更散
为何需要新增stripeSize来控制能打散到的chain的数量，有什么好处？增加这个stripeSize不就更不容易打散了么？

Originally created by @hmy1229 on GitHub (Mar 6, 2025). Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/112 每个chunk直接对chainTable中的chainNum直接取余即可得到chain： chain = chains[chunkIndex % chainsNum] **而且这样能将文件打的更散** 为何需要新增stripeSize来控制能打散到的chain的数量，有什么好处？增加这个stripeSize不就更不容易打散了么？
bsakaguchi commented 2026-10-26 09:44:29 +00:00
Author
Owner
Copy link

@beef9999 commented on GitHub (Mar 7, 2025):

Suppose you have 10,000 machines and an extremely large file. If you fully scatter the file to all chains, then when reading this file, your client would have to establish RDMA connections with all 10,000 machines. Not to mention the impact of long-tail latency caused by machine failures. Therefore, it is a better choice to limit the range the scattering.

假如你有10000台机器，和一个特别大的文件，如果是全打散，那么读这个文件的时候，你的客户端就得跟10000台机器建立RDMA链接。更别说宕机导致的长尾延迟问题。所以控制打散范围是更好的选择。

<!-- gh-comment-id:2706601781 --> @beef9999 commented on GitHub (Mar 7, 2025): Suppose you have 10,000 machines and an extremely large file. If you fully scatter the file to all chains, then when reading this file, your client would have to establish RDMA connections with all 10,000 machines. Not to mention the impact of long-tail latency caused by machine failures. Therefore, it is a better choice to limit the range the scattering. --- 假如你有10000台机器，和一个特别大的文件，如果是全打散，那么读这个文件的时候，你的客户端就得跟10000台机器建立RDMA链接。更别说宕机导致的长尾延迟问题。所以控制打散范围是更好的选择。
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
SF-Zhou-patch-1
No results found.
Labels
Clear labels   
pull-request
Mirrored from GitHub Pull Request

No labels
pull-request
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/3FS#66
No description provided.