[GH-ISSUE #135] How to change a secondary mgmtd to primary mgmtd? #77

Closed
opened 2026-10-26 09:44:39 +00:00 by bsakaguchi · 2 comments
Owner

Originally created by @zhengxle on GitHub (Mar 10, 2025).
Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/135

we had set up a 3FS cluster as one primary mgmtd node and four storage node, after 2 days, the only primary mgmtd change the status as not primary, and all of mounted /3fs disappeared
how to change the not primary mgmtd to primary status?

Image
Originally created by @zhengxle on GitHub (Mar 10, 2025). Original GitHub issue: https://github.com/deepseek-ai/3FS/issues/135 we had set up a 3FS cluster as one primary mgmtd node and four storage node, after 2 days, the only primary mgmtd change the status as not primary, and all of mounted /3fs disappeared how to change the not primary mgmtd to primary status? <img width="1537" alt="Image" src="https://github.com/user-attachments/assets/8d15846c-79a2-4fb6-99da-431eac5c1933" />
Author
Owner

@fuzhe1989 commented on GitHub (Mar 11, 2025):

Mgmtd will extend the lease periodically (encapsulated as a FoundationDB transaction). In two cases it will become secondary without any other mgmtd instance:

  1. fails to commit FoundationDB transaction, or
  2. clock rolls back to a past time.

Please check the status of your FoundationDB and NTP, and if both are OK, delete the key "SINGMgmtdLease" in FoundationDB via FDB CLI.

<!-- gh-comment-id:2712454553 --> @fuzhe1989 commented on GitHub (Mar 11, 2025): Mgmtd will extend the lease periodically (encapsulated as a FoundationDB transaction). In two cases it will become secondary without any other mgmtd instance: 1. fails to commit FoundationDB transaction, or 2. clock rolls back to a past time. Please check the status of your FoundationDB and NTP, and if both are OK, delete the key "SINGMgmtdLease" in FoundationDB via FDB CLI.
Author
Owner

@zhengxle commented on GitHub (Mar 12, 2025):

thanks

<!-- gh-comment-id:2716271690 --> @zhengxle commented on GitHub (Mar 12, 2025): thanks
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/3FS#77
No description provided.