[PR #388] [MERGED] make backlog size of handshake listen configurable #1532

New issue

Closed

opened 2026-10-29 21:28:14 +00:00 by bsakaguchi · 0 comments

bsakaguchi commented

2026-10-29 21:28:14 +00:00

Owner

📋 Pull Request Information

Original PR: https://github.com/kvcache-ai/Mooncake/pull/388
Author: @jiafuzha
Created: 5/22/2025
Status: ✅ Merged
Merged: 5/29/2025
Merged by: @doujiang24

Base: main ← Head: config_handshake_listen_backlog

📝 Commits (7)

45502b1 make backlog size of handshake listen configurable
90f3cce Update mooncake-transfer-engine/src/config.cpp
ca0b4df Revert "Update mooncake-transfer-engine/src/config.cpp
"
f629396 Merge branch 'config_handshake_listen_backlog'
ece6661 make backlog size of handshake listen configurable
35f807a Merge branch 'main' into config_handshake_listen_backlog
d8fdab1 Update mooncake-transfer-engine/include/config.h

📊 Changes

6 files changed (+21 additions, -4 deletions)

View changed files

📝 doc/en/transfer-engine.md (+1 -0)
📝 doc/zh/transfer-engine.md (+1 -1)
📝 docs/source/design/transfer-engine.md (+1 -1)
📝 mooncake-transfer-engine/include/config.h (+1 -0)
📝 mooncake-transfer-engine/src/config.cpp (+11 -0)
📝 mooncake-transfer-engine/src/transfer_metadata_plugin.cpp (+6 -2)

📄 Description

When transfer engine configured with more cards, e.g., 8, via auto discovery, we get "connection reset by peer" error during handshaking. From dmesg, it shows "request_sock_TCP: Possible SYN flooding on port 0.0.0.0:16023. Sending cookies.". It means we need to increase backlog size of the listen API which is hard-coded to 5. We should make it configurable.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/kvcache-ai/Mooncake/pull/388 **Author:** [@jiafuzha](https://github.com/jiafuzha) **Created:** 5/22/2025 **Status:** ✅ Merged **Merged:** 5/29/2025 **Merged by:** [@doujiang24](https://github.com/doujiang24) **Base:** `main` ← **Head:** `config_handshake_listen_backlog` --- ### 📝 Commits (7) - [`45502b1`](https://github.com/kvcache-ai/Mooncake/commit/45502b1f52104d323a70171f5fc0ad0e646d5f9e) make backlog size of handshake listen configurable - [`90f3cce`](https://github.com/kvcache-ai/Mooncake/commit/90f3cce80ad8fc2eee3f44ea21cb41873d0439b3) Update mooncake-transfer-engine/src/config.cpp - [`ca0b4df`](https://github.com/kvcache-ai/Mooncake/commit/ca0b4dfdff5b95d224ead5cc44f294fc635d8849) Revert "Update mooncake-transfer-engine/src/config.cpp " - [`f629396`](https://github.com/kvcache-ai/Mooncake/commit/f6293968ec5bd7543fb12142eb4f08334b04db1f) Merge branch 'config_handshake_listen_backlog' - [`ece6661`](https://github.com/kvcache-ai/Mooncake/commit/ece66612f7b6046d01a4800d065b0045eb8100a3) make backlog size of handshake listen configurable - [`35f807a`](https://github.com/kvcache-ai/Mooncake/commit/35f807a8ec567337d4d912594ceeaa78f5df211e) Merge branch 'main' into config_handshake_listen_backlog - [`d8fdab1`](https://github.com/kvcache-ai/Mooncake/commit/d8fdab1d0614d5e5be60ff97456f50495d44efc1) Update mooncake-transfer-engine/include/config.h ### 📊 Changes **6 files changed** (+21 additions, -4 deletions) <details> <summary>View changed files</summary> 📝 `doc/en/transfer-engine.md` (+1 -0) 📝 `doc/zh/transfer-engine.md` (+1 -1) 📝 `docs/source/design/transfer-engine.md` (+1 -1) 📝 `mooncake-transfer-engine/include/config.h` (+1 -0) 📝 `mooncake-transfer-engine/src/config.cpp` (+11 -0) 📝 `mooncake-transfer-engine/src/transfer_metadata_plugin.cpp` (+6 -2) </details> ### 📄 Description When transfer engine configured with more cards, e.g., 8, via auto discovery, we get "connection reset by peer" error during handshaking. From dmesg, it shows "request_sock_TCP: Possible SYN flooding on port 0.0.0.0:16023. Sending cookies.". It means we need to increase backlog size of the listen API which is hard-coded to 5. We should make it configurable. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

bsakaguchi

2026-10-29 21:28:14 +00:00