[GH-ISSUE #29] proposal: add a new "http" metadata protocol #18

New issue

Closed

opened 2026-10-29 21:07:55 +00:00 by bsakaguchi · 1 comment

bsakaguchi commented

2026-10-29 21:07:55 +00:00

Owner

Originally created by @doujiang24 on GitHub (Dec 10, 2024).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/29

Glad to see https://github.com/kvcache-ai/Mooncake/pull/21 start to support multiple metadata servers.

Now, only etcd and redis are supported. I'm here to proposal a new "http" metadata type, benifits:

http metadata server are easy to deploy and scale.
the http metadata server could expose more APIs for system operator know/manage the system better.

Design:
The http server provide three restful APIs:

GET $metadata_uri?key=$key
PUT $$metadata_uri?key=$key, with json body
DELETE $metadata_uri?key=$key

If this does make sense, I'd like to have a try, thanks.

Originally created by @doujiang24 on GitHub (Dec 10, 2024). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/29 Glad to see https://github.com/kvcache-ai/Mooncake/pull/21 start to support multiple metadata servers. Now, only etcd and redis are supported. I'm here to proposal a new "http" metadata type, benifits: 1. http metadata server are easy to deploy and scale. 2. the http metadata server could expose more APIs for system operator know/manage the system better. Design: The http server provide three restful APIs: 1. GET $metadata_uri?key=$key 2. PUT $$metadata_uri?key=$key, with json body 3. DELETE $metadata_uri?key=$key If this does make sense, I'd like to have a try, thanks.

bsakaguchi closed this issue

2026-10-29 21:07:55 +00:00

bsakaguchi commented

2026-10-29 21:07:56 +00:00

Author

Owner

@alogfans commented on GitHub (Dec 10, 2024):

Good idea! I think inheriting TransferMetadataImpl in mooncake-transfer-engine/src/transfer_metadata.cpp is enough :)

@alogfans commented on GitHub (Dec 10, 2024): Good idea! I think inheriting `TransferMetadataImpl` in `mooncake-transfer-engine/src/transfer_metadata.cpp` is enough :)

bsakaguchi referenced this issue

2026-10-29 21:17:35 +00:00

[GH-ISSUE #2440] [Bug]: Execute mooncake+hixl, final destruction phase core #646

bsakaguchi referenced this issue

2026-10-29 21:26:01 +00:00

[PR #18] [MERGED] [Bugfix] cpp std::string #1283

bsakaguchi referenced this issue

2026-10-29 21:26:06 +00:00

[PR #32] [MERGED] [Bugfix] build error when USE_CUDA #1292