DISK内存的？ #117

New issue

Closed

opened 2026-10-29 21:09:37 +00:00 by bsakaguchi · 3 comments

bsakaguchi commented

2026-10-29 21:09:37 +00:00

Owner

Originally created by @zhaotyer on GitHub (Apr 23, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/295

看vllm中的实现

    @staticmethod
    def from_file(file_path: str) -> 'MooncakeStoreConfig':
        """Load the config from a JSON file."""
        with open(file_path) as fin:
            config = json.load(fin)
        return MooncakeStoreConfig(
            local_hostname=config.get("local_hostname"),
            metadata_server=config.get("metadata_server"),
            global_segment_size=config.get("global_segment_size",
                                           DEFAULT_GLOBAL_SEGMENT_SIZE),
            local_buffer_size=config.get("local_buffer_size",
                                         DEFAULT_LOCAL_BUFFER_SIZE),
            protocol=config.get("protocol", "tcp"),
            device_name=config.get("device_name", ""),
            master_server_address=config.get("master_server_address"),
        )

            self.store.setup(self.config.local_hostname,
                             self.config.metadata_server,
                             self.config.global_segment_size,
                             self.config.local_buffer_size,
                             self.config.protocol, self.config.device_name,
                             self.config.master_server_address)

只申请了部分cpu memory,没有池化管理DRAM/VRAM/DISK内存

Originally created by @zhaotyer on GitHub (Apr 23, 2025). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/295 看vllm中的实现 ``` @staticmethod def from_file(file_path: str) -> 'MooncakeStoreConfig': """Load the config from a JSON file.""" with open(file_path) as fin: config = json.load(fin) return MooncakeStoreConfig( local_hostname=config.get("local_hostname"), metadata_server=config.get("metadata_server"), global_segment_size=config.get("global_segment_size", DEFAULT_GLOBAL_SEGMENT_SIZE), local_buffer_size=config.get("local_buffer_size", DEFAULT_LOCAL_BUFFER_SIZE), protocol=config.get("protocol", "tcp"), device_name=config.get("device_name", ""), master_server_address=config.get("master_server_address"), ) self.store.setup(self.config.local_hostname, self.config.metadata_server, self.config.global_segment_size, self.config.local_buffer_size, self.config.protocol, self.config.device_name, self.config.master_server_address) ``` 只申请了部分cpu memory,没有池化管理DRAM/VRAM/DISK内存

bsakaguchi

2026-10-29 21:09:37 +00:00

closed this issue
added the
stale

auto-closed
labels

bsakaguchi commented

2026-10-29 21:09:38 +00:00

Author

Owner

@alogfans commented on GitHub (Apr 25, 2025):

Currently Mooncake Store uses DRAM-based memory pool. For VRAM-based memory pool, since the VRAM space is limited, we think that it's better to manage VRAM KVCache per node (i.e., not interconnected). We are also working at the support of SSD-based tiered caching. Stay tuned!

@alogfans commented on GitHub (Apr 25, 2025): Currently Mooncake Store uses DRAM-based memory pool. For VRAM-based memory pool, since the VRAM space is limited, we think that it's better to manage VRAM KVCache per node (i.e., not interconnected). We are also working at the support of SSD-based tiered caching. Stay tuned!

bsakaguchi commented

2026-10-29 21:09:38 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 14, 2026):

This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

@github-actions[bot] commented on GitHub (Jul 14, 2026): This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

bsakaguchi commented

2026-10-29 21:09:38 +00:00

Author

Owner

@github-actions[bot] commented on GitHub (Jul 21, 2026):

Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

@github-actions[bot] commented on GitHub (Jul 21, 2026): Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.