[GH-ISSUE #495] core dumped #169

New issue

Closed

opened 2026-10-29 21:10:28 +00:00 by bsakaguchi · 4 comments

bsakaguchi commented

2026-10-29 21:10:28 +00:00

Owner

Originally created by @Xerxes-cn on GitHub (Jun 16, 2025).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/495

Originally assigned to: @xiaguan on GitHub.

我在vllm 集成 mooncake pd分离测试的时候遇到问题

我尝试按照vllm 代码里面的样子单独启动mooncake engine 发现也报相同的错误 mooncake-transfer-engine 用的是0.3.3.post1

Originally created by @Xerxes-cn on GitHub (Jun 16, 2025). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/495 Originally assigned to: @xiaguan on GitHub. 我在vllm 集成 mooncake pd分离测试的时候遇到问题 ![Image](https://github.com/user-attachments/assets/14950bc9-e2d9-4301-9e87-b89746ea8425) 我尝试按照vllm 代码里面的样子单独启动mooncake engine 发现也报相同的错误 mooncake-transfer-engine 用的是0.3.3.post1

bsakaguchi closed this issue

2026-10-29 21:10:28 +00:00

bsakaguchi commented

2026-10-29 21:10:29 +00:00

Author

Owner

@Xerxes-cn commented on GitHub (Jun 16, 2025):

我看你们在这个issue和guide中说可以用http 但是在vllm 里面似乎并不支持

@Xerxes-cn commented on GitHub (Jun 16, 2025): 我看你们在这个[issue](https://github.com/kvcache-ai/Mooncake/issues/476)和[guide](https://github.com/kvcache-ai/Mooncake/blob/main/doc/en/vllm-integration-v0.2.md)中说可以用http 但是在vllm 里面似乎并不支持 ![Image](https://github.com/user-attachments/assets/2816d9f7-01a2-4b64-bbc7-47be471b48c9)

bsakaguchi commented

2026-10-29 21:10:29 +00:00

Author

Owner

@Xerxes-cn commented on GitHub (Jun 16, 2025):

我按照https://github.com/kvcache-ai/Mooncake/blob/main/doc/zh/vllm-integration-v1.md 这个教程能把服务启动了但是在测试的时候 decode instance 报错
INFO 06-16 09:49:16 [launcher.py:36] Route: /metrics, Methods: GET INFO: Started server process [11506] INFO: Waiting for application startup. INFO: Application startup complete. INFO 06-16 09:49:30 [logger.py:39] Received request cmpl-807b5ad07b884846a8ad27608a20a3f2-0: prompt: 'San Francisco is a', params: SamplingParams(n=1, presence_penalty=0.0, frequency_penalty=0.0, repetition_penalty=1.0, temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, seed=None, stop=[], stop_token_ids=[], bad_words=[], include_stop_str_in_output=False, ignore_eos=False, max_tokens=100, min_tokens=0, logprobs=None, prompt_logprobs=None, skip_special_tokens=True, spaces_between_special_tokens=True, truncate_prompt_tokens=None, guided_decoding=None, extra_args=None), prompt_token_ids: [23729, 12879, 374, 264], lora_request: None, prompt_adapter_request: None. INFO 06-16 09:49:30 [engine.py:313] Added request cmpl-807b5ad07b884846a8ad27608a20a3f2-0. python3: /home/runner/work/Mooncake/Mooncake/mooncake-store/src/transfer_task.cpp:164: void mooncake::TransferEngineOperationState::set_result_internal(mooncake::ErrorCode): Assertion!result_.has_value() && "Result should only be set once."' failed.
ERROR 06-16 09:49:36 [client.py:306] RuntimeError('Engine process (pid 11809) died.')
ERROR 06-16 09:49:36 [client.py:306] NoneType: None
INFO: Shutting down
INFO: Waiting for connections to close. (CTRL+C to force quit)
INFO: 127.0.0.1:51976 - "POST /v1/completions HTTP/1.1" 500 Internal Server Error
INFO: Waiting for application shutdown.
INFO: Application shutdown complete.
INFO: Finished server process [11506]
/usr/lib/python3.12/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
`
单独对decode/prefill instance 测试都是没问题的

config.json配置
{ "local_hostname": "33.254.xxx.xxx", "metadata_server": "http://33.254.xxx.xxx:8080/metadata", "protocol": "tcp", "device_name": "", "master_server_address": "33.254.xxx.xxx:50001" }

启动服务命令:
MOONCAKE_CONFIG_PATH=./config.json VLLM_USE_V1=0 python3 -m vllm.entrypoints.openai.api_server --model /model/qwen3-8b/ --port 8100 --max-model-len 10000 --gpu-memory-utilization 0.8 --kv-transfer-config '{"kv_connector":"MooncakeStoreConnector","kv_role":"kv_producer"}'

MOONCAKE_CONFIG_PATH=./config.json CUDA_VISIBLE_DEVICES=1 MOONCAKE_CONFIG_PATH=./config.json VLLM_USE_V1=0 python3 -m vllm.entrypoints.openai.api_server --model /model/qwen3-8b/ --port 8200 --max-model-len 10000 --gpu-memory-utilization 0.8 --kv-transfer-config '{"kv_connector":"MooncakeStoreConnector","kv_role":"kv_consumer"}'

@Xerxes-cn commented on GitHub (Jun 16, 2025): 我按照https://github.com/kvcache-ai/Mooncake/blob/main/doc/zh/vllm-integration-v1.md 这个教程能把服务启动了但是在测试的时候 decode instance 报错 ` INFO 06-16 09:49:16 [launcher.py:36] Route: /metrics, Methods: GET INFO: Started server process [11506] INFO: Waiting for application startup. INFO: Application startup complete. INFO 06-16 09:49:30 [logger.py:39] Received request cmpl-807b5ad07b884846a8ad27608a20a3f2-0: prompt: 'San Francisco is a', params: SamplingParams(n=1, presence_penalty=0.0, frequency_penalty=0.0, repetition_penalty=1.0, temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, seed=None, stop=[], stop_token_ids=[], bad_words=[], include_stop_str_in_output=False, ignore_eos=False, max_tokens=100, min_tokens=0, logprobs=None, prompt_logprobs=None, skip_special_tokens=True, spaces_between_special_tokens=True, truncate_prompt_tokens=None, guided_decoding=None, extra_args=None), prompt_token_ids: [23729, 12879, 374, 264], lora_request: None, prompt_adapter_request: None. INFO 06-16 09:49:30 [engine.py:313] Added request cmpl-807b5ad07b884846a8ad27608a20a3f2-0. python3: /home/runner/work/Mooncake/Mooncake/mooncake-store/src/transfer_task.cpp:164: void mooncake::TransferEngineOperationState::set_result_internal(mooncake::ErrorCode): Assertion `!result_.has_value() && "Result should only be set once."' failed. ERROR 06-16 09:49:36 [client.py:306] RuntimeError('Engine process (pid 11809) died.') ERROR 06-16 09:49:36 [client.py:306] NoneType: None INFO: Shutting down INFO: Waiting for connections to close. (CTRL+C to force quit) INFO: 127.0.0.1:51976 - "POST /v1/completions HTTP/1.1" 500 Internal Server Error INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [11506] /usr/lib/python3.12/multiprocessing/resource_tracker.py:254: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown warnings.warn('resource_tracker: There appear to be %d ' ` 单独对decode/prefill instance 测试都是没问题的 config.json配置 `{ "local_hostname": "33.254.xxx.xxx", "metadata_server": "http://33.254.xxx.xxx:8080/metadata", "protocol": "tcp", "device_name": "", "master_server_address": "33.254.xxx.xxx:50001" }` 启动服务命令: MOONCAKE_CONFIG_PATH=./config.json VLLM_USE_V1=0 python3 -m vllm.entrypoints.openai.api_server --model /model/qwen3-8b/ --port 8100 --max-model-len 10000 --gpu-memory-utilization 0.8 --kv-transfer-config '{"kv_connector":"MooncakeStoreConnector","kv_role":"kv_producer"}' MOONCAKE_CONFIG_PATH=./config.json CUDA_VISIBLE_DEVICES=1 MOONCAKE_CONFIG_PATH=./config.json VLLM_USE_V1=0 python3 -m vllm.entrypoints.openai.api_server --model /model/qwen3-8b/ --port 8200 --max-model-len 10000 --gpu-memory-utilization 0.8 --kv-transfer-config '{"kv_connector":"MooncakeStoreConnector","kv_role":"kv_consumer"}'

bsakaguchi commented

2026-10-29 21:10:29 +00:00

Author

Owner

@xiaguan commented on GitHub (Jun 16, 2025):

new version released, you could try again. Thanks

@xiaguan commented on GitHub (Jun 16, 2025): new version released, you could try again. Thanks

bsakaguchi commented

2026-10-29 21:10:29 +00:00

Author

Owner

@Xerxes-cn commented on GitHub (Jun 17, 2025):

new version released, you could try again. Thanks

I tried the latest version mooncake-transfer-engine 0.3.3.post2 and it works. Thanks

@Xerxes-cn commented on GitHub (Jun 17, 2025): > new version released, you could try again. Thanks I tried the latest version mooncake-transfer-engine 0.3.3.post2 and it works. Thanks

bsakaguchi referenced this issue

2026-10-29 21:26:49 +00:00

[PR #169] [MERGED] [TransferEngine] fix typos for cancel status in transfer engine #1368