kvcache-ai/Mooncake
1
0
Fork 0
mirror of https://github.com/kvcache-ai/Mooncake.git synced 2026-11-05 01:17:55 +00:00
Code Issues 368 Projects Packages Wiki Activity

[GH-ISSUE #2440] [Bug]: Execute mooncake+hixl, final destruction phase core #646

New issue
Closed
opened 2026-10-29 21:17:35 +00:00 by bsakaguchi · 5 comments
bsakaguchi commented 2026-10-29 21:17:35 +00:00
Owner
Copy link

Originally created by @CherryHuhu on GitHub (Jun 12, 2026).
Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/2440

Originally assigned to: @CherryHuhu on GitHub.

Bug Report

#0 xxx in ?? () from /usr/lib64/libc.so.6
#1 xxx in raise () from /usr/lib64/libc.so.6
#2 xxx in abort () from /usr/lib64/libc.so.6
#3 xxx in ?? () from /usr/lib64/libc.so.6
#4 xxx in ?? () from /usr/lib64/libc.so.6
#5 xxx in ?? () from /usr/lib64/libc.so.6
#6 xxx in ?? () from /usr/lib64/libc.so.6
#7 xxx in ?? () from /usr/lib64/libc.so.6
#8 xxx in ?? () from /usr/lib64/libc.so.6
#9 xxx in free () from /usr/lib64/libc.so.6
#10 xxx in ?? () from /home/xxx/run/master_0611/cann-9.1.0/lib64/libascend_trace.so
#11 xxx in ?? () from /home/xxx/run/master_0611/cann-9.1.0/lib64/libascend_trace.so
#12 xxx in ?? () from /home/xxx/run/master_0611/cann-9.1.0/lib64/libascend_trace.so
#13 xxx in ?? () from /lib/ld-linux-aarch64.so.1
#14 xxx in ?? () from /lib/ld-linux-aarch64.so.1
#15 xxx in ?? () from /usr/lib64/libc.so.6
#16 xxx in exit () from /usr/lib64/libc.so.6
#17 xxx in ?? () from /usr/lib64/libc.so.6
#18 xxx in __libc_start_main () from /usr/lib64/libc.so.6
#19 xxx in _start ()

Before submitting...

  • Ensure you searched for relevant issues and read the [documentation]
Originally created by @CherryHuhu on GitHub (Jun 12, 2026). Original GitHub issue: https://github.com/kvcache-ai/Mooncake/issues/2440 Originally assigned to: @CherryHuhu on GitHub. ### Bug Report #0 xxx in ?? () from /usr/lib64/libc.so.6 #1 xxx in raise () from /usr/lib64/libc.so.6 #2 xxx in abort () from /usr/lib64/libc.so.6 #3 xxx in ?? () from /usr/lib64/libc.so.6 #4 xxx in ?? () from /usr/lib64/libc.so.6 #5 xxx in ?? () from /usr/lib64/libc.so.6 #6 xxx in ?? () from /usr/lib64/libc.so.6 #7 xxx in ?? () from /usr/lib64/libc.so.6 #8 xxx in ?? () from /usr/lib64/libc.so.6 #9 xxx in free () from /usr/lib64/libc.so.6 #10 xxx in ?? () from /home/xxx/run/master_0611/cann-9.1.0/lib64/libascend_trace.so #11 xxx in ?? () from /home/xxx/run/master_0611/cann-9.1.0/lib64/libascend_trace.so #12 xxx in ?? () from /home/xxx/run/master_0611/cann-9.1.0/lib64/libascend_trace.so #13 xxx in ?? () from /lib/ld-linux-aarch64.so.1 #14 xxx in ?? () from /lib/ld-linux-aarch64.so.1 #15 xxx in ?? () from /usr/lib64/libc.so.6 #16 xxx in exit () from /usr/lib64/libc.so.6 #17 xxx in ?? () from /usr/lib64/libc.so.6 #18 xxx in __libc_start_main () from /usr/lib64/libc.so.6 #19 xxx in _start () ### Before submitting... - [x] Ensure you searched for relevant issues and read the [documentation]
bsakaguchi 2026-10-29 21:17:35 +00:00
bsakaguchi commented 2026-10-29 21:17:37 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Jun 12, 2026):

Thanks for opening this issue, @CherryHuhu!

Field Value
Issue #2440
GitHub user ID 43200950
Reporter @CherryHuhu

A maintainer will triage this when possible. To help us respond faster, please include:

  • Mooncake version or commit SHA
  • Environment (OS, CUDA/driver, RDMA stack if relevant)
  • Steps to reproduce and expected vs. actual behavior

Useful links: Documentation · Contributing guide

This message was posted automatically by the issue bot.

<!-- gh-comment-id:4686822391 --> @github-actions[bot] commented on GitHub (Jun 12, 2026): Thanks for opening this issue, @CherryHuhu! | Field | Value | |-------|-------| | **Issue** | #2440 | | **GitHub user ID** | `43200950` | | **Reporter** | @CherryHuhu | A maintainer will triage this when possible. To help us respond faster, please include: - Mooncake version or commit SHA - Environment (OS, CUDA/driver, RDMA stack if relevant) - Steps to reproduce and expected vs. actual behavior Useful links: [Documentation](https://kvcache-ai.github.io/Mooncake/) · [Contributing guide](https://github.com/kvcache-ai/Mooncake/blob/main/CONTRIBUTING.md) > This message was posted automatically by the issue bot.
bsakaguchi commented 2026-10-29 21:17:37 +00:00
Author
Owner
Copy link

@ykwd commented on GitHub (Jun 15, 2026):

@JieTang66 Could you kindly take a look when you have time? Thanks

<!-- gh-comment-id:4704008763 --> @ykwd commented on GitHub (Jun 15, 2026): @JieTang66 Could you kindly take a look when you have time? Thanks
bsakaguchi commented 2026-10-29 21:17:37 +00:00
Author
Owner
Copy link

@VNightMare commented on GitHub (Jun 16, 2026):

Thank you for reporting this issue, we need more details to trace it. Would you please provide:

  1. Hixl or CANN version.
  2. Mooncake version or commit SHA.
  3. Detailed core dump and Mooncake logs.

Notes: I previously encountered a similar problem , but I'm not sure if it's the same one. In my case, I solved it by changing the memory allocator to jemalloc, maybe you can have a try.

<!-- gh-comment-id:4716195687 --> @VNightMare commented on GitHub (Jun 16, 2026): Thank you for reporting this issue, we need more details to trace it. Would you please provide: 1. Hixl or CANN version. 2. Mooncake version or commit SHA. 3. Detailed core dump and Mooncake logs. > Notes: I previously encountered a similar problem , but I'm not sure if it's the same one. In my case, I solved it by changing the memory allocator to jemalloc, maybe you can have a try.
bsakaguchi commented 2026-10-29 21:17:37 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Sep 15, 2026):

This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.

<!-- gh-comment-id:5674168554 --> @github-actions[bot] commented on GitHub (Sep 15, 2026): This issue has had no activity for 90 days and will be closed in 7 days if there is no further activity. Please comment or react if it should stay open.
bsakaguchi commented 2026-10-29 21:17:37 +00:00
Author
Owner
Copy link

@github-actions[bot] commented on GitHub (Sep 23, 2026):

Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.

<!-- gh-comment-id:5788363380 --> @github-actions[bot] commented on GitHub (Sep 23, 2026): Closing due to 3 months of inactivity. If this is still relevant, please comment and we can reopen.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
te-coro
staryxchen-tent-capability-research
feature/musa-ep-jit
zxpdemonio/fix-tent-bootstrap-admission
add-store-rs-tone-tests
scatter-rdma-completion-pr2
P2P-Mooncake-Store
release/v0.3.14
feat/tent-rdma-adaptive-adapter
fix/ep-local-counter-gpu-scope
codex/kvcs-oplog-eviction
give-me-a-star
cruz/mooncake-kvcs-lowlevel-pr1-20261008
ylt-handshake-limits
ci/rocm-e2e-tent
sima/docs-pypi-downloads
fix-ci/hicache-mooncake-metadata-loopback
sima/cuda-driver-loading
sima/ci-performance-gate
fix/tent-rdma-unknown-topology-rail-pairing
ci/tent-e2e-dual-job
mc-patch-1
codex/p2p-merge-prerequisites
sima/store-hca-numa-placement
codex/p2p-merge-cli
codex/p2p-merge-ipv6
copilot/fix-ctests-job-failure
czh/pg-device-collectives-pr6
dependabot/cargo/mooncake-store-rs/pyo3-0.29.0
czh/pg-device-collectives-pr5
codex/segment-pool-master-cutover
sima/nightly-ci-recovery
ci/tent-params
stmatengss-patch-1
dependabot/cargo/mooncake-store-rs/rand-0.8.8
dependabot/cargo/mooncake-store-rs/opentelemetry_sdk-0.32.1
dependabot/cargo/mooncake-store-rs/xxhash-rust-0.8.16
codex/migrate-store-rest-service
fix/tone-wheel-arch-selection
czh/pg-device-collectives-pr4
czh/pg-device-collectives-pr3
ketong/fix_moe_tc
copilot/fix-test-wheel-ubuntu-job
fix/ci-wheel-torch-pg-pin
codex/migrate-structured-object-storage
codex/migrate-allocator-python
codex/migrate-vllm-python
codex/migrate-shared-segment
ci/fix_sgl_eval_install
codex/segment-pool-nof-placement-cleanup
feat/pip-native-release
copilot/bugfix-ha-standby-promotion
copilot/mooncake-store-transport-settings
copilot/fix-tensor-support-issues
copilot/optimize-rl-direction
copilot/mooncake-storeagentic-workflow
copilot/fix-client-reconnect-timeout
copilot/mooncake-error-debugging
copilot/mooncake-ipv6-support
feat/nccl-host-python-api
dependabot/go_modules/mooncake-p2p-store/src/p2pstore/google.golang.org/grpc-1.82.1
copilot/migrate-and-move-operations
copilot/migrate-and-move-operations-again
refactor/centralize-env-vars
idhanani/mooncake-retain-groups
copilot/codeownerreviewer
copilot/give-feedback-on-issue-2123
copilot/create-issue-rfc
copilot/break-cuda-monopoly-logic
copilot/compare-cudamemcpy-cu12-cu13
copilot/report-ci-error-issue
copilot/research-commit-history-analysis
copilot/explain-mooncake-store-service
copilot/analyze-project-functionality
copilot/sub-pr-1680
copilot/review-pr-1680
copilot/sub-pr-1597
copilot/fix-github-actions-job-failure
copilot/move-test-sglang-integration-job
v0.3.14
v0.3.14-pre-4
v0.3.14-pre-3
v0.3.14-pre-2
v0.3.14-pre
v0.3.14-rc1
v0.3.13.post1
v0.3.13-rc2
v0.3.13-rc1
v0.3.13
v0.3.12.post1
v0.3.12
v0.3.11-rc1
v0.3.11.post1
v0.3.11
v0.3.10.post2
v0.3.10.post1
v0.3.10
v0.3.9
v0.3.8.post1
v0.3.8
v0.3.7.post2
v0.3.7.post1
v0.3.7
v0.3.6.post1
v0.3.6
v0.3.5
v0.3.4.post2
v0.3.4.post1
v0.3.4
v0.3.3.post2
v0.3.3.post1
v0.3.3
v0.3.2.post1
v0.3.2
v0.3.1
v0.3.0
v0.3.0-beta
v0.3.0-alpha
v0.2.0
Labels
Clear labels   
ascend

   
auto-closed

   
bug

   
bug

   
CI/Build

   
Common

   
documentation

   
enhancement

   
feature request

   
good first issue

   
help wanted

   
high priority

   
MetaX

   
nightly-failure

   
pull-request
Mirrored from GitHub Pull Request

  
PyTorch Backend

   
question

   
RFC

   
Roadmap

   
stale

   
Store

   
Tests

   
Transfer Engine
No labels
ascend
auto-closed
bug
bug
CI/Build
Common
documentation
enhancement
feature request
good first issue
help wanted
high priority
MetaX
nightly-failure
pull-request
PyTorch Backend
question
RFC
Roadmap
stale
Store
Tests
Transfer Engine
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
kvcache-ai/Mooncake#646
No description provided.