[GH-ISSUE #479] test hybrid Ep #308

Closed
opened 2026-10-26 09:58:21 +00:00 by bsakaguchi · 0 comments
Owner

Originally created by @kzlxd on GitHub (Nov 4, 2025).
Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/479

python3: /opt/DeepEP/csrc/hybrid_ep/executor/executor.cu:20: std::tuple<at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor> Executor::metadata_preprocess_core(HybridEpConfigInstance, hybrid_ep::tmp_state_t*, at::Tensor, int): Assertion `num_of_expert == config.num_of_experts_per_rank * config.num_of_ranks_per_node * config.num_of_nodes' failed.

After modifying the default --num-processes to 8 in test_hybrid_ep.py, this error occurred. Could you advise whether it is possible to test with 8 ranks?

Originally created by @kzlxd on GitHub (Nov 4, 2025). Original GitHub issue: https://github.com/deepseek-ai/DeepEP/issues/479 python3: /opt/DeepEP/csrc/hybrid_ep/executor/executor.cu:20: std::tuple<at::Tensor, at::Tensor, at::Tensor, at::Tensor, at::Tensor> Executor::metadata_preprocess_core(HybridEpConfigInstance, hybrid_ep::tmp_state_t*, at::Tensor, int): Assertion `num_of_expert == config.num_of_experts_per_rank * config.num_of_ranks_per_node * config.num_of_nodes' failed. After modifying the default --num-processes to 8 in test_hybrid_ep.py, this error occurred. Could you advise whether it is possible to test with 8 ranks?
Sign in to join this conversation.
No labels
pull-request
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
deepseek-ai/DeepEP#308
No description provided.