Skip to content

[Core][MoE] Add explicit expert-parallel topology - #52099

Draft
LiuYinfeng01 wants to merge 1 commit into
vllm-project:mainfrom
LiuYinfeng01:feat/explicit-expert-parallel-size
Draft

[Core][MoE] Add explicit expert-parallel topology#52099
LiuYinfeng01 wants to merge 1 commit into
vllm-project:mainfrom
LiuYinfeng01:feat/explicit-expert-parallel-size

Conversation

@LiuYinfeng01

@LiuYinfeng01 LiuYinfeng01 commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add an experimental --expert-parallel-size independent of tensor parallel size
  • construct fixed-TP-lane EP groups, e.g. TP4/DP2 gives [0,4], [1,5], [2,6], [3,7]
  • preserve existing flattened EP behavior when the option is unset
  • fail closed for PP/PCP, EPLB, elastic EP, non-AG/RS backends, and EP sizes other than DP

This is the topology foundation for experts that remain tensor-sharded while ownership is distributed across DP ranks. MoE execution support is stacked in #52100.

Test plan

  • pytest -q tests/config/test_explicit_expert_parallel.py — 9 passed
  • Ruff check and format check on changed files
  • git diff --check

Allow an experimental EP size independent of TP and construct fixed-lane EP groups while rejecting unsupported backends and parallel modes.

Signed-off-by: Liuyinfeng01 <yinfeliu@amd.com>

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@LiuYinfeng01
LiuYinfeng01 marked this pull request as draft August 13, 2026 05:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant