[Feature]: Support Mega-Moe V1

[yanboshao]

Suggestion Description

Fused dispatch&sorting&moe-gemm1 and moe-gemm2 & combine.

Operating System

No response

GPU

No response

ROCm Component

No response

[yanboshao]

6/23 Update:

1. Optimize the performance degradation of flydsl combine under large shapes.
2. During E2E testing, severe inter-card desynchronization issues were observed under concurrency of c512 and c4096. This accounts for the major performance gap between EP+DP and TP+DP configurations. An E2E test with a dummy EPLB needs to be implemented subsequently.

[yanboshao]

6/30 Update:
Dsv4 pro e2e:

1. conc2048+1k/1k: fake-eplb ep+dp == real routing tp+dp
2. conc1024 + 8K/1K: 20%-imbalance/fake-eplb ep+dp >> 20%-imbalance/fake-eplb tp+dp