Skip to content

[MoE] Add Comprehensive MoE Integration Tests#12090

Merged
ch-wan merged 30 commits intosgl-project:mainfrom
Jonahcb:moe/comprehensive-moe-integration-tests
Nov 7, 2025
Merged

[MoE] Add Comprehensive MoE Integration Tests#12090
ch-wan merged 30 commits intosgl-project:mainfrom
Jonahcb:moe/comprehensive-moe-integration-tests

Conversation

@Jonahcb
Copy link
Contributor

@Jonahcb Jonahcb commented Oct 24, 2025

Motivation

This PR adds a comphrensive suite of MoE integration tests to add test coverage for MoE models from beginning to end. Currently, MoE code is only tested tangentially through the testing of other features (i.e., quantization).

Modifications

Added test file test/srt/layers/moe/test_moe_runners.py with integration tests.

Accuracy Tests

Benchmarking and Profiling

Checklist

@b8zhong b8zhong added the run-ci label Oct 28, 2025
@Jonahcb Jonahcb marked this pull request as ready for review November 3, 2025 21:06
@ch-wan ch-wan self-assigned this Nov 4, 2025
@ch-wan ch-wan merged commit bc25ea6 into sgl-project:main Nov 7, 2025
67 of 81 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

Comments