Skip to content

[smg][ci]: migrate benchmarks to e2e_test/benchmarks/, use parent conftest#16597

Merged
slin1237 merged 3 commits intomainfrom
smg-ci-n/15
Jan 7, 2026
Merged

[smg][ci]: migrate benchmarks to e2e_test/benchmarks/, use parent conftest#16597
slin1237 merged 3 commits intomainfrom
smg-ci-n/15

Conversation

@slin1237
Copy link
Collaborator

@slin1237 slin1237 commented Jan 6, 2026

  • rename router-http-tests to router-benchmark-tests, use e2e_test/benchmarks
  • clean up genai_bench_runner with BenchmarkResult dataclass
  • add GPUMonitor class

Checklist

Review Process

  1. Ping Merge Oncalls to start the PR flow. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments (/tag-run-ci-label, /rerun-failed-ci, /tag-and-rerun-ci) or contact authorized users to do so.
  4. After green CI and required approvals, ask Merge Oncalls to merge.

@gemini-code-assist
Copy link
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

model_path=model_path,
experiment_folder=f"benchmark_cache_aware_regular_{backend}",
thresholds={
"ttft_mean_max": 6,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how is this defined?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

came out of thin air
no logical reason behind this
which is a problem lol
we need to address this

@slin1237 slin1237 force-pushed the smg-ci-n/15 branch 7 times, most recently from 2231bcc to 4bd6929 Compare January 7, 2026 02:51
…ftest

- rename router-http-tests to router-benchmark-tests, use e2e_test/benchmarks
- clean up genai_bench_runner with BenchmarkResult dataclass
- add GPUMonitor class
@slin1237 slin1237 merged commit d8b8198 into main Jan 7, 2026
63 checks passed
@slin1237 slin1237 deleted the smg-ci-n/15 branch January 7, 2026 04:15
michaelzhang-ai pushed a commit to michaelzhang-ai/sglang that referenced this pull request Jan 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments