Skip to content

Comments

Scenario: Run multiple latency benchmarks with different sizes and rates#35

Open
tbroden84 wants to merge 11 commits intomainfrom
multiple-latency-runs
Open

Scenario: Run multiple latency benchmarks with different sizes and rates#35
tbroden84 wants to merge 11 commits intomainfrom
multiple-latency-runs

Conversation

@tbroden84
Copy link
Contributor

WHY are these changes introduced?

Extended #34 to benchmark latency instead of throughput.

Part of making multiple runs: #30

WHAT is this pull request doing?

  • Uploads multiple latency runs script
  • Collect and present the results in a summary table

HOW was this pull request tested?

Tested for c8g.large for 20 seconds over message sizes [16, 64, 256, 512, 1024] and rate limits [10, 100, 1000, 10000, 50000, 100000, 200000, 500000]

https://gist.github.com/tbroden84/79ba926c519f7a52d64d690088297abd

@tbroden84 tbroden84 requested a review from a team as a code owner February 23, 2026 11:54
@tbroden84
Copy link
Contributor Author

Interesting observation on small rate limit where latency can be really high. From the output it's during the first second of the run. Perhaps lavinmqperf needs a warmup period or discard -N number of starting measurements.

@jage
Copy link
Member

jage commented Feb 24, 2026

Interesting observation on small rate limit where latency can be really high. From the output it's during the first second of the run. Perhaps lavinmqperf needs a warmup period or discard -N number of starting measurements.

IIRC the latest version should have a "ready" gate, e.g. publisher won't start until consumer is ready, maybe we need to revisit that. Can you reproduce it locally?

@viktorerlingsson
Copy link
Member

I wonder if it would make a difference using a lower prefetch-value when running the latency tests 🤔

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants