Skip to content

ci(versioning): use commit headless to sign commits#1763

Draft
iunanua wants to merge 4 commits intomainfrom
igor/versioning/use-commit-headless-and-check-deps
Draft

ci(versioning): use commit headless to sign commits#1763
iunanua wants to merge 4 commits intomainfrom
igor/versioning/use-commit-headless-and-check-deps

Conversation

@iunanua
Copy link
Contributor

@iunanua iunanua commented Mar 18, 2026

What does this PR do?

  • use commit-headless to sign commits
  • add a new workflow input to allow selecting the starting SHA commit where to start the release from
  • add the new check-breaking-deps job to check if the crates in the proposal have duplicated dependencies with different versions. It just prints the warning but it should be included in the PR's body if it is useful

@pr-commenter
Copy link

pr-commenter bot commented Mar 18, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-03-18 16:42:53

Comparing candidate commit db23630 in PR branch igor/versioning/use-commit-headless-and-check-deps with baseline commit 6e12752 in branch ``.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 2 unstable metrics.

Explanation

This is an A/B test comparing a candidate commit's performance against that of a baseline commit. Performance changes are noted in the tables below as:

  • 🟩 = significantly better candidate vs. baseline
  • 🟥 = significantly worse candidate vs. baseline

We compute a confidence interval (CI) over the relative difference of means between metrics from the candidate and baseline commits, considering the baseline as the reference.

If the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD), the change is considered significant.

Feel free to reach out to #apm-benchmarking-platform on Slack if you have any questions.

More details about the CI and significant changes

You can imagine this CI as a range of values that is likely to contain the true difference of means between the candidate and baseline commits.

CIs of the difference of means are often centered around 0%, because often changes are not that big:

---------------------------------(------|---^--------)-------------------------------->
                              -0.6%    0%  0.3%     +1.2%
                                 |          |        |
         lower bound of the CI --'          |        |
sample mean (center of the CI) -------------'        |
         upper bound of the CI ----------------------'

As described above, a change is considered significant if the CI is entirely outside the configured SIGNIFICANT_IMPACT_THRESHOLD (or the deprecated UNCONFIDENCE_THRESHOLD).

For instance, for an execution time metric, this confidence interval indicates a significantly worse performance:

----------------------------------------|---------|---(---------^---------)---------->
                                       0%        1%  1.3%      2.2%      3.1%
                                                  |   |         |         |
       significant impact threshold --------------'   |         |         |
                      lower bound of CI --------------'         |         |
       sample mean (center of the CI) --------------------------'         |
                      upper bound of CI ----------------------------------'

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.194ms 14.234ms ± 0.025ms 14.230ms ± 0.010ms 14.241ms 14.268ms 14.337ms 14.385ms 1.09% 2.630 10.858 0.18% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.230ms; 14.237ms] or [-0.025%; +0.025%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_timestamped_x1000 execution_time 4.270ms 4.275ms ± 0.008ms 4.274ms ± 0.001ms 4.276ms 4.279ms 4.286ms 4.378ms 2.42% 11.360 144.326 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_timestamped_x1000 execution_time [4.274ms; 4.276ms] or [-0.025%; +0.025%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.804µs 147.124µs ± 1.695µs 146.867µs ± 0.531µs 147.441µs 148.628µs 153.785µs 162.953µs 10.95% 5.360 41.106 1.15% 0.120µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.889µs; 147.359µs] or [-0.160%; +0.160%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.427µs 33.478µs ± 1.521µs 32.517µs ± 0.053µs 35.568µs 36.072µs 36.279µs 36.473µs 12.16% 0.941 -1.055 4.53% 0.108µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.267µs; 33.688µs] or [-0.630%; +0.630%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 87.003µs 87.639µs ± 0.166µs 87.626µs ± 0.048µs 87.683µs 87.776µs 87.927µs 89.153µs 1.74% 5.139 44.786 0.19% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [87.616µs; 87.662µs] or [-0.026%; +0.026%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 237.919ns 249.056ns ± 14.152ns 242.708ns ± 3.263ns 249.138ns 285.192ns 287.875ns 290.590ns 19.73% 1.773 1.729 5.67% 1.001ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [247.095ns; 251.018ns] or [-0.788%; +0.788%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.270µs 3.222µs ± 1.390µs 3.022µs ± 0.030µs 3.043µs 3.702µs 13.712µs 14.789µs 389.35% 7.335 55.167 43.03% 0.098µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.029µs; 3.415µs] or [-5.979%; +5.979%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 12.979ms 13.011ms ± 0.017ms 13.009ms ± 0.009ms 13.018ms 13.040ms 13.060ms 13.121ms 0.86% 2.028 8.696 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [13.009ms; 13.013ms] or [-0.018%; +0.018%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.427µs 2.466µs ± 0.021µs 2.460µs ± 0.011µs 2.476µs 2.517µs 2.528µs 2.529µs 2.82% 1.266 1.644 0.84% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.463µs; 2.468µs] or [-0.116%; +0.116%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.056µs 160.726µs ± 0.344µs 160.639µs ± 0.179µs 160.868µs 161.302µs 161.771µs 162.798µs 1.34% 1.906 6.939 0.21% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.678µs; 160.773µs] or [-0.030%; +0.030%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 719.309µs 720.005µs ± 0.441µs 719.940µs ± 0.242µs 720.186µs 720.852µs 721.522µs 722.158µs 0.31% 1.680 3.998 0.06% 0.031µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [719.944µs; 720.066µs] or [-0.008%; +0.008%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.004ms 49.342ms ± 1.110ms 49.179ms ± 0.058ms 49.238ms 49.385ms 55.224ms 59.689ms 21.37% 7.953 65.217 2.24% 0.078ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [49.188ms; 49.496ms] or [-0.312%; +0.312%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.895µs 3.914µs ± 0.003µs 3.914µs ± 0.002µs 3.915µs 3.918µs 3.920µs 3.925µs 0.29% -0.799 9.030 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254777120.855op/s 255521586.672op/s ± 183579.287op/s 255521874.187op/s ± 111822.642op/s 255640065.196op/s 255756711.107op/s 255834022.954op/s 256720404.863op/s 0.47% 0.821 9.149 0.07% 12981.016op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 80.210µs 80.782µs ± 0.271µs 80.752µs ± 0.192µs 80.954µs 81.269µs 81.576µs 81.606µs 1.06% 0.503 0.120 0.33% 0.019µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12254059.058op/s 12379200.185op/s ± 41399.021op/s 12383644.306op/s ± 29397.177op/s 12411512.609op/s 12440682.525op/s 12449539.674op/s 12467223.268op/s 0.67% -0.484 0.086 0.33% 2927.353op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 72.971µs 73.501µs ± 0.288µs 73.477µs ± 0.215µs 73.689µs 74.020µs 74.265µs 74.490µs 1.38% 0.684 0.370 0.39% 0.020µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13424652.558op/s 13605474.426op/s ± 53120.239op/s 13609694.914op/s ± 39880.209op/s 13650338.695op/s 13677447.807op/s 13687891.950op/s 13704030.033op/s 0.69% -0.662 0.315 0.39% 3756.168op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.892µs 3.913µs ± 0.003µs 3.913µs ± 0.001µs 3.914µs 3.917µs 3.920µs 3.938µs 0.66% 1.537 31.476 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 253911690.388op/s 255572047.817op/s ± 201605.293op/s 255577458.069op/s ± 76321.521op/s 255651047.125op/s 255789587.412op/s 255848184.536op/s 256922818.516op/s 0.53% -1.463 31.240 0.08% 14255.647op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 69.989µs 70.642µs ± 0.305µs 70.620µs ± 0.216µs 70.844µs 71.210µs 71.351µs 71.844µs 1.73% 0.624 0.605 0.43% 0.022µs 1 200
credit_card/is_card_number/378282246310005 throughput 13919057.739op/s 14156047.179op/s ± 60898.092op/s 14160299.498op/s ± 43241.148op/s 14202065.336op/s 14240072.364op/s 14262609.383op/s 14288006.979op/s 0.90% -0.595 0.535 0.43% 4306.145op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 53.073µs 53.155µs ± 0.112µs 53.146µs ± 0.018µs 53.163µs 53.188µs 53.238µs 54.248µs 2.07% 8.919 83.201 0.21% 0.008µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18433701.097op/s 18813061.381op/s ± 38766.205op/s 18816124.304op/s ± 6540.094op/s 18823031.682op/s 18835155.551op/s 18838921.076op/s 18841916.025op/s 0.14% -8.883 82.750 0.21% 2741.185op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.430µs 6.437µs ± 0.005µs 6.437µs ± 0.003µs 6.440µs 6.445µs 6.453µs 6.459µs 0.34% 1.138 2.380 0.07% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154833387.219op/s 155343432.110op/s ± 113330.114op/s 155359365.768op/s ± 68923.175op/s 155425031.202op/s 155495415.875op/s 155523842.236op/s 155529042.447op/s 0.11% -1.131 2.353 0.07% 8013.649op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.894µs 3.913µs ± 0.003µs 3.913µs ± 0.001µs 3.914µs 3.917µs 3.918µs 3.920µs 0.19% -1.810 14.245 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255100971.898op/s 255571841.497op/s ± 167316.918op/s 255579570.908op/s ± 90879.358op/s 255659612.176op/s 255812805.779op/s 255863543.884op/s 256823629.059op/s 0.49% 1.836 14.460 0.07% 11831.093op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.833µs 65.141µs ± 0.123µs 65.106µs ± 0.066µs 65.202µs 65.390µs 65.500µs 65.527µs 0.65% 0.975 0.706 0.19% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15260786.527op/s 15351399.164op/s ± 29029.637op/s 15359452.581op/s ± 15510.825op/s 15370648.979op/s 15383936.940op/s 15395718.240op/s 15424321.069op/s 0.42% -0.965 0.687 0.19% 2052.705op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.203µs 58.386µs ± 0.131µs 58.367µs ± 0.074µs 58.436µs 58.612µs 58.789µs 59.083µs 1.23% 1.763 5.415 0.22% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16925247.382op/s 17127608.515op/s ± 38204.068op/s 17132822.209op/s ± 21825.192op/s 17155005.852op/s 17170958.673op/s 17178818.793op/s 17181159.141op/s 0.28% -1.735 5.243 0.22% 2701.436op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.918µs 3.919µs 0.16% -1.226 7.989 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255181527.813op/s 255590292.000op/s ± 172590.009op/s 255598300.273op/s ± 115668.994op/s 255707339.549op/s 255809724.335op/s 255882509.851op/s 256730074.442op/s 0.44% 1.243 8.116 0.07% 12203.957op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 55.124µs 55.529µs ± 0.168µs 55.505µs ± 0.111µs 55.627µs 55.843µs 55.963µs 56.063µs 1.01% 0.622 0.130 0.30% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17837049.780op/s 18008634.658op/s ± 54332.984op/s 18016515.969op/s ± 36248.112op/s 18051146.378op/s 18081302.144op/s 18100686.116op/s 18140871.383op/s 0.69% -0.606 0.104 0.30% 3841.922op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.710µs 52.902µs ± 0.059µs 52.903µs ± 0.037µs 52.938µs 53.002µs 53.043µs 53.056µs 0.29% 0.009 0.268 0.11% 0.004µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 18847977.697op/s 18902825.612op/s ± 20923.585op/s 18902601.945op/s ± 13242.099op/s 18917086.859op/s 18937144.641op/s 18951641.214op/s 18971617.857op/s 0.37% -0.002 0.270 0.11% 1479.521op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.429µs 6.439µs ± 0.005µs 6.438µs ± 0.003µs 6.442µs 6.447µs 6.454µs 6.456µs 0.29% 0.822 0.883 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154882684.096op/s 155305108.283op/s ± 115791.130op/s 155327096.812op/s ± 72599.864op/s 155386546.422op/s 155454658.731op/s 155506568.578op/s 155534592.826op/s 0.13% -0.817 0.870 0.07% 8187.669op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.913µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255496144.348op/s; 255547028.995op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.744µs; 80.819µs] or [-0.046%; +0.046%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12373462.678op/s; 12384937.691op/s] or [-0.046%; +0.046%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [73.461µs; 73.541µs] or [-0.054%; +0.054%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13598112.471op/s; 13612836.380op/s] or [-0.054%; +0.054%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255544107.262op/s; 255599988.372op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [70.600µs; 70.685µs] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/378282246310005 throughput [14147607.290op/s; 14164487.069op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [53.139µs; 53.170µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [18807688.757op/s; 18818434.004op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.437µs; 6.438µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 throughput [155327725.646op/s; 155359138.573op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255548652.982op/s; 255595030.013op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.124µs; 65.158µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15347375.936op/s; 15355422.393op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.367µs; 58.404µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17122313.799op/s; 17132903.232op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255566372.685op/s; 255614211.315op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [55.506µs; 55.553µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18001104.629op/s; 18016164.687op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.894µs; 52.910µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [18899925.804op/s; 18905725.420op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.438µs; 6.440µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155289060.746op/s; 155321155.820op/s] or [-0.010%; +0.010%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 4.226ms 4.230ms ± 0.003ms 4.230ms ± 0.001ms 4.231ms 4.234ms 4.245ms 4.247ms 0.41% 3.083 12.116 0.07% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [4.230ms; 4.231ms] or [-0.010%; +0.010%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2598 execution_time 3.425ms 3.453ms ± 0.023ms 3.450ms ± 0.008ms 3.458ms 3.480ms 3.497ms 3.721ms 7.85% 7.629 83.131 0.68% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2598 execution_time [3.449ms; 3.456ms] or [-0.094%; +0.094%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.993µs 5.057µs ± 0.044µs 5.046µs ± 0.029µs 5.089µs 5.144µs 5.148µs 5.149µs 2.05% 0.705 -0.692 0.87% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.050µs; 5.063µs] or [-0.121%; +0.121%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 190.718ns 193.143ns ± 2.219ns 192.835ns ± 1.422ns 193.923ns 197.949ns 199.419ns 206.182ns 6.92% 1.899 5.936 1.15% 0.157ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.835ns; 193.450ns] or [-0.159%; +0.159%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 495.453µs 496.195µs ± 0.440µs 496.135µs ± 0.319µs 496.490µs 497.016µs 497.327µs 497.844µs 0.34% 0.662 0.238 0.09% 0.031µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 2008660.675op/s 2015337.439op/s ± 1786.594op/s 2015579.309op/s ± 1295.999op/s 2016778.759op/s 2017720.462op/s 2018263.543op/s 2018356.278op/s 0.14% -0.657 0.225 0.09% 126.331op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 369.860µs 370.534µs ± 0.817µs 370.443µs ± 0.171µs 370.616µs 370.923µs 373.290µs 378.425µs 2.15% 7.934 69.547 0.22% 0.058µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2642530.938op/s 2698824.087op/s ± 5845.566op/s 2699473.485op/s ± 1246.479op/s 2700672.121op/s 2702184.969op/s 2703268.750op/s 2703725.734op/s 0.16% -7.877 68.794 0.22% 413.344op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 168.804µs 169.279µs ± 0.382µs 169.260µs ± 0.180µs 169.427µs 169.593µs 169.848µs 173.739µs 2.65% 8.015 91.248 0.22% 0.027µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5755760.077op/s 5907428.567op/s ± 13090.932op/s 5908058.654op/s ± 6266.938op/s 5914790.022op/s 5919090.086op/s 5920733.333op/s 5924022.075op/s 0.27% -7.821 88.246 0.22% 925.669op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.833µs 37.027µs ± 0.109µs 37.061µs ± 0.076µs 37.114µs 37.180µs 37.203µs 37.207µs 0.39% -0.299 -1.284 0.29% 0.008µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26876797.084op/s 27007756.956op/s ± 79933.479op/s 26982864.911op/s ± 55500.376op/s 27095067.288op/s 27132570.266op/s 27143676.306op/s 27149924.484op/s 0.62% 0.305 -1.283 0.30% 5652.151op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 46.198µs 46.326µs ± 0.056µs 46.316µs ± 0.028µs 46.349µs 46.430µs 46.534µs 46.598µs 0.61% 1.600 4.661 0.12% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21460338.728op/s 21586239.717op/s ± 25853.059op/s 21590864.165op/s ± 12943.938op/s 21602098.503op/s 21617983.399op/s 21628927.320op/s 21646147.139op/s 0.26% -1.585 4.592 0.12% 1828.087op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [496.134µs; 496.256µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [2015089.834op/s; 2015585.043op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [370.420µs; 370.647µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2698013.948op/s; 2699634.226op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [169.226µs; 169.332µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5905614.290op/s; 5909242.844op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.012µs; 37.042µs] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26996678.945op/s; 27018834.968op/s] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.318µs; 46.334µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21582656.732op/s; 21589822.702op/s] or [-0.017%; +0.017%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 186.032µs 186.384µs ± 0.183µs 186.363µs ± 0.128µs 186.499µs 186.708µs 186.813µs 186.837µs 0.25% 0.405 -0.566 0.10% 0.013µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5352248.178op/s 5365286.583op/s ± 5251.466op/s 5365881.699op/s ± 3696.951op/s 5369342.290op/s 5372984.129op/s 5374857.295op/s 5375411.337op/s 0.18% -0.401 -0.569 0.10% 371.335op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.921µs 17.992µs ± 0.034µs 17.987µs ± 0.021µs 18.013µs 18.048µs 18.083µs 18.146µs 0.88% 0.902 1.853 0.19% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55109508.150op/s 55580664.615op/s ± 104771.474op/s 55595266.460op/s ± 66102.866op/s 55645050.046op/s 55727379.075op/s 55782606.676op/s 55800614.557op/s 0.37% -0.885 1.792 0.19% 7408.462op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.236µs 10.322µs ± 0.040µs 10.316µs ± 0.027µs 10.355µs 10.385µs 10.424µs 10.437µs 1.17% 0.413 -0.219 0.39% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 95816196.741op/s 96884786.947op/s ± 375267.006op/s 96937873.209op/s ± 251303.133op/s 97149748.764op/s 97436052.622op/s 97629313.589op/s 97694994.735op/s 0.78% -0.395 -0.241 0.39% 26535.385op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [186.358µs; 186.409µs] or [-0.014%; +0.014%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5364558.781op/s; 5366014.386op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.987µs; 17.997µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [55566144.296op/s; 55595184.933op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.316µs; 10.327µs] or [-0.054%; +0.054%] None None None
normalization/normalize_name/normalize_name/good throughput [96832778.549op/s; 96936795.345op/s] or [-0.054%; +0.054%] None None None

Group 20

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db23630 1773851014 igor/versioning/use-commit-headless-and-check-deps
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.162µs 26.262µs ± 9.844µs 18.699µs ± 0.460µs 33.786µs 43.613µs 49.141µs 74.182µs 296.71% 1.236 2.331 37.39% 0.696µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.898µs; 27.626µs] or [-5.195%; +5.195%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Mar 18, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.46%. Comparing base (4cdb16c) to head (db23630).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1763      +/-   ##
==========================================
- Coverage   71.47%   71.46%   -0.01%     
==========================================
  Files         430      430              
  Lines       64105    64132      +27     
==========================================
+ Hits        45820    45834      +14     
- Misses      18285    18298      +13
Components Coverage Δ
libdd-crashtracker 63.94% <ø> (ø)
libdd-crashtracker-ffi 18.19% <ø> (ø)
libdd-alloc 98.77% <ø> (ø)
libdd-data-pipeline 87.92% <ø> (ø)
libdd-data-pipeline-ffi 74.85% <ø> (ø)
libdd-common 79.73% <ø> (ø)
libdd-common-ffi 73.40% <ø> (ø)
libdd-telemetry 62.48% <ø> (ø)
libdd-telemetry-ffi 16.75% <ø> (ø)
libdd-dogstatsd-client 82.64% <ø> (ø)
datadog-ipc 80.35% <ø> (ø)
libdd-profiling 81.47% <ø> (-0.02%) ⬇️
libdd-profiling-ffi 63.65% <ø> (ø)
datadog-sidecar 33.10% <ø> (ø)
datdog-sidecar-ffi 10.79% <ø> (ø)
spawn-worker 54.69% <ø> (ø)
libdd-tinybytes 93.16% <ø> (ø)
libdd-trace-normalization 81.71% <ø> (ø)
libdd-trace-obfuscation 91.80% <ø> (ø)
libdd-trace-protobuf 68.25% <ø> (ø)
libdd-trace-utils 88.95% <ø> (ø)
datadog-tracer-flare 90.46% <ø> (ø)
libdd-log 74.69% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@dd-octo-sts
Copy link
Contributor

dd-octo-sts bot commented Mar 18, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.70 MB 8.70 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 100.36 MB 100.36 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 117.03 MB 117.03 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.28 MB 11.28 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 27.18 MB 27.18 MB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 77.17 KB 77.17 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 186.12 MB 186.13 MB +0% (+16.00 KB) 👌
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 917.08 MB 917.08 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.94 MB 9.94 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 77.17 KB 77.17 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 24.78 MB 24.78 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 51.47 MB 51.47 MB 0% (0 B) 👌
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 22.98 MB 22.98 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 78.37 KB 78.37 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 190.31 MB 190.33 MB +0% (+16.00 KB) 👌
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 900.75 MB 900.75 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.54 MB 7.54 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 78.37 KB 78.37 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 26.52 MB 26.52 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 47.09 MB 47.09 MB 0% (0 B) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 87.57 MB 87.57 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 10.22 MB 10.22 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 109.90 MB 109.90 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.97 MB 11.97 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

ci-build

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@iunanua @codecov-commenter