Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aj/compress metrics #901

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

aj/compress metrics #901

wants to merge 4 commits into from

Conversation

astuyve
Copy link
Contributor

@astuyve astuyve commented Feb 26, 2025

  • feat: use zstd for dogstatsd
  • feat: licenses

What does this PR do?

Uses zstd for dogstatsd. Not optional, always enabled.

Motivation

should help a small bit with network bytes:
Screenshot 2025-02-26 at 2 52 29 PM

@astuyve astuyve requested review from a team as code owners February 26, 2025 19:54
@codecov-commenter
Copy link

codecov-commenter commented Feb 26, 2025

Codecov Report

Attention: Patch coverage is 78.57143% with 3 lines in your changes missing coverage. Please review.

Project coverage is 71.75%. Comparing base (a1d958b) to head (17c18f8).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #901      +/-   ##
==========================================
- Coverage   71.77%   71.75%   -0.02%     
==========================================
  Files         328      328              
  Lines       48702    48712      +10     
==========================================
- Hits        34955    34954       -1     
- Misses      13747    13758      +11     
Components Coverage Δ
crashtracker 42.87% <ø> (-0.03%) ⬇️
crashtracker-ffi 6.25% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 92.21% <ø> (ø)
data-pipeline-ffi 90.39% <ø> (ø)
ddcommon 80.08% <ø> (ø)
ddcommon-ffi 61.05% <ø> (ø)
ddtelemetry 61.74% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.02% <78.57%> (-0.15%) ⬇️
dogstatsd-client 82.57% <ø> (ø)
ipc 82.63% <ø> (ø)
profiling 80.04% <ø> (ø)
profiling-ffi 70.68% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.23% <ø> (ø)
sidecar-ffi 0.14% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 92.00% <ø> (ø)
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 78.13% <ø> (ø)
trace-utils 93.29% <ø> (ø)

@pr-commenter
Copy link

pr-commenter bot commented Feb 26, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-02-27 00:22:48

Comparing candidate commit 17c18f8 in PR branch aj/compress-metrics with baseline commit a1d958b in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.175µs 3.194µs ± 1.423µs 3.003µs ± 0.020µs 3.023µs 3.644µs 13.887µs 14.896µs 396.09% 7.410 55.814 44.42% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.997µs; 3.392µs] or [-6.172%; +6.172%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 67.373µs 67.638µs ± 0.235µs 67.638µs ± 0.072µs 67.697µs 67.783µs 68.021µs 70.552µs 4.31% 9.659 117.424 0.35% 0.017µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [67.605µs; 67.670µs] or [-0.048%; +0.048%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.623ns 253.178ns ± 10.100ns 248.785ns ± 1.363ns 252.299ns 279.540ns 283.259ns 283.365ns 13.90% 2.023 2.608 3.98% 0.714ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [251.778ns; 254.577ns] or [-0.553%; +0.553%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.895µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.919µs 3.921µs 3.922µs 0.19% -1.412 10.473 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254991648.649op/s 255486994.718op/s ± 182750.609op/s 255482806.010op/s ± 79884.041op/s 255562689.528op/s 255783580.871op/s 255891631.912op/s 256742350.560op/s 0.49% 1.435 10.628 0.07% 12922.419op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 82.283µs 82.634µs ± 0.278µs 82.556µs ± 0.129µs 82.736µs 83.247µs 83.598µs 84.041µs 1.80% 1.984 4.899 0.34% 0.020µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11898885.045op/s 12101661.944op/s ± 40455.402op/s 12112983.908op/s ± 18914.406op/s 12128499.852op/s 12141797.775op/s 12150804.116op/s 12153162.795op/s 0.33% -1.954 4.736 0.33% 2860.629op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.376µs 76.898µs ± 0.243µs 76.858µs ± 0.143µs 77.021µs 77.334µs 77.545µs 77.753µs 1.16% 0.688 0.402 0.32% 0.017µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12861229.979op/s 13004305.309op/s ± 41002.829op/s 13011058.359op/s ± 24159.954op/s 13032275.825op/s 13062261.598op/s 13071497.460op/s 13093078.998op/s 0.63% -0.670 0.367 0.31% 2899.338op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.919µs 3.922µs 3.923µs 0.22% -1.462 14.799 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254932749.140op/s 255464496.256op/s ± 179681.189op/s 255484811.428op/s ± 78927.411op/s 255551321.095op/s 255673593.422op/s 255770720.345op/s 256806683.768op/s 0.52% 1.493 15.037 0.07% 12705.379op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 73.016µs 73.794µs ± 0.411µs 73.797µs ± 0.293µs 74.073µs 74.486µs 74.839µs 75.070µs 1.73% 0.285 -0.309 0.56% 0.029µs 1 200
credit_card/is_card_number/378282246310005 throughput 13320836.560op/s 13551655.759op/s ± 75363.320op/s 13550704.671op/s ± 53839.420op/s 13610026.204op/s 13666389.348op/s 13692653.601op/s 13695713.866op/s 1.07% -0.258 -0.347 0.55% 5328.991op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.978µs 52.231µs ± 0.110µs 52.228µs ± 0.083µs 52.316µs 52.423µs 52.467µs 52.563µs 0.64% 0.213 -0.425 0.21% 0.008µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19024789.300op/s 19145969.099op/s ± 40260.127op/s 19146790.114op/s ± 30538.448op/s 19176650.517op/s 19206048.491op/s 19228960.433op/s 19239028.293op/s 0.48% -0.204 -0.432 0.21% 2846.821op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.479µs 6.653µs ± 0.058µs 6.646µs ± 0.037µs 6.693µs 6.754µs 6.766µs 6.774µs 1.91% -0.182 -0.276 0.87% 0.004µs 1 200
credit_card/is_card_number/x371413321323331 throughput 147630302.663op/s 150325582.107op/s ± 1316057.177op/s 150457155.052op/s ± 841873.990op/s 151128792.372op/s 152553469.840op/s 153419128.135op/s 154352863.801op/s 2.59% 0.227 -0.233 0.87% 93059.295op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.895µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.918µs 3.920µs 3.920µs 0.16% -3.100 20.764 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255071619.141op/s 255488387.245op/s ± 181835.821op/s 255476400.520op/s ± 71276.097op/s 255550091.070op/s 255708392.258op/s 255888929.908op/s 256749157.881op/s 0.50% 3.128 20.989 0.07% 12857.734op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.689µs 63.863µs ± 0.086µs 63.851µs ± 0.042µs 63.900µs 64.005µs 64.170µs 64.294µs 0.69% 1.565 5.388 0.13% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15553640.245op/s 15658443.129op/s ± 21131.294op/s 15661576.672op/s ± 10240.699op/s 15671057.516op/s 15688180.527op/s 15699107.899op/s 15701323.622op/s 0.25% -1.545 5.287 0.13% 1494.208op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.437µs 57.548µs ± 0.096µs 57.528µs ± 0.023µs 57.560µs 57.666µs 57.900µs 58.413µs 1.54% 4.951 35.420 0.17% 0.007µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17119338.713op/s 17376848.286op/s ± 28660.641op/s 17382867.446op/s ± 6870.001op/s 17388985.384op/s 17399474.464op/s 17409029.264op/s 17410467.173op/s 0.16% -4.888 34.588 0.16% 2026.613op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.895µs 3.914µs ± 0.003µs 3.914µs ± 0.001µs 3.915µs 3.917µs 3.919µs 3.924µs 0.26% -1.705 13.689 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254854707.880op/s 255518011.805op/s ± 172767.957op/s 255515305.380op/s ± 79047.276op/s 255587577.083op/s 255788675.448op/s 255882313.068op/s 256772229.365op/s 0.49% 1.731 13.870 0.07% 12216.539op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.573µs 54.716µs ± 0.168µs 54.665µs ± 0.022µs 54.691µs 55.125µs 55.444µs 55.556µs 1.63% 3.018 8.930 0.31% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17999939.213op/s 18276352.564op/s ± 55485.085op/s 18293332.081op/s ± 7272.754op/s 18299886.998op/s 18307471.554op/s 18318760.059op/s 18323954.906op/s 0.17% -3.001 8.802 0.30% 3923.388op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.020µs 52.261µs ± 0.112µs 52.255µs ± 0.076µs 52.340µs 52.456µs 52.505µs 52.565µs 0.59% 0.121 -0.164 0.21% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19024199.277op/s 19134667.788op/s ± 40940.261op/s 19136917.077op/s ± 27716.874op/s 19160568.987op/s 19211001.853op/s 19220264.059op/s 19223360.227op/s 0.45% -0.110 -0.168 0.21% 2894.914op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.474µs 6.660µs ± 0.067µs 6.673µs ± 0.043µs 6.712µs 6.758µs 6.796µs 6.829µs 2.34% -0.243 -0.379 1.01% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 146431522.372op/s 150157635.975op/s ± 1523055.488op/s 149857343.326op/s ± 962803.351op/s 151346899.053op/s 152655898.171op/s 153521919.926op/s 154466173.144op/s 3.08% 0.291 -0.350 1.01% 107696.286op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.914µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255461667.241op/s; 255512322.195op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.596µs; 82.673µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12096055.215op/s; 12107268.674op/s] or [-0.046%; +0.046%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [76.865µs; 76.932µs] or [-0.044%; +0.044%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12998622.711op/s; 13009987.907op/s] or [-0.044%; +0.044%] None None None
credit_card/is_card_number/37828224631 execution_time [3.914µs; 3.915µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255439594.171op/s; 255489398.341op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [73.737µs; 73.851µs] or [-0.077%; +0.077%] None None None
credit_card/is_card_number/378282246310005 throughput [13541211.128op/s; 13562100.391op/s] or [-0.077%; +0.077%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.215µs; 52.246µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19140389.433op/s; 19151548.765op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.645µs; 6.661µs] or [-0.121%; +0.121%] None None None
credit_card/is_card_number/x371413321323331 throughput [150143189.239op/s; 150507974.974op/s] or [-0.121%; +0.121%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.914µs; 3.914µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ throughput [255463186.549op/s; 255513587.941op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [63.851µs; 63.875µs] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15655514.535op/s; 15661371.723op/s] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.535µs; 57.561µs] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17372876.197op/s; 17380820.375op/s] or [-0.023%; +0.023%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.913µs; 3.914µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255494067.827op/s; 255541955.782op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.693µs; 54.739µs] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18268662.865op/s; 18284042.263op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.246µs; 52.277µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19128993.862op/s; 19140341.715op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.651µs; 6.670µs] or [-0.140%; +0.140%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [149946555.132op/s; 150368716.817op/s] or [-0.141%; +0.141%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.504µs 25.888µs ± 10.864µs 17.919µs ± 0.185µs 35.658µs 44.677µs 46.220µs 73.639µs 310.96% 1.249 1.866 41.86% 0.768µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.382µs; 27.394µs] or [-5.816%; +5.816%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 149.292µs 150.063µs ± 0.298µs 150.016µs ± 0.156µs 150.189µs 150.607µs 151.249µs 151.478µs 0.97% 1.357 4.086 0.20% 0.021µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [150.022µs; 150.105µs] or [-0.028%; +0.028%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 504.989µs 505.867µs ± 0.608µs 505.825µs ± 0.298µs 506.107µs 506.531µs 506.988µs 512.219µs 1.26% 5.811 57.612 0.12% 0.043µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1952291.844op/s 1976807.679op/s ± 2360.742op/s 1976967.125op/s ± 1165.350op/s 1978166.754op/s 1979237.469op/s 1979640.826op/s 1980241.372op/s 0.17% -5.719 56.326 0.12% 166.930op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 452.715µs 453.417µs ± 0.322µs 453.397µs ± 0.210µs 453.602µs 454.048µs 454.366µs 454.502µs 0.24% 0.724 0.683 0.07% 0.023µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2200208.646op/s 2205476.307op/s ± 1564.710op/s 2205573.937op/s ± 1021.300op/s 2206584.952op/s 2207618.544op/s 2208378.011op/s 2208896.441op/s 0.15% -0.720 0.673 0.07% 110.642op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 174.550µs 176.031µs ± 0.413µs 176.033µs ± 0.258µs 176.290µs 176.649µs 176.808µs 177.515µs 0.84% -0.169 0.760 0.23% 0.029µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5633322.117op/s 5680851.417op/s ± 13325.322op/s 5680745.569op/s ± 8298.402op/s 5688990.523op/s 5701042.056op/s 5713502.540op/s 5729003.865op/s 0.85% 0.188 0.765 0.23% 942.243op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.590µs 37.706µs ± 0.082µs 37.700µs ± 0.032µs 37.729µs 37.783µs 38.070µs 38.415µs 1.90% 4.625 32.940 0.22% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26031403.559op/s 26521252.654op/s ± 57153.630op/s 26524959.660op/s ± 22377.754op/s 26549235.693op/s 26580770.187op/s 26597603.746op/s 26603124.382op/s 0.29% -4.538 31.978 0.21% 4041.372op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.231µs 48.320µs ± 0.109µs 48.311µs ± 0.027µs 48.339µs 48.381µs 48.420µs 49.751µs 2.98% 11.410 147.393 0.22% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20099956.168op/s 20695312.895op/s ± 45498.915op/s 20699173.391op/s ± 11588.598op/s 20710227.846op/s 20724400.214op/s 20729566.253op/s 20733733.856op/s 0.17% -11.280 145.116 0.22% 3217.259op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [505.783µs; 505.951µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1976480.503op/s; 1977134.856op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [453.372µs; 453.462µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2205259.454op/s; 2205693.161op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [175.974µs; 176.088µs] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5679004.656op/s; 5682698.179op/s] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.694µs; 37.717µs] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26513331.711op/s; 26529173.597op/s] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.305µs; 48.335µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20689007.183op/s; 20701618.607op/s] or [-0.030%; +0.030%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.746µs 209.127µs ± 0.154µs 209.133µs ± 0.094µs 209.219µs 209.382µs 209.539µs 209.629µs 0.24% 0.285 0.539 0.07% 0.011µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4770342.463op/s 4781781.383op/s ± 3519.062op/s 4781651.210op/s ± 2151.135op/s 4783919.811op/s 4787170.065op/s 4789865.481op/s 4790504.581op/s 0.19% -0.280 0.532 0.07% 248.835op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.222µs 18.317µs ± 0.058µs 18.318µs ± 0.027µs 18.340µs 18.377µs 18.400µs 18.922µs 3.29% 5.634 58.125 0.31% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52848489.155op/s 54594205.330op/s ± 169351.677op/s 54589635.197op/s ± 81437.517op/s 54676795.818op/s 54826145.142op/s 54868817.243op/s 54879325.436op/s 0.53% -5.371 54.636 0.31% 11974.972op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.665µs 10.720µs ± 0.026µs 10.719µs ± 0.017µs 10.737µs 10.760µs 10.798µs 10.804µs 0.80% 0.437 0.562 0.24% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 92556927.850op/s 93283838.428op/s ± 223802.247op/s 93294393.689op/s ± 144875.866op/s 93419360.594op/s 93653711.153op/s 9371738.749op/s 93767558.877op/s 0.51% -0.420 0.530 0.24% 15825.209op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.106µs; 209.149µs] or [-0.010%; +0.010%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4781293.675op/s; 4782269.091op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.309µs; 18.325µs] or [-0.044%; +0.044%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54570734.816op/s; 54617675.843op/s] or [-0.043%; +0.043%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.716µs; 10.724µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/good throughput [93252821.589op/s; 93314855.267op/s] or [-0.033%; +0.033%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 53.325ms 53.587ms ± 0.199ms 53.545ms ± 0.087ms 53.643ms 53.891ms 54.327ms 54.885ms 2.50% 2.747 11.560 0.37% 0.014ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [53.560ms; 53.615ms] or [-0.052%; +0.052%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.012ms 6.022ms ± 0.005ms 6.021ms ± 0.003ms 6.024ms 6.028ms 6.035ms 6.060ms 0.64% 3.112 20.133 0.08% 0.000ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.021ms; 6.022ms] or [-0.011%; +0.011%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.841µs 33.548µs ± 1.069µs 33.084µs ± 0.104µs 33.195µs 35.849µs 35.950µs 36.364µs 9.91% 1.685 0.906 3.18% 0.076µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.400µs; 33.697µs] or [-0.442%; +0.442%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.936µs 5.030µs ± 0.056µs 5.024µs ± 0.050µs 5.056µs 5.131µs 5.134µs 5.135µs 2.21% 0.330 -0.897 1.11% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.022µs; 5.038µs] or [-0.154%; +0.154%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 17c18f8 1740615154 aj/compress-metrics
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.372µs 2.394µs ± 0.016µs 2.391µs ± 0.007µs 2.398µs 2.436µs 2.442µs 2.457µs 2.76% 1.697 2.751 0.66% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.392µs; 2.397µs] or [-0.092%; +0.092%] None None None

Baseline

Omitted due to size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants