Skip to content

Conversation

@paullegranddc
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@pr-commenter
Copy link

pr-commenter bot commented Nov 20, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-11-20 13:15:16

Comparing candidate commit 211d2d3 in PR branch paullgdc/data-pipeline/runtime_agnostisc_code with baseline commit a3f9e86 in branch main.

Found 0 performance improvements and 8 performance regressions! Performance is the same for 47 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+7.510µs; +7.538µs] or [+16.469%; +16.531%]
  • 🟥 throughput [-3112590.250op/s; -3099246.873op/s] or [-14.194%; -14.133%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+5.504µs; +5.562µs] or [+10.302%; +10.410%]
  • 🟥 throughput [-1764454.035op/s; -1747797.147op/s] or [-9.428%; -9.339%]

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟥 execution_time [+5.414µs; +5.470µs] or [+10.780%; +10.892%]
  • 🟥 throughput [-1955775.143op/s; -1937443.267op/s] or [-9.822%; -9.730%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟥 execution_time [+7.491µs; +7.525µs] or [+16.420%; +16.494%]
  • 🟥 throughput [-3105321.922op/s; -3089421.698op/s] or [-14.168%; -14.095%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 160.409µs 161.369µs ± 0.346µs 161.322µs ± 0.104µs 161.434µs 161.812µs 162.148µs 164.995µs 2.28% 5.999 59.681 0.21% 0.024µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [161.321µs; 161.417µs] or [-0.030%; +0.030%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.239ms 6.417ms ± 0.037ms 6.419ms ± 0.017ms 6.434ms 6.476ms 6.504ms 6.548ms 2.02% -0.950 5.786 0.58% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.412ms; 6.422ms] or [-0.081%; +0.081%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.121µs 205.606µs ± 0.301µs 205.558µs ± 0.182µs 205.754µs 206.143µs 206.496µs 207.271µs 0.83% 1.483 4.272 0.15% 0.021µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4824607.900op/s 4863684.879op/s ± 7100.995op/s 4864815.969op/s ± 4304.345op/s 4868788.774op/s 4872301.777op/s 4873585.531op/s 4875164.174op/s 0.21% -1.465 4.164 0.15% 502.116op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.189µs 18.347µs ± 0.118µs 18.302µs ± 0.057µs 18.418µs 18.578µs 18.710µs 18.855µs 3.02% 1.283 1.591 0.64% 0.008µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53036329.886op/s 54507992.322op/s ± 348558.839op/s 54638912.557op/s ± 169808.381op/s 54762074.341op/s 54870710.428op/s 54916455.492op/s 54979045.591op/s 0.62% -1.246 1.423 0.64% 24646.832op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.533µs 10.787µs ± 0.102µs 10.807µs ± 0.067µs 10.861µs 10.955µs 10.981µs 11.031µs 2.07% -0.250 -0.529 0.95% 0.007µs 1 200
normalization/normalize_name/normalize_name/good throughput 90654876.884op/s 92710991.246op/s ± 882460.314op/s 92529522.298op/s ± 572521.561op/s 93352243.720op/s 94168708.951op/s 94686717.630op/s 94935761.352op/s 2.60% 0.290 -0.521 0.95% 62399.367op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.564µs; 205.648µs] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4862700.750op/s; 4864669.009op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.330µs; 18.363µs] or [-0.089%; +0.089%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54459685.419op/s; 54556299.225op/s] or [-0.089%; +0.089%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.773µs; 10.801µs] or [-0.132%; +0.132%] None None None
normalization/normalize_name/normalize_name/good throughput [92588690.734op/s; 92833291.758op/s] or [-0.132%; +0.132%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.254µs 3.206µs ± 1.426µs 3.004µs ± 0.026µs 3.029µs 3.643µs 13.808µs 14.902µs 396.00% 7.416 55.943 44.37% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.008µs; 3.403µs] or [-6.165%; +6.165%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.932µs 534.721µs ± 0.614µs 534.619µs ± 0.245µs 534.912µs 535.458µs 535.793µs 541.445µs 1.28% 6.697 69.897 0.11% 0.043µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1846911.264op/s 1870136.584op/s ± 2132.584op/s 1870489.816op/s ± 857.807op/s 1871187.198op/s 1872129.049op/s 1872784.868op/s 1872899.117op/s 0.13% -6.604 68.534 0.11% 150.796op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.259µs 381.043µs ± 0.322µs 381.036µs ± 0.209µs 381.226µs 381.627µs 381.864µs 382.182µs 0.30% 0.490 0.482 0.08% 0.023µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2616552.035op/s 2624377.790op/s ± 2216.014op/s 2624421.992op/s ± 1439.316op/s 2625950.430op/s 2627783.214op/s 2628728.125op/s 2629787.442op/s 0.20% -0.485 0.473 0.08% 156.696op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 194.614µs 195.040µs ± 0.188µs 195.027µs ± 0.112µs 195.152µs 195.325µs 195.473µs 196.180µs 0.59% 1.266 5.801 0.10% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5097358.884op/s 5127153.906op/s ± 4944.094op/s 5127490.324op/s ± 2950.111op/s 5130322.511op/s 5134310.489op/s 5136572.815op/s 5138363.972op/s 0.21% -1.249 5.686 0.10% 349.600op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.762µs 36.979µs ± 0.078µs 36.977µs ± 0.048µs 37.026µs 37.101µs 37.166µs 37.258µs 0.76% 0.164 0.534 0.21% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26839550.825op/s 27042824.339op/s ± 56821.171op/s 27043733.886op/s ± 35141.409op/s 27078539.652op/s 27129674.307op/s 27187977.552op/s 27201847.195op/s 0.58% -0.148 0.521 0.21% 4017.864op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.901µs 45.089µs ± 0.121µs 45.079µs ± 0.108µs 45.195µs 45.274µs 45.304µs 45.318µs 0.53% 0.059 -1.214 0.27% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 22066438.614op/s 22178760.066op/s ± 59419.042op/s 22183136.168op/s ± 52904.512op/s 22233347.132op/s 22267659.243op/s 22270238.561op/s 22271373.218op/s 0.40% -0.052 -1.216 0.27% 4201.561op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.636µs; 534.806µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1869841.028op/s; 1870432.140op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.998µs; 381.088µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2624070.672op/s; 2624684.908op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [195.014µs; 195.066µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5126468.703op/s; 5127839.110op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.968µs; 36.989µs] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27034949.471op/s; 27050699.206op/s] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.072µs; 45.105µs] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22170525.158op/s; 22186994.974op/s] or [-0.037%; +0.037%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.010µs 5.079µs ± 0.038µs 5.083µs ± 0.037µs 5.108µs 5.128µs 5.133µs 5.139µs 1.10% -0.322 -1.292 0.74% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.074µs; 5.084µs] or [-0.103%; +0.103%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 189.963ns 192.498ns ± 1.967ns 192.229ns ± 1.264ns 193.544ns 195.590ns 198.048ns 204.103ns 6.18% 1.766 6.063 1.02% 0.139ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.226ns; 192.771ns] or [-0.142%; +0.142%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.635µs 24.908µs ± 8.899µs 17.987µs ± 0.221µs 33.920µs 40.399µs 43.429µs 52.404µs 191.35% 0.718 -0.906 35.64% 0.629µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.675µs; 26.142µs] or [-4.952%; +4.952%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.236ms 62.082ms ± 2.403ms 61.723ms ± 0.072ms 61.980ms 62.206ms 77.547ms 83.899ms 35.93% 8.079 64.988 3.86% 0.170ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.749ms; 62.415ms] or [-0.536%; +0.536%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.601µs 34.197µs ± 1.000µs 33.745µs ± 0.066µs 33.867µs 36.318µs 36.353µs 37.796µs 12.00% 1.743 1.256 2.92% 0.071µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.059µs; 34.336µs] or [-0.405%; +0.405%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.901µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.920µs 3.922µs 3.926µs 0.30% 0.133 4.193 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254691567.315op/s 255420038.470op/s ± 183251.555op/s 255443993.856op/s ± 97198.706op/s 255532963.014op/s 255659647.932op/s 255702068.602op/s 256377065.691op/s 0.37% -0.120 4.228 0.07% 12957.842op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 76.643µs 78.422µs ± 0.902µs 78.310µs ± 0.581µs 78.962µs 80.162µs 81.173µs 81.551µs 4.14% 0.741 0.790 1.15% 0.064µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12262268.855op/s 12753200.458op/s ± 145498.308op/s 12769764.425op/s ± 94785.332op/s 12850308.967op/s 12966895.902op/s 13020952.691op/s 13047475.380op/s 2.17% -0.666 0.628 1.14% 10288.284op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.718µs 72.186µs ± 0.719µs 72.165µs ± 0.475µs 72.618µs 73.416µs 73.909µs 74.212µs 2.84% 0.256 -0.232 0.99% 0.051µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13474984.177op/s 13854458.423op/s ± 137733.711op/s 13857069.417op/s ± 91810.958op/s 13949425.960op/s 14090624.164op/s 14125765.317op/s 14140737.573op/s 2.05% -0.206 -0.270 0.99% 9739.244op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.917µs ± 0.010µs 3.916µs ± 0.002µs 3.918µs 3.920µs 3.930µs 4.012µs 2.46% 8.417 77.316 0.25% 0.001µs 1 200
credit_card/is_card_number/37828224631 throughput 249257351.677op/s 255326340.082op/s ± 638417.084op/s 255377756.600op/s ± 127945.587op/s 255520107.228op/s 255656492.517op/s 255719220.472op/s 256720002.911op/s 0.53% -8.351 76.553 0.25% 45142.905op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.309µs 68.860µs ± 0.657µs 68.849µs ± 0.457µs 69.305µs 70.007µs 70.334µs 70.769µs 2.79% 0.189 -0.234 0.95% 0.046µs 1 200
credit_card/is_card_number/378282246310005 throughput 14130551.976op/s 14523520.625op/s ± 138395.201op/s 14524508.143op/s ± 96351.370op/s 14621683.635op/s 14736204.834op/s 14832826.189op/s 14856857.233op/s 2.29% -0.139 -0.252 0.95% 9786.018op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 53.003µs 53.125µs ± 0.037µs 53.121µs ± 0.022µs 53.145µs 53.182µs 53.222µs 53.254µs 0.25% 0.184 1.412 0.07% 0.003µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 18777952.696op/s 18823370.652op/s ± 13108.519op/s 18824915.882op/s ± 7652.225op/s 18831921.662op/s 18839373.014op/s 18861109.285op/s 18867031.749op/s 0.22% -0.177 1.414 0.07% 926.912op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.429µs 6.440µs ± 0.017µs 6.437µs ± 0.003µs 6.441µs 6.447µs 6.477µs 6.603µs 2.57% 8.373 75.615 0.26% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 151448149.554op/s 155289722.946op/s ± 397854.167op/s 155341980.403op/s ± 75440.767op/s 155418027.569op/s 155485296.001op/s 155510835.105op/s 155553938.831op/s 0.14% -8.314 74.838 0.26% 28132.538op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.916µs ± 0.003µs 3.916µs ± 0.002µs 3.917µs 3.920µs 3.923µs 3.927µs 0.29% -1.303 12.277 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254640359.610op/s 255390423.429op/s ± 209618.803op/s 255389710.069op/s ± 116469.284op/s 255511823.812op/s 255668847.543op/s 255715470.765op/s 256889024.645op/s 0.59% 1.334 12.497 0.08% 14822.288op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.803µs 65.181µs ± 0.180µs 65.139µs ± 0.094µs 65.263µs 65.492µs 65.800µs 65.838µs 1.07% 1.155 2.223 0.28% 0.013µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15188745.810op/s 15341942.947op/s ± 42169.138op/s 15351826.776op/s ± 22246.062op/s 15369483.124op/s 15398932.029op/s 15417281.627op/s 15431449.294op/s 0.52% -1.131 2.152 0.27% 2981.808op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.573µs 58.964µs ± 0.206µs 58.931µs ± 0.134µs 59.081µs 59.380µs 59.487µs 59.729µs 1.35% 0.819 0.509 0.35% 0.015µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16742342.053op/s 16959796.875op/s ± 59047.766op/s 16969003.579op/s ± 38612.434op/s 17006046.932op/s 17036145.615op/s 17051449.843op/s 17072801.842op/s 0.61% -0.799 0.461 0.35% 4175.308op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.898µs 3.915µs ± 0.004µs 3.915µs ± 0.001µs 3.916µs 3.919µs 3.925µs 3.948µs 0.86% 4.182 33.291 0.10% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 253276931.450op/s 255411110.155op/s ± 263264.086op/s 255443629.773op/s ± 95857.916op/s 255533081.629op/s 255638153.782op/s 255715970.068op/s 256539832.128op/s 0.43% -4.127 32.872 0.10% 18615.582op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 55.317µs 55.660µs ± 0.194µs 55.604µs ± 0.095µs 55.743µs 56.005µs 56.307µs 56.716µs 2.00% 1.783 4.957 0.35% 0.014µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17631570.699op/s 17966282.138op/s ± 62392.234op/s 17984241.309op/s ± 30736.350op/s 18007182.165op/s 18031474.033op/s 18043938.289op/s 18077754.229op/s 0.52% -1.744 4.719 0.35% 4411.797op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 53.053µs 53.133µs ± 0.033µs 53.132µs ± 0.020µs 53.151µs 53.189µs 53.228µs 53.260µs 0.24% 0.558 0.935 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 18775913.741op/s 18820707.695op/s ± 11774.820op/s 18821188.157op/s ± 7172.910op/s 18828950.372op/s 18837729.155op/s 18843537.432op/s 18849113.050op/s 0.15% -0.553 0.924 0.06% 832.605op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.429µs 6.439µs ± 0.006µs 6.439µs ± 0.004µs 6.442µs 6.447µs 6.460µs 6.474µs 0.54% 1.813 6.978 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154475301.879op/s 155305449.084op/s ± 146157.223op/s 155315570.255op/s ± 93225.439op/s 155408770.030op/s 155482965.430op/s 155524087.593op/s 155551035.783op/s 0.15% -1.797 6.878 0.09% 10334.876op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255394641.567op/s; 255445435.373op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.297µs; 78.547µs] or [-0.159%; +0.159%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12733035.792op/s; 12773365.124op/s] or [-0.158%; +0.158%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [72.086µs; 72.286µs] or [-0.138%; +0.138%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13835369.855op/s; 13873546.990op/s] or [-0.138%; +0.138%] None None None
credit_card/is_card_number/37828224631 execution_time [3.915µs; 3.918µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/37828224631 throughput [255237861.614op/s; 255414818.550op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.769µs; 68.951µs] or [-0.132%; +0.132%] None None None
credit_card/is_card_number/378282246310005 throughput [14504340.382op/s; 14542700.869op/s] or [-0.132%; +0.132%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [53.120µs; 53.131µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [18821553.938op/s; 18825187.367op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.437µs; 6.442µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number/x371413321323331 throughput [155234584.184op/s; 155344861.707op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.916µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255361372.279op/s; 255419474.579op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.156µs; 65.206µs] or [-0.038%; +0.038%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15336098.710op/s; 15347787.184op/s] or [-0.038%; +0.038%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.935µs; 58.992µs] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [16951613.422op/s; 16967980.327op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.915µs; 3.916µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255374624.285op/s; 255447596.025op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [55.634µs; 55.687µs] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [17957635.174op/s; 17974929.101op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [53.128µs; 53.138µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [18819075.818op/s; 18822339.572op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.438µs; 6.440µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155285193.098op/s; 155325705.069op/s] or [-0.013%; +0.013%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.772µs 146.900µs ± 1.536µs 146.758µs ± 0.634µs 147.304µs 148.783µs 152.512µs 160.847µs 9.60% 4.696 35.366 1.04% 0.109µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [146.687µs; 147.112µs] or [-0.145%; +0.145%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.813ms 14.859ms ± 0.024ms 14.857ms ± 0.013ms 14.870ms 14.889ms 14.946ms 15.005ms 1.00% 2.047 8.115 0.16% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.855ms; 14.862ms] or [-0.023%; +0.023%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.609ms 10.636ms ± 0.014ms 10.634ms ± 0.010ms 10.644ms 10.662ms 10.675ms 10.689ms 0.52% 0.636 0.346 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.634ms; 10.638ms] or [-0.019%; +0.019%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 88.599µs 89.017µs ± 0.198µs 89.006µs ± 0.115µs 89.118µs 89.304µs 89.399µs 90.502µs 1.68% 2.120 14.604 0.22% 0.014µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [88.989µs; 89.044µs] or [-0.031%; +0.031%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.390µs 2.444µs ± 0.026µs 2.440µs ± 0.012µs 2.450µs 2.514µs 2.522µs 2.528µs 3.60% 1.596 2.598 1.05% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.440µs; 2.447µs] or [-0.146%; +0.146%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 211d2d3 1763643631 paullgdc/data-pipeline/runtime_agnostisc_code
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.261ns 254.505ns ± 12.291ns 249.741ns ± 3.827ns 257.586ns 287.039ns 295.420ns 298.380ns 19.48% 1.882 3.040 4.82% 0.869ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.802ns; 256.208ns] or [-0.669%; +0.669%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

❌ Patch coverage is 78.80435% with 78 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.93%. Comparing base (6e559d7) to head (211d2d3).
⚠️ Report is 6 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1358      +/-   ##
==========================================
- Coverage   70.96%   70.93%   -0.03%     
==========================================
  Files         390      393       +3     
  Lines       62588    62712     +124     
==========================================
+ Hits        44416    44486      +70     
- Misses      18172    18226      +54     
Components Coverage Δ
libdd-crashtracker 60.01% <ø> (+2.35%) ⬆️
libdd-crashtracker-ffi 16.60% <ø> (+2.35%) ⬆️
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 85.57% <75.58%> (-0.53%) ⬇️
libdd-data-pipeline-ffi 77.32% <100.00%> (-0.84%) ⬇️
libdd-common 81.15% <96.96%> (+0.22%) ⬆️
libdd-common-ffi 73.90% <ø> (ø)
libdd-telemetry 60.02% <ø> (ø)
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.61% <ø> (-0.11%) ⬇️
libdd-profiling 79.69% <ø> (+0.01%) ⬆️
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 35.18% <100.00%> (-1.00%) ⬇️
datdog-sidecar-ffi 7.32% <ø> (-5.00%) ⬇️
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 90.06% <88.57%> (-0.01%) ⬇️
datadog-tracer-flare 62.06% <ø> (+1.00%) ⬆️
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@paullegranddc paullegranddc changed the title Paullgdc/data pipeline/runtime agnostisc code Paullgdc/data pipeline/runtime agnostic code Nov 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants