Skip to content

[profiling] Experiment using antithesis assertions #1114

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

[profiling] Experiment using antithesis assertions #1114

wants to merge 2 commits into from

Conversation

danielsn
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@github-actions github-actions bot added profiling Relates to the profiling* modules. common crashtracker labels Jun 17, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 17, 2025 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2025-06-18 19:12:58

Comparing candidate commit 7b76664 in PR branch dsn/assert-api with baseline commit a51462a in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.261µs 3.220µs ± 1.429µs 3.020µs ± 0.026µs 3.044µs 3.673µs 13.960µs 14.939µs 394.63% 7.385 55.488 44.26% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.022µs; 3.418µs] or [-6.149%; +6.149%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 84.597µs 84.892µs ± 0.180µs 84.873µs ± 0.063µs 84.940µs 85.054µs 85.404µs 86.531µs 1.95% 4.919 38.003 0.21% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [84.867µs; 84.917µs] or [-0.029%; +0.029%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.307µs 2.368µs ± 0.017µs 2.369µs ± 0.006µs 2.374µs 2.403µs 2.411µs 2.416µs 2.01% -0.580 3.333 0.71% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.366µs; 2.370µs] or [-0.098%; +0.098%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 247.839ns 257.850ns ± 12.761ns 252.143ns ± 1.662ns 256.194ns 289.071ns 297.855ns 302.798ns 20.09% 1.873 2.323 4.94% 0.902ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [256.082ns; 259.619ns] or [-0.686%; +0.686%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 35.061µs 35.343µs ± 0.413µs 35.176µs ± 0.036µs 35.230µs 36.089µs 36.113µs 38.601µs 9.74% 3.337 18.237 1.17% 0.029µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [35.286µs; 35.400µs] or [-0.162%; +0.162%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.434µs 25.133µs ± 9.896µs 17.900µs ± 0.342µs 34.609µs 43.349µs 45.242µs 76.021µs 324.69% 1.250 2.130 39.27% 0.700µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.762µs; 26.505µs] or [-5.457%; +5.457%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.260ms 8.275ms ± 0.007ms 8.274ms ± 0.005ms 8.279ms 8.287ms 8.291ms 8.301ms 0.33% 0.500 0.110 0.09% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.274ms; 8.276ms] or [-0.012%; +0.012%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.195µs 535.167µs ± 0.764µs 535.039µs ± 0.421µs 535.498µs 536.406µs 536.799µs 541.273µs 1.17% 3.072 19.541 0.14% 0.054µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1847495.747op/s 1868580.625op/s ± 2657.039op/s 1869023.867op/s ± 1470.990op/s 1870426.172op/s 1871357.183op/s 1871695.453op/s 1871976.620op/s 0.16% -3.021 18.996 0.14% 187.881op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.860µs 381.348µs ± 0.312µs 381.310µs ± 0.136µs 381.458µs 381.717µs 382.155µs 384.403µs 0.81% 4.978 44.370 0.08% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2601434.748op/s 2622279.075op/s ± 2140.056op/s 2622538.242op/s ± 936.567op/s 2623458.608op/s 2624543.654op/s 2624899.983op/s 2625639.415op/s 0.12% -4.925 43.677 0.08% 151.325op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.007µs 190.442µs ± 0.169µs 190.455µs ± 0.115µs 190.555µs 190.720µs 190.780µs 190.834µs 0.20% -0.187 -0.349 0.09% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5240152.142op/s 5250937.635op/s ± 4658.893op/s 5250595.084op/s ± 3162.629op/s 5253990.355op/s 5259084.482op/s 5261179.604op/s 5262961.865op/s 0.24% 0.191 -0.348 0.09% 329.433op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.345µs 37.493µs ± 0.099µs 37.481µs ± 0.037µs 37.528µs 37.592µs 37.636µs 38.625µs 3.05% 7.489 83.116 0.26% 0.007µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 25889697.101op/s 26672028.580op/s ± 69242.907op/s 26679858.732op/s ± 26668.230op/s 26703747.340op/s 26735092.184op/s 26769542.346op/s 26777514.824op/s 0.37% -7.262 79.699 0.26% 4896.213op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.796µs 45.892µs ± 0.099µs 45.883µs ± 0.024µs 45.905µs 45.971µs 46.037µs 47.157µs 2.78% 10.393 129.052 0.22% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21205904.384op/s 21790274.567op/s ± 46197.184op/s 21794633.048op/s ± 11569.897op/s 21806908.308op/s 21822405.076op/s 21832492.820op/s 21836137.740op/s 0.19% -10.243 126.479 0.21% 3266.634op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.061µs; 535.273µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1868212.385op/s; 1868948.865op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.305µs; 381.391µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2621982.484op/s; 2622575.667op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.419µs; 190.466µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5250291.958op/s; 5251583.313op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.479µs; 37.506µs] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26662432.179op/s; 26681624.981op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.878µs; 45.906µs] or [-0.030%; +0.030%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21783872.081op/s; 21796677.052op/s] or [-0.029%; +0.029%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 154.930µs 156.071µs ± 0.529µs 156.052µs ± 0.124µs 156.164µs 156.370µs 156.770µs 162.681µs 4.25% 9.794 120.544 0.34% 0.037µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [155.997µs; 156.144µs] or [-0.047%; +0.047%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.500µs 205.130µs ± 0.390µs 205.070µs ± 0.278µs 205.359µs 205.893µs 206.168µs 206.373µs 0.64% 0.792 -0.025 0.19% 0.028µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4845596.381op/s 4874967.309op/s ± 9253.319op/s 4876381.424op/s ± 6592.658op/s 4882522.710op/s 4886310.027op/s 4887771.683op/s 4889967.149op/s 0.28% -0.784 -0.042 0.19% 654.308op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.603µs 18.764µs ± 0.122µs 18.742µs ± 0.085µs 18.841µs 19.002µs 19.082µs 19.167µs 2.27% 0.890 0.141 0.65% 0.009µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52172290.589op/s 53296204.283op/s ± 343567.507op/s 53356135.007op/s ± 242184.887op/s 53572958.876op/s 53667156.389op/s 53744703.435op/s 53753570.854op/s 0.74% -0.864 0.066 0.64% 24293.891op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.740µs 10.856µs ± 0.049µs 10.849µs ± 0.031µs 10.885µs 10.941µs 10.974µs 11.005µs 1.44% 0.502 -0.098 0.45% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90870963.232op/s 92114888.487op/s ± 412032.730op/s 92177400.387op/s ± 265597.979op/s 92422279.533op/s 92684822.090op/s 92812606.325op/s 93106068.582op/s 1.01% -0.480 -0.124 0.45% 29135.114op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.076µs; 205.184µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4873684.888op/s; 4876249.730op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.747µs; 18.781µs] or [-0.090%; +0.090%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53248589.131op/s; 53343819.435op/s] or [-0.089%; +0.089%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.849µs; 10.863µs] or [-0.062%; +0.062%] None None None
normalization/normalize_name/normalize_name/good throughput [92057784.713op/s; 92171992.260op/s] or [-0.062%; +0.062%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.917µs ± 0.002µs 3.917µs ± 0.001µs 3.918µs 3.919µs 3.920µs 3.926µs 0.24% -4.102 45.509 0.05% 0.000µs 1 200
credit_card/is_card_number/ throughput 254695068.422op/s 255306899.027op/s ± 140057.625op/s 255316420.055op/s ± 51029.580op/s 255357595.419op/s 255435656.533op/s 255587395.727op/s 256676887.883op/s 0.53% 4.153 46.024 0.05% 9903.570op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 78.541µs 80.384µs ± 0.862µs 80.329µs ± 0.562µs 80.837µs 81.905µs 82.291µs 83.179µs 3.55% 0.502 -0.055 1.07% 0.061µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12022276.798op/s 12441637.773op/s ± 132769.434op/s 12448821.862op/s ± 87060.983op/s 12548314.685op/s 12639177.267op/s 12673788.928op/s 12732256.734op/s 2.28% -0.448 -0.141 1.06% 9388.217op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 74.558µs 74.936µs ± 0.185µs 74.919µs ± 0.080µs 74.998µs 75.200µs 75.466µs 76.342µs 1.90% 3.697 24.307 0.25% 0.013µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13098976.354op/s 13344882.710op/s ± 32735.047op/s 13347687.079op/s ± 14310.628op/s 13362443.523op/s 13382172.439op/s 13406838.023op/s 13412380.969op/s 0.48% -3.604 23.473 0.24% 2314.717op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.891µs 3.912µs ± 0.008µs 3.912µs ± 0.001µs 3.913µs 3.915µs 3.919µs 3.994µs 2.11% 8.706 82.699 0.20% 0.001µs 1 200
credit_card/is_card_number/37828224631 throughput 250365740.418op/s 255593572.900op/s ± 511366.201op/s 255647267.113op/s ± 70412.347op/s 255718024.662op/s 255776017.691op/s 255814791.681op/s 256997069.089op/s 0.53% -8.651 82.064 0.20% 36159.051op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.695µs 72.088µs ± 0.160µs 72.081µs ± 0.075µs 72.159µs 72.360µs 72.524µs 72.646µs 0.78% 0.348 0.938 0.22% 0.011µs 1 200
credit_card/is_card_number/378282246310005 throughput 13765414.169op/s 13872023.056op/s ± 30763.416op/s 13873311.223op/s ± 14488.538op/s 13886603.247op/s 13926968.181op/s 13942089.905op/s 13947941.866op/s 0.54% -0.329 0.915 0.22% 2175.302op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.166µs 52.213µs ± 0.028µs 52.206µs ± 0.014µs 52.226µs 52.267µs 52.309µs 52.334µs 0.24% 1.428 2.736 0.05% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19108190.875op/s 19152336.821op/s ± 10256.979op/s 19154860.613op/s ± 5278.117op/s 19159551.313op/s 19164011.041op/s 19168120.311op/s 19169497.496op/s 0.08% -1.424 2.719 0.05% 725.278op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 5.752µs 5.899µs ± 0.064µs 5.898µs ± 0.042µs 5.945µs 6.007µs 6.041µs 6.045µs 2.48% -0.042 -0.504 1.09% 0.005µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165433228.877op/s 169526913.300op/s ± 1848655.752op/s 169542673.264op/s ± 1206616.428op/s 170683616.377op/s 172518987.878op/s 173574520.396op/s 173850239.851op/s 2.54% 0.090 -0.500 1.09% 130719.702op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.890µs 3.911µs ± 0.003µs 3.911µs ± 0.001µs 3.912µs 3.917µs 3.919µs 3.920µs 0.24% -0.942 11.528 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255101328.203op/s 255674667.859op/s ± 197927.657op/s 255705420.962op/s ± 86226.051op/s 255784843.833op/s 255887769.232op/s 255956897.291op/s 257067237.811op/s 0.53% 0.972 11.734 0.08% 13995.599op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.135µs 64.287µs ± 0.079µs 64.273µs ± 0.043µs 64.327µs 64.423µs 64.524µs 64.623µs 0.54% 1.105 1.971 0.12% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15474271.544op/s 15555366.293op/s ± 18978.666op/s 15558531.850op/s ± 10380.146op/s 15568402.373op/s 15581271.626op/s 15586345.684op/s 15592172.729op/s 0.22% -1.095 1.936 0.12% 1341.994op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 57.403µs 57.563µs ± 0.107µs 57.549µs ± 0.069µs 57.628µs 57.747µs 57.880µs 57.991µs 0.77% 0.917 1.055 0.19% 0.008µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17244053.403op/s 17372273.716op/s ± 32205.204op/s 17376521.713op/s ± 20840.848op/s 17396568.093op/s 17413412.944op/s 17418277.262op/s 17420646.951op/s 0.25% -0.905 1.013 0.18% 2277.252op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.888µs 3.911µs ± 0.003µs 3.910µs ± 0.002µs 3.912µs 3.916µs 3.918µs 3.920µs 0.24% -1.550 15.844 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255128552.675op/s 255712174.270op/s ± 194825.430op/s 255732985.175op/s ± 101816.780op/s 255818246.236op/s 255918392.967op/s 256003592.825op/s 257196111.935op/s 0.57% 1.586 16.126 0.08% 13776.238op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.602µs 54.793µs ± 0.136µs 54.761µs ± 0.077µs 54.854µs 55.070µs 55.204µs 55.295µs 0.98% 1.212 1.406 0.25% 0.010µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 18084796.349op/s 18250601.676op/s ± 45142.650op/s 18261259.664op/s ± 25706.857op/s 18283587.738op/s 18304290.172op/s 18312206.386op/s 18314204.497op/s 0.29% -1.198 1.360 0.25% 3192.067op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.124µs 52.192µs ± 0.038µs 52.188µs ± 0.024µs 52.210µs 52.251µs 52.279µs 52.443µs 0.49% 1.878 8.766 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19068496.024op/s 19160114.856op/s ± 13859.261op/s 19161450.037op/s ± 8805.070op/s 19170476.986op/s 19176351.723op/s 19182002.180op/s 19184955.158op/s 0.12% -1.862 8.639 0.07% 979.998op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 5.714µs 5.878µs ± 0.068µs 5.885µs ± 0.048µs 5.928µs 5.981µs 6.004µs 6.031µs 2.49% -0.262 -0.575 1.16% 0.005µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 165803951.687op/s 170141306.197op/s ± 1988041.992op/s 169930056.131op/s ± 1377072.871op/s 171655857.900op/s 173568485.473op/s 174924461.498op/s 175003477.369op/s 2.99% 0.310 -0.538 1.17% 140575.797op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.917µs; 3.917µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ throughput [255287488.387op/s; 255326309.667op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [80.265µs; 80.504µs] or [-0.149%; +0.149%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12423237.206op/s; 12460038.340op/s] or [-0.148%; +0.148%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [74.910µs; 74.961µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13340345.947op/s; 13349419.473op/s] or [-0.034%; +0.034%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.914µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/37828224631 throughput [255522702.463op/s; 255664443.338op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.066µs; 72.110µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/378282246310005 throughput [13867759.542op/s; 13876286.569op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.209µs; 52.217µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19150915.302op/s; 19153758.339op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/x371413321323331 execution_time [5.891µs; 5.908µs] or [-0.151%; +0.151%] None None None
credit_card/is_card_number/x371413321323331 throughput [169270707.392op/s; 169783119.208op/s] or [-0.151%; +0.151%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255647236.989op/s; 255702098.729op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.276µs; 64.297µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15552736.033op/s; 15557996.554op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [57.548µs; 57.578µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17367810.385op/s; 17376737.048op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.910µs; 3.911µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255685173.339op/s; 255739175.201op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.774µs; 54.812µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18244345.338op/s; 18256858.013op/s] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.187µs; 52.197µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19158194.096op/s; 19162035.617op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [5.869µs; 5.888µs] or [-0.161%; +0.161%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [169865782.697op/s; 170416829.697op/s] or [-0.162%; +0.162%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 72.967ms 73.292ms ± 0.182ms 73.279ms ± 0.097ms 73.373ms 73.531ms 73.745ms 74.818ms 2.10% 3.116 23.533 0.25% 0.013ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [73.266ms; 73.317ms] or [-0.034%; +0.034%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 7b76664 1750273273 dsn/assert-api
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.011µs 5.081µs ± 0.035µs 5.083µs ± 0.031µs 5.109µs 5.130µs 5.146µs 5.155µs 1.41% -0.049 -1.183 0.70% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.076µs; 5.086µs] or [-0.097%; +0.097%] None None None

Baseline

Omitted due to size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
ci-build common crashtracker profiling Relates to the profiling* modules.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@danielsn