Skip to content

Conversation

gyuheon0h
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

Copy link

datadog-official bot commented Oct 1, 2025

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 5d2d9e9 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 1, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-10-01 21:11:42

Comparing candidate commit 5d2d9e9 in PR branch gyuheon0h/prof-12432-runtime-stacks with baseline commit 4ad519f in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

scenario:concentrator/add_spans_to_concentrator

  • 🟥 execution_time [+1.252ms; +1.258ms] or [+11.927%; +11.980%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 61.036ms 61.538ms ± 1.788ms 61.306ms ± 0.106ms 61.414ms 61.615ms 68.008ms 83.297ms 35.87% 10.045 112.095 2.90% 0.126ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [61.290ms; 61.786ms] or [-0.403%; +0.403%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.726µs 26.267µs ± 10.409µs 18.327µs ± 0.339µs 35.863µs 45.213µs 51.892µs 56.577µs 208.70% 0.807 -0.699 39.53% 0.736µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.824µs; 27.709µs] or [-5.492%; +5.492%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 186.287µs 186.660µs ± 0.203µs 186.630µs ± 0.135µs 186.789µs 186.948µs 187.194µs 187.981µs 0.72% 1.644 8.001 0.11% 0.014µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5319699.299op/s 5357343.268op/s ± 5805.962op/s 5358191.412op/s ± 3873.742op/s 5361607.772op/s 5364794.460op/s 5367499.457op/s 5368069.034op/s 0.18% -1.620 7.820 0.11% 410.544op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 17.768µs 17.835µs ± 0.034µs 17.834µs ± 0.022µs 17.855µs 17.892µs 17.917µs 17.935µs 0.57% 0.230 -0.225 0.19% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 55755500.977op/s 56068646.367op/s ± 106214.589op/s 56071530.453op/s ± 68728.509op/s 56139884.694op/s 56241837.510op/s 56279750.620op/s 56281429.661op/s 0.37% -0.220 -0.234 0.19% 7510.506op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 9.859µs 10.052µs ± 0.105µs 10.099µs ± 0.037µs 10.128µs 10.160µs 10.182µs 10.210µs 1.10% -0.751 -1.068 1.04% 0.007µs 1 200
normalization/normalize_name/normalize_name/good throughput 97940722.120op/s 99497376.098op/s ± 1048007.526op/s 99021376.314op/s ± 363239.084op/s 100789556.406op/s 101361527.204op/s 101426067.413op/s 101432815.360op/s 2.44% 0.762 -1.059 1.05% 74105.323op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [186.632µs; 186.688µs] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5356538.617op/s; 5358147.918op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [17.831µs; 17.840µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [56053926.046op/s; 56083366.687op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.037µs; 10.066µs] or [-0.145%; +0.145%] None None None
normalization/normalize_name/normalize_name/good throughput [99352132.334op/s; 99642619.862op/s] or [-0.146%; +0.146%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.848µs 34.224µs ± 0.592µs 33.961µs ± 0.047µs 34.053µs 35.417µs 35.474µs 37.337µs 9.94% 2.037 3.712 1.73% 0.042µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.142µs; 34.306µs] or [-0.240%; +0.240%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 11.718ms 11.753ms ± 0.015ms 11.752ms ± 0.010ms 11.763ms 11.776ms 11.788ms 11.832ms 0.68% 0.768 2.758 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [11.751ms; 11.755ms] or [-0.018%; +0.018%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 158.072µs 158.698µs ± 0.268µs 158.637µs ± 0.129µs 158.825µs 159.101µs 159.756µs 159.939µs 0.82% 1.519 4.417 0.17% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [158.661µs; 158.736µs] or [-0.023%; +0.023%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.216µs 3.201µs ± 1.433µs 2.989µs ± 0.025µs 3.015µs 3.667µs 14.055µs 14.978µs 401.09% 7.333 54.983 44.65% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.003µs; 3.400µs] or [-6.203%; +6.203%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 86.800µs 87.101µs ± 0.159µs 87.079µs ± 0.048µs 87.135µs 87.232µs 87.669µs 88.788µs 1.96% 6.741 64.691 0.18% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [87.079µs; 87.123µs] or [-0.025%; +0.025%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.397µs 2.428µs ± 0.012µs 2.428µs ± 0.009µs 2.436µs 2.450µs 2.457µs 2.462µs 1.43% 0.182 -0.237 0.51% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.426µs; 2.429µs] or [-0.071%; +0.071%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.957µs 5.032µs ± 0.046µs 5.037µs ± 0.047µs 5.066µs 5.104µs 5.107µs 5.113µs 1.49% 0.075 -1.327 0.92% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.025µs; 5.038µs] or [-0.128%; +0.128%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.125µs 535.057µs ± 0.391µs 535.043µs ± 0.250µs 535.289µs 535.732µs 536.049µs 536.335µs 0.24% 0.439 0.224 0.07% 0.028µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1864506.325op/s 1868959.439op/s ± 1366.866op/s 1869009.790op/s ± 873.913op/s 1869877.687op/s 1871052.200op/s 1871342.290op/s 1872220.510op/s 0.17% -0.434 0.217 0.07% 96.652op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 379.315µs 380.003µs ± 0.362µs 379.983µs ± 0.208µs 380.177µs 380.461µs 380.912µs 382.814µs 0.75% 2.504 17.053 0.09% 0.026µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2612237.036op/s 2631563.908op/s ± 2497.611op/s 2631699.994op/s ± 1438.022op/s 2633278.527op/s 2634855.589op/s 2635740.333op/s 2636331.886op/s 0.18% -2.468 16.705 0.09% 176.608op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 194.051µs 194.959µs ± 0.314µs 194.962µs ± 0.169µs 195.145µs 195.339µs 195.521µs 197.086µs 1.09% 0.983 9.983 0.16% 0.022µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5073939.313op/s 5129299.297op/s ± 8248.673op/s 5129200.512op/s ± 4454.810op/s 5132840.097op/s 5142853.970op/s 5151341.918op/s 5153278.855op/s 0.47% -0.930 9.641 0.16% 583.269op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 35.974µs 36.125µs ± 0.064µs 36.129µs ± 0.045µs 36.166µs 36.222µs 36.295µs 36.334µs 0.57% 0.295 -0.010 0.18% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27522073.810op/s 27681909.842op/s ± 49306.494op/s 27678979.202op/s ± 34624.394op/s 27722177.420op/s 27753762.402op/s 27774965.221op/s 27797831.801op/s 0.43% -0.285 -0.026 0.18% 3486.496op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.895µs 45.071µs ± 0.121µs 45.066µs ± 0.104µs 45.170µs 45.266µs 45.296µs 45.318µs 0.56% 0.115 -1.155 0.27% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 22066357.460op/s 22187607.565op/s ± 59585.271op/s 22189600.770op/s ± 50988.706op/s 22236724.240op/s 22273005.500op/s 22274185.146op/s 22274443.417op/s 0.38% -0.108 -1.158 0.27% 4213.315op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.003µs; 535.112µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1868770.004op/s; 1869148.873op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [379.952µs; 380.053µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2631217.763op/s; 2631910.053op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [194.915µs; 195.002µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5128156.111op/s; 5130442.484op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.116µs; 36.134µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27675076.436op/s; 27688743.248op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.054µs; 45.087µs] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22179349.619op/s; 22195865.510op/s] or [-0.037%; +0.037%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 241.947ns 253.567ns ± 13.589ns 247.260ns ± 3.858ns 257.498ns 283.563ns 298.072ns 299.984ns 21.32% 1.737 2.421 5.35% 0.961ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [251.683ns; 255.450ns] or [-0.743%; +0.743%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.893µs 3.912µs ± 0.003µs 3.911µs ± 0.002µs 3.914µs 3.917µs 3.921µs 3.932µs 0.52% 0.927 11.124 0.09% 0.000µs 1 200
credit_card/is_card_number/ throughput 254330759.490op/s 255627768.559op/s ± 223007.742op/s 255663708.541op/s ± 108953.085op/s 255751495.567op/s 255860808.565op/s 255929943.357op/s 256884029.870op/s 0.48% -0.895 11.114 0.09% 15769.029op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 76.639µs 78.350µs ± 0.741µs 78.328µs ± 0.496µs 78.820µs 79.578µs 80.429µs 80.951µs 3.35% 0.394 0.478 0.94% 0.052µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12353155.456op/s 12764386.045op/s ± 120324.649op/s 12766808.622op/s ± 80922.149op/s 12849027.987op/s 12951871.752op/s 13005813.220op/s 13048186.954op/s 2.20% -0.330 0.376 0.94% 8508.238op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 69.894µs 71.049µs ± 0.588µs 70.975µs ± 0.348µs 71.406µs 72.030µs 72.768µs 72.899µs 2.71% 0.532 0.335 0.83% 0.042µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13717638.655op/s 14075657.604op/s ± 116003.961op/s 14089527.271op/s ± 69382.458op/s 14149660.011op/s 14264755.014op/s 14292138.076op/s 14307376.843op/s 1.55% -0.482 0.253 0.82% 8202.719op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.917µs 3.918µs 3.922µs 0.25% -0.591 5.725 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254987030.763op/s 255636620.220op/s ± 182282.430op/s 255634276.428op/s ± 92975.653op/s 255726506.053op/s 255883710.431op/s 255945821.127op/s 256718840.061op/s 0.42% 0.607 5.801 0.07% 12889.314op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 66.705µs 68.132µs ± 0.649µs 68.125µs ± 0.467µs 68.515µs 69.307µs 69.815µs 70.042µs 2.81% 0.523 0.016 0.95% 0.046µs 1 200
credit_card/is_card_number/378282246310005 throughput 14277090.152op/s 14678686.790op/s ± 139193.682op/s 14678984.327op/s ± 99961.682op/s 14791466.447op/s 14875242.173op/s 14920404.738op/s 14991407.290op/s 2.13% -0.474 -0.055 0.95% 9842.480op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 52.138µs 52.203µs ± 0.030µs 52.199µs ± 0.015µs 52.216µs 52.259µs 52.302µs 52.319µs 0.23% 1.078 2.084 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19113366.754op/s 19156162.757op/s ± 11022.187op/s 19157434.098op/s ± 5664.483op/s 19162673.029op/s 19171581.965op/s 19174940.156op/s 19179707.869op/s 0.12% -1.073 2.069 0.06% 779.386op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.027µs 6.037µs ± 0.014µs 6.034µs ± 0.002µs 6.036µs 6.062µs 6.112µs 6.131µs 1.62% 4.499 22.476 0.23% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163105497.167op/s 165652864.106op/s ± 375404.007op/s 165739993.066op/s ± 58607.362op/s 165796817.057op/s 165865352.829op/s 165896877.629op/s 165911055.454op/s 0.10% -4.470 22.191 0.23% 26545.072op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.911µs ± 0.002µs 3.911µs ± 0.001µs 3.913µs 3.915µs 3.917µs 3.917µs 0.14% -1.850 14.528 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 255303488.153op/s 255671999.780op/s ± 161242.012op/s 255672080.609op/s ± 95945.575op/s 255765200.946op/s 255879768.337op/s 255948601.342op/s 256886197.707op/s 0.47% 1.875 14.743 0.06% 11401.532op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 63.959µs 64.374µs ± 0.170µs 64.363µs ± 0.095µs 64.461µs 64.671µs 64.830µs 65.040µs 1.05% 0.555 1.054 0.26% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15375044.647op/s 15534399.587op/s ± 41041.056op/s 15536992.099op/s ± 23034.970op/s 15559353.142op/s 15598766.372op/s 15623607.792op/s 15635133.709op/s 0.63% -0.533 1.014 0.26% 2902.041op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.121µs 58.407µs ± 0.150µs 58.376µs ± 0.087µs 58.484µs 58.685µs 58.854µs 59.001µs 1.07% 1.089 1.626 0.26% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16948771.746op/s 17121471.380op/s ± 43953.141op/s 17130283.176op/s ± 25495.020op/s 17152701.426op/s 17174506.854op/s 17197130.741op/s 17205586.654op/s 0.44% -1.071 1.564 0.26% 3107.956op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.922µs 0.25% -0.360 4.228 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254999745.200op/s 255611366.939op/s ± 208050.821op/s 255641662.573op/s ± 137270.806op/s 255764567.770op/s 255849582.479op/s 255906465.593op/s 256801318.133op/s 0.45% 0.375 4.308 0.08% 14711.415op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.563µs 54.859µs ± 0.218µs 54.825µs ± 0.163µs 54.993µs 55.287µs 55.430µs 55.647µs 1.50% 0.835 0.317 0.40% 0.015µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17970533.628op/s 18228983.198op/s ± 72043.773op/s 18239905.896op/s ± 54041.290op/s 18288159.340op/s 18316334.966op/s 18323717.769op/s 18327351.740op/s 0.48% -0.816 0.262 0.39% 5094.264op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 52.151µs 52.217µs ± 0.037µs 52.213µs ± 0.023µs 52.237µs 52.277µs 52.307µs 52.432µs 0.42% 1.226 4.617 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19072176.367op/s 19151027.111op/s ± 13629.078op/s 19152187.522op/s ± 8491.859op/s 19160401.677op/s 19170763.531op/s 19173872.167op/s 19175005.380op/s 0.12% -1.215 4.548 0.07% 963.721op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.026µs 6.038µs ± 0.012µs 6.035µs ± 0.003µs 6.038µs 6.062µs 6.106µs 6.112µs 1.27% 3.960 17.815 0.20% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163612985.480op/s 165625316.837op/s ± 335711.781op/s 165697729.942op/s ± 78689.484op/s 165777277.078op/s 165858587.348op/s 165898747.697op/s 165934664.803op/s 0.14% -3.935 17.603 0.20% 23738.408op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.911µs; 3.912µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [255596861.830op/s; 255658675.287op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [78.247µs; 78.453µs] or [-0.131%; +0.131%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12747710.206op/s; 12781061.884op/s] or [-0.131%; +0.131%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [70.968µs; 71.131µs] or [-0.115%; +0.115%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14059580.571op/s; 14091734.637op/s] or [-0.114%; +0.114%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255611357.628op/s; 255661882.812op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.042µs; 68.222µs] or [-0.132%; +0.132%] None None None
credit_card/is_card_number/378282246310005 throughput [14659395.885op/s; 14697977.696op/s] or [-0.131%; +0.131%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.198µs; 52.207µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19154635.188op/s; 19157690.326op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.035µs; 6.039µs] or [-0.032%; +0.032%] None None None
credit_card/is_card_number/x371413321323331 throughput [165600836.721op/s; 165704891.491op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.911µs; 3.912µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255649653.188op/s; 255694346.372op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.350µs; 64.397µs] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15528711.691op/s; 15540087.482op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.386µs; 58.427µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17115379.897op/s; 17127562.862op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255582533.097op/s; 255640200.782op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.828µs; 54.889µs] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18218998.624op/s; 18238967.772op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.211µs; 52.222µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19149138.252op/s; 19152915.971op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165578790.413op/s; 165671843.261op/s] or [-0.028%; +0.028%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.310ms 14.392ms ± 0.036ms 14.390ms ± 0.019ms 14.409ms 14.446ms 14.519ms 14.581ms 1.33% 1.415 4.740 0.25% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.387ms; 14.397ms] or [-0.035%; +0.035%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5d2d9e9 1759338703 gyuheon0h/prof-12432-runtime-stacks
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.254ms 6.294ms ± 0.024ms 6.290ms ± 0.014ms 6.305ms 6.334ms 6.376ms 6.417ms 2.02% 1.389 3.926 0.38% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.290ms; 6.297ms] or [-0.053%; +0.053%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

❌ Patch coverage is 64.24051% with 226 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.56%. Comparing base (f61c42a) to head (5d2d9e9).
⚠️ Report is 5 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1252      +/-   ##
==========================================
- Coverage   71.65%   71.56%   -0.10%     
==========================================
  Files         355      357       +2     
  Lines       56317    57074     +757     
==========================================
+ Hits        40354    40844     +490     
- Misses      15963    16230     +267     
Components Coverage Δ
datadog-crashtracker 51.17% <64.24%> (+1.84%) ⬆️
datadog-crashtracker-ffi 15.69% <76.72%> (+9.76%) ⬆️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.47% <ø> (+0.05%) ⬆️
data-pipeline-ffi 88.19% <ø> (ø)
ddcommon 84.54% <ø> (+0.24%) ⬆️
ddcommon-ffi 73.84% <ø> (ø)
ddtelemetry 59.45% <ø> (-0.53%) ⬇️
ddtelemetry-ffi 21.24% <ø> (ø)
dogstatsd-client 83.26% <ø> (ø)
datadog-ipc 82.39% <ø> (-0.11%) ⬇️
datadog-profiling 76.90% <ø> (ø)
datadog-profiling-ffi 62.12% <ø> (ø)
datadog-sidecar 37.19% <ø> (+0.10%) ⬆️
datdog-sidecar-ffi 11.87% <ø> (+0.50%) ⬆️
spawn-worker 55.35% <ø> (ø)
tinybytes 92.22% <ø> (ø)
datadog-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
datadog-trace-protobuf 59.65% <ø> (ø)
datadog-trace-utils 89.77% <ø> (ø)
datadog-tracer-flare 54.52% <ø> (ø)
datadog-log 76.31% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@dd-octo-sts
Copy link

dd-octo-sts bot commented Oct 1, 2025

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.19 MB 7.19 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 71.00 MB 71.15 MB +.21% (+158.64 KB) 🔍
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.25 MB 9.26 MB +.06% (+5.88 KB) 🔍
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 83.28 MB 83.49 MB +.25% (+216.24 KB) 🔍
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 18.39 MB 18.42 MB +.11% (+22.00 KB) 🔍
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 65.77 KB 67.12 KB +2.04% (+1.34 KB) ⚠️
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 125.21 MB 125.33 MB +.09% (+120.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 654.56 MB 655.56 MB +.15% (+1020.06 KB) 🔍
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 5.89 MB 5.90 MB +.08% (+5.00 KB) 🔍
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 65.77 KB 67.12 KB +2.04% (+1.34 KB) ⚠️
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 17.37 MB 17.39 MB +.13% (+24.00 KB) 🔍
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 32.24 MB 32.27 MB +.09% (+31.51 KB) 🔍
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 15.68 MB 15.70 MB +.13% (+22.00 KB) 🔍
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 66.79 KB 68.15 KB +2.04% (+1.36 KB) ⚠️
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 127.50 MB 127.66 MB +.12% (+168.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 644.68 MB 645.68 MB +.15% (+1017.76 KB) 🔍
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 4.50 MB 4.50 MB +.10% (+5.00 KB) 🔍
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 66.79 KB 68.15 KB +2.04% (+1.36 KB) ⚠️
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 18.51 MB 18.54 MB +.16% (+32.00 KB) 🔍
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 30.27 MB 30.30 MB +.10% (+32.10 KB) 🔍
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 63.65 MB 63.79 MB +.22% (+144.36 KB) 🔍
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.51 MB 8.52 MB +.18% (+16.00 KB) 🔍
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 78.06 MB 78.26 MB +.24% (+198.20 KB) 🔍
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 9.85 MB 9.87 MB +.23% (+24.00 KB) 🔍

@gyuheon0h gyuheon0h changed the title [crashtracking] Allow runtimes to register runtime collection callbacks [crashtracking] Allow runtimes to register runtime stack collection callbacks Oct 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants