Skip to content

Don't run check-big-regressions on master or release branches #9086

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Jul 7, 2025
Merged

Don't run check-big-regressions on master or release branches #9086

merged 2 commits into from
Jul 7, 2025

Conversation

bric3
Copy link
Contributor

@bric3 bric3 commented Jul 2, 2025

What Does This Do

Up for discussion, whether running check-big-regression job on master.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@bric3 bric3 requested review from igoragoli, ddyurchenko and a team July 2, 2025 15:22
@bric3 bric3 marked this pull request as ready for review July 4, 2025 16:17
@bric3 bric3 requested a review from a team as a code owner July 4, 2025 16:17
@bric3 bric3 requested review from randomanderson and removed request for a team July 4, 2025 16:17
@bric3 bric3 enabled auto-merge (squash) July 4, 2025 16:17
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jul 4, 2025 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@pr-commenter
Copy link

pr-commenter bot commented Jul 4, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/dont-run-check-big-regression-on-master
git_commit_date 1751896011 1751896480
git_commit_sha 6cca46e b04023d
release_version 1.51.0-SNAPSHOT~6cca46e0b4 1.51.0-SNAPSHOT~b04023d86a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751898225 1751898225
ci_job_id 1016075635 1016075635
ci_pipeline_id 69777988 69777988
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-k6ls7b5o 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-k6ls7b5o 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 7 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (999.105 ms) : 0, 999105
Total [baseline] (10.617 s) : 0, 10616714
Agent [candidate] (995.382 ms) : 0, 995382
Total [candidate] (10.589 s) : 0, 10589058
section appsec
Agent [baseline] (1.176 s) : 0, 1176456
Total [baseline] (10.764 s) : 0, 10763717
Agent [candidate] (1.176 s) : 0, 1176279
Total [candidate] (10.745 s) : 0, 10744733
section iast
Agent [baseline] (1.144 s) : 0, 1143815
Total [baseline] (10.845 s) : 0, 10844785
Agent [candidate] (1.134 s) : 0, 1133897
Total [candidate] (10.847 s) : 0, 10847475
section profiling
Agent [baseline] (1.244 s) : 0, 1243991
Total [baseline] (10.886 s) : 0, 10886372
Agent [candidate] (1.248 s) : 0, 1247575
Total [candidate] (10.994 s) : 0, 10994238
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 999.105 ms -
Agent appsec 1.176 s 177.351 ms (17.8%)
Agent iast 1.144 s 144.71 ms (14.5%)
Agent profiling 1.244 s 244.886 ms (24.5%)
Total tracing 10.617 s -
Total appsec 10.764 s 147.003 ms (1.4%)
Total iast 10.845 s 228.071 ms (2.1%)
Total profiling 10.886 s 269.657 ms (2.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 995.382 ms -
Agent appsec 1.176 s 180.897 ms (18.2%)
Agent iast 1.134 s 138.515 ms (13.9%)
Agent profiling 1.248 s 252.194 ms (25.3%)
Total tracing 10.589 s -
Total appsec 10.745 s 155.675 ms (1.5%)
Total iast 10.847 s 258.417 ms (2.4%)
Total profiling 10.994 s 405.18 ms (3.8%) 
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (689.787 ms) : 0, 689787
BytebuddyAgent [candidate] (687.244 ms) : 0, 687244
GlobalTracer [baseline] (242.911 ms) : 0, 242911
GlobalTracer [candidate] (242.338 ms) : 0, 242338
AppSec [baseline] (30.484 ms) : 0, 30484
AppSec [candidate] (30.081 ms) : 0, 30081
Debugger [baseline] (6.058 ms) : 0, 6058
Debugger [candidate] (6.019 ms) : 0, 6019
Remote Config [baseline] (677.79 µs) : 0, 678
Remote Config [candidate] (680.763 µs) : 0, 681
Telemetry [baseline] (8.198 ms) : 0, 8198
Telemetry [candidate] (8.199 ms) : 0, 8199
section appsec
BytebuddyAgent [baseline] (711.228 ms) : 0, 711228
BytebuddyAgent [candidate] (710.23 ms) : 0, 710230
GlobalTracer [baseline] (235.523 ms) : 0, 235523
GlobalTracer [candidate] (236.043 ms) : 0, 236043
IAST [baseline] (23.127 ms) : 0, 23127
IAST [candidate] (23.345 ms) : 0, 23345
AppSec [baseline] (171.146 ms) : 0, 171146
AppSec [candidate] (171.495 ms) : 0, 171495
Debugger [baseline] (5.778 ms) : 0, 5778
Debugger [candidate] (5.694 ms) : 0, 5694
Remote Config [baseline] (600.449 µs) : 0, 600
Remote Config [candidate] (594.403 µs) : 0, 594
Telemetry [baseline] (8.128 ms) : 0, 8128
Telemetry [candidate] (7.97 ms) : 0, 7970
section iast
BytebuddyAgent [baseline] (815.664 ms) : 0, 815664
BytebuddyAgent [candidate] (808.368 ms) : 0, 808368
GlobalTracer [baseline] (235.057 ms) : 0, 235057
GlobalTracer [candidate] (233.238 ms) : 0, 233238
IAST [baseline] (29.609 ms) : 0, 29609
IAST [candidate] (29.434 ms) : 0, 29434
AppSec [baseline] (27.177 ms) : 0, 27177
AppSec [candidate] (27.671 ms) : 0, 27671
Debugger [baseline] (6.719 ms) : 0, 6719
Debugger [candidate] (5.807 ms) : 0, 5807
Remote Config [baseline] (584.561 µs) : 0, 585
Remote Config [candidate] (579.963 µs) : 0, 580
Telemetry [baseline] (8.06 ms) : 0, 8060
Telemetry [candidate] (7.988 ms) : 0, 7988
section profiling
BytebuddyAgent [baseline] (677.415 ms) : 0, 677415
BytebuddyAgent [candidate] (679.178 ms) : 0, 679178
GlobalTracer [baseline] (361.424 ms) : 0, 361424
GlobalTracer [candidate] (362.673 ms) : 0, 362673
AppSec [baseline] (30.986 ms) : 0, 30986
AppSec [candidate] (31.051 ms) : 0, 31051
Debugger [baseline] (12.776 ms) : 0, 12776
Debugger [candidate] (12.984 ms) : 0, 12984
Remote Config [baseline] (668.15 µs) : 0, 668
Remote Config [candidate] (664.686 µs) : 0, 665
Telemetry [baseline] (8.662 ms) : 0, 8662
Telemetry [candidate] (8.794 ms) : 0, 8794
ProfilingAgent [baseline] (103.605 ms) : 0, 103605
ProfilingAgent [candidate] (103.54 ms) : 0, 103540
Profiling [baseline] (103.629 ms) : 0, 103629
Profiling [candidate] (103.564 ms) : 0, 103564
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (999.791 ms) : 0, 999791
Total [baseline] (8.602 s) : 0, 8602181
Agent [candidate] (1.002 s) : 0, 1001868
Total [candidate] (8.605 s) : 0, 8605296
section iast
Agent [baseline] (1.135 s) : 0, 1135350
Total [baseline] (9.315 s) : 0, 9315236
Agent [candidate] (1.144 s) : 0, 1144019
Total [candidate] (9.33 s) : 0, 9330455
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 999.791 ms -
Agent iast 1.135 s 135.559 ms (13.6%)
Total tracing 8.602 s -
Total iast 9.315 s 713.055 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.002 s -
Agent iast 1.144 s 142.15 ms (14.2%)
Total tracing 8.605 s -
Total iast 9.33 s 725.159 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (690.901 ms) : 0, 690901
BytebuddyAgent [candidate] (691.938 ms) : 0, 691938
GlobalTracer [baseline] (242.56 ms) : 0, 242560
GlobalTracer [candidate] (243.466 ms) : 0, 243466
AppSec [baseline] (30.367 ms) : 0, 30367
AppSec [candidate] (30.517 ms) : 0, 30517
Debugger [baseline] (6.083 ms) : 0, 6083
Debugger [candidate] (6.093 ms) : 0, 6093
Remote Config [baseline] (683.655 µs) : 0, 684
Remote Config [candidate] (683.996 µs) : 0, 684
Telemetry [baseline] (8.291 ms) : 0, 8291
Telemetry [candidate] (8.275 ms) : 0, 8275
section iast
BytebuddyAgent [baseline] (809.081 ms) : 0, 809081
BytebuddyAgent [candidate] (815.903 ms) : 0, 815903
GlobalTracer [baseline] (233.422 ms) : 0, 233422
GlobalTracer [candidate] (234.769 ms) : 0, 234769
IAST [baseline] (28.733 ms) : 0, 28733
IAST [candidate] (28.201 ms) : 0, 28201
AppSec [baseline] (28.76 ms) : 0, 28760
AppSec [candidate] (29.531 ms) : 0, 29531
Debugger [baseline] (5.865 ms) : 0, 5865
Debugger [candidate] (5.865 ms) : 0, 5865
Remote Config [baseline] (580.244 µs) : 0, 580
Remote Config [candidate] (591.747 µs) : 0, 592
Telemetry [baseline] (8.071 ms) : 0, 8071
Telemetry [candidate] (8.163 ms) : 0, 8163
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/dont-run-check-big-regression-on-master
git_commit_date 1751896011 1751896480
git_commit_sha 6cca46e b04023d
release_version 1.51.0-SNAPSHOT~6cca46e0b4 1.51.0-SNAPSHOT~b04023d86a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751897985 1751897985
ci_job_id 1016075636 1016075636
ci_pipeline_id 69777988 69777988
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gr6sc0ct 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gr6sc0ct 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load better
[-261.554µs; -145.443µs] or [-5.765%; -3.206%]		 unstable
[-70.500op/s; +163.313op/s] or [-6.964%; +16.131%]		 4.334ms 1058.812op/s 4.537ms 1012.406op/s
scenario:load:insecure-bank:tracing:high_load worse
[+189.171µs; +419.350µs] or [+2.581%; +5.722%]		 unstable
[-103.083op/s; +53.021op/s] or [-16.316%; +8.392%]		 7.633ms 606.750op/s 7.329ms 631.781op/s
scenario:load:petclinic:no_agent:high_load better
[-1.527ms; -0.898ms] or [-4.139%; -2.435%]		 unstable
[-5.026op/s; +13.601op/s] or [-3.966%; +10.734%]		 35.677ms 131.000op/s 36.890ms 126.713op/s
scenario:load:petclinic:appsec:high_load better
[-2.126ms; -1.215ms] or [-4.443%; -2.539%]		 unstable
[-4.156op/s; +11.081op/s] or [-4.248%; +11.327%]		 46.192ms 101.287op/s 47.863ms 97.825op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.537 ms) : 4478, 4596
.   : milestone, 4537,
iast (9.276 ms) : 9118, 9433
.   : milestone, 9276,
iast_FULL (14.025 ms) : 13748, 14302
.   : milestone, 14025,
iast_GLOBAL (10.362 ms) : 10183, 10542
.   : milestone, 10362,
profiling (8.774 ms) : 8630, 8919
.   : milestone, 8774,
tracing (7.329 ms) : 7222, 7435
.   : milestone, 7329,
section candidate
no_agent (4.334 ms) : 4285, 4382
.   : milestone, 4334,
iast (9.5 ms) : 9344, 9656
.   : milestone, 9500,
iast_FULL (14.561 ms) : 14270, 14852
.   : milestone, 14561,
iast_GLOBAL (10.164 ms) : 9975, 10352
.   : milestone, 10164,
profiling (8.918 ms) : 8769, 9067
.   : milestone, 8918,
tracing (7.633 ms) : 7525, 7740
.   : milestone, 7633,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.537 ms [4.478 ms, 4.596 ms] -
iast 9.276 ms [9.118 ms, 9.433 ms] 4.738 ms (104.4%)
iast_FULL 14.025 ms [13.748 ms, 14.302 ms] 9.488 ms (209.1%)
iast_GLOBAL 10.362 ms [10.183 ms, 10.542 ms] 5.825 ms (128.4%)
profiling 8.774 ms [8.63 ms, 8.919 ms] 4.237 ms (93.4%)
tracing 7.329 ms [7.222 ms, 7.435 ms] 2.791 ms (61.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.334 ms [4.285 ms, 4.382 ms] -
iast 9.5 ms [9.344 ms, 9.656 ms] 5.167 ms (119.2%)
iast_FULL 14.561 ms [14.27 ms, 14.852 ms] 10.228 ms (236.0%)
iast_GLOBAL 10.164 ms [9.975 ms, 10.352 ms] 5.83 ms (134.5%)
profiling 8.918 ms [8.769 ms, 9.067 ms] 4.584 ms (105.8%)
tracing 7.633 ms [7.525 ms, 7.74 ms] 3.299 ms (76.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.89 ms) : 36589, 37190
.   : milestone, 36890,
appsec (47.863 ms) : 47432, 48294
.   : milestone, 47863,
code_origins (44.641 ms) : 44258, 45024
.   : milestone, 44641,
iast (45.16 ms) : 44757, 45562
.   : milestone, 45160,
profiling (48.504 ms) : 48020, 48988
.   : milestone, 48504,
tracing (44.028 ms) : 43647, 44409
.   : milestone, 44028,
section candidate
no_agent (35.677 ms) : 35393, 35960
.   : milestone, 35677,
appsec (46.192 ms) : 45777, 46608
.   : milestone, 46192,
code_origins (45.936 ms) : 45534, 46337
.   : milestone, 45936,
iast (45.502 ms) : 45094, 45911
.   : milestone, 45502,
profiling (49.444 ms) : 48981, 49906
.   : milestone, 49444,
tracing (44.703 ms) : 44313, 45093
.   : milestone, 44703,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.89 ms [36.589 ms, 37.19 ms] -
appsec 47.863 ms [47.432 ms, 48.294 ms] 10.974 ms (29.7%)
code_origins 44.641 ms [44.258 ms, 45.024 ms] 7.751 ms (21.0%)
iast 45.16 ms [44.757 ms, 45.562 ms] 8.27 ms (22.4%)
profiling 48.504 ms [48.02 ms, 48.988 ms] 11.615 ms (31.5%)
tracing 44.028 ms [43.647 ms, 44.409 ms] 7.139 ms (19.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 35.677 ms [35.393 ms, 35.96 ms] -
appsec 46.192 ms [45.777 ms, 46.608 ms] 10.515 ms (29.5%)
code_origins 45.936 ms [45.534 ms, 46.337 ms] 10.259 ms (28.8%)
iast 45.502 ms [45.094 ms, 45.911 ms] 9.825 ms (27.5%)
profiling 49.444 ms [48.981 ms, 49.906 ms] 13.767 ms (38.6%)
tracing 44.703 ms [44.313 ms, 45.093 ms] 9.026 ms (25.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/dont-run-check-big-regression-on-master
git_commit_date 1751896011 1751896480
git_commit_sha 6cca46e b04023d
release_version 1.51.0-SNAPSHOT~6cca46e0b4 1.51.0-SNAPSHOT~b04023d86a
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1751898427 1751898427
ci_job_id 1016075637 1016075637
ci_pipeline_id 69777988 69777988
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-b84on53z 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-b84on53z 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.667 s) : 15667000, 15667000
.   : milestone, 15667000,
appsec (14.621 s) : 14621000, 14621000
.   : milestone, 14621000,
iast (18.334 s) : 18334000, 18334000
.   : milestone, 18334000,
iast_GLOBAL (17.957 s) : 17957000, 17957000
.   : milestone, 17957000,
profiling (15.022 s) : 15022000, 15022000
.   : milestone, 15022000,
tracing (14.668 s) : 14668000, 14668000
.   : milestone, 14668000,
section candidate
no_agent (14.77 s) : 14770000, 14770000
.   : milestone, 14770000,
appsec (14.714 s) : 14714000, 14714000
.   : milestone, 14714000,
iast (18.457 s) : 18457000, 18457000
.   : milestone, 18457000,
iast_GLOBAL (18.127 s) : 18127000, 18127000
.   : milestone, 18127000,
profiling (15.014 s) : 15014000, 15014000
.   : milestone, 15014000,
tracing (14.88 s) : 14880000, 14880000
.   : milestone, 14880000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.667 s [15.667 s, 15.667 s] -
appsec 14.621 s [14.621 s, 14.621 s] -1.046 s (-6.7%)
iast 18.334 s [18.334 s, 18.334 s] 2.667 s (17.0%)
iast_GLOBAL 17.957 s [17.957 s, 17.957 s] 2.29 s (14.6%)
profiling 15.022 s [15.022 s, 15.022 s] -645.0 ms (-4.1%)
tracing 14.668 s [14.668 s, 14.668 s] -999.0 ms (-6.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.77 s [14.77 s, 14.77 s] -
appsec 14.714 s [14.714 s, 14.714 s] -56.0 ms (-0.4%)
iast 18.457 s [18.457 s, 18.457 s] 3.687 s (25.0%)
iast_GLOBAL 18.127 s [18.127 s, 18.127 s] 3.357 s (22.7%)
profiling 15.014 s [15.014 s, 15.014 s] 244.0 ms (1.7%)
tracing 14.88 s [14.88 s, 14.88 s] 110.0 ms (0.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1495
.   : milestone, 1483,
appsec (2.415 ms) : 2366, 2465
.   : milestone, 2415,
iast (2.196 ms) : 2134, 2258
.   : milestone, 2196,
iast_GLOBAL (2.24 ms) : 2178, 2302
.   : milestone, 2240,
profiling (2.071 ms) : 2019, 2122
.   : milestone, 2071,
tracing (2.016 ms) : 1968, 2064
.   : milestone, 2016,
section candidate
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (2.402 ms) : 2353, 2452
.   : milestone, 2402,
iast (2.195 ms) : 2133, 2258
.   : milestone, 2195,
iast_GLOBAL (2.247 ms) : 2184, 2310
.   : milestone, 2247,
profiling (2.053 ms) : 2002, 2104
.   : milestone, 2053,
tracing (2.024 ms) : 1976, 2073
.   : milestone, 2024,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.495 ms] -
appsec 2.415 ms [2.366 ms, 2.465 ms] 932.431 µs (62.9%)
iast 2.196 ms [2.134 ms, 2.258 ms] 712.989 µs (48.1%)
iast_GLOBAL 2.24 ms [2.178 ms, 2.302 ms] 756.795 µs (51.0%)
profiling 2.071 ms [2.019 ms, 2.122 ms] 587.495 µs (39.6%)
tracing 2.016 ms [1.968 ms, 2.064 ms] 532.627 µs (35.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 2.402 ms [2.353 ms, 2.452 ms] 920.006 µs (62.1%)
iast 2.195 ms [2.133 ms, 2.258 ms] 712.954 µs (48.1%)
iast_GLOBAL 2.247 ms [2.184 ms, 2.31 ms] 764.575 µs (51.6%)
profiling 2.053 ms [2.002 ms, 2.104 ms] 570.883 µs (38.5%)
tracing 2.024 ms [1.976 ms, 2.073 ms] 542.018 µs (36.6%)

@bric3 bric3 force-pushed the bdu/dont-run-check-big-regression-on-master branch from 2e703c4 to 89fdf19 Compare July 7, 2025 11:25
@bric3 bric3 force-pushed the bdu/dont-run-check-big-regression-on-master branch from 89fdf19 to 509bbde Compare July 7, 2025 13:18
@bric3 bric3 added comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes tag: performance Performance related changes labels Jul 7, 2025
@bric3 bric3 merged commit c01b987 into master Jul 7, 2025
509 of 511 checks passed
@bric3 bric3 deleted the bdu/dont-run-check-big-regression-on-master branch July 7, 2025 14:48
@github-actions github-actions bot added this to the 1.51.0 milestone Jul 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ddyurchenko ddyurchenko ddyurchenko approved these changes

@igoragoli igoragoli Awaiting requested review from igoragoli

@randomanderson randomanderson Awaiting requested review from randomanderson randomanderson is a code owner automatically assigned from DataDog/apm-release-platform

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes tag: performance Performance related changes
Projects
None yet
Milestone
1.51.0
Development

Successfully merging this pull request may close these issues.
2 participants
@bric3 @ddyurchenko