Skip to content

Clean up Platform and CLIHelper component #9101

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jul 7, 2025
Merged

Clean up Platform and CLIHelper component #9101

merged 1 commit into from
Jul 7, 2025

Conversation

PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Jul 4, 2025 •
edited
Loading

What Does This Do

This PR cleans up Platform methods and the original CLIHelper component.

Follow-up to:

Motivation

The behavior moved into the dedicated environment component.

Additional Notes

This should be the last PR for the environment component for now.
Next steps would be to keep porting related features to this component.

Contributor Checklist

Jira ticket: LANGPLAT-458

@PerfectSlayer PerfectSlayer added tag: no release notes Changes to exclude from release notes type: refactoring comp: platform Platform components labels Jul 4, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jul 4, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment-step6
git_commit_date 1751637515 1751637564
git_commit_sha 1de42c8 eaf8c40
release_version 1.51.0-SNAPSHOT~1de42c8097 1.51.0-SNAPSHOT~eaf8c40d59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751639396 1751639396
ci_job_id 1014448367 1014448367
ci_pipeline_id 69678605 69678605
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tc6z00hw 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tc6z00hw 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (997.35 ms) : 0, 997350
Total [baseline] (8.564 s) : 0, 8564229
Agent [candidate] (996.397 ms) : 0, 996397
Total [candidate] (8.587 s) : 0, 8586519
section iast
Agent [baseline] (1.137 s) : 0, 1137152
Total [baseline] (9.274 s) : 0, 9273669
Agent [candidate] (1.141 s) : 0, 1141159
Total [candidate] (9.306 s) : 0, 9306284
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 997.35 ms -
Agent iast 1.137 s 139.802 ms (14.0%)
Total tracing 8.564 s -
Total iast 9.274 s 709.44 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 996.397 ms -
Agent iast 1.141 s 144.761 ms (14.5%)
Total tracing 8.587 s -
Total iast 9.306 s 719.765 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.644 ms) : 0, 688644
BytebuddyAgent [candidate] (687.974 ms) : 0, 687974
GlobalTracer [baseline] (241.872 ms) : 0, 241872
GlobalTracer [candidate] (242.595 ms) : 0, 242595
AppSec [baseline] (30.393 ms) : 0, 30393
AppSec [candidate] (30.133 ms) : 0, 30133
Debugger [baseline] (6.068 ms) : 0, 6068
Debugger [candidate] (6.022 ms) : 0, 6022
Remote Config [baseline] (688.492 µs) : 0, 688
Remote Config [candidate] (677.705 µs) : 0, 678
Telemetry [baseline] (8.249 ms) : 0, 8249
Telemetry [candidate] (8.213 ms) : 0, 8213
section iast
BytebuddyAgent [baseline] (811.021 ms) : 0, 811021
BytebuddyAgent [candidate] (813.518 ms) : 0, 813518
GlobalTracer [baseline] (232.991 ms) : 0, 232991
GlobalTracer [candidate] (234.162 ms) : 0, 234162
IAST [baseline] (28.402 ms) : 0, 28402
IAST [candidate] (28.18 ms) : 0, 28180
AppSec [baseline] (27.104 ms) : 0, 27104
AppSec [candidate] (29.815 ms) : 0, 29815
Debugger [baseline] (7.623 ms) : 0, 7623
Debugger [candidate] (5.893 ms) : 0, 5893
Remote Config [baseline] (584.389 µs) : 0, 584
Remote Config [candidate] (585.112 µs) : 0, 585
Telemetry [baseline] (8.079 ms) : 0, 8079
Telemetry [candidate] (8.141 ms) : 0, 8141
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (996.997 ms) : 0, 996997
Total [baseline] (10.719 s) : 0, 10719330
Agent [candidate] (996.664 ms) : 0, 996664
Total [candidate] (10.649 s) : 0, 10648960
section appsec
Agent [baseline] (1.175 s) : 0, 1174773
Total [baseline] (10.725 s) : 0, 10724504
Agent [candidate] (1.174 s) : 0, 1174373
Total [candidate] (10.699 s) : 0, 10699017
section iast
Agent [baseline] (1.142 s) : 0, 1141740
Total [baseline] (10.944 s) : 0, 10943650
Agent [candidate] (1.135 s) : 0, 1134953
Total [candidate] (10.928 s) : 0, 10928185
section profiling
Agent [baseline] (1.245 s) : 0, 1245136
Total [baseline] (10.98 s) : 0, 10980212
Agent [candidate] (1.245 s) : 0, 1245037
Total [candidate] (11.03 s) : 0, 11029821
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 996.997 ms -
Agent appsec 1.175 s 177.776 ms (17.8%)
Agent iast 1.142 s 144.743 ms (14.5%)
Agent profiling 1.245 s 248.139 ms (24.9%)
Total tracing 10.719 s -
Total appsec 10.725 s 5.173 ms (0.0%)
Total iast 10.944 s 224.319 ms (2.1%)
Total profiling 10.98 s 260.882 ms (2.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 996.664 ms -
Agent appsec 1.174 s 177.709 ms (17.8%)
Agent iast 1.135 s 138.289 ms (13.9%)
Agent profiling 1.245 s 248.373 ms (24.9%)
Total tracing 10.649 s -
Total appsec 10.699 s 50.057 ms (0.5%)
Total iast 10.928 s 279.225 ms (2.6%)
Total profiling 11.03 s 380.861 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.258 ms) : 0, 688258
BytebuddyAgent [candidate] (688.571 ms) : 0, 688571
GlobalTracer [baseline] (242.275 ms) : 0, 242275
GlobalTracer [candidate] (242.089 ms) : 0, 242089
AppSec [baseline] (30.102 ms) : 0, 30102
AppSec [candidate] (30.32 ms) : 0, 30320
Debugger [baseline] (6.058 ms) : 0, 6058
Debugger [candidate] (6.069 ms) : 0, 6069
Remote Config [baseline] (668.609 µs) : 0, 669
Remote Config [candidate] (673.31 µs) : 0, 673
Telemetry [baseline] (8.19 ms) : 0, 8190
Telemetry [candidate] (8.214 ms) : 0, 8214
section appsec
BytebuddyAgent [baseline] (710.226 ms) : 0, 710226
BytebuddyAgent [candidate] (709.743 ms) : 0, 709743
GlobalTracer [baseline] (234.93 ms) : 0, 234930
GlobalTracer [candidate] (234.922 ms) : 0, 234922
AppSec [baseline] (170.548 ms) : 0, 170548
AppSec [candidate] (171.242 ms) : 0, 171242
Debugger [baseline] (5.719 ms) : 0, 5719
Debugger [candidate] (5.748 ms) : 0, 5748
Remote Config [baseline] (597.817 µs) : 0, 598
Remote Config [candidate] (598.096 µs) : 0, 598
Telemetry [baseline] (8.006 ms) : 0, 8006
Telemetry [candidate] (8.022 ms) : 0, 8022
IAST [baseline] (23.338 ms) : 0, 23338
IAST [candidate] (23.356 ms) : 0, 23356
section iast
BytebuddyAgent [baseline] (813.317 ms) : 0, 813317
BytebuddyAgent [candidate] (808.37 ms) : 0, 808370
GlobalTracer [baseline] (234.146 ms) : 0, 234146
GlobalTracer [candidate] (233.245 ms) : 0, 233245
AppSec [baseline] (29.086 ms) : 0, 29086
AppSec [candidate] (31.641 ms) : 0, 31641
Debugger [baseline] (6.767 ms) : 0, 6767
Debugger [candidate] (5.848 ms) : 0, 5848
Remote Config [baseline] (597.032 µs) : 0, 597
Remote Config [candidate] (582.661 µs) : 0, 583
Telemetry [baseline] (8.101 ms) : 0, 8101
Telemetry [candidate] (8.092 ms) : 0, 8092
IAST [baseline] (28.214 ms) : 0, 28214
IAST [candidate] (26.311 ms) : 0, 26311
section profiling
ProfilingAgent [baseline] (103.311 ms) : 0, 103311
ProfilingAgent [candidate] (103.609 ms) : 0, 103609
BytebuddyAgent [baseline] (678.85 ms) : 0, 678850
BytebuddyAgent [candidate] (678.832 ms) : 0, 678832
GlobalTracer [baseline] (360.908 ms) : 0, 360908
GlobalTracer [candidate] (360.983 ms) : 0, 360983
AppSec [baseline] (30.877 ms) : 0, 30877
AppSec [candidate] (32.976 ms) : 0, 32976
Debugger [baseline] (13.363 ms) : 0, 13363
Debugger [candidate] (9.967 ms) : 0, 9967
Remote Config [baseline] (663.463 µs) : 0, 663
Remote Config [candidate] (659.01 µs) : 0, 659
Telemetry [baseline] (8.022 ms) : 0, 8022
Telemetry [candidate] (9.519 ms) : 0, 9519
Profiling [baseline] (103.334 ms) : 0, 103334
Profiling [candidate] (103.633 ms) : 0, 103633
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment-step6
git_commit_date 1751637515 1751637564
git_commit_sha 1de42c8 eaf8c40
release_version 1.51.0-SNAPSHOT~1de42c8097 1.51.0-SNAPSHOT~eaf8c40d59
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751872658 1751872658
ci_job_id 1015265295 1015265295
ci_pipeline_id 69678605 69678605
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qis2vib5 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qis2vib5 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load worse
[+243.653µs; +476.989µs] or [+3.333%; +6.524%]		 unstable
[-106.015op/s; +47.140op/s] or [-16.743%; +7.445%]		 7.672ms 603.750op/s 7.311ms 633.188op/s
scenario:load:petclinic:code_origins:high_load better
[-2.345ms; -1.516ms] or [-5.191%; -3.356%]		 unstable
[-2.827op/s; +12.077op/s] or [-2.729%; +11.659%]		 43.253ms 108.213op/s 45.184ms 103.588op/s
scenario:load:petclinic:tracing:high_load better
[-2.475ms; -1.667ms] or [-5.632%; -3.794%]		 unstable
[-2.498op/s; +12.998op/s] or [-2.345%; +12.202%]		 41.866ms 111.775op/s 43.937ms 106.525op/s
scenario:load:petclinic:profiling:high_load better
[-4.341ms; -3.416ms] or [-8.853%; -6.968%]		 unstable
[+1.002op/s; +15.248op/s] or [+1.049%; +15.966%]		 45.151ms 103.625op/s 49.029ms 95.500op/s
scenario:load:petclinic:iast:high_load worse
[+1.599ms; +2.432ms] or [+3.690%; +5.612%]		 unstable
[-10.360op/s; +3.398op/s] or [-9.595%; +3.147%]		 45.346ms 104.494op/s 43.331ms 107.975op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.745 ms) : 36443, 37047
.   : milestone, 36745,
appsec (46.636 ms) : 46210, 47062
.   : milestone, 46636,
code_origins (45.184 ms) : 44785, 45582
.   : milestone, 45184,
iast (43.331 ms) : 42956, 43705
.   : milestone, 43331,
profiling (49.029 ms) : 48567, 49492
.   : milestone, 49029,
tracing (43.937 ms) : 43540, 44334
.   : milestone, 43937,
section candidate
no_agent (36.222 ms) : 35935, 36508
.   : milestone, 36222,
appsec (45.932 ms) : 45533, 46331
.   : milestone, 45932,
code_origins (43.253 ms) : 42881, 43624
.   : milestone, 43253,
iast (45.346 ms) : 44947, 45745
.   : milestone, 45346,
profiling (45.151 ms) : 44757, 45544
.   : milestone, 45151,
tracing (41.866 ms) : 41514, 42218
.   : milestone, 41866,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.745 ms [36.443 ms, 37.047 ms] -
appsec 46.636 ms [46.21 ms, 47.062 ms] 9.891 ms (26.9%)
code_origins 45.184 ms [44.785 ms, 45.582 ms] 8.439 ms (23.0%)
iast 43.331 ms [42.956 ms, 43.705 ms] 6.586 ms (17.9%)
profiling 49.029 ms [48.567 ms, 49.492 ms] 12.284 ms (33.4%)
tracing 43.937 ms [43.54 ms, 44.334 ms] 7.192 ms (19.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.222 ms [35.935 ms, 36.508 ms] -
appsec 45.932 ms [45.533 ms, 46.331 ms] 9.711 ms (26.8%)
code_origins 43.253 ms [42.881 ms, 43.624 ms] 7.031 ms (19.4%)
iast 45.346 ms [44.947 ms, 45.745 ms] 9.125 ms (25.2%)
profiling 45.151 ms [44.757 ms, 45.544 ms] 8.929 ms (24.7%)
tracing 41.866 ms [41.514 ms, 42.218 ms] 5.644 ms (15.6%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.547 ms) : 4495, 4600
.   : milestone, 4547,
iast (9.314 ms) : 9154, 9473
.   : milestone, 9314,
iast_FULL (14.224 ms) : 13937, 14511
.   : milestone, 14224,
iast_GLOBAL (10.595 ms) : 10404, 10787
.   : milestone, 10595,
profiling (8.632 ms) : 8493, 8770
.   : milestone, 8632,
tracing (7.311 ms) : 7205, 7418
.   : milestone, 7311,
section candidate
no_agent (4.49 ms) : 4438, 4542
.   : milestone, 4490,
iast (9.088 ms) : 8937, 9240
.   : milestone, 9088,
iast_FULL (14.625 ms) : 14332, 14919
.   : milestone, 14625,
iast_GLOBAL (10.308 ms) : 10131, 10486
.   : milestone, 10308,
profiling (8.816 ms) : 8666, 8966
.   : milestone, 8816,
tracing (7.672 ms) : 7562, 7782
.   : milestone, 7672,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.547 ms [4.495 ms, 4.6 ms] -
iast 9.314 ms [9.154 ms, 9.473 ms] 4.766 ms (104.8%)
iast_FULL 14.224 ms [13.937 ms, 14.511 ms] 9.677 ms (212.8%)
iast_GLOBAL 10.595 ms [10.404 ms, 10.787 ms] 6.048 ms (133.0%)
profiling 8.632 ms [8.493 ms, 8.77 ms] 4.085 ms (89.8%)
tracing 7.311 ms [7.205 ms, 7.418 ms] 2.764 ms (60.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.49 ms [4.438 ms, 4.542 ms] -
iast 9.088 ms [8.937 ms, 9.24 ms] 4.598 ms (102.4%)
iast_FULL 14.625 ms [14.332 ms, 14.919 ms] 10.136 ms (225.8%)
iast_GLOBAL 10.308 ms [10.131 ms, 10.486 ms] 5.819 ms (129.6%)
profiling 8.816 ms [8.666 ms, 8.966 ms] 4.326 ms (96.4%)
tracing 7.672 ms [7.562 ms, 7.782 ms] 3.182 ms (70.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment-step6
git_commit_date 1751637515 1751637564
git_commit_sha 1de42c8 eaf8c40
release_version 1.51.0-SNAPSHOT~1de42c8097 1.51.0-SNAPSHOT~eaf8c40d59
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1751639565 1751639565
ci_job_id 1014448387 1014448387
ci_pipeline_id 69678605 69678605
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-zh1sh5ej 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-zh1sh5ej 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.393 ms) : 2344, 2441
.   : milestone, 2393,
iast (2.179 ms) : 2118, 2241
.   : milestone, 2179,
iast_GLOBAL (2.227 ms) : 2165, 2289
.   : milestone, 2227,
profiling (2.035 ms) : 1985, 2084
.   : milestone, 2035,
tracing (2.002 ms) : 1954, 2050
.   : milestone, 2002,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.392 ms) : 2343, 2441
.   : milestone, 2392,
iast (2.182 ms) : 2120, 2243
.   : milestone, 2182,
iast_GLOBAL (2.224 ms) : 2162, 2286
.   : milestone, 2224,
profiling (2.031 ms) : 1980, 2081
.   : milestone, 2031,
tracing (2.01 ms) : 1962, 2058
.   : milestone, 2010,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.393 ms [2.344 ms, 2.441 ms] 920.389 µs (62.5%)
iast 2.179 ms [2.118 ms, 2.241 ms] 707.016 µs (48.0%)
iast_GLOBAL 2.227 ms [2.165 ms, 2.289 ms] 754.855 µs (51.3%)
profiling 2.035 ms [1.985 ms, 2.084 ms] 562.356 µs (38.2%)
tracing 2.002 ms [1.954 ms, 2.05 ms] 529.94 µs (36.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.392 ms [2.343 ms, 2.441 ms] 921.133 µs (62.6%)
iast 2.182 ms [2.12 ms, 2.243 ms] 711.021 µs (48.3%)
iast_GLOBAL 2.224 ms [2.162 ms, 2.286 ms] 753.657 µs (51.2%)
profiling 2.031 ms [1.98 ms, 2.081 ms] 560.002 µs (38.1%)
tracing 2.01 ms [1.962 ms, 2.058 ms] 539.167 µs (36.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.787 s) : 15787000, 15787000
.   : milestone, 15787000,
appsec (14.858 s) : 14858000, 14858000
.   : milestone, 14858000,
iast (18.279 s) : 18279000, 18279000
.   : milestone, 18279000,
iast_GLOBAL (18.042 s) : 18042000, 18042000
.   : milestone, 18042000,
profiling (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,
tracing (14.825 s) : 14825000, 14825000
.   : milestone, 14825000,
section candidate
no_agent (15.249 s) : 15249000, 15249000
.   : milestone, 15249000,
appsec (14.732 s) : 14732000, 14732000
.   : milestone, 14732000,
iast (18.174 s) : 18174000, 18174000
.   : milestone, 18174000,
iast_GLOBAL (17.879 s) : 17879000, 17879000
.   : milestone, 17879000,
profiling (15.412 s) : 15412000, 15412000
.   : milestone, 15412000,
tracing (14.765 s) : 14765000, 14765000
.   : milestone, 14765000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.787 s [15.787 s, 15.787 s] -
appsec 14.858 s [14.858 s, 14.858 s] -929.0 ms (-5.9%)
iast 18.279 s [18.279 s, 18.279 s] 2.492 s (15.8%)
iast_GLOBAL 18.042 s [18.042 s, 18.042 s] 2.255 s (14.3%)
profiling 15.04 s [15.04 s, 15.04 s] -747.0 ms (-4.7%)
tracing 14.825 s [14.825 s, 14.825 s] -962.0 ms (-6.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.249 s [15.249 s, 15.249 s] -
appsec 14.732 s [14.732 s, 14.732 s] -517.0 ms (-3.4%)
iast 18.174 s [18.174 s, 18.174 s] 2.925 s (19.2%)
iast_GLOBAL 17.879 s [17.879 s, 17.879 s] 2.63 s (17.2%)
profiling 15.412 s [15.412 s, 15.412 s] 163.0 ms (1.1%)
tracing 14.765 s [14.765 s, 14.765 s] -484.0 ms (-3.2%)

@PerfectSlayer PerfectSlayer force-pushed the bbujon/environment-step5 branch from 4d467d1 to 115d3dc Compare July 4, 2025 05:12
@PerfectSlayer PerfectSlayer force-pushed the bbujon/environment-step6 branch from 721cba2 to fea3156 Compare July 4, 2025 05:17
@pr-commenter
Copy link

pr-commenter bot commented Jul 4, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1751606772 1751607155
end_time 2025-07-04T05:27:33 2025-07-04T05:33:55
git_branch master bbujon/environment-step6
git_commit_sha dd59589 fea3156
start_time 2025-07-04T05:26:13 2025-07-04T05:32:36
See matching parameters
Baseline Candidate
ci_job_id 1013696559 1013696559
ci_pipeline_id 69642172 69642172
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1751605910 1751605910

Summary

Found 6 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:basic better
[-11.729µs; -3.295µs] or [-4.170%; -1.172%]		 same same unstable
[+9.835µs; +202.784µs] or [+1.263%; +26.039%]		 unstable
[-71.228op/s; +193.179op/s] or [-2.920%; +7.920%]
scenario:loop better
[-654.659µs; -648.815µs] or [-6.148%; -6.093%]		 better
[-679.771µs; -617.779µs] or [-6.281%; -5.708%]		 better
[-693.821µs; -583.026µs] or [-6.358%; -5.342%]		 better
[-824.996µs; -475.204µs] or [-7.351%; -4.234%]		 better
[+4.956op/s; +6.571op/s] or [+5.426%; +7.195%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-27.284µs; +14.046µs] or [-9.732%; +5.010%]		 unstable
[-38.752µs; +23.479µs] or [-12.153%; +7.363%]		 unstable
[-51.205µs; +32.715µs] or [-15.319%; +9.788%]		 unstable
[+34.917µs; +246.017µs] or [+3.898%; +27.467%]		 same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (318.88 µs) : 284, 354
.   : milestone, 319,
basic (309.805 µs) : 302, 318
.   : milestone, 310,
loop (10.823 ms) : 10801, 10844
.   : milestone, 10823,
section candidate
noprobe (311.244 µs) : 288, 335
.   : milestone, 311,
basic (303.612 µs) : 295, 312
.   : milestone, 304,
loop (10.174 ms) : 10139, 10208
.   : milestone, 10174,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 318.88 µs [284.218 µs, 353.543 µs]
basic 309.805 µs [301.648 µs, 317.962 µs]
loop 10.823 ms [10.801 ms, 10.844 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 311.244 µs [287.713 µs, 334.775 µs]
basic 303.612 µs [295.119 µs, 312.106 µs]
loop 10.174 ms [10.139 ms, 10.208 ms]

Base automatically changed from bbujon/environment-step5 to master July 4, 2025 13:58
@PerfectSlayer PerfectSlayer force-pushed the bbujon/environment-step6 branch from fea3156 to eaf8c40 Compare July 4, 2025 14:00
@PerfectSlayer PerfectSlayer mentioned this pull request Jul 4, 2025
Merged
@PerfectSlayer PerfectSlayer marked this pull request as ready for review July 4, 2025 14:00
@PerfectSlayer PerfectSlayer requested review from a team as code owners July 4, 2025 14:00
@PerfectSlayer PerfectSlayer requested review from sarahchen6 and smola and removed request for a team July 4, 2025 14:00
@PerfectSlayer PerfectSlayer enabled auto-merge (squash) July 4, 2025 14:10
@PerfectSlayer PerfectSlayer merged commit bbdc0b7 into master Jul 7, 2025
508 of 509 checks passed
@PerfectSlayer PerfectSlayer deleted the bbujon/environment-step6 branch July 7, 2025 07:24
@github-actions github-actions bot added this to the 1.51.0 milestone Jul 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bric3 bric3 bric3 approved these changes

@sarahchen6 sarahchen6 Awaiting requested review from sarahchen6 sarahchen6 is a code owner automatically assigned from DataDog/apm-lang-platform-java

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: platform Platform components tag: no release notes Changes to exclude from release notes type: refactoring
Projects
None yet
Milestone
1.51.0
Development

Successfully merging this pull request may close these issues.
2 participants
@PerfectSlayer @bric3