Skip to content

Increase CiVis smoke tests timeout #9062

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 10 commits into from
Jul 9, 2025
Merged

Increase CiVis smoke tests timeout #9062

merged 10 commits into from
Jul 9, 2025

Conversation

daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Jun 30, 2025 •
edited
Loading

What Does This Do

  • Separates the Maven smoke tests' individual timeout between dependency resolution/downloads and test running. The dependency download timeout has been increased to 400s to avoid timeouts on the first test run, the test running timeouts have been reduced to 120s.
  • Increase Gradle task timeout for Maven smoke test to 25m (from 20m), to account for the increase timeout in dependency download.
  • Increase Gradle task timeout for Gradle smoke tests to 20m (from 15m).

Motivation

After fixing the Maven smoke test suite timeout in #9040, test failures are being correctly reported. Although the Maven smoke tests are passing, sometimes the first one or two individual smoke tests need a retry after timing out (usually test test_successful_maven_run, v3.5.4, less often test test_successful_maven_run, v3.6.3, which are coincidentally the first two tests in the suite). Currently there are limitations on both the caching of smoke tests dependencies and the caching of maven dependencies, as well as issues related to the Maven smoke tests setup. This changes serve as a patch for now until the implementation can be improved to make use of the dependencies caching capabilities.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@daniel-mohedano daniel-mohedano added type: bug Bug report and fix tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jun 30, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 30, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-smoke-warmup-timeout
git_commit_date 1751549586 1751551030
git_commit_sha 53e4f70 99a5b11
release_version 1.51.0-SNAPSHOT~53e4f70038 1.51.0-SNAPSHOT~99a5b11ce8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751552977 1751552977
ci_job_id 1012328896 1012328896
ci_pipeline_id 69564949 69564949
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-8pyzl8mv 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-8pyzl8mv 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (999.837 ms) : 0, 999837
Total [baseline] (8.587 s) : 0, 8587211
Agent [candidate] (1.003 s) : 0, 1002690
Total [candidate] (8.578 s) : 0, 8577752
section iast
Agent [baseline] (1.142 s) : 0, 1141622
Total [baseline] (9.283 s) : 0, 9282581
Agent [candidate] (1.159 s) : 0, 1159308
Total [candidate] (9.393 s) : 0, 9392591
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 999.837 ms -
Agent iast 1.142 s 141.785 ms (14.2%)
Total tracing 8.587 s -
Total iast 9.283 s 695.37 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.003 s -
Agent iast 1.159 s 156.618 ms (15.6%)
Total tracing 8.578 s -
Total iast 9.393 s 814.839 ms (9.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (691.87 ms) : 0, 691870
BytebuddyAgent [candidate] (692.35 ms) : 0, 692350
GlobalTracer [baseline] (241.884 ms) : 0, 241884
GlobalTracer [candidate] (243.728 ms) : 0, 243728
AppSec [baseline] (30.2 ms) : 0, 30200
AppSec [candidate] (30.637 ms) : 0, 30637
Debugger [baseline] (6.059 ms) : 0, 6059
Debugger [candidate] (6.105 ms) : 0, 6105
Remote Config [baseline] (681.981 µs) : 0, 682
Remote Config [candidate] (685.716 µs) : 0, 686
Telemetry [baseline] (8.226 ms) : 0, 8226
Telemetry [candidate] (8.268 ms) : 0, 8268
section iast
BytebuddyAgent [baseline] (814.399 ms) : 0, 814399
BytebuddyAgent [candidate] (828.266 ms) : 0, 828266
GlobalTracer [baseline] (233.901 ms) : 0, 233901
GlobalTracer [candidate] (238.095 ms) : 0, 238095
IAST [baseline] (28.056 ms) : 0, 28056
IAST [candidate] (27.798 ms) : 0, 27798
AppSec [baseline] (28.966 ms) : 0, 28966
AppSec [candidate] (28.541 ms) : 0, 28541
Debugger [baseline] (6.708 ms) : 0, 6708
Debugger [candidate] (5.972 ms) : 0, 5972
Remote Config [baseline] (592.25 µs) : 0, 592
Remote Config [candidate] (589.08 µs) : 0, 589
Telemetry [baseline] (8.146 ms) : 0, 8146
Telemetry [candidate] (8.118 ms) : 0, 8118
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (998.571 ms) : 0, 998571
Total [baseline] (10.584 s) : 0, 10584149
Agent [candidate] (1.005 s) : 0, 1005320
Total [candidate] (10.702 s) : 0, 10702208
section appsec
Agent [baseline] (1.176 s) : 0, 1176073
Total [baseline] (10.734 s) : 0, 10733872
Agent [candidate] (1.186 s) : 0, 1185820
Total [candidate] (10.765 s) : 0, 10765000
section iast
Agent [baseline] (1.135 s) : 0, 1134898
Total [baseline] (10.846 s) : 0, 10845962
Agent [candidate] (1.133 s) : 0, 1132651
Total [candidate] (10.847 s) : 0, 10846717
section profiling
Agent [baseline] (1.247 s) : 0, 1246580
Total [baseline] (10.949 s) : 0, 10949141
Agent [candidate] (1.245 s) : 0, 1245384
Total [candidate] (11.024 s) : 0, 11023838
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 998.571 ms -
Agent appsec 1.176 s 177.501 ms (17.8%)
Agent iast 1.135 s 136.326 ms (13.7%)
Agent profiling 1.247 s 248.008 ms (24.8%)
Total tracing 10.584 s -
Total appsec 10.734 s 149.723 ms (1.4%)
Total iast 10.846 s 261.813 ms (2.5%)
Total profiling 10.949 s 364.992 ms (3.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.005 s -
Agent appsec 1.186 s 180.5 ms (18.0%)
Agent iast 1.133 s 127.331 ms (12.7%)
Agent profiling 1.245 s 240.064 ms (23.9%)
Total tracing 10.702 s -
Total appsec 10.765 s 62.792 ms (0.6%)
Total iast 10.847 s 144.509 ms (1.4%)
Total profiling 11.024 s 321.63 ms (3.0%) 
gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (689.737 ms) : 0, 689737
BytebuddyAgent [candidate] (694.246 ms) : 0, 694246
GlobalTracer [baseline] (242.835 ms) : 0, 242835
GlobalTracer [candidate] (244.27 ms) : 0, 244270
AppSec [baseline] (30.179 ms) : 0, 30179
AppSec [candidate] (30.76 ms) : 0, 30760
Debugger [baseline] (6.095 ms) : 0, 6095
Debugger [candidate] (6.144 ms) : 0, 6144
Remote Config [baseline] (685.831 µs) : 0, 686
Remote Config [candidate] (697.416 µs) : 0, 697
Telemetry [baseline] (8.235 ms) : 0, 8235
Telemetry [candidate] (8.3 ms) : 0, 8300
section appsec
BytebuddyAgent [baseline] (711.053 ms) : 0, 711053
BytebuddyAgent [candidate] (717.758 ms) : 0, 717758
GlobalTracer [baseline] (234.907 ms) : 0, 234907
GlobalTracer [candidate] (237.851 ms) : 0, 237851
IAST [baseline] (23.228 ms) : 0, 23228
IAST [candidate] (22.407 ms) : 0, 22407
AppSec [baseline] (171.531 ms) : 0, 171531
AppSec [candidate] (172.213 ms) : 0, 172213
Debugger [baseline] (5.765 ms) : 0, 5765
Debugger [candidate] (5.852 ms) : 0, 5852
Remote Config [baseline] (601.52 µs) : 0, 602
Remote Config [candidate] (612.811 µs) : 0, 613
Telemetry [baseline] (8.123 ms) : 0, 8123
Telemetry [candidate] (8.211 ms) : 0, 8211
section iast
BytebuddyAgent [baseline] (808.611 ms) : 0, 808611
BytebuddyAgent [candidate] (808.864 ms) : 0, 808864
GlobalTracer [baseline] (233.348 ms) : 0, 233348
GlobalTracer [candidate] (232.952 ms) : 0, 232952
IAST [baseline] (26.411 ms) : 0, 26411
IAST [candidate] (28.64 ms) : 0, 28640
AppSec [baseline] (30.271 ms) : 0, 30271
AppSec [candidate] (26.951 ms) : 0, 26951
Debugger [baseline] (6.758 ms) : 0, 6758
Debugger [candidate] (5.856 ms) : 0, 5856
Remote Config [baseline] (591.246 µs) : 0, 591
Remote Config [candidate] (593.399 µs) : 0, 593
Telemetry [baseline] (8.016 ms) : 0, 8016
Telemetry [candidate] (8.029 ms) : 0, 8029
section profiling
BytebuddyAgent [baseline] (678.917 ms) : 0, 678917
BytebuddyAgent [candidate] (679.349 ms) : 0, 679349
GlobalTracer [baseline] (362.528 ms) : 0, 362528
GlobalTracer [candidate] (361.787 ms) : 0, 361787
AppSec [baseline] (31.579 ms) : 0, 31579
AppSec [candidate] (30.845 ms) : 0, 30845
Debugger [baseline] (12.176 ms) : 0, 12176
Debugger [candidate] (12.018 ms) : 0, 12018
Remote Config [baseline] (650.511 µs) : 0, 651
Remote Config [candidate] (2.141 ms) : 0, 2141
Telemetry [baseline] (8.796 ms) : 0, 8796
Telemetry [candidate] (8.057 ms) : 0, 8057
ProfilingAgent [baseline] (103.328 ms) : 0, 103328
ProfilingAgent [candidate] (102.54 ms) : 0, 102540
Profiling [baseline] (103.353 ms) : 0, 103353
Profiling [candidate] (102.565 ms) : 0, 102565
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-smoke-warmup-timeout
git_commit_date 1751549586 1751551030
git_commit_sha 53e4f70 99a5b11
release_version 1.51.0-SNAPSHOT~53e4f70038 1.51.0-SNAPSHOT~99a5b11ce8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1751552656 1751552656
ci_job_id 1012328898 1012328898
ci_pipeline_id 69564949 69564949
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-hkw25hov 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-hkw25hov 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load better
[-220.465µs; -100.928µs] or [-4.930%; -2.257%]		 unstable
[-84.711op/s; +159.898op/s] or [-8.253%; +15.578%]		 4.312ms 1064.062op/s 4.472ms 1026.469op/s
scenario:load:petclinic:appsec:high_load better
[-2.015ms; -1.118ms] or [-4.211%; -2.336%]		 unstable
[-3.331op/s; +12.296op/s] or [-3.448%; +12.729%]		 46.286ms 101.088op/s 47.853ms 96.605op/s
scenario:load:petclinic:no_agent:high_load better
[-1.649ms; -1.006ms] or [-4.371%; -2.667%]		 unstable
[-5.799op/s; +11.687op/s] or [-4.621%; +9.313%]		 36.394ms 128.425op/s 37.721ms 125.481op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.472 ms) : 4411, 4534
.   : milestone, 4472,
iast (8.94 ms) : 8796, 9085
.   : milestone, 8940,
iast_FULL (14.253 ms) : 13973, 14533
.   : milestone, 14253,
iast_GLOBAL (10.349 ms) : 10170, 10528
.   : milestone, 10349,
profiling (9.017 ms) : 8871, 9164
.   : milestone, 9017,
tracing (7.856 ms) : 7745, 7966
.   : milestone, 7856,
section candidate
no_agent (4.312 ms) : 4263, 4360
.   : milestone, 4312,
iast (8.967 ms) : 8819, 9116
.   : milestone, 8967,
iast_FULL (13.784 ms) : 13510, 14058
.   : milestone, 13784,
iast_GLOBAL (10.018 ms) : 9834, 10202
.   : milestone, 10018,
profiling (8.774 ms) : 8637, 8910
.   : milestone, 8774,
tracing (7.698 ms) : 7578, 7817
.   : milestone, 7698,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.472 ms [4.411 ms, 4.534 ms] -
iast 8.94 ms [8.796 ms, 9.085 ms] 4.468 ms (99.9%)
iast_FULL 14.253 ms [13.973 ms, 14.533 ms] 9.781 ms (218.7%)
iast_GLOBAL 10.349 ms [10.17 ms, 10.528 ms] 5.877 ms (131.4%)
profiling 9.017 ms [8.871 ms, 9.164 ms] 4.545 ms (101.6%)
tracing 7.856 ms [7.745 ms, 7.966 ms] 3.383 ms (75.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.312 ms [4.263 ms, 4.36 ms] -
iast 8.967 ms [8.819 ms, 9.116 ms] 4.656 ms (108.0%)
iast_FULL 13.784 ms [13.51 ms, 14.058 ms] 9.473 ms (219.7%)
iast_GLOBAL 10.018 ms [9.834 ms, 10.202 ms] 5.706 ms (132.4%)
profiling 8.774 ms [8.637 ms, 8.91 ms] 4.462 ms (103.5%)
tracing 7.698 ms [7.578 ms, 7.817 ms] 3.386 ms (78.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.721 ms) : 37418, 38024
.   : milestone, 37721,
appsec (47.853 ms) : 47422, 48284
.   : milestone, 47853,
code_origins (44.205 ms) : 43817, 44594
.   : milestone, 44205,
iast (44.41 ms) : 44018, 44802
.   : milestone, 44410,
profiling (45.822 ms) : 45422, 46222
.   : milestone, 45822,
tracing (43.679 ms) : 43310, 44048
.   : milestone, 43679,
section candidate
no_agent (36.394 ms) : 36099, 36688
.   : milestone, 36394,
appsec (46.286 ms) : 45884, 46689
.   : milestone, 46286,
code_origins (44.603 ms) : 44217, 44990
.   : milestone, 44603,
iast (45.707 ms) : 45311, 46102
.   : milestone, 45707,
profiling (46.528 ms) : 46120, 46936
.   : milestone, 46528,
tracing (43.016 ms) : 42662, 43370
.   : milestone, 43016,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.721 ms [37.418 ms, 38.024 ms] -
appsec 47.853 ms [47.422 ms, 48.284 ms] 10.132 ms (26.9%)
code_origins 44.205 ms [43.817 ms, 44.594 ms] 6.484 ms (17.2%)
iast 44.41 ms [44.018 ms, 44.802 ms] 6.689 ms (17.7%)
profiling 45.822 ms [45.422 ms, 46.222 ms] 8.101 ms (21.5%)
tracing 43.679 ms [43.31 ms, 44.048 ms] 5.958 ms (15.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.394 ms [36.099 ms, 36.688 ms] -
appsec 46.286 ms [45.884 ms, 46.689 ms] 9.893 ms (27.2%)
code_origins 44.603 ms [44.217 ms, 44.99 ms] 8.21 ms (22.6%)
iast 45.707 ms [45.311 ms, 46.102 ms] 9.313 ms (25.6%)
profiling 46.528 ms [46.12 ms, 46.936 ms] 10.134 ms (27.8%)
tracing 43.016 ms [42.662 ms, 43.37 ms] 6.622 ms (18.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-smoke-warmup-timeout
git_commit_date 1751549586 1751551030
git_commit_sha 53e4f70 99a5b11
release_version 1.51.0-SNAPSHOT~53e4f70038 1.51.0-SNAPSHOT~99a5b11ce8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1751553221 1751553221
ci_job_id 1012328899 1012328899
ci_pipeline_id 69564949 69564949
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-0zcwcycf 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-0zcwcycf 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.773 s) : 14773000, 14773000
.   : milestone, 14773000,
appsec (15.266 s) : 15266000, 15266000
.   : milestone, 15266000,
iast (18.476 s) : 18476000, 18476000
.   : milestone, 18476000,
iast_GLOBAL (18.063 s) : 18063000, 18063000
.   : milestone, 18063000,
profiling (15.133 s) : 15133000, 15133000
.   : milestone, 15133000,
tracing (14.83 s) : 14830000, 14830000
.   : milestone, 14830000,
section candidate
no_agent (14.982 s) : 14982000, 14982000
.   : milestone, 14982000,
appsec (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
iast (18.275 s) : 18275000, 18275000
.   : milestone, 18275000,
iast_GLOBAL (17.682 s) : 17682000, 17682000
.   : milestone, 17682000,
profiling (15.174 s) : 15174000, 15174000
.   : milestone, 15174000,
tracing (14.78 s) : 14780000, 14780000
.   : milestone, 14780000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.773 s [14.773 s, 14.773 s] -
appsec 15.266 s [15.266 s, 15.266 s] 493.0 ms (3.3%)
iast 18.476 s [18.476 s, 18.476 s] 3.703 s (25.1%)
iast_GLOBAL 18.063 s [18.063 s, 18.063 s] 3.29 s (22.3%)
profiling 15.133 s [15.133 s, 15.133 s] 360.0 ms (2.4%)
tracing 14.83 s [14.83 s, 14.83 s] 57.0 ms (0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.982 s [14.982 s, 14.982 s] -
appsec 14.843 s [14.843 s, 14.843 s] -139.0 ms (-0.9%)
iast 18.275 s [18.275 s, 18.275 s] 3.293 s (22.0%)
iast_GLOBAL 17.682 s [17.682 s, 17.682 s] 2.7 s (18.0%)
profiling 15.174 s [15.174 s, 15.174 s] 192.0 ms (1.3%)
tracing 14.78 s [14.78 s, 14.78 s] -202.0 ms (-1.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (2.422 ms) : 2373, 2471
.   : milestone, 2422,
iast (2.198 ms) : 2136, 2260
.   : milestone, 2198,
iast_GLOBAL (2.257 ms) : 2195, 2320
.   : milestone, 2257,
profiling (2.054 ms) : 2003, 2105
.   : milestone, 2054,
tracing (2.02 ms) : 1972, 2068
.   : milestone, 2020,
section candidate
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (2.423 ms) : 2373, 2473
.   : milestone, 2423,
iast (2.202 ms) : 2139, 2264
.   : milestone, 2202,
iast_GLOBAL (2.252 ms) : 2189, 2315
.   : milestone, 2252,
profiling (2.059 ms) : 2008, 2110
.   : milestone, 2059,
tracing (2.027 ms) : 1979, 2076
.   : milestone, 2027,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 2.422 ms [2.373 ms, 2.471 ms] 939.299 µs (63.3%)
iast 2.198 ms [2.136 ms, 2.26 ms] 715.135 µs (48.2%)
iast_GLOBAL 2.257 ms [2.195 ms, 2.32 ms] 774.438 µs (52.2%)
profiling 2.054 ms [2.003 ms, 2.105 ms] 570.842 µs (38.5%)
tracing 2.02 ms [1.972 ms, 2.068 ms] 537.025 µs (36.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 2.423 ms [2.373 ms, 2.473 ms] 944.139 µs (63.9%)
iast 2.202 ms [2.139 ms, 2.264 ms] 723.138 µs (48.9%)
iast_GLOBAL 2.252 ms [2.189 ms, 2.315 ms] 773.594 µs (52.3%)
profiling 2.059 ms [2.008 ms, 2.11 ms] 580.321 µs (39.3%)
tracing 2.027 ms [1.979 ms, 2.076 ms] 548.845 µs (37.1%)

@daniel-mohedano daniel-mohedano changed the title Increase individual Maven smoke test timeout to 180 Increase CiVis smoke tests timeout Jun 30, 2025
@daniel-mohedano daniel-mohedano removed the tag: do not merge Do not merge changes label Jul 3, 2025
@daniel-mohedano daniel-mohedano marked this pull request as ready for review July 3, 2025 13:18
@daniel-mohedano daniel-mohedano requested a review from a team as a code owner July 3, 2025 13:18
nikita-tkachenko-datadog
nikita-tkachenko-datadog approved these changes Jul 3, 2025
View reviewed changes
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we bump the gradle task timeout for Maven smoke tests module as well?

@daniel-mohedano
Copy link
Contributor Author

Sounds good, let's bump it up to 25min just in case

@bric3
Copy link
Contributor

bric3 commented Jul 4, 2025

FYI there's this PR for possibly improving download latencies #9099

@daniel-mohedano
Copy link
Contributor Author

@bric3 We'll hold off on merging this PR to see how the download latencies improve and if those changes are enough 👍

@daniel-mohedano daniel-mohedano merged commit 37922ad into master Jul 9, 2025
509 checks passed
@daniel-mohedano daniel-mohedano deleted the daniel.mohedano/maven-smoke-warmup-timeout branch July 9, 2025 07:53
@github-actions github-actions bot added this to the 1.51.0 milestone Jul 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nikita-tkachenko-datadog nikita-tkachenko-datadog nikita-tkachenko-datadog approved these changes

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees
No one assigned
Labels
comp: ci visibility Continuous Integration Visibility tag: no release notes Changes to exclude from release notes type: bug Bug report and fix
Projects
None yet
Milestone
1.51.0
Development

Successfully merging this pull request may close these issues.
3 participants
@daniel-mohedano @bric3 @nikita-tkachenko-datadog