Reproducer for Virtual Thread issues#10698
Draft
AlexeyKuznetsov-DD wants to merge 3 commits intomasterfrom
Draft
Reproducer for Virtual Thread issues#10698AlexeyKuznetsov-DD wants to merge 3 commits intomasterfrom
AlexeyKuznetsov-DD wants to merge 3 commits intomasterfrom
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~482d8f5481, baseline=1.61.0-SNAPSHOT~92b8b827eb
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1064400
Total [baseline] (11.051 s) : 0, 11050879
Agent [candidate] (1.062 s) : 0, 1062050
Total [candidate] (11.037 s) : 0, 11036531
section appsec
Agent [baseline] (1.254 s) : 0, 1254017
Total [baseline] (11.195 s) : 0, 11195416
Agent [candidate] (1.251 s) : 0, 1250893
Total [candidate] (11.183 s) : 0, 11183494
section iast
Agent [baseline] (1.234 s) : 0, 1233659
Total [baseline] (11.277 s) : 0, 11276615
Agent [candidate] (1.242 s) : 0, 1242102
Total [candidate] (11.446 s) : 0, 11445604
section profiling
Agent [baseline] (1.194 s) : 0, 1194142
Total [baseline] (11.079 s) : 0, 11078935
Agent [candidate] (1.192 s) : 0, 1192021
Total [candidate] (11.022 s) : 0, 11022300
gantt
title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~482d8f5481, baseline=1.61.0-SNAPSHOT~92b8b827eb
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (634.29 ms) : 0, 634290
BytebuddyAgent [candidate] (631.548 ms) : 0, 631548
AgentMeter [baseline] (29.504 ms) : 0, 29504
AgentMeter [candidate] (29.447 ms) : 0, 29447
GlobalTracer [baseline] (257.951 ms) : 0, 257951
GlobalTracer [candidate] (257.916 ms) : 0, 257916
AppSec [baseline] (32.092 ms) : 0, 32092
AppSec [candidate] (31.813 ms) : 0, 31813
Debugger [baseline] (60.878 ms) : 0, 60878
Debugger [candidate] (60.292 ms) : 0, 60292
Remote Config [baseline] (595.597 µs) : 0, 596
Remote Config [candidate] (605.803 µs) : 0, 606
Telemetry [baseline] (8.089 ms) : 0, 8089
Telemetry [candidate] (8.048 ms) : 0, 8048
Flare Poller [baseline] (3.568 ms) : 0, 3568
Flare Poller [candidate] (5.11 ms) : 0, 5110
section appsec
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (661.627 ms) : 0, 661627
BytebuddyAgent [candidate] (660.532 ms) : 0, 660532
AgentMeter [baseline] (12.286 ms) : 0, 12286
AgentMeter [candidate] (12.224 ms) : 0, 12224
GlobalTracer [baseline] (259.911 ms) : 0, 259911
GlobalTracer [candidate] (258.953 ms) : 0, 258953
AppSec [baseline] (178.313 ms) : 0, 178313
AppSec [candidate] (178.117 ms) : 0, 178117
Debugger [baseline] (66.95 ms) : 0, 66950
Debugger [candidate] (66.567 ms) : 0, 66567
Remote Config [baseline] (665.103 µs) : 0, 665
Remote Config [candidate] (646.737 µs) : 0, 647
Telemetry [baseline] (8.533 ms) : 0, 8533
Telemetry [candidate] (8.389 ms) : 0, 8389
Flare Poller [baseline] (3.652 ms) : 0, 3652
Flare Poller [candidate] (3.659 ms) : 0, 3659
IAST [baseline] (24.388 ms) : 0, 24388
IAST [candidate] (24.261 ms) : 0, 24261
section iast
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (799.583 ms) : 0, 799583
BytebuddyAgent [candidate] (806.78 ms) : 0, 806780
AgentMeter [baseline] (11.418 ms) : 0, 11418
AgentMeter [candidate] (11.72 ms) : 0, 11720
GlobalTracer [baseline] (248.515 ms) : 0, 248515
GlobalTracer [candidate] (249.775 ms) : 0, 249775
AppSec [baseline] (26.751 ms) : 0, 26751
AppSec [candidate] (26.851 ms) : 0, 26851
Debugger [baseline] (71.169 ms) : 0, 71169
Debugger [candidate] (70.742 ms) : 0, 70742
Remote Config [baseline] (545.719 µs) : 0, 546
Remote Config [candidate] (527.719 µs) : 0, 528
Telemetry [baseline] (9.383 ms) : 0, 9383
Telemetry [candidate] (9.19 ms) : 0, 9190
Flare Poller [baseline] (3.506 ms) : 0, 3506
Flare Poller [candidate] (3.396 ms) : 0, 3396
IAST [baseline] (25.399 ms) : 0, 25399
IAST [candidate] (25.605 ms) : 0, 25605
section profiling
ProfilingAgent [baseline] (94.686 ms) : 0, 94686
ProfilingAgent [candidate] (93.672 ms) : 0, 93672
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (689.712 ms) : 0, 689712
BytebuddyAgent [candidate] (689.115 ms) : 0, 689115
AgentMeter [baseline] (9.075 ms) : 0, 9075
AgentMeter [candidate] (9.074 ms) : 0, 9074
GlobalTracer [baseline] (216.899 ms) : 0, 216899
GlobalTracer [candidate] (216.639 ms) : 0, 216639
AppSec [baseline] (32.589 ms) : 0, 32589
AppSec [candidate] (32.771 ms) : 0, 32771
Debugger [baseline] (66.552 ms) : 0, 66552
Debugger [candidate] (66.227 ms) : 0, 66227
Remote Config [baseline] (579.326 µs) : 0, 579
Remote Config [candidate] (569.2 µs) : 0, 569
Telemetry [baseline] (7.814 ms) : 0, 7814
Telemetry [candidate] (7.785 ms) : 0, 7785
Flare Poller [baseline] (3.567 ms) : 0, 3567
Flare Poller [candidate] (3.566 ms) : 0, 3566
Profiling [baseline] (95.247 ms) : 0, 95247
Profiling [candidate] (94.222 ms) : 0, 94222
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~482d8f5481, baseline=1.61.0-SNAPSHOT~92b8b827eb
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058470
Total [baseline] (8.877 s) : 0, 8877119
Agent [candidate] (1.064 s) : 0, 1064464
Total [candidate] (8.923 s) : 0, 8922882
section iast
Agent [baseline] (1.242 s) : 0, 1242063
Total [baseline] (9.608 s) : 0, 9607815
Agent [candidate] (1.236 s) : 0, 1236285
Total [candidate] (9.561 s) : 0, 9561436
gantt
title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~482d8f5481, baseline=1.61.0-SNAPSHOT~92b8b827eb
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (631.346 ms) : 0, 631346
BytebuddyAgent [candidate] (632.801 ms) : 0, 632801
AgentMeter [baseline] (29.405 ms) : 0, 29405
AgentMeter [candidate] (29.644 ms) : 0, 29644
GlobalTracer [baseline] (256.911 ms) : 0, 256911
GlobalTracer [candidate] (259.252 ms) : 0, 259252
AppSec [baseline] (31.805 ms) : 0, 31805
AppSec [candidate] (32.292 ms) : 0, 32292
Debugger [baseline] (59.461 ms) : 0, 59461
Debugger [candidate] (60.159 ms) : 0, 60159
Remote Config [baseline] (612.569 µs) : 0, 613
Remote Config [candidate] (587.663 µs) : 0, 588
Telemetry [baseline] (8.075 ms) : 0, 8075
Telemetry [candidate] (8.071 ms) : 0, 8071
Flare Poller [baseline] (3.489 ms) : 0, 3489
Flare Poller [candidate] (4.279 ms) : 0, 4279
section iast
crashtracking [baseline] (1.236 ms) : 0, 1236
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (807.017 ms) : 0, 807017
BytebuddyAgent [candidate] (802.954 ms) : 0, 802954
AgentMeter [baseline] (11.704 ms) : 0, 11704
AgentMeter [candidate] (11.488 ms) : 0, 11488
GlobalTracer [baseline] (250.167 ms) : 0, 250167
GlobalTracer [candidate] (249.061 ms) : 0, 249061
IAST [baseline] (25.655 ms) : 0, 25655
IAST [candidate] (25.542 ms) : 0, 25542
AppSec [baseline] (27.628 ms) : 0, 27628
AppSec [candidate] (26.782 ms) : 0, 26782
Debugger [baseline] (67.029 ms) : 0, 67029
Debugger [candidate] (67.266 ms) : 0, 67266
Remote Config [baseline] (535.018 µs) : 0, 535
Remote Config [candidate] (525.691 µs) : 0, 526
Telemetry [baseline] (10.686 ms) : 0, 10686
Telemetry [candidate] (11.195 ms) : 0, 11195
Flare Poller [baseline] (3.871 ms) : 0, 3871
Flare Poller [candidate] (3.996 ms) : 0, 3996
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 18 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~482d8f5481, baseline=1.61.0-SNAPSHOT~92b8b827eb
dateFormat X
axisFormat %s
section baseline
no_agent (18.653 ms) : 18460, 18845
. : milestone, 18653,
appsec (19.655 ms) : 19456, 19854
. : milestone, 19655,
code_origins (18.566 ms) : 18376, 18756
. : milestone, 18566,
iast (17.798 ms) : 17620, 17975
. : milestone, 17798,
profiling (18.408 ms) : 18226, 18590
. : milestone, 18408,
tracing (17.697 ms) : 17521, 17872
. : milestone, 17697,
section candidate
no_agent (19.335 ms) : 19137, 19533
. : milestone, 19335,
appsec (19.753 ms) : 19551, 19956
. : milestone, 19753,
code_origins (17.961 ms) : 17781, 18141
. : milestone, 17961,
iast (18.016 ms) : 17840, 18192
. : milestone, 18016,
profiling (18.767 ms) : 18577, 18956
. : milestone, 18767,
tracing (17.949 ms) : 17769, 18130
. : milestone, 17949,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~482d8f5481, baseline=1.61.0-SNAPSHOT~92b8b827eb
dateFormat X
axisFormat %s
section baseline
no_agent (1.226 ms) : 1214, 1238
. : milestone, 1226,
iast (3.325 ms) : 3278, 3373
. : milestone, 3325,
iast_FULL (6.068 ms) : 6006, 6131
. : milestone, 6068,
iast_GLOBAL (3.553 ms) : 3498, 3607
. : milestone, 3553,
profiling (2.29 ms) : 2268, 2311
. : milestone, 2290,
tracing (1.868 ms) : 1853, 1883
. : milestone, 1868,
section candidate
no_agent (1.254 ms) : 1241, 1266
. : milestone, 1254,
iast (3.31 ms) : 3266, 3354
. : milestone, 3310,
iast_FULL (5.999 ms) : 5938, 6059
. : milestone, 5999,
iast_GLOBAL (3.837 ms) : 3773, 3901
. : milestone, 3837,
profiling (2.187 ms) : 2167, 2207
. : milestone, 2187,
tracing (1.92 ms) : 1903, 1938
. : milestone, 1920,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~482d8f5481, baseline=1.61.0-SNAPSHOT~92b8b827eb
dateFormat X
axisFormat %s
section baseline
no_agent (15.053 s) : 15053000, 15053000
. : milestone, 15053000,
appsec (14.747 s) : 14747000, 14747000
. : milestone, 14747000,
iast (17.981 s) : 17981000, 17981000
. : milestone, 17981000,
iast_GLOBAL (17.833 s) : 17833000, 17833000
. : milestone, 17833000,
profiling (14.772 s) : 14772000, 14772000
. : milestone, 14772000,
tracing (14.903 s) : 14903000, 14903000
. : milestone, 14903000,
section candidate
no_agent (15.426 s) : 15426000, 15426000
. : milestone, 15426000,
appsec (14.823 s) : 14823000, 14823000
. : milestone, 14823000,
iast (18.269 s) : 18269000, 18269000
. : milestone, 18269000,
iast_GLOBAL (17.795 s) : 17795000, 17795000
. : milestone, 17795000,
profiling (14.874 s) : 14874000, 14874000
. : milestone, 14874000,
tracing (14.967 s) : 14967000, 14967000
. : milestone, 14967000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~482d8f5481, baseline=1.61.0-SNAPSHOT~92b8b827eb
dateFormat X
axisFormat %s
section baseline
no_agent (1.486 ms) : 1475, 1498
. : milestone, 1486,
appsec (3.766 ms) : 3547, 3986
. : milestone, 3766,
iast (2.27 ms) : 2202, 2339
. : milestone, 2270,
iast_GLOBAL (2.323 ms) : 2254, 2393
. : milestone, 2323,
profiling (2.087 ms) : 2032, 2141
. : milestone, 2087,
tracing (2.085 ms) : 2032, 2139
. : milestone, 2085,
section candidate
no_agent (1.487 ms) : 1476, 1499
. : milestone, 1487,
appsec (3.817 ms) : 3592, 4043
. : milestone, 3817,
iast (2.266 ms) : 2197, 2335
. : milestone, 2266,
iast_GLOBAL (2.311 ms) : 2241, 2380
. : milestone, 2311,
profiling (2.093 ms) : 2039, 2148
. : milestone, 2093,
tracing (2.072 ms) : 2018, 2125
. : milestone, 2072,
|
fe5b6e5 to
5aaa71a
Compare
…en VirtualThread and Runnable
9f0a7fb to
a862b9a
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
Reproducer for Virtual Thread issues.
Motivation
Debug why test failed on CI
Additional Notes
This PR can be used as sample for other similar investigations.