-
Notifications
You must be signed in to change notification settings - Fork 312
Add JDK 25-EA testing to CI #9140
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
sarahchen6
wants to merge
8
commits into
master
Choose a base branch
from
sarahchen6/try-jdk-25-image-and-tests
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 44 metrics, 9 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~6c321d588a, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (996.157 ms) : 0, 996157
Total [baseline] (10.658 s) : 0, 10657630
Agent [candidate] (996.799 ms) : 0, 996799
Total [candidate] (10.688 s) : 0, 10687928
section appsec
Agent [baseline] (1.179 s) : 0, 1178797
Total [baseline] (10.766 s) : 0, 10766253
Agent [candidate] (1.173 s) : 0, 1173144
Total [candidate] (10.809 s) : 0, 10809233
section iast
Agent [baseline] (1.141 s) : 0, 1140786
Total [baseline] (10.825 s) : 0, 10824733
Agent [candidate] (1.134 s) : 0, 1134092
Total [candidate] (10.857 s) : 0, 10857102
section profiling
Agent [baseline] (1.252 s) : 0, 1251514
Total [baseline] (11.014 s) : 0, 11013948
Agent [candidate] (1.244 s) : 0, 1244403
Total [candidate] (10.913 s) : 0, 10913184
gantt
title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~6c321d588a, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.394 ms) : 0, 686394
BytebuddyAgent [candidate] (687.197 ms) : 0, 687197
GlobalTracer [baseline] (243.583 ms) : 0, 243583
GlobalTracer [candidate] (243.271 ms) : 0, 243271
AppSec [baseline] (30.416 ms) : 0, 30416
AppSec [candidate] (30.501 ms) : 0, 30501
Debugger [baseline] (6.018 ms) : 0, 6018
Debugger [candidate] (5.97 ms) : 0, 5970
Remote Config [baseline] (677.819 µs) : 0, 678
Remote Config [candidate] (685.626 µs) : 0, 686
Telemetry [baseline] (8.223 ms) : 0, 8223
Telemetry [candidate] (8.219 ms) : 0, 8219
section appsec
BytebuddyAgent [baseline] (710.529 ms) : 0, 710529
BytebuddyAgent [candidate] (708.57 ms) : 0, 708570
GlobalTracer [baseline] (237.573 ms) : 0, 237573
GlobalTracer [candidate] (235.291 ms) : 0, 235291
IAST [baseline] (23.472 ms) : 0, 23472
IAST [candidate] (23.48 ms) : 0, 23480
AppSec [baseline] (171.914 ms) : 0, 171914
AppSec [candidate] (170.659 ms) : 0, 170659
Debugger [baseline] (5.781 ms) : 0, 5781
Debugger [candidate] (5.699 ms) : 0, 5699
Remote Config [baseline] (605.607 µs) : 0, 606
Remote Config [candidate] (597.531 µs) : 0, 598
Telemetry [baseline] (8.021 ms) : 0, 8021
Telemetry [candidate] (7.986 ms) : 0, 7986
section iast
BytebuddyAgent [baseline] (812.6 ms) : 0, 812600
BytebuddyAgent [candidate] (807.135 ms) : 0, 807135
GlobalTracer [baseline] (234.83 ms) : 0, 234830
GlobalTracer [candidate] (233.465 ms) : 0, 233465
IAST [baseline] (25.667 ms) : 0, 25667
IAST [candidate] (25.023 ms) : 0, 25023
AppSec [baseline] (32.442 ms) : 0, 32442
AppSec [candidate] (33.188 ms) : 0, 33188
Debugger [baseline] (5.711 ms) : 0, 5711
Debugger [candidate] (5.727 ms) : 0, 5727
Remote Config [baseline] (564.182 µs) : 0, 564
Remote Config [candidate] (581.152 µs) : 0, 581
Telemetry [baseline] (7.91 ms) : 0, 7910
Telemetry [candidate] (7.903 ms) : 0, 7903
section profiling
BytebuddyAgent [baseline] (680.103 ms) : 0, 680103
BytebuddyAgent [candidate] (676.753 ms) : 0, 676753
GlobalTracer [baseline] (364.937 ms) : 0, 364937
GlobalTracer [candidate] (362.032 ms) : 0, 362032
AppSec [baseline] (32.046 ms) : 0, 32046
AppSec [candidate] (30.884 ms) : 0, 30884
Debugger [baseline] (12.762 ms) : 0, 12762
Debugger [candidate] (11.345 ms) : 0, 11345
Remote Config [baseline] (658.455 µs) : 0, 658
Remote Config [candidate] (665.433 µs) : 0, 665
Telemetry [baseline] (8.035 ms) : 0, 8035
Telemetry [candidate] (10.306 ms) : 0, 10306
ProfilingAgent [baseline] (104.115 ms) : 0, 104115
ProfilingAgent [candidate] (103.69 ms) : 0, 103690
Profiling [baseline] (104.139 ms) : 0, 104139
Profiling [candidate] (103.714 ms) : 0, 103714
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~6c321d588a, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (995.883 ms) : 0, 995883
Total [baseline] (8.601 s) : 0, 8601137
Agent [candidate] (996.793 ms) : 0, 996793
Total [candidate] (8.59 s) : 0, 8590352
section iast
Agent [baseline] (1.13 s) : 0, 1129664
Total [baseline] (9.263 s) : 0, 9262612
Agent [candidate] (1.133 s) : 0, 1133369
Total [candidate] (9.319 s) : 0, 9318679
gantt
title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~6c321d588a, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (685.922 ms) : 0, 685922
BytebuddyAgent [candidate] (687.736 ms) : 0, 687736
GlobalTracer [baseline] (243.663 ms) : 0, 243663
GlobalTracer [candidate] (242.916 ms) : 0, 242916
AppSec [baseline] (30.627 ms) : 0, 30627
AppSec [candidate] (30.395 ms) : 0, 30395
Debugger [baseline] (6.028 ms) : 0, 6028
Debugger [candidate] (6.013 ms) : 0, 6013
Remote Config [baseline] (679.319 µs) : 0, 679
Remote Config [candidate] (690.739 µs) : 0, 691
Telemetry [baseline] (8.142 ms) : 0, 8142
Telemetry [candidate] (8.257 ms) : 0, 8257
section iast
BytebuddyAgent [baseline] (803.299 ms) : 0, 803299
BytebuddyAgent [candidate] (807.689 ms) : 0, 807689
GlobalTracer [baseline] (233.613 ms) : 0, 233613
GlobalTracer [candidate] (233.066 ms) : 0, 233066
IAST [baseline] (28.676 ms) : 0, 28676
IAST [candidate] (27.935 ms) : 0, 27935
AppSec [baseline] (29.151 ms) : 0, 29151
AppSec [candidate] (28.824 ms) : 0, 28824
Debugger [baseline] (5.718 ms) : 0, 5718
Debugger [candidate] (6.565 ms) : 0, 6565
Remote Config [baseline] (582.747 µs) : 0, 583
Remote Config [candidate] (575.139 µs) : 0, 575
Telemetry [baseline] (7.878 ms) : 0, 7878
Telemetry [candidate] (7.898 ms) : 0, 7898
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 12 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~6c321d588a, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section baseline
no_agent (4.274 ms) : 4222, 4326
. : milestone, 4274,
iast (9.567 ms) : 9408, 9726
. : milestone, 9567,
iast_FULL (13.876 ms) : 13599, 14152
. : milestone, 13876,
iast_GLOBAL (10.432 ms) : 10235, 10628
. : milestone, 10432,
profiling (8.416 ms) : 8289, 8543
. : milestone, 8416,
tracing (7.482 ms) : 7378, 7586
. : milestone, 7482,
section candidate
no_agent (4.238 ms) : 4191, 4285
. : milestone, 4238,
iast (9.355 ms) : 9204, 9506
. : milestone, 9355,
iast_FULL (13.734 ms) : 13461, 14006
. : milestone, 13734,
iast_GLOBAL (10.236 ms) : 10059, 10414
. : milestone, 10236,
profiling (8.639 ms) : 8493, 8786
. : milestone, 8639,
tracing (7.343 ms) : 7242, 7443
. : milestone, 7343,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~6c321d588a, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section baseline
no_agent (37.034 ms) : 36735, 37333
. : milestone, 37034,
appsec (48.402 ms) : 47973, 48830
. : milestone, 48402,
code_origins (43.171 ms) : 42795, 43547
. : milestone, 43171,
iast (44.414 ms) : 44024, 44803
. : milestone, 44414,
profiling (48.28 ms) : 47828, 48732
. : milestone, 48280,
tracing (45.134 ms) : 44752, 45516
. : milestone, 45134,
section candidate
no_agent (36.573 ms) : 36281, 36866
. : milestone, 36573,
appsec (46.645 ms) : 46220, 47069
. : milestone, 46645,
code_origins (43.569 ms) : 43214, 43923
. : milestone, 43569,
iast (44.972 ms) : 44586, 45359
. : milestone, 44972,
profiling (48.972 ms) : 48505, 49439
. : milestone, 48972,
tracing (43.838 ms) : 43477, 44200
. : milestone, 43838,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~6c321d588a, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section baseline
no_agent (15.244 s) : 15244000, 15244000
. : milestone, 15244000,
appsec (14.939 s) : 14939000, 14939000
. : milestone, 14939000,
iast (18.034 s) : 18034000, 18034000
. : milestone, 18034000,
iast_GLOBAL (18.047 s) : 18047000, 18047000
. : milestone, 18047000,
profiling (15.176 s) : 15176000, 15176000
. : milestone, 15176000,
tracing (14.83 s) : 14830000, 14830000
. : milestone, 14830000,
section candidate
no_agent (15.416 s) : 15416000, 15416000
. : milestone, 15416000,
appsec (14.929 s) : 14929000, 14929000
. : milestone, 14929000,
iast (18.419 s) : 18419000, 18419000
. : milestone, 18419000,
iast_GLOBAL (17.956 s) : 17956000, 17956000
. : milestone, 17956000,
profiling (15.687 s) : 15687000, 15687000
. : milestone, 15687000,
tracing (14.899 s) : 14899000, 14899000
. : milestone, 14899000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~6c321d588a, baseline=1.52.0-SNAPSHOT~d9df78f4c9
dateFormat X
axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1487
. : milestone, 1475,
appsec (2.407 ms) : 2357, 2457
. : milestone, 2407,
iast (2.198 ms) : 2136, 2261
. : milestone, 2198,
iast_GLOBAL (2.251 ms) : 2187, 2314
. : milestone, 2251,
profiling (2.063 ms) : 2011, 2114
. : milestone, 2063,
tracing (2.024 ms) : 1975, 2073
. : milestone, 2024,
section candidate
no_agent (1.472 ms) : 1461, 1484
. : milestone, 1472,
appsec (2.419 ms) : 2369, 2469
. : milestone, 2419,
iast (2.2 ms) : 2138, 2262
. : milestone, 2200,
iast_GLOBAL (2.243 ms) : 2180, 2306
. : milestone, 2243,
profiling (2.067 ms) : 2014, 2119
. : milestone, 2067,
tracing (2.022 ms) : 1973, 2071
. : milestone, 2022,
|
802838e
to
a7d756b
Compare
a7d756b
to
33dc1bb
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Add testing for JDK
25
EA as a non-default JVM.Motivation
Prepare for the general release of Java 25 (ETA Sep 16, 2025).
Additional Notes
Once the general release of JDK 25 is out, we will test it as a default JVM.
For testing, I manually triggered NON_DEFAULT_JVM (e.g. 25) tests to run on this PR: https://gitlab.ddbuild.io/DataDog/apm-reliability/dd-trace-java/-/pipelines/70631693
The next steps are to unskip the ignored tests - in particular
RuntimeCallSiteTest
andMdcTest
. The other tests will need increased support from gradle and jacoco.Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-83