Change Java 25 to default JVM testing #9453

sarahchen6 · 2025-09-02T19:42:26Z

What Does This Do

Change Java 25 to be a default JVM for testing. Remove "stable" testing, as the latest stable version is LTS v25.

Motivation

Additional Notes

Java 25 hasn't officially GA-ed yet, but since the final release candidate out and the feature set is frozen, we can promote it to stable testing. Once Java 25 officially comes out, we will update the builder image from the current EA one.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-83

datadog-datadog-prod-us1 · 2025-09-05T14:18:09Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 57.62% (-0.01%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 7d719e0 | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-09-05T14:23:39Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/change-java-25-to-default-testing
git_commit_date	1757079015	1757080123
git_commit_sha	`646461c`	`7d719e0`
release_version	1.54.0-SNAPSHOT~646461c3fa	1.53.0-SNAPSHOT~7d719e04e7

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1757081979	1757081979
ci_job_id	1115753201	1115753201
ci_pipeline_id	75659518	75659518
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-d5eiavv1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-d5eiavv1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 14 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:tracing:Remote Config	better [-46.955µs; -17.955µs] or [-6.721%; -2.570%]	666.147µs	698.603µs
scenario:startup:petclinic:tracing:Remote Config	better [-47.308µs; -22.126µs] or [-6.776%; -3.169%]	663.457µs	698.174µs

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~7d719e04e7, baseline=1.54.0-SNAPSHOT~646461c3fa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051200
Total [baseline] (8.64 s) : 0, 8639902
Agent [candidate] (1.048 s) : 0, 1048151
Total [candidate] (8.619 s) : 0, 8618762
section iast
Agent [baseline] (1.187 s) : 0, 1186976
Total [baseline] (9.391 s) : 0, 9390818
Agent [candidate] (1.179 s) : 0, 1179217
Total [candidate] (9.37 s) : 0, 9369501

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	iast	1.187 s	135.776 ms (12.9%)
Total	tracing	8.64 s	-
Total	iast	9.391 s	750.916 ms (8.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.048 s	-
Agent	iast	1.179 s	131.066 ms (12.5%)
Total	tracing	8.619 s	-
Total	iast	9.37 s	750.738 ms (8.7%)

gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~7d719e04e7, baseline=1.54.0-SNAPSHOT~646461c3fa

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (736.854 ms) : 0, 736854
BytebuddyAgent [candidate] (733.191 ms) : 0, 733191
GlobalTracer [baseline] (242.419 ms) : 0, 242419
GlobalTracer [candidate] (242.745 ms) : 0, 242745
AppSec [baseline] (30.143 ms) : 0, 30143
AppSec [candidate] (30.102 ms) : 0, 30102
Debugger [baseline] (6.088 ms) : 0, 6088
Debugger [candidate] (6.036 ms) : 0, 6036
Remote Config [baseline] (698.603 µs) : 0, 699
Remote Config [candidate] (666.147 µs) : 0, 666
Telemetry [baseline] (12.407 ms) : 0, 12407
Telemetry [candidate] (12.947 ms) : 0, 12947
section iast
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.447 ms) : 0, 1447
BytebuddyAgent [baseline] (858.417 ms) : 0, 858417
BytebuddyAgent [candidate] (850.927 ms) : 0, 850927
GlobalTracer [baseline] (233.268 ms) : 0, 233268
GlobalTracer [candidate] (232.951 ms) : 0, 232951
IAST [baseline] (31.892 ms) : 0, 31892
IAST [candidate] (29.552 ms) : 0, 29552
AppSec [baseline] (25.24 ms) : 0, 25240
AppSec [candidate] (27.854 ms) : 0, 27854
Debugger [baseline] (6.654 ms) : 0, 6654
Debugger [candidate] (6.606 ms) : 0, 6606
Remote Config [baseline] (610.107 µs) : 0, 610
Remote Config [candidate] (604.397 µs) : 0, 604
Telemetry [baseline] (8.346 ms) : 0, 8346
Telemetry [candidate] (8.312 ms) : 0, 8312

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~7d719e04e7, baseline=1.54.0-SNAPSHOT~646461c3fa

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052126
Total [baseline] (10.848 s) : 0, 10848089
Agent [candidate] (1.045 s) : 0, 1045160
Total [candidate] (10.688 s) : 0, 10688069
section appsec
Agent [baseline] (1.224 s) : 0, 1223733
Total [baseline] (10.817 s) : 0, 10816728
Agent [candidate] (1.222 s) : 0, 1221866
Total [candidate] (10.805 s) : 0, 10805189
section iast
Agent [baseline] (1.18 s) : 0, 1179707
Total [baseline] (10.892 s) : 0, 10892025
Agent [candidate] (1.178 s) : 0, 1178259
Total [candidate] (10.955 s) : 0, 10955349
section profiling
Agent [baseline] (1.205 s) : 0, 1205172
Total [baseline] (10.947 s) : 0, 10946824
Agent [candidate] (1.2 s) : 0, 1199501
Total [candidate] (10.919 s) : 0, 10919398

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.052 s	-
Agent	appsec	1.224 s	171.608 ms (16.3%)
Agent	iast	1.18 s	127.581 ms (12.1%)
Agent	profiling	1.205 s	153.046 ms (14.5%)
Total	tracing	10.848 s	-
Total	appsec	10.817 s	-31.362 ms (-0.3%)
Total	iast	10.892 s	43.936 ms (0.4%)
Total	profiling	10.947 s	98.735 ms (0.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.045 s	-
Agent	appsec	1.222 s	176.705 ms (16.9%)
Agent	iast	1.178 s	133.099 ms (12.7%)
Agent	profiling	1.2 s	154.341 ms (14.8%)
Total	tracing	10.688 s	-
Total	appsec	10.805 s	117.121 ms (1.1%)
Total	iast	10.955 s	267.281 ms (2.5%)
Total	profiling	10.919 s	231.33 ms (2.2%)

gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~7d719e04e7, baseline=1.54.0-SNAPSHOT~646461c3fa

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (734.709 ms) : 0, 734709
BytebuddyAgent [candidate] (732.024 ms) : 0, 732024
GlobalTracer [baseline] (243.688 ms) : 0, 243688
GlobalTracer [candidate] (242.524 ms) : 0, 242524
AppSec [baseline] (30.386 ms) : 0, 30386
AppSec [candidate] (30.0 ms) : 0, 30000
Debugger [baseline] (6.129 ms) : 0, 6129
Debugger [candidate] (6.005 ms) : 0, 6005
Remote Config [baseline] (698.174 µs) : 0, 698
Remote Config [candidate] (663.457 µs) : 0, 663
Telemetry [baseline] (13.9 ms) : 0, 13900
Telemetry [candidate] (11.508 ms) : 0, 11508
section appsec
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (756.018 ms) : 0, 756018
BytebuddyAgent [candidate] (754.667 ms) : 0, 754667
GlobalTracer [baseline] (235.189 ms) : 0, 235189
GlobalTracer [candidate] (234.704 ms) : 0, 234704
IAST [baseline] (23.624 ms) : 0, 23624
IAST [candidate] (23.608 ms) : 0, 23608
AppSec [baseline] (167.717 ms) : 0, 167717
AppSec [candidate] (169.028 ms) : 0, 169028
Debugger [baseline] (9.508 ms) : 0, 9508
Debugger [candidate] (6.523 ms) : 0, 6523
Remote Config [baseline] (631.303 µs) : 0, 631
Remote Config [candidate] (653.01 µs) : 0, 653
Telemetry [baseline] (8.53 ms) : 0, 8530
Telemetry [candidate] (10.086 ms) : 0, 10086
section iast
crashtracking [baseline] (1.455 ms) : 0, 1455
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (851.234 ms) : 0, 851234
BytebuddyAgent [candidate] (850.332 ms) : 0, 850332
GlobalTracer [baseline] (233.187 ms) : 0, 233187
GlobalTracer [candidate] (232.927 ms) : 0, 232927
IAST [baseline] (29.513 ms) : 0, 29513
IAST [candidate] (30.328 ms) : 0, 30328
AppSec [baseline] (27.665 ms) : 0, 27665
AppSec [candidate] (26.767 ms) : 0, 26767
Debugger [baseline] (6.625 ms) : 0, 6625
Debugger [candidate] (6.618 ms) : 0, 6618
Remote Config [baseline] (610.465 µs) : 0, 610
Remote Config [candidate] (596.135 µs) : 0, 596
Telemetry [baseline] (8.372 ms) : 0, 8372
Telemetry [candidate] (8.195 ms) : 0, 8195
section profiling
crashtracking [baseline] (1.464 ms) : 0, 1464
crashtracking [candidate] (1.441 ms) : 0, 1441
BytebuddyAgent [baseline] (766.411 ms) : 0, 766411
BytebuddyAgent [candidate] (763.681 ms) : 0, 763681
GlobalTracer [baseline] (223.616 ms) : 0, 223616
GlobalTracer [candidate] (223.061 ms) : 0, 223061
AppSec [baseline] (30.639 ms) : 0, 30639
AppSec [candidate] (30.075 ms) : 0, 30075
Debugger [baseline] (7.074 ms) : 0, 7074
Debugger [candidate] (6.263 ms) : 0, 6263
Remote Config [baseline] (722.729 µs) : 0, 723
Remote Config [candidate] (699.843 µs) : 0, 700
Telemetry [baseline] (15.026 ms) : 0, 15026
Telemetry [candidate] (16.3 ms) : 0, 16300
ProfilingAgent [baseline] (109.435 ms) : 0, 109435
ProfilingAgent [candidate] (107.435 ms) : 0, 107435
Profiling [baseline] (110.11 ms) : 0, 110110
Profiling [candidate] (108.108 ms) : 0, 108108

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/change-java-25-to-default-testing
git_commit_date	1757079015	1757080123
git_commit_sha	`646461c`	`7d719e0`
release_version	1.54.0-SNAPSHOT~646461c3fa	1.53.0-SNAPSHOT~7d719e04e7

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1757081659	1757081659
ci_job_id	1115753202	1115753202
ci_pipeline_id	75659518	75659518
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-bfk3pfeb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-bfk3pfeb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+544.872µs; +857.730µs] or [+6.453%; +10.159%]	unstable [-117.324op/s; +33.699op/s] or [-21.367%; +6.137%]	9.144ms	507.281op/s	8.443ms	549.094op/s
scenario:load:petclinic:code_origins:high_load	worse [+0.987ms; +1.782ms] or [+2.301%; +4.155%]	unstable [-10.892op/s; +4.342op/s] or [-9.991%; +3.983%]	44.289ms	105.737op/s	42.904ms	109.013op/s
scenario:load:petclinic:iast:high_load	better [-3.488ms; -2.619ms] or [-7.383%; -5.545%]	unstable [-0.451op/s; +14.226op/s] or [-0.456%; +14.368%]	44.185ms	105.900op/s	47.238ms	99.013op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~7d719e04e7, baseline=1.54.0-SNAPSHOT~646461c3fa
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.237 ms) : 4191, 4284
.   : milestone, 4237,
iast (9.22 ms) : 9070, 9369
.   : milestone, 9220,
iast_FULL (13.942 ms) : 13666, 14218
.   : milestone, 13942,
iast_GLOBAL (10.307 ms) : 10128, 10486
.   : milestone, 10307,
profiling (8.443 ms) : 8307, 8580
.   : milestone, 8443,
tracing (7.678 ms) : 7570, 7786
.   : milestone, 7678,
section candidate
no_agent (4.366 ms) : 4312, 4420
.   : milestone, 4366,
iast (8.979 ms) : 8833, 9124
.   : milestone, 8979,
iast_FULL (13.844 ms) : 13570, 14117
.   : milestone, 13844,
iast_GLOBAL (9.995 ms) : 9809, 10181
.   : milestone, 9995,
profiling (9.144 ms) : 8991, 9298
.   : milestone, 9144,
tracing (7.578 ms) : 7455, 7700
.   : milestone, 7578,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.237 ms [4.191 ms, 4.284 ms]	-
iast	9.22 ms [9.07 ms, 9.369 ms]	4.982 ms (117.6%)
iast_FULL	13.942 ms [13.666 ms, 14.218 ms]	9.705 ms (229.0%)
iast_GLOBAL	10.307 ms [10.128 ms, 10.486 ms]	6.069 ms (143.2%)
profiling	8.443 ms [8.307 ms, 8.58 ms]	4.206 ms (99.2%)
tracing	7.678 ms [7.57 ms, 7.786 ms]	3.44 ms (81.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.366 ms [4.312 ms, 4.42 ms]	-
iast	8.979 ms [8.833 ms, 9.124 ms]	4.613 ms (105.6%)
iast_FULL	13.844 ms [13.57 ms, 14.117 ms]	9.478 ms (217.1%)
iast_GLOBAL	9.995 ms [9.809 ms, 10.181 ms]	5.629 ms (128.9%)
profiling	9.144 ms [8.991 ms, 9.298 ms]	4.778 ms (109.4%)
tracing	7.578 ms [7.455 ms, 7.7 ms]	3.212 ms (73.6%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~7d719e04e7, baseline=1.54.0-SNAPSHOT~646461c3fa
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.646 ms) : 36360, 36933
.   : milestone, 36646,
appsec (45.686 ms) : 45287, 46084
.   : milestone, 45686,
code_origins (42.904 ms) : 42538, 43270
.   : milestone, 42904,
iast (47.238 ms) : 46814, 47663
.   : milestone, 47238,
profiling (46.068 ms) : 45611, 46524
.   : milestone, 46068,
tracing (44.682 ms) : 44295, 45069
.   : milestone, 44682,
section candidate
no_agent (36.841 ms) : 36546, 37136
.   : milestone, 36841,
appsec (45.782 ms) : 45369, 46194
.   : milestone, 45782,
code_origins (44.289 ms) : 43915, 44662
.   : milestone, 44289,
iast (44.185 ms) : 43803, 44566
.   : milestone, 44185,
profiling (46.956 ms) : 46538, 47374
.   : milestone, 46956,
tracing (43.69 ms) : 43313, 44067
.   : milestone, 43690,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.646 ms [36.36 ms, 36.933 ms]	-
appsec	45.686 ms [45.287 ms, 46.084 ms]	9.039 ms (24.7%)
code_origins	42.904 ms [42.538 ms, 43.27 ms]	6.257 ms (17.1%)
iast	47.238 ms [46.814 ms, 47.663 ms]	10.592 ms (28.9%)
profiling	46.068 ms [45.611 ms, 46.524 ms]	9.421 ms (25.7%)
tracing	44.682 ms [44.295 ms, 45.069 ms]	8.035 ms (21.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.841 ms [36.546 ms, 37.136 ms]	-
appsec	45.782 ms [45.369 ms, 46.194 ms]	8.941 ms (24.3%)
code_origins	44.289 ms [43.915 ms, 44.662 ms]	7.448 ms (20.2%)
iast	44.185 ms [43.803 ms, 44.566 ms]	7.344 ms (19.9%)
profiling	46.956 ms [46.538 ms, 47.374 ms]	10.116 ms (27.5%)
tracing	43.69 ms [43.313 ms, 44.067 ms]	6.849 ms (18.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/change-java-25-to-default-testing
git_commit_date	1757079015	1757080123
git_commit_sha	`646461c`	`7d719e0`
release_version	1.54.0-SNAPSHOT~646461c3fa	1.53.0-SNAPSHOT~7d719e04e7

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1757082137	1757082137
ci_job_id	1115753203	1115753203
ci_pipeline_id	75659518	75659518
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-gprotmei 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-gprotmei 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~7d719e04e7, baseline=1.54.0-SNAPSHOT~646461c3fa
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.97 s) : 14970000, 14970000
.   : milestone, 14970000,
appsec (15.218 s) : 15218000, 15218000
.   : milestone, 15218000,
iast (18.114 s) : 18114000, 18114000
.   : milestone, 18114000,
iast_GLOBAL (18.125 s) : 18125000, 18125000
.   : milestone, 18125000,
profiling (15.455 s) : 15455000, 15455000
.   : milestone, 15455000,
tracing (14.904 s) : 14904000, 14904000
.   : milestone, 14904000,
section candidate
no_agent (15.325 s) : 15325000, 15325000
.   : milestone, 15325000,
appsec (14.614 s) : 14614000, 14614000
.   : milestone, 14614000,
iast (18.467 s) : 18467000, 18467000
.   : milestone, 18467000,
iast_GLOBAL (18.207 s) : 18207000, 18207000
.   : milestone, 18207000,
profiling (15.34 s) : 15340000, 15340000
.   : milestone, 15340000,
tracing (15.149 s) : 15149000, 15149000
.   : milestone, 15149000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.97 s [14.97 s, 14.97 s]	-
appsec	15.218 s [15.218 s, 15.218 s]	248.0 ms (1.7%)
iast	18.114 s [18.114 s, 18.114 s]	3.144 s (21.0%)
iast_GLOBAL	18.125 s [18.125 s, 18.125 s]	3.155 s (21.1%)
profiling	15.455 s [15.455 s, 15.455 s]	485.0 ms (3.2%)
tracing	14.904 s [14.904 s, 14.904 s]	-66.0 ms (-0.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.325 s [15.325 s, 15.325 s]	-
appsec	14.614 s [14.614 s, 14.614 s]	-711.0 ms (-4.6%)
iast	18.467 s [18.467 s, 18.467 s]	3.142 s (20.5%)
iast_GLOBAL	18.207 s [18.207 s, 18.207 s]	2.882 s (18.8%)
profiling	15.34 s [15.34 s, 15.34 s]	15.0 ms (0.1%)
tracing	15.149 s [15.149 s, 15.149 s]	-176.0 ms (-1.1%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~7d719e04e7, baseline=1.54.0-SNAPSHOT~646461c3fa
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.668 ms) : 3450, 3886
.   : milestone, 3668,
iast (2.202 ms) : 2139, 2265
.   : milestone, 2202,
iast_GLOBAL (2.24 ms) : 2177, 2302
.   : milestone, 2240,
profiling (2.035 ms) : 1985, 2085
.   : milestone, 2035,
tracing (2.02 ms) : 1972, 2069
.   : milestone, 2020,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.608 ms) : 3397, 3819
.   : milestone, 3608,
iast (2.199 ms) : 2136, 2262
.   : milestone, 2199,
iast_GLOBAL (2.237 ms) : 2174, 2300
.   : milestone, 2237,
profiling (2.039 ms) : 1989, 2090
.   : milestone, 2039,
tracing (2.018 ms) : 1969, 2067
.   : milestone, 2018,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.462 ms, 1.485 ms]	-
appsec	3.668 ms [3.45 ms, 3.886 ms]	2.195 ms (149.0%)
iast	2.202 ms [2.139 ms, 2.265 ms]	728.358 µs (49.4%)
iast_GLOBAL	2.24 ms [2.177 ms, 2.302 ms]	766.267 µs (52.0%)
profiling	2.035 ms [1.985 ms, 2.085 ms]	561.931 µs (38.1%)
tracing	2.02 ms [1.972 ms, 2.069 ms]	547.175 µs (37.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	3.608 ms [3.397 ms, 3.819 ms]	2.134 ms (144.8%)
iast	2.199 ms [2.136 ms, 2.262 ms]	724.937 µs (49.2%)
iast_GLOBAL	2.237 ms [2.174 ms, 2.3 ms]	763.301 µs (51.8%)
profiling	2.039 ms [1.989 ms, 2.09 ms]	565.34 µs (38.4%)
tracing	2.018 ms [1.969 ms, 2.067 ms]	544.187 µs (36.9%)

Add Java 25 to default testing

faf5405

sarahchen6 added type: enhancement Enhancements and improvements tag: do not merge Do not merge changes comp: testing Testing tag: no release notes Changes to exclude from release notes labels Sep 2, 2025

sarahchen6 added 2 commits September 5, 2025 09:45

Revert builder image version

d318e49

Edit comment

7d719e0

sarahchen6 marked this pull request as ready for review September 5, 2025 15:58

sarahchen6 requested review from a team as code owners September 5, 2025 15:58

sarahchen6 requested review from randomanderson and manuel-alvarez-alvarez and removed request for a team September 5, 2025 15:58

sarahchen6 removed the tag: do not merge Do not merge changes label Sep 5, 2025

PerfectSlayer approved these changes Sep 10, 2025

View reviewed changes

sarahchen6 merged commit 853b95c into master Sep 10, 2025
506 checks passed

sarahchen6 deleted the sarahchen6/change-java-25-to-default-testing branch September 10, 2025 12:38

github-actions bot added this to the 1.54.0 milestone Sep 10, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Change Java 25 to default JVM testing #9453

Change Java 25 to default JVM testing #9453

Uh oh!

sarahchen6 commented Sep 2, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 5, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Sep 5, 2025

Uh oh!

Uh oh!

Uh oh!

Change Java 25 to default JVM testing #9453

Change Java 25 to default JVM testing #9453

Uh oh!

Conversation

sarahchen6 commented Sep 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-datadog-prod-us1 bot commented Sep 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Sep 5, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Uh oh!

sarahchen6 commented Sep 2, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Sep 5, 2025 •

edited

Loading