Bump Groovy: 3.0.24 -> 4.0.28 #9745

AlexeyKuznetsov-DD · 2025-10-13T18:42:18Z

DO NOT MERGE

What Does This Do

Bump Groovy: 3.0.24 -> 4.0.28

Motivation

Latest Groovy

Additional Notes

pr-commenter · 2025-10-13T19:24:55Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1761489355	1761526112
git_commit_sha	`c553751`	`612eae0`
release_version	1.55.0-SNAPSHOT~c5537512d2	1.55.0-SNAPSHOT~612eae0772

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761528091	1761528091
ci_job_id	1198697320	1198697320
ci_pipeline_id	80332137	80332137
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-0hgt653e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-0hgt653e 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~612eae0772, baseline=1.55.0-SNAPSHOT~c5537512d2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.031 s) : 0, 1030596
Total [baseline] (10.866 s) : 0, 10866469
Agent [candidate] (1.043 s) : 0, 1043188
Total [candidate] (10.871 s) : 0, 10870928
section appsec
Agent [baseline] (1.203 s) : 0, 1202709
Total [baseline] (11.046 s) : 0, 11046485
Agent [candidate] (1.203 s) : 0, 1202631
Total [candidate] (10.991 s) : 0, 10990544
section iast
Agent [baseline] (1.161 s) : 0, 1160810
Total [baseline] (11.092 s) : 0, 11092349
Agent [candidate] (1.173 s) : 0, 1173127
Total [candidate] (11.215 s) : 0, 11214652
section profiling
Agent [baseline] (1.173 s) : 0, 1173312
Total [baseline] (11.069 s) : 0, 11068917
Agent [candidate] (1.178 s) : 0, 1178238
Total [candidate] (11.042 s) : 0, 11042293

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.031 s	-
Agent	appsec	1.203 s	172.112 ms (16.7%)
Agent	iast	1.161 s	130.213 ms (12.6%)
Agent	profiling	1.173 s	142.715 ms (13.8%)
Total	tracing	10.866 s	-
Total	appsec	11.046 s	180.016 ms (1.7%)
Total	iast	11.092 s	225.88 ms (2.1%)
Total	profiling	11.069 s	202.448 ms (1.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.043 s	-
Agent	appsec	1.203 s	159.443 ms (15.3%)
Agent	iast	1.173 s	129.939 ms (12.5%)
Agent	profiling	1.178 s	135.05 ms (12.9%)
Total	tracing	10.871 s	-
Total	appsec	10.991 s	119.616 ms (1.1%)
Total	iast	11.215 s	343.723 ms (3.2%)
Total	profiling	11.042 s	171.365 ms (1.6%)

gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~612eae0772, baseline=1.55.0-SNAPSHOT~c5537512d2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.476 ms) : 0, 1476
BytebuddyAgent [baseline] (702.626 ms) : 0, 702626
BytebuddyAgent [candidate] (711.741 ms) : 0, 711741
GlobalTracer [baseline] (245.233 ms) : 0, 245233
GlobalTracer [candidate] (247.636 ms) : 0, 247636
AppSec [baseline] (32.129 ms) : 0, 32129
AppSec [candidate] (32.739 ms) : 0, 32739
Debugger [baseline] (6.32 ms) : 0, 6320
Debugger [candidate] (6.534 ms) : 0, 6534
Remote Config [baseline] (679.036 µs) : 0, 679
Remote Config [candidate] (702.951 µs) : 0, 703
Telemetry [baseline] (14.489 ms) : 0, 14489
Telemetry [candidate] (14.385 ms) : 0, 14385
Flare Poller [baseline] (6.49 ms) : 0, 6490
Flare Poller [candidate] (6.503 ms) : 0, 6503
section appsec
crashtracking [baseline] (1.461 ms) : 0, 1461
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (725.492 ms) : 0, 725492
BytebuddyAgent [candidate] (726.364 ms) : 0, 726364
GlobalTracer [baseline] (236.412 ms) : 0, 236412
GlobalTracer [candidate] (235.83 ms) : 0, 235830
IAST [baseline] (25.003 ms) : 0, 25003
IAST [candidate] (24.976 ms) : 0, 24976
AppSec [baseline] (174.387 ms) : 0, 174387
AppSec [candidate] (173.908 ms) : 0, 173908
Debugger [baseline] (5.923 ms) : 0, 5923
Debugger [candidate] (5.918 ms) : 0, 5918
Remote Config [baseline] (626.337 µs) : 0, 626
Remote Config [candidate] (624.76 µs) : 0, 625
Telemetry [baseline] (8.445 ms) : 0, 8445
Telemetry [candidate] (8.457 ms) : 0, 8457
Flare Poller [baseline] (3.867 ms) : 0, 3867
Flare Poller [candidate] (3.97 ms) : 0, 3970
section iast
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.485 ms) : 0, 1485
BytebuddyAgent [baseline] (823.909 ms) : 0, 823909
BytebuddyAgent [candidate] (832.591 ms) : 0, 832591
GlobalTracer [baseline] (233.56 ms) : 0, 233560
GlobalTracer [candidate] (235.882 ms) : 0, 235882
IAST [baseline] (32.327 ms) : 0, 32327
IAST [candidate] (31.974 ms) : 0, 31974
AppSec [baseline] (28.882 ms) : 0, 28882
AppSec [candidate] (29.877 ms) : 0, 29877
Debugger [baseline] (6.136 ms) : 0, 6136
Debugger [candidate] (6.268 ms) : 0, 6268
Remote Config [baseline] (599.232 µs) : 0, 599
Remote Config [candidate] (621.151 µs) : 0, 621
Telemetry [baseline] (8.435 ms) : 0, 8435
Telemetry [candidate] (8.611 ms) : 0, 8611
Flare Poller [baseline] (4.11 ms) : 0, 4110
Flare Poller [candidate] (4.192 ms) : 0, 4192
section profiling
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (725.569 ms) : 0, 725569
BytebuddyAgent [candidate] (727.978 ms) : 0, 727978
GlobalTracer [baseline] (219.589 ms) : 0, 219589
GlobalTracer [candidate] (221.42 ms) : 0, 221420
AppSec [baseline] (32.363 ms) : 0, 32363
AppSec [candidate] (32.677 ms) : 0, 32677
Debugger [baseline] (12.889 ms) : 0, 12889
Debugger [candidate] (11.514 ms) : 0, 11514
Remote Config [baseline] (739.954 µs) : 0, 740
Remote Config [candidate] (2.881 ms) : 0, 2881
Telemetry [baseline] (9.806 ms) : 0, 9806
Telemetry [candidate] (9.359 ms) : 0, 9359
Flare Poller [baseline] (4.181 ms) : 0, 4181
Flare Poller [candidate] (4.185 ms) : 0, 4185
ProfilingAgent [baseline] (111.404 ms) : 0, 111404
ProfilingAgent [candidate] (111.271 ms) : 0, 111271
Profiling [baseline] (112.046 ms) : 0, 112046
Profiling [candidate] (111.94 ms) : 0, 111940

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~612eae0772, baseline=1.55.0-SNAPSHOT~c5537512d2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1044447
Total [baseline] (8.753 s) : 0, 8753482
Agent [candidate] (1.035 s) : 0, 1035199
Total [candidate] (8.696 s) : 0, 8695734
section iast
Agent [baseline] (1.16 s) : 0, 1160282
Total [baseline] (9.402 s) : 0, 9402315
Agent [candidate] (1.162 s) : 0, 1161684
Total [candidate] (9.424 s) : 0, 9423861

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	iast	1.16 s	115.834 ms (11.1%)
Total	tracing	8.753 s	-
Total	iast	9.402 s	648.833 ms (7.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.035 s	-
Agent	iast	1.162 s	126.486 ms (12.2%)
Total	tracing	8.696 s	-
Total	iast	9.424 s	728.127 ms (8.4%)

gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~612eae0772, baseline=1.55.0-SNAPSHOT~c5537512d2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.491 ms) : 0, 1491
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (712.959 ms) : 0, 712959
BytebuddyAgent [candidate] (706.102 ms) : 0, 706102
GlobalTracer [baseline] (248.3 ms) : 0, 248300
GlobalTracer [candidate] (246.057 ms) : 0, 246057
AppSec [baseline] (32.864 ms) : 0, 32864
AppSec [candidate] (32.318 ms) : 0, 32318
Debugger [baseline] (6.534 ms) : 0, 6534
Debugger [candidate] (6.44 ms) : 0, 6440
Remote Config [baseline] (692.587 µs) : 0, 693
Remote Config [candidate] (686.075 µs) : 0, 686
Telemetry [baseline] (12.975 ms) : 0, 12975
Telemetry [candidate] (14.474 ms) : 0, 14474
Flare Poller [baseline] (7.261 ms) : 0, 7261
Flare Poller [candidate] (6.373 ms) : 0, 6373
section iast
crashtracking [baseline] (1.462 ms) : 0, 1462
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (822.988 ms) : 0, 822988
BytebuddyAgent [candidate] (823.886 ms) : 0, 823886
GlobalTracer [baseline] (233.929 ms) : 0, 233929
GlobalTracer [candidate] (234.141 ms) : 0, 234141
IAST [baseline] (31.59 ms) : 0, 31590
IAST [candidate] (32.785 ms) : 0, 32785
AppSec [baseline] (29.743 ms) : 0, 29743
AppSec [candidate] (28.912 ms) : 0, 28912
Debugger [baseline] (6.063 ms) : 0, 6063
Debugger [candidate] (6.076 ms) : 0, 6076
Remote Config [baseline] (594.836 µs) : 0, 595
Remote Config [candidate] (597.639 µs) : 0, 598
Telemetry [baseline] (8.438 ms) : 0, 8438
Telemetry [candidate] (8.329 ms) : 0, 8329
Flare Poller [baseline] (4.182 ms) : 0, 4182
Flare Poller [candidate] (4.146 ms) : 0, 4146

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1761489355	1761526112
git_commit_sha	`c553751`	`612eae0`
release_version	1.55.0-SNAPSHOT~c5537512d2	1.55.0-SNAPSHOT~612eae0772

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1761527759	1761527759
ci_job_id	1198697321	1198697321
ci_pipeline_id	80332137	80332137
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ub9adw59 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ub9adw59 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	better [-587.057µs; -218.645µs] or [-5.889%; -2.193%]	unstable [-36.985op/s; +75.423op/s] or [-7.936%; +16.184%]	9.567ms	485.250op/s	9.969ms	466.031op/s
scenario:load:insecure-bank:tracing:high_load	worse [+710.065µs; +968.429µs] or [+9.352%; +12.755%]	unstable [-131.122op/s; +11.497op/s] or [-21.504%; +1.886%]	8.432ms	549.938op/s	7.593ms	609.750op/s
scenario:load:petclinic:tracing:high_load	worse [+0.930ms; +1.723ms] or [+2.203%; +4.080%]	unstable [-11.314op/s; +4.464op/s] or [-10.210%; +4.028%]	43.545ms	107.388op/s	42.219ms	110.812op/s
scenario:load:petclinic:no_agent:high_load	better [-1.740ms; -1.095ms] or [-4.626%; -2.912%]	unstable [-3.948op/s; +13.673op/s] or [-3.177%; +11.002%]	36.197ms	129.137op/s	37.615ms	124.275op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~612eae0772, baseline=1.55.0-SNAPSHOT~c5537512d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.615 ms) : 37305, 37925
.   : milestone, 37615,
appsec (48.159 ms) : 47718, 48600
.   : milestone, 48159,
code_origins (44.903 ms) : 44503, 45304
.   : milestone, 44903,
iast (44.204 ms) : 43818, 44590
.   : milestone, 44204,
profiling (47.354 ms) : 46924, 47785
.   : milestone, 47354,
tracing (42.219 ms) : 41857, 42581
.   : milestone, 42219,
section candidate
no_agent (36.197 ms) : 35908, 36486
.   : milestone, 36197,
appsec (47.456 ms) : 47043, 47869
.   : milestone, 47456,
code_origins (44.438 ms) : 44045, 44831
.   : milestone, 44438,
iast (44.348 ms) : 43969, 44726
.   : milestone, 44348,
profiling (48.265 ms) : 47788, 48742
.   : milestone, 48265,
tracing (43.545 ms) : 43171, 43919
.   : milestone, 43545,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.615 ms [37.305 ms, 37.925 ms]	-
appsec	48.159 ms [47.718 ms, 48.6 ms]	10.544 ms (28.0%)
code_origins	44.903 ms [44.503 ms, 45.304 ms]	7.288 ms (19.4%)
iast	44.204 ms [43.818 ms, 44.59 ms]	6.589 ms (17.5%)
profiling	47.354 ms [46.924 ms, 47.785 ms]	9.739 ms (25.9%)
tracing	42.219 ms [41.857 ms, 42.581 ms]	4.604 ms (12.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.197 ms [35.908 ms, 36.486 ms]	-
appsec	47.456 ms [47.043 ms, 47.869 ms]	11.259 ms (31.1%)
code_origins	44.438 ms [44.045 ms, 44.831 ms]	8.241 ms (22.8%)
iast	44.348 ms [43.969 ms, 44.726 ms]	8.151 ms (22.5%)
profiling	48.265 ms [47.788 ms, 48.742 ms]	12.068 ms (33.3%)
tracing	43.545 ms [43.171 ms, 43.919 ms]	7.348 ms (20.3%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~612eae0772, baseline=1.55.0-SNAPSHOT~c5537512d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.289 ms) : 4237, 4341
.   : milestone, 4289,
iast (9.969 ms) : 9799, 10139
.   : milestone, 9969,
iast_FULL (14.687 ms) : 14388, 14987
.   : milestone, 14687,
iast_GLOBAL (10.592 ms) : 10401, 10782
.   : milestone, 10592,
profiling (9.089 ms) : 8938, 9240
.   : milestone, 9089,
tracing (7.593 ms) : 7482, 7704
.   : milestone, 7593,
section candidate
no_agent (4.27 ms) : 4222, 4318
.   : milestone, 4270,
iast (9.567 ms) : 9394, 9739
.   : milestone, 9567,
iast_FULL (14.19 ms) : 13904, 14477
.   : milestone, 14190,
iast_GLOBAL (10.714 ms) : 10522, 10905
.   : milestone, 10714,
profiling (8.836 ms) : 8686, 8986
.   : milestone, 8836,
tracing (8.432 ms) : 8303, 8560
.   : milestone, 8432,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.289 ms [4.237 ms, 4.341 ms]	-
iast	9.969 ms [9.799 ms, 10.139 ms]	5.681 ms (132.4%)
iast_FULL	14.687 ms [14.388 ms, 14.987 ms]	10.398 ms (242.5%)
iast_GLOBAL	10.592 ms [10.401 ms, 10.782 ms]	6.303 ms (147.0%)
profiling	9.089 ms [8.938 ms, 9.24 ms]	4.8 ms (111.9%)
tracing	7.593 ms [7.482 ms, 7.704 ms]	3.304 ms (77.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.27 ms [4.222 ms, 4.318 ms]	-
iast	9.567 ms [9.394 ms, 9.739 ms]	5.297 ms (124.0%)
iast_FULL	14.19 ms [13.904 ms, 14.477 ms]	9.92 ms (232.3%)
iast_GLOBAL	10.714 ms [10.522 ms, 10.905 ms]	6.444 ms (150.9%)
profiling	8.836 ms [8.686 ms, 8.986 ms]	4.566 ms (106.9%)
tracing	8.432 ms [8.303 ms, 8.56 ms]	4.162 ms (97.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1761489355	1761526112
git_commit_sha	`c553751`	`612eae0`
release_version	1.55.0-SNAPSHOT~c5537512d2	1.55.0-SNAPSHOT~612eae0772

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1761528272	1761528272
ci_job_id	1198697322	1198697322
ci_pipeline_id	80332137	80332137
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-qy3drjvq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-qy3drjvq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~612eae0772, baseline=1.55.0-SNAPSHOT~c5537512d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
appsec (15.179 s) : 15179000, 15179000
.   : milestone, 15179000,
iast (18.726 s) : 18726000, 18726000
.   : milestone, 18726000,
iast_GLOBAL (18.27 s) : 18270000, 18270000
.   : milestone, 18270000,
profiling (15.574 s) : 15574000, 15574000
.   : milestone, 15574000,
tracing (15.274 s) : 15274000, 15274000
.   : milestone, 15274000,
section candidate
no_agent (15.001 s) : 15001000, 15001000
.   : milestone, 15001000,
appsec (15.085 s) : 15085000, 15085000
.   : milestone, 15085000,
iast (18.699 s) : 18699000, 18699000
.   : milestone, 18699000,
iast_GLOBAL (17.992 s) : 17992000, 17992000
.   : milestone, 17992000,
profiling (15.728 s) : 15728000, 15728000
.   : milestone, 15728000,
tracing (15.259 s) : 15259000, 15259000
.   : milestone, 15259000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.923 s [14.923 s, 14.923 s]	-
appsec	15.179 s [15.179 s, 15.179 s]	256.0 ms (1.7%)
iast	18.726 s [18.726 s, 18.726 s]	3.803 s (25.5%)
iast_GLOBAL	18.27 s [18.27 s, 18.27 s]	3.347 s (22.4%)
profiling	15.574 s [15.574 s, 15.574 s]	651.0 ms (4.4%)
tracing	15.274 s [15.274 s, 15.274 s]	351.0 ms (2.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.001 s [15.001 s, 15.001 s]	-
appsec	15.085 s [15.085 s, 15.085 s]	84.0 ms (0.6%)
iast	18.699 s [18.699 s, 18.699 s]	3.698 s (24.7%)
iast_GLOBAL	17.992 s [17.992 s, 17.992 s]	2.991 s (19.9%)
profiling	15.728 s [15.728 s, 15.728 s]	727.0 ms (4.8%)
tracing	15.259 s [15.259 s, 15.259 s]	258.0 ms (1.7%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~612eae0772, baseline=1.55.0-SNAPSHOT~c5537512d2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.484 ms) : 1473, 1496
.   : milestone, 1484,
appsec (3.736 ms) : 3518, 3953
.   : milestone, 3736,
iast (2.217 ms) : 2153, 2281
.   : milestone, 2217,
iast_GLOBAL (2.269 ms) : 2205, 2333
.   : milestone, 2269,
profiling (2.1 ms) : 2047, 2154
.   : milestone, 2100,
tracing (2.044 ms) : 1994, 2094
.   : milestone, 2044,
section candidate
no_agent (1.485 ms) : 1473, 1497
.   : milestone, 1485,
appsec (3.723 ms) : 3505, 3942
.   : milestone, 3723,
iast (2.209 ms) : 2145, 2272
.   : milestone, 2209,
iast_GLOBAL (2.269 ms) : 2205, 2333
.   : milestone, 2269,
profiling (2.063 ms) : 2011, 2115
.   : milestone, 2063,
tracing (2.045 ms) : 1995, 2095
.   : milestone, 2045,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.484 ms [1.473 ms, 1.496 ms]	-
appsec	3.736 ms [3.518 ms, 3.953 ms]	2.251 ms (151.7%)
iast	2.217 ms [2.153 ms, 2.281 ms]	732.647 µs (49.4%)
iast_GLOBAL	2.269 ms [2.205 ms, 2.333 ms]	784.737 µs (52.9%)
profiling	2.1 ms [2.047 ms, 2.154 ms]	615.958 µs (41.5%)
tracing	2.044 ms [1.994 ms, 2.094 ms]	559.486 µs (37.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.485 ms [1.473 ms, 1.497 ms]	-
appsec	3.723 ms [3.505 ms, 3.942 ms]	2.238 ms (150.7%)
iast	2.209 ms [2.145 ms, 2.272 ms]	723.929 µs (48.8%)
iast_GLOBAL	2.269 ms [2.205 ms, 2.333 ms]	783.986 µs (52.8%)
profiling	2.063 ms [2.011 ms, 2.115 ms]	578.261 µs (38.9%)
tracing	2.045 ms [1.995 ms, 2.095 ms]	560.184 µs (37.7%)

# Conflicts: # dd-smoke-tests/src/main/groovy/datadog/smoketest/ProcessManager.groovy

pr-commenter · 2025-10-25T03:32:28Z

Kafka / producer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1761332592	1761526112
git_commit_sha	`f69e043`	`612eae0`

See matching parameters

	Baseline	Candidate
ci_job_date	1761527302	1761527302
ci_job_id	1198697325	1198697325
ci_pipeline_id	80332137	80332137
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce	same

pr-commenter · 2025-10-25T03:45:37Z

Kafka / consumer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/groovy-4
git_commit_date	1761332592	1761526112
git_commit_sha	`f69e043`	`612eae0`

See matching parameters

	Baseline	Candidate
ci_job_date	1761527342	1761527342
ci_job_id	1198697326	1198697326
ci_pipeline_id	80332137	80332137
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.25	11.0.25
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant	-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.25+9-post-Ubuntu-1ubuntu122.04	11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume	unsure [-12514.429op/s; -1679.606op/s] or [-4.161%; -0.558%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same

…pringboot-openliberty-20` - it is failing on CI.

datadog-datadog-prod-us1 · 2025-10-25T18:51:51Z

🎯 Code Coverage
• Patch Coverage: 50.00%
• Total Coverage: 59.57% (-0.11%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 612eae0 | Docs | Was this helpful? Give us feedback!}

Bump Groovy: 3.0.24 -> 4.0.28

3866a54

AlexeyKuznetsov-DD self-assigned this Oct 13, 2025

AlexeyKuznetsov-DD added tag: do not merge Do not merge changes comp: tooling Build & Tooling labels Oct 13, 2025

WIP

f128d3c

AlexeyKuznetsov-DD added 11 commits October 13, 2025 16:38

WIP 2

9dffccd

WIP 3

d88be22

WIP 4

51da522

Merge branch 'master' into alexeyk/groovy-4

fb2f81e

Merge branch 'master' into alexeyk/groovy-4

af5d06d

Merge branch 'master' into alexeyk/groovy-4

765fd92

Spotbugs tweaks.

1ca9595

Merge branch 'master' into alexeyk/groovy-4

226a2c5

WIP tweaks

a429354

Merge branch 'master' into alexeyk/groovy-4

ad15665

# Conflicts: # dd-smoke-tests/src/main/groovy/datadog/smoketest/ProcessManager.groovy

Fixed Groovy ambiguity. Tweaked

8fdf26b

AlexeyKuznetsov-DD added 5 commits October 24, 2025 23:52

Build workaround.

e687aa9

Fixed Groovy compiler settings.

6da67dd

Fixed Groovy compiler settings.

69ccd4a

Fixed Groovy compiler settings.

7c04a1c

Refactored Groovy compiler config. Disabled module `:dd-smoke-tests:s…

5b73524

…pringboot-openliberty-20` - it is failing on CI.

AlexeyKuznetsov-DD added 5 commits October 25, 2025 19:30

Tests fixed.

7a0bd21

Revert some code. Ignore tests.

e863a91

Fixed tests. Ignore tests.

76dcdd8

Ignore tests.

ca64f39

Ignore tests

27c46bc

AlexeyKuznetsov-DD added 3 commits October 26, 2025 14:33

Ignore tests.

ba98146

Tweaking Groovy setup.

2b04db3

Tweaking build.

612eae0

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Bump Groovy: 3.0.24 -> 4.0.28 #9745

Bump Groovy: 3.0.24 -> 4.0.28 #9745

Uh oh!

AlexeyKuznetsov-DD commented Oct 13, 2025

Uh oh!

pr-commenter bot commented Oct 13, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Oct 25, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Oct 25, 2025 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 bot commented Oct 25, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Bump Groovy: 3.0.24 -> 4.0.28 #9745

Are you sure you want to change the base?

Bump Groovy: 3.0.24 -> 4.0.28 #9745

Uh oh!

Conversation

AlexeyKuznetsov-DD commented Oct 13, 2025

What Does This Do

Motivation

Additional Notes

Uh oh!

pr-commenter bot commented Oct 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

pr-commenter bot commented Oct 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Kafka / producer-benchmark

Parameters

Summary

Uh oh!

pr-commenter bot commented Oct 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Kafka / consumer-benchmark

Parameters

Summary

Uh oh!

datadog-datadog-prod-us1 bot commented Oct 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

pr-commenter bot commented Oct 13, 2025 •

edited

Loading

pr-commenter bot commented Oct 25, 2025 •

edited

Loading

pr-commenter bot commented Oct 25, 2025 •

edited

Loading

datadog-datadog-prod-us1 bot commented Oct 25, 2025 •

edited

Loading