Fix flaky test configuration #9918

sarahchen6 · 2025-11-07T16:03:08Z

What Does This Do

Use a safe instanceOf check with options as? JUnitPlatformOptions instead of the wrong testFramework is JUnitPlatformOptions evaluation to check if tests marked as @Flaky should be skipped or not.

Motivation

Previously when using testFramework, it had the wrong type, and the check always evaluated as false, skipping the test configuration entirely.

Additional Notes

After converting configure-tests to a convention plug-in in #9859, JUnit flaky test configurations were skipped and causing failures on the master branch of CI. This PR restores the functionality.

datadog-official · 2025-11-07T16:14:15Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.58% (-0.06%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 2b8f175 | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

pr-commenter · 2025-11-07T16:41:40Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-test-configuration
git_commit_date	1762533227	1762541658
git_commit_sha	`54da873`	`2b8f175`
release_version	1.56.0-SNAPSHOT~54da873ecc	1.56.0-SNAPSHOT~2b8f1757fe

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1762543631	1762543631
ci_job_id	1223173880	1223173880
ci_pipeline_id	81640452	81640452
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-5virmvc5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-5virmvc5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 14 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~2b8f1757fe, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053562
Total [baseline] (10.778 s) : 0, 10777817
Agent [candidate] (1.055 s) : 0, 1054933
Total [candidate] (10.652 s) : 0, 10652428
section appsec
Agent [baseline] (1.222 s) : 0, 1222144
Total [baseline] (10.821 s) : 0, 10820762
Agent [candidate] (1.243 s) : 0, 1242886
Total [candidate] (10.946 s) : 0, 10946024
section iast
Agent [baseline] (1.188 s) : 0, 1187637
Total [baseline] (11.14 s) : 0, 11140277
Agent [candidate] (1.176 s) : 0, 1175894
Total [candidate] (11.157 s) : 0, 11156766
section profiling
Agent [baseline] (1.194 s) : 0, 1194037
Total [baseline] (10.879 s) : 0, 10879024
Agent [candidate] (1.199 s) : 0, 1198542
Total [candidate] (10.911 s) : 0, 10910641

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	appsec	1.222 s	168.582 ms (16.0%)
Agent	iast	1.188 s	134.075 ms (12.7%)
Agent	profiling	1.194 s	140.476 ms (13.3%)
Total	tracing	10.778 s	-
Total	appsec	10.821 s	42.945 ms (0.4%)
Total	iast	11.14 s	362.46 ms (3.4%)
Total	profiling	10.879 s	101.207 ms (0.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	appsec	1.243 s	187.953 ms (17.8%)
Agent	iast	1.176 s	120.961 ms (11.5%)
Agent	profiling	1.199 s	143.608 ms (13.6%)
Total	tracing	10.652 s	-
Total	appsec	10.946 s	293.596 ms (2.8%)
Total	iast	11.157 s	504.338 ms (4.7%)
Total	profiling	10.911 s	258.213 ms (2.4%)

gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~2b8f1757fe, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.487 ms) : 0, 1487
crashtracking [candidate] (1.473 ms) : 0, 1473
BytebuddyAgent [baseline] (708.759 ms) : 0, 708759
BytebuddyAgent [candidate] (711.17 ms) : 0, 711170
GlobalTracer [baseline] (247.229 ms) : 0, 247229
GlobalTracer [candidate] (246.595 ms) : 0, 246595
AppSec [baseline] (32.872 ms) : 0, 32872
AppSec [candidate] (32.465 ms) : 0, 32465
Debugger [baseline] (6.523 ms) : 0, 6523
Debugger [candidate] (6.44 ms) : 0, 6440
Remote Config [baseline] (718.643 µs) : 0, 719
Remote Config [candidate] (717.64 µs) : 0, 718
Telemetry [baseline] (13.74 ms) : 0, 13740
Telemetry [candidate] (13.061 ms) : 0, 13061
Flare Poller [baseline] (7.421 ms) : 0, 7421
Flare Poller [candidate] (8.071 ms) : 0, 8071
section appsec
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.484 ms) : 0, 1484
BytebuddyAgent [baseline] (729.915 ms) : 0, 729915
BytebuddyAgent [candidate] (742.672 ms) : 0, 742672
GlobalTracer [baseline] (237.54 ms) : 0, 237540
GlobalTracer [candidate] (242.133 ms) : 0, 242133
AppSec [baseline] (174.232 ms) : 0, 174232
AppSec [candidate] (175.944 ms) : 0, 175944
Debugger [baseline] (5.971 ms) : 0, 5971
Debugger [candidate] (6.104 ms) : 0, 6104
Remote Config [baseline] (667.124 µs) : 0, 667
Remote Config [candidate] (675.849 µs) : 0, 676
Telemetry [baseline] (8.483 ms) : 0, 8483
Telemetry [candidate] (8.856 ms) : 0, 8856
Flare Poller [baseline] (3.991 ms) : 0, 3991
Flare Poller [candidate] (4.133 ms) : 0, 4133
IAST [baseline] (24.941 ms) : 0, 24941
IAST [candidate] (25.611 ms) : 0, 25611
section iast
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (834.637 ms) : 0, 834637
BytebuddyAgent [candidate] (825.816 ms) : 0, 825816
GlobalTracer [baseline] (235.61 ms) : 0, 235610
GlobalTracer [candidate] (234.211 ms) : 0, 234211
AppSec [baseline] (30.668 ms) : 0, 30668
AppSec [candidate] (26.818 ms) : 0, 26818
Debugger [baseline] (6.025 ms) : 0, 6025
Debugger [candidate] (5.957 ms) : 0, 5957
Remote Config [baseline] (627.553 µs) : 0, 628
Remote Config [candidate] (595.055 µs) : 0, 595
Telemetry [baseline] (8.619 ms) : 0, 8619
Telemetry [candidate] (8.321 ms) : 0, 8321
Flare Poller [baseline] (4.199 ms) : 0, 4199
Flare Poller [candidate] (4.145 ms) : 0, 4145
IAST [baseline] (30.887 ms) : 0, 30887
IAST [candidate] (33.897 ms) : 0, 33897
section profiling
crashtracking [baseline] (1.436 ms) : 0, 1436
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (730.187 ms) : 0, 730187
BytebuddyAgent [candidate] (734.347 ms) : 0, 734347
GlobalTracer [baseline] (222.227 ms) : 0, 222227
GlobalTracer [candidate] (221.979 ms) : 0, 221979
AppSec [baseline] (32.136 ms) : 0, 32136
AppSec [candidate] (32.198 ms) : 0, 32198
Debugger [baseline] (9.046 ms) : 0, 9046
Debugger [candidate] (7.5 ms) : 0, 7500
Remote Config [baseline] (716.217 µs) : 0, 716
Remote Config [candidate] (681.01 µs) : 0, 681
Telemetry [baseline] (13.785 ms) : 0, 13785
Telemetry [candidate] (15.432 ms) : 0, 15432
Flare Poller [baseline] (4.111 ms) : 0, 4111
Flare Poller [candidate] (4.215 ms) : 0, 4215
ProfilingAgent [baseline] (110.524 ms) : 0, 110524
ProfilingAgent [candidate] (110.609 ms) : 0, 110609
Profiling [baseline] (111.227 ms) : 0, 111227
Profiling [candidate] (111.285 ms) : 0, 111285

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~2b8f1757fe, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.05 s) : 0, 1050277
Total [baseline] (8.671 s) : 0, 8671065
Agent [candidate] (1.05 s) : 0, 1049614
Total [candidate] (8.649 s) : 0, 8649402
section iast
Agent [baseline] (1.179 s) : 0, 1178643
Total [baseline] (9.267 s) : 0, 9267162
Agent [candidate] (1.19 s) : 0, 1190373
Total [candidate] (9.274 s) : 0, 9273647

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.05 s	-
Agent	iast	1.179 s	128.366 ms (12.2%)
Total	tracing	8.671 s	-
Total	iast	9.267 s	596.097 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.05 s	-
Agent	iast	1.19 s	140.759 ms (13.4%)
Total	tracing	8.649 s	-
Total	iast	9.274 s	624.245 ms (7.2%)

gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~2b8f1757fe, baseline=1.56.0-SNAPSHOT~54da873ecc

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.452 ms) : 0, 1452
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (706.533 ms) : 0, 706533
BytebuddyAgent [candidate] (706.68 ms) : 0, 706680
GlobalTracer [baseline] (246.467 ms) : 0, 246467
GlobalTracer [candidate] (246.14 ms) : 0, 246140
AppSec [baseline] (32.868 ms) : 0, 32868
AppSec [candidate] (32.476 ms) : 0, 32476
Debugger [baseline] (6.527 ms) : 0, 6527
Debugger [candidate] (6.403 ms) : 0, 6403
Remote Config [baseline] (729.366 µs) : 0, 729
Remote Config [candidate] (713.743 µs) : 0, 714
Telemetry [baseline] (12.95 ms) : 0, 12950
Telemetry [candidate] (12.906 ms) : 0, 12906
Flare Poller [baseline] (8.087 ms) : 0, 8087
Flare Poller [candidate] (8.067 ms) : 0, 8067
section iast
crashtracking [baseline] (1.458 ms) : 0, 1458
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (827.698 ms) : 0, 827698
BytebuddyAgent [candidate] (837.003 ms) : 0, 837003
GlobalTracer [baseline] (234.485 ms) : 0, 234485
GlobalTracer [candidate] (236.123 ms) : 0, 236123
AppSec [baseline] (28.615 ms) : 0, 28615
AppSec [candidate] (27.228 ms) : 0, 27228
Debugger [baseline] (5.995 ms) : 0, 5995
Debugger [candidate] (6.015 ms) : 0, 6015
Remote Config [baseline] (604.791 µs) : 0, 605
Remote Config [candidate] (598.196 µs) : 0, 598
Telemetry [baseline] (8.375 ms) : 0, 8375
Telemetry [candidate] (8.318 ms) : 0, 8318
Flare Poller [baseline] (4.155 ms) : 0, 4155
Flare Poller [candidate] (4.143 ms) : 0, 4143
IAST [baseline] (32.505 ms) : 0, 32505
IAST [candidate] (34.653 ms) : 0, 34653

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-test-configuration
git_commit_date	1762533227	1762541658
git_commit_sha	`54da873`	`2b8f175`
release_version	1.56.0-SNAPSHOT~54da873ecc	1.56.0-SNAPSHOT~2b8f1757fe

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1762544109	1762544109
ci_job_id	1223173881	1223173881
ci_pipeline_id	81640452	81640452
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-71yknro2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-71yknro2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:profiling:high_load	worse [+131.194µs; +168.728µs] or [+6.692%; +8.607%]	unstable [-408.113op/s; +91.425op/s] or [-17.742%; +3.975%]	2.110ms	2141.906op/s	1.960ms	2300.250op/s
scenario:load:petclinic:code_origins:high_load	worse [+0.896ms; +1.299ms] or [+5.033%; +7.295%]	unstable [-42.469op/s; +12.281op/s] or [-16.206%; +4.686%]	18.901ms	246.969op/s	17.803ms	262.062op/s
scenario:load:petclinic:tracing:high_load	worse [+363.872µs; +742.670µs] or [+2.062%; +4.208%]	unstable [-35.464op/s; +19.589op/s] or [-13.419%; +7.412%]	18.204ms	256.344op/s	17.651ms	264.281op/s
scenario:load:petclinic:profiling:high_load	worse [+0.899ms; +1.321ms] or [+4.844%; +7.120%]	unstable [-40.187op/s; +11.937op/s] or [-15.979%; +4.746%]	19.668ms	237.375op/s	18.558ms	251.500op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~2b8f1757fe, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.183 ms) : 1171, 1194
.   : milestone, 1183,
iast (3.112 ms) : 3073, 3152
.   : milestone, 3112,
iast_FULL (5.92 ms) : 5861, 5979
.   : milestone, 5920,
iast_GLOBAL (3.494 ms) : 3444, 3544
.   : milestone, 3494,
profiling (1.96 ms) : 1944, 1976
.   : milestone, 1960,
tracing (1.811 ms) : 1796, 1825
.   : milestone, 1811,
section candidate
no_agent (1.197 ms) : 1186, 1209
.   : milestone, 1197,
iast (3.198 ms) : 3157, 3239
.   : milestone, 3198,
iast_FULL (5.931 ms) : 5871, 5990
.   : milestone, 5931,
iast_GLOBAL (3.596 ms) : 3543, 3649
.   : milestone, 3596,
profiling (2.11 ms) : 2092, 2129
.   : milestone, 2110,
tracing (1.781 ms) : 1766, 1796
.   : milestone, 1781,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.183 ms [1.171 ms, 1.194 ms]	-
iast	3.112 ms [3.073 ms, 3.152 ms]	1.93 ms (163.2%)
iast_FULL	5.92 ms [5.861 ms, 5.979 ms]	4.737 ms (400.6%)
iast_GLOBAL	3.494 ms [3.444 ms, 3.544 ms]	2.311 ms (195.4%)
profiling	1.96 ms [1.944 ms, 1.976 ms]	777.717 µs (65.8%)
tracing	1.811 ms [1.796 ms, 1.825 ms]	628.046 µs (53.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.197 ms [1.186 ms, 1.209 ms]	-
iast	3.198 ms [3.157 ms, 3.239 ms]	2.001 ms (167.1%)
iast_FULL	5.931 ms [5.871 ms, 5.99 ms]	4.733 ms (395.4%)
iast_GLOBAL	3.596 ms [3.543 ms, 3.649 ms]	2.399 ms (200.4%)
profiling	2.11 ms [2.092 ms, 2.129 ms]	913.075 µs (76.3%)
tracing	1.781 ms [1.766 ms, 1.796 ms]	584.259 µs (48.8%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~2b8f1757fe, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.149 ms) : 17959, 18340
.   : milestone, 18149,
appsec (18.618 ms) : 18431, 18806
.   : milestone, 18618,
code_origins (17.803 ms) : 17626, 17981
.   : milestone, 17803,
iast (17.78 ms) : 17602, 17958
.   : milestone, 17780,
profiling (18.558 ms) : 18368, 18749
.   : milestone, 18558,
tracing (17.651 ms) : 17476, 17825
.   : milestone, 17651,
section candidate
no_agent (17.759 ms) : 17578, 17940
.   : milestone, 17759,
appsec (18.645 ms) : 18459, 18832
.   : milestone, 18645,
code_origins (18.901 ms) : 18704, 19097
.   : milestone, 18901,
iast (17.654 ms) : 17479, 17830
.   : milestone, 17654,
profiling (19.668 ms) : 19466, 19870
.   : milestone, 19668,
tracing (18.204 ms) : 18026, 18382
.   : milestone, 18204,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.149 ms [17.959 ms, 18.34 ms]	-
appsec	18.618 ms [18.431 ms, 18.806 ms]	468.876 µs (2.6%)
code_origins	17.803 ms [17.626 ms, 17.981 ms]	-346.228 µs (-1.9%)
iast	17.78 ms [17.602 ms, 17.958 ms]	-369.455 µs (-2.0%)
profiling	18.558 ms [18.368 ms, 18.749 ms]	408.623 µs (2.3%)
tracing	17.651 ms [17.476 ms, 17.825 ms]	-498.949 µs (-2.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.759 ms [17.578 ms, 17.94 ms]	-
appsec	18.645 ms [18.459 ms, 18.832 ms]	886.664 µs (5.0%)
code_origins	18.901 ms [18.704 ms, 19.097 ms]	1.142 ms (6.4%)
iast	17.654 ms [17.479 ms, 17.83 ms]	-104.25 µs (-0.6%)
profiling	19.668 ms [19.466 ms, 19.87 ms]	1.91 ms (10.8%)
tracing	18.204 ms [18.026 ms, 18.382 ms]	445.107 µs (2.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/fix-test-configuration
git_commit_date	1762533227	1762541658
git_commit_sha	`54da873`	`2b8f175`
release_version	1.56.0-SNAPSHOT~54da873ecc	1.56.0-SNAPSHOT~2b8f1757fe

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1762543863	1762543863
ci_job_id	1223173882	1223173882
ci_pipeline_id	81640452	81640452
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-fa4jcjxc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-fa4jcjxc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~2b8f1757fe, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
appsec (14.844 s) : 14844000, 14844000
.   : milestone, 14844000,
iast (18.141 s) : 18141000, 18141000
.   : milestone, 18141000,
iast_GLOBAL (17.938 s) : 17938000, 17938000
.   : milestone, 17938000,
profiling (15.057 s) : 15057000, 15057000
.   : milestone, 15057000,
tracing (14.472 s) : 14472000, 14472000
.   : milestone, 14472000,
section candidate
no_agent (15.604 s) : 15604000, 15604000
.   : milestone, 15604000,
appsec (14.64 s) : 14640000, 14640000
.   : milestone, 14640000,
iast (18.44 s) : 18440000, 18440000
.   : milestone, 18440000,
iast_GLOBAL (17.976 s) : 17976000, 17976000
.   : milestone, 17976000,
profiling (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
tracing (14.701 s) : 14701000, 14701000
.   : milestone, 14701000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.957 s [14.957 s, 14.957 s]	-
appsec	14.844 s [14.844 s, 14.844 s]	-113.0 ms (-0.8%)
iast	18.141 s [18.141 s, 18.141 s]	3.184 s (21.3%)
iast_GLOBAL	17.938 s [17.938 s, 17.938 s]	2.981 s (19.9%)
profiling	15.057 s [15.057 s, 15.057 s]	100.0 ms (0.7%)
tracing	14.472 s [14.472 s, 14.472 s]	-485.0 ms (-3.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.604 s [15.604 s, 15.604 s]	-
appsec	14.64 s [14.64 s, 14.64 s]	-964.0 ms (-6.2%)
iast	18.44 s [18.44 s, 18.44 s]	2.836 s (18.2%)
iast_GLOBAL	17.976 s [17.976 s, 17.976 s]	2.372 s (15.2%)
profiling	14.934 s [14.934 s, 14.934 s]	-670.0 ms (-4.3%)
tracing	14.701 s [14.701 s, 14.701 s]	-903.0 ms (-5.8%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~2b8f1757fe, baseline=1.56.0-SNAPSHOT~54da873ecc
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.466 ms) : 1455, 1478
.   : milestone, 1466,
appsec (3.69 ms) : 3471, 3908
.   : milestone, 3690,
iast (2.201 ms) : 2137, 2264
.   : milestone, 2201,
iast_GLOBAL (2.241 ms) : 2177, 2305
.   : milestone, 2241,
profiling (2.05 ms) : 1998, 2101
.   : milestone, 2050,
tracing (2.021 ms) : 1971, 2071
.   : milestone, 2021,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.621 ms) : 3408, 3835
.   : milestone, 3621,
iast (2.187 ms) : 2123, 2251
.   : milestone, 2187,
iast_GLOBAL (2.237 ms) : 2173, 2300
.   : milestone, 2237,
profiling (2.059 ms) : 2006, 2112
.   : milestone, 2059,
tracing (2.018 ms) : 1969, 2068
.   : milestone, 2018,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.466 ms [1.455 ms, 1.478 ms]	-
appsec	3.69 ms [3.471 ms, 3.908 ms]	2.223 ms (151.6%)
iast	2.201 ms [2.137 ms, 2.264 ms]	734.572 µs (50.1%)
iast_GLOBAL	2.241 ms [2.177 ms, 2.305 ms]	774.873 µs (52.8%)
profiling	2.05 ms [1.998 ms, 2.101 ms]	583.333 µs (39.8%)
tracing	2.021 ms [1.971 ms, 2.071 ms]	554.958 µs (37.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	3.621 ms [3.408 ms, 3.835 ms]	2.149 ms (146.0%)
iast	2.187 ms [2.123 ms, 2.251 ms]	714.733 µs (48.5%)
iast_GLOBAL	2.237 ms [2.173 ms, 2.3 ms]	764.226 µs (51.9%)
profiling	2.059 ms [2.006 ms, 2.112 ms]	586.663 µs (39.8%)
tracing	2.018 ms [1.969 ms, 2.068 ms]	545.904 µs (37.1%)

sarahchen6 added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Nov 7, 2025

sarahchen6 marked this pull request as ready for review November 7, 2025 17:28

sarahchen6 requested a review from a team as a code owner November 7, 2025 17:28

sarahchen6 requested review from AlexeyKuznetsov-DD and manuel-alvarez-alvarez November 7, 2025 17:28

AlexeyKuznetsov-DD approved these changes Nov 7, 2025

View reviewed changes

Fix flaky test configuration

2b8f175

sarahchen6 force-pushed the sarahchen6/fix-test-configuration branch from b7a159c to 2b8f175 Compare November 7, 2025 18:54

sarahchen6 enabled auto-merge (squash) November 7, 2025 18:54

sarahchen6 merged commit f132c86 into master Nov 7, 2025
538 of 539 checks passed

sarahchen6 deleted the sarahchen6/fix-test-configuration branch November 7, 2025 19:48

github-actions bot added this to the 1.56.0 milestone Nov 7, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Fix flaky test configuration #9918

Fix flaky test configuration #9918

Uh oh!

sarahchen6 commented Nov 7, 2025 •

edited

Loading

Uh oh!

datadog-official bot commented Nov 7, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Nov 7, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Fix flaky test configuration #9918

Fix flaky test configuration #9918

Uh oh!

Conversation

sarahchen6 commented Nov 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Uh oh!

datadog-official bot commented Nov 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Nov 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

sarahchen6 commented Nov 7, 2025 •

edited

Loading

datadog-official bot commented Nov 7, 2025 •

edited

Loading

pr-commenter bot commented Nov 7, 2025 •

edited

Loading