Flaky flare test #10221

AlexeyKuznetsov-DD · 2025-12-15T22:38:22Z

What Does This Do

Mark test as flaky

Motivation

Green CI.

pr-commenter · 2025-12-15T23:25:57Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/flaky-flare-test
git_commit_date	1765826150	1765838195
git_commit_sha	`3101a85`	`ae7f3e1`
release_version	1.57.0-SNAPSHOT~3101a85cf1	1.57.0-SNAPSHOT~ae7f3e1d8f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765840099	1765840099
ci_job_id	1297313411	1297313411
ci_pipeline_id	86923864	86923864
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-c9k8heah 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-c9k8heah 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 10 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~ae7f3e1d8f, baseline=1.57.0-SNAPSHOT~3101a85cf1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1080148
Total [baseline] (10.856 s) : 0, 10855906
Agent [candidate] (1.091 s) : 0, 1090980
Total [candidate] (10.978 s) : 0, 10978490
section appsec
Agent [baseline] (1.269 s) : 0, 1268860
Total [baseline] (11.053 s) : 0, 11052978
Agent [candidate] (1.262 s) : 0, 1262224
Total [candidate] (10.995 s) : 0, 10995177
section iast
Agent [baseline] (1.223 s) : 0, 1222682
Total [baseline] (11.204 s) : 0, 11203871
Agent [candidate] (1.221 s) : 0, 1221205
Total [candidate] (11.148 s) : 0, 11147615
section profiling
Agent [baseline] (1.202 s) : 0, 1201907
Total [baseline] (10.913 s) : 0, 10913138
Agent [candidate] (1.205 s) : 0, 1205286
Total [candidate] (10.898 s) : 0, 10897816

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.08 s	-
Agent	appsec	1.269 s	188.711 ms (17.5%)
Agent	iast	1.223 s	142.533 ms (13.2%)
Agent	profiling	1.202 s	121.758 ms (11.3%)
Total	tracing	10.856 s	-
Total	appsec	11.053 s	197.073 ms (1.8%)
Total	iast	11.204 s	347.966 ms (3.2%)
Total	profiling	10.913 s	57.233 ms (0.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.091 s	-
Agent	appsec	1.262 s	171.243 ms (15.7%)
Agent	iast	1.221 s	130.224 ms (11.9%)
Agent	profiling	1.205 s	114.306 ms (10.5%)
Total	tracing	10.978 s	-
Total	appsec	10.995 s	16.686 ms (0.2%)
Total	iast	11.148 s	169.125 ms (1.5%)
Total	profiling	10.898 s	-80.674 ms (-0.7%)

gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~ae7f3e1d8f, baseline=1.57.0-SNAPSHOT~3101a85cf1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (647.44 ms) : 0, 647440
BytebuddyAgent [candidate] (653.554 ms) : 0, 653554
GlobalTracer [baseline] (282.57 ms) : 0, 282570
GlobalTracer [candidate] (285.006 ms) : 0, 285006
AppSec [baseline] (32.276 ms) : 0, 32276
AppSec [candidate] (32.824 ms) : 0, 32824
Debugger [baseline] (67.973 ms) : 0, 67973
Debugger [candidate] (69.116 ms) : 0, 69116
Remote Config [baseline] (639.377 µs) : 0, 639
Remote Config [candidate] (637.313 µs) : 0, 637
Telemetry [baseline] (8.9 ms) : 0, 8900
Telemetry [candidate] (9.154 ms) : 0, 9154
Flare Poller [baseline] (3.649 ms) : 0, 3649
Flare Poller [candidate] (3.739 ms) : 0, 3739
section appsec
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (692.439 ms) : 0, 692439
BytebuddyAgent [candidate] (687.679 ms) : 0, 687679
GlobalTracer [baseline] (260.15 ms) : 0, 260150
GlobalTracer [candidate] (258.573 ms) : 0, 258573
IAST [baseline] (24.802 ms) : 0, 24802
IAST [candidate] (24.559 ms) : 0, 24559
AppSec [baseline] (172.506 ms) : 0, 172506
AppSec [candidate] (173.875 ms) : 0, 173875
Debugger [baseline] (68.454 ms) : 0, 68454
Debugger [candidate] (67.373 ms) : 0, 67373
Remote Config [baseline] (716.866 µs) : 0, 717
Remote Config [candidate] (709.075 µs) : 0, 709
Telemetry [baseline] (9.001 ms) : 0, 9001
Telemetry [candidate] (8.967 ms) : 0, 8967
Flare Poller [baseline] (4.013 ms) : 0, 4013
Flare Poller [candidate] (3.821 ms) : 0, 3821
section iast
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (790.002 ms) : 0, 790002
BytebuddyAgent [candidate] (789.2 ms) : 0, 789200
GlobalTracer [baseline] (256.185 ms) : 0, 256185
GlobalTracer [candidate] (255.6 ms) : 0, 255600
IAST [baseline] (27.059 ms) : 0, 27059
IAST [candidate] (26.97 ms) : 0, 26970
AppSec [baseline] (35.423 ms) : 0, 35423
AppSec [candidate] (31.6 ms) : 0, 31600
Debugger [baseline] (65.037 ms) : 0, 65037
Debugger [candidate] (68.867 ms) : 0, 68867
Remote Config [baseline] (551.223 µs) : 0, 551
Remote Config [candidate] (580.121 µs) : 0, 580
Telemetry [baseline] (8.371 ms) : 0, 8371
Telemetry [candidate] (8.355 ms) : 0, 8355
Flare Poller [baseline] (3.476 ms) : 0, 3476
Flare Poller [candidate] (3.461 ms) : 0, 3461
section profiling
crashtracking [baseline] (1.245 ms) : 0, 1245
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (699.155 ms) : 0, 699155
BytebuddyAgent [candidate] (702.101 ms) : 0, 702101
GlobalTracer [baseline] (220.822 ms) : 0, 220822
GlobalTracer [candidate] (221.632 ms) : 0, 221632
AppSec [baseline] (32.051 ms) : 0, 32051
AppSec [candidate] (32.095 ms) : 0, 32095
Debugger [baseline] (68.269 ms) : 0, 68269
Debugger [candidate] (67.978 ms) : 0, 67978
Remote Config [baseline] (636.518 µs) : 0, 637
Remote Config [candidate] (652.52 µs) : 0, 653
Telemetry [baseline] (8.83 ms) : 0, 8830
Telemetry [candidate] (8.843 ms) : 0, 8843
Flare Poller [baseline] (3.763 ms) : 0, 3763
Flare Poller [candidate] (3.78 ms) : 0, 3780
ProfilingAgent [baseline] (97.372 ms) : 0, 97372
ProfilingAgent [candidate] (97.188 ms) : 0, 97188
Profiling [baseline] (97.97 ms) : 0, 97970
Profiling [candidate] (97.757 ms) : 0, 97757

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~ae7f3e1d8f, baseline=1.57.0-SNAPSHOT~3101a85cf1

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1090869
Total [baseline] (8.743 s) : 0, 8743062
Agent [candidate] (1.094 s) : 0, 1094196
Total [candidate] (8.754 s) : 0, 8753811
section iast
Agent [baseline] (1.22 s) : 0, 1219853
Total [baseline] (9.371 s) : 0, 9371087
Agent [candidate] (1.219 s) : 0, 1219414
Total [candidate] (9.367 s) : 0, 9366567

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.091 s	-
Agent	iast	1.22 s	128.984 ms (11.8%)
Total	tracing	8.743 s	-
Total	iast	9.371 s	628.025 ms (7.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.094 s	-
Agent	iast	1.219 s	125.218 ms (11.4%)
Total	tracing	8.754 s	-
Total	iast	9.367 s	612.756 ms (7.0%)

gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~ae7f3e1d8f, baseline=1.57.0-SNAPSHOT~3101a85cf1

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (654.614 ms) : 0, 654614
BytebuddyAgent [candidate] (657.421 ms) : 0, 657421
GlobalTracer [baseline] (285.214 ms) : 0, 285214
GlobalTracer [candidate] (286.04 ms) : 0, 286040
AppSec [baseline] (32.764 ms) : 0, 32764
AppSec [candidate] (32.662 ms) : 0, 32662
Debugger [baseline] (67.055 ms) : 0, 67055
Debugger [candidate] (67.599 ms) : 0, 67599
Remote Config [baseline] (630.992 µs) : 0, 631
Remote Config [candidate] (625.952 µs) : 0, 626
Telemetry [baseline] (8.99 ms) : 0, 8990
Telemetry [candidate] (9.068 ms) : 0, 9068
Flare Poller [baseline] (4.548 ms) : 0, 4548
Flare Poller [candidate] (3.769 ms) : 0, 3769
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (788.338 ms) : 0, 788338
BytebuddyAgent [candidate] (788.42 ms) : 0, 788420
GlobalTracer [baseline] (255.479 ms) : 0, 255479
GlobalTracer [candidate] (255.78 ms) : 0, 255780
IAST [baseline] (27.028 ms) : 0, 27028
IAST [candidate] (27.048 ms) : 0, 27048
AppSec [baseline] (33.53 ms) : 0, 33530
AppSec [candidate] (33.544 ms) : 0, 33544
Debugger [baseline] (66.402 ms) : 0, 66402
Debugger [candidate] (65.649 ms) : 0, 65649
Remote Config [baseline] (561.013 µs) : 0, 561
Remote Config [candidate] (601.696 µs) : 0, 602
Telemetry [baseline] (8.405 ms) : 0, 8405
Telemetry [candidate] (8.345 ms) : 0, 8345
Flare Poller [baseline] (3.58 ms) : 0, 3580
Flare Poller [candidate] (3.498 ms) : 0, 3498

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/flaky-flare-test
git_commit_date	1765826150	1765838195
git_commit_sha	`3101a85`	`ae7f3e1`
release_version	1.57.0-SNAPSHOT~3101a85cf1	1.57.0-SNAPSHOT~ae7f3e1d8f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765840583	1765840583
ci_job_id	1297313412	1297313412
ci_pipeline_id	86923864	86923864
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-vhnmjzc4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-vhnmjzc4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 2 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-309.796µs; -168.256µs] or [-10.878%; -5.908%]	unsure [-710.062µs; -37.378µs] or [-8.947%; -0.471%]	unstable [-140.150op/s; +215.406op/s] or [-10.964%; +16.851%]	2.609ms	7.563ms	1315.909op/s	2.848ms	7.937ms	1278.281op/s
scenario:load:petclinic:no_agent:high_load	better [-2.758ms; -1.341ms] or [-14.689%; -7.139%]	unstable [-4.367ms; -0.971ms] or [-13.992%; -3.113%]	unstable [-3.118op/s; +55.431op/s] or [-1.283%; +22.805%]	16.728ms	28.540ms	269.219op/s	18.777ms	31.210ms	243.062op/s
scenario:load:petclinic:appsec:high_load	better [-1372.366µs; -548.157µs] or [-7.169%; -2.863%]	better [-2.122ms; -0.644ms] or [-6.826%; -2.072%]	unstable [-14.231op/s; +39.856op/s] or [-5.950%; +16.663%]	18.183ms	29.704ms	252.000op/s	19.143ms	31.087ms	239.188op/s
scenario:load:petclinic:profiling:high_load	worse [+0.950ms; +1.798ms] or [+4.954%; +9.379%]	worse [+1.280ms; +2.740ms] or [+4.239%; +9.077%]	unstable [-41.315op/s; +9.565op/s] or [-17.125%; +3.965%]	20.540ms	32.200ms	225.375op/s	19.166ms	30.190ms	241.250op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~ae7f3e1d8f, baseline=1.57.0-SNAPSHOT~3101a85cf1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.222 ms) : 1210, 1234
.   : milestone, 1222,
iast (3.14 ms) : 3103, 3178
.   : milestone, 3140,
iast_FULL (5.66 ms) : 5603, 5717
.   : milestone, 5660,
iast_GLOBAL (3.587 ms) : 3536, 3638
.   : milestone, 3587,
profiling (1.987 ms) : 1969, 2006
.   : milestone, 1987,
tracing (1.807 ms) : 1793, 1822
.   : milestone, 1807,
section candidate
no_agent (1.208 ms) : 1196, 1220
.   : milestone, 1208,
iast (3.188 ms) : 3143, 3232
.   : milestone, 3188,
iast_FULL (5.71 ms) : 5653, 5766
.   : milestone, 5710,
iast_GLOBAL (3.376 ms) : 3327, 3426
.   : milestone, 3376,
profiling (2.074 ms) : 2056, 2092
.   : milestone, 2074,
tracing (1.904 ms) : 1887, 1920
.   : milestone, 1904,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.222 ms [1.21 ms, 1.234 ms]	-
iast	3.14 ms [3.103 ms, 3.178 ms]	1.918 ms (156.9%)
iast_FULL	5.66 ms [5.603 ms, 5.717 ms]	4.438 ms (363.1%)
iast_GLOBAL	3.587 ms [3.536 ms, 3.638 ms]	2.365 ms (193.5%)
profiling	1.987 ms [1.969 ms, 2.006 ms]	764.794 µs (62.6%)
tracing	1.807 ms [1.793 ms, 1.822 ms]	585.131 µs (47.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.208 ms [1.196 ms, 1.22 ms]	-
iast	3.188 ms [3.143 ms, 3.232 ms]	1.98 ms (163.9%)
iast_FULL	5.71 ms [5.653 ms, 5.766 ms]	4.502 ms (372.8%)
iast_GLOBAL	3.376 ms [3.327 ms, 3.426 ms]	2.169 ms (179.6%)
profiling	2.074 ms [2.056 ms, 2.092 ms]	866.103 µs (71.7%)
tracing	1.904 ms [1.887 ms, 1.92 ms]	696.155 µs (57.6%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~ae7f3e1d8f, baseline=1.57.0-SNAPSHOT~3101a85cf1
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.209 ms) : 19010, 19407
.   : milestone, 19209,
appsec (19.515 ms) : 19315, 19715
.   : milestone, 19515,
code_origins (17.803 ms) : 17628, 17978
.   : milestone, 17803,
iast (17.479 ms) : 17307, 17650
.   : milestone, 17479,
profiling (19.351 ms) : 19160, 19542
.   : milestone, 19351,
tracing (17.489 ms) : 17318, 17659
.   : milestone, 17489,
section candidate
no_agent (17.332 ms) : 17156, 17508
.   : milestone, 17332,
appsec (18.519 ms) : 18332, 18706
.   : milestone, 18519,
code_origins (17.403 ms) : 17228, 17577
.   : milestone, 17403,
iast (17.649 ms) : 17474, 17825
.   : milestone, 17649,
profiling (20.716 ms) : 20507, 20925
.   : milestone, 20716,
tracing (17.631 ms) : 17454, 17807
.   : milestone, 17631,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.209 ms [19.01 ms, 19.407 ms]	-
appsec	19.515 ms [19.315 ms, 19.715 ms]	306.213 µs (1.6%)
code_origins	17.803 ms [17.628 ms, 17.978 ms]	-1.406 ms (-7.3%)
iast	17.479 ms [17.307 ms, 17.65 ms]	-1.73 ms (-9.0%)
profiling	19.351 ms [19.16 ms, 19.542 ms]	142.167 µs (0.7%)
tracing	17.489 ms [17.318 ms, 17.659 ms]	-1.72 ms (-9.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.332 ms [17.156 ms, 17.508 ms]	-
appsec	18.519 ms [18.332 ms, 18.706 ms]	1.188 ms (6.9%)
code_origins	17.403 ms [17.228 ms, 17.577 ms]	70.929 µs (0.4%)
iast	17.649 ms [17.474 ms, 17.825 ms]	317.91 µs (1.8%)
profiling	20.716 ms [20.507 ms, 20.925 ms]	3.384 ms (19.5%)
tracing	17.631 ms [17.454 ms, 17.807 ms]	299.002 µs (1.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/flaky-flare-test
git_commit_date	1765826150	1765838195
git_commit_sha	`3101a85`	`ae7f3e1`
release_version	1.57.0-SNAPSHOT~3101a85cf1	1.57.0-SNAPSHOT~ae7f3e1d8f

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1765840313	1765840313
ci_job_id	1297313413	1297313413
ci_pipeline_id	86923864	86923864
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-vv710k52 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-vv710k52 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~ae7f3e1d8f, baseline=1.57.0-SNAPSHOT~3101a85cf1
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.456 ms) : 2404, 2507
.   : milestone, 2456,
iast (2.212 ms) : 2147, 2276
.   : milestone, 2212,
iast_GLOBAL (2.253 ms) : 2188, 2317
.   : milestone, 2253,
profiling (2.099 ms) : 2045, 2153
.   : milestone, 2099,
tracing (2.041 ms) : 1991, 2092
.   : milestone, 2041,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (3.706 ms) : 3487, 3925
.   : milestone, 3706,
iast (2.214 ms) : 2150, 2279
.   : milestone, 2214,
iast_GLOBAL (2.257 ms) : 2193, 2322
.   : milestone, 2257,
profiling (2.068 ms) : 2016, 2121
.   : milestone, 2068,
tracing (2.048 ms) : 1997, 2099
.   : milestone, 2048,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.462 ms, 1.485 ms]	-
appsec	2.456 ms [2.404 ms, 2.507 ms]	982.215 µs (66.7%)
iast	2.212 ms [2.147 ms, 2.276 ms]	738.229 µs (50.1%)
iast_GLOBAL	2.253 ms [2.188 ms, 2.317 ms]	779.165 µs (52.9%)
profiling	2.099 ms [2.045 ms, 2.153 ms]	625.574 µs (42.5%)
tracing	2.041 ms [1.991 ms, 2.092 ms]	567.722 µs (38.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.459 ms, 1.482 ms]	-
appsec	3.706 ms [3.487 ms, 3.925 ms]	2.235 ms (152.0%)
iast	2.214 ms [2.15 ms, 2.279 ms]	743.384 µs (50.5%)
iast_GLOBAL	2.257 ms [2.193 ms, 2.322 ms]	786.514 µs (53.5%)
profiling	2.068 ms [2.016 ms, 2.121 ms]	597.379 µs (40.6%)
tracing	2.048 ms [1.997 ms, 2.099 ms]	577.295 µs (39.2%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~ae7f3e1d8f, baseline=1.57.0-SNAPSHOT~3101a85cf1
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.927 s) : 14927000, 14927000
.   : milestone, 14927000,
appsec (14.457 s) : 14457000, 14457000
.   : milestone, 14457000,
iast (18.003 s) : 18003000, 18003000
.   : milestone, 18003000,
iast_GLOBAL (18.098 s) : 18098000, 18098000
.   : milestone, 18098000,
profiling (14.771 s) : 14771000, 14771000
.   : milestone, 14771000,
tracing (14.66 s) : 14660000, 14660000
.   : milestone, 14660000,
section candidate
no_agent (15.237 s) : 15237000, 15237000
.   : milestone, 15237000,
appsec (14.854 s) : 14854000, 14854000
.   : milestone, 14854000,
iast (18.279 s) : 18279000, 18279000
.   : milestone, 18279000,
iast_GLOBAL (17.86 s) : 17860000, 17860000
.   : milestone, 17860000,
profiling (14.472 s) : 14472000, 14472000
.   : milestone, 14472000,
tracing (14.634 s) : 14634000, 14634000
.   : milestone, 14634000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.927 s [14.927 s, 14.927 s]	-
appsec	14.457 s [14.457 s, 14.457 s]	-470.0 ms (-3.1%)
iast	18.003 s [18.003 s, 18.003 s]	3.076 s (20.6%)
iast_GLOBAL	18.098 s [18.098 s, 18.098 s]	3.171 s (21.2%)
profiling	14.771 s [14.771 s, 14.771 s]	-156.0 ms (-1.0%)
tracing	14.66 s [14.66 s, 14.66 s]	-267.0 ms (-1.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.237 s [15.237 s, 15.237 s]	-
appsec	14.854 s [14.854 s, 14.854 s]	-383.0 ms (-2.5%)
iast	18.279 s [18.279 s, 18.279 s]	3.042 s (20.0%)
iast_GLOBAL	17.86 s [17.86 s, 17.86 s]	2.623 s (17.2%)
profiling	14.472 s [14.472 s, 14.472 s]	-765.0 ms (-5.0%)
tracing	14.634 s [14.634 s, 14.634 s]	-603.0 ms (-4.0%)

AlexeyKuznetsov-DD added 2 commits December 15, 2025 17:34

Marked test as @Flaky.

65fc294

Minor

ae7f3e1

AlexeyKuznetsov-DD requested a review from jbachorik December 15, 2025 22:38

AlexeyKuznetsov-DD self-assigned this Dec 15, 2025

AlexeyKuznetsov-DD added tag: no release notes Changes to exclude from release notes tag: flaky test Flaky tests comp: profiling Profiling labels Dec 15, 2025

AlexeyKuznetsov-DD marked this pull request as ready for review December 15, 2025 22:38

AlexeyKuznetsov-DD temporarily deployed to ci-build December 15, 2025 22:38 — with GitHub Actions Inactive

AlexeyKuznetsov-DD requested a review from a team as a code owner December 15, 2025 22:38

AlexeyKuznetsov-DD requested a review from smola December 15, 2025 22:38

AlexeyKuznetsov-DD requested a review from sarahchen6 December 17, 2025 16:09

sarahchen6 approved these changes Dec 17, 2025

View reviewed changes

AlexeyKuznetsov-DD merged commit eb94b8f into master Dec 17, 2025
724 of 726 checks passed

AlexeyKuznetsov-DD deleted the alexeyk/flaky-flare-test branch December 17, 2025 16:12

github-actions bot added this to the 1.57.0 milestone Dec 17, 2025

jandro996 pushed a commit that referenced this pull request Dec 18, 2025

Flaky flare test (#10221)

d892770

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Flaky flare test #10221

Flaky flare test #10221

Uh oh!

AlexeyKuznetsov-DD commented Dec 15, 2025

Uh oh!

pr-commenter bot commented Dec 15, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Flaky flare test #10221

Flaky flare test #10221

Uh oh!

Conversation

AlexeyKuznetsov-DD commented Dec 15, 2025

What Does This Do

Motivation

Uh oh!

pr-commenter bot commented Dec 15, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants