Environment component dev #9189

PerfectSlayer · 2025-07-17T06:35:16Z

What Does This Do

DRAFT

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-07-17T07:10:32Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/environment
git_commit_date	1753085095	1753096878
git_commit_sha	`9b8db74`	`d6ef787`
release_version	1.52.0-SNAPSHOT~9b8db749f5	1.52.0-SNAPSHOT~d6ef7876f8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753099567	1753099567
ci_job_id	1038381022	1038381022
ci_pipeline_id	71152669	71152669
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-x9luuqo9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-x9luuqo9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~d6ef7876f8, baseline=1.52.0-SNAPSHOT~9b8db749f5

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.038 s) : 0, 1038438
Total [baseline] (8.614 s) : 0, 8614183
Agent [candidate] (1.039 s) : 0, 1039096
Total [candidate] (8.595 s) : 0, 8594724
section iast
Agent [baseline] (1.178 s) : 0, 1177960
Total [baseline] (9.26 s) : 0, 9259738
Agent [candidate] (1.172 s) : 0, 1171621
Total [candidate] (9.234 s) : 0, 9233700

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.038 s	-
Agent	iast	1.178 s	139.522 ms (13.4%)
Total	tracing	8.614 s	-
Total	iast	9.26 s	645.555 ms (7.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.039 s	-
Agent	iast	1.172 s	132.526 ms (12.8%)
Total	tracing	8.595 s	-
Total	iast	9.234 s	638.977 ms (7.4%)

gantt
    title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~d6ef7876f8, baseline=1.52.0-SNAPSHOT~9b8db749f5

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.431 ms) : 0, 1431
crashtracking [candidate] (1.424 ms) : 0, 1424
BytebuddyAgent [baseline] (729.73 ms) : 0, 729730
BytebuddyAgent [candidate] (730.631 ms) : 0, 730631
GlobalTracer [baseline] (241.011 ms) : 0, 241011
GlobalTracer [candidate] (240.913 ms) : 0, 240913
AppSec [baseline] (30.373 ms) : 0, 30373
AppSec [candidate] (30.306 ms) : 0, 30306
Debugger [baseline] (6.003 ms) : 0, 6003
Debugger [candidate] (5.997 ms) : 0, 5997
Remote Config [baseline] (644.688 µs) : 0, 645
Remote Config [candidate] (632.984 µs) : 0, 633
Telemetry [baseline] (8.205 ms) : 0, 8205
Telemetry [candidate] (8.176 ms) : 0, 8176
section iast
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.427 ms) : 0, 1427
BytebuddyAgent [baseline] (852.033 ms) : 0, 852033
BytebuddyAgent [candidate] (847.078 ms) : 0, 847078
GlobalTracer [baseline] (231.141 ms) : 0, 231141
GlobalTracer [candidate] (231.378 ms) : 0, 231378
IAST [baseline] (30.63 ms) : 0, 30630
IAST [candidate] (28.656 ms) : 0, 28656
AppSec [baseline] (26.597 ms) : 0, 26597
AppSec [candidate] (27.095 ms) : 0, 27095
Debugger [baseline] (6.635 ms) : 0, 6635
Debugger [candidate] (6.712 ms) : 0, 6712
Remote Config [baseline] (589.214 µs) : 0, 589
Remote Config [candidate] (584.444 µs) : 0, 584
Telemetry [baseline] (7.979 ms) : 0, 7979
Telemetry [candidate] (7.83 ms) : 0, 7830

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~d6ef7876f8, baseline=1.52.0-SNAPSHOT~9b8db749f5

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.036 s) : 0, 1035800
Total [baseline] (10.661 s) : 0, 10660647
Agent [candidate] (1.041 s) : 0, 1040666
Total [candidate] (10.716 s) : 0, 10716147
section appsec
Agent [baseline] (1.22 s) : 0, 1219842
Total [baseline] (10.778 s) : 0, 10777947
Agent [candidate] (1.217 s) : 0, 1217113
Total [candidate] (10.768 s) : 0, 10767575
section iast
Agent [baseline] (1.172 s) : 0, 1172244
Total [baseline] (10.948 s) : 0, 10947973
Agent [candidate] (1.172 s) : 0, 1172483
Total [candidate] (10.824 s) : 0, 10824344
section profiling
Agent [baseline] (1.18 s) : 0, 1180336
Total [baseline] (10.938 s) : 0, 10938172
Agent [candidate] (1.184 s) : 0, 1183803
Total [candidate] (10.862 s) : 0, 10862236

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.036 s	-
Agent	appsec	1.22 s	184.042 ms (17.8%)
Agent	iast	1.172 s	136.444 ms (13.2%)
Agent	profiling	1.18 s	144.536 ms (14.0%)
Total	tracing	10.661 s	-
Total	appsec	10.778 s	117.3 ms (1.1%)
Total	iast	10.948 s	287.327 ms (2.7%)
Total	profiling	10.938 s	277.526 ms (2.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.041 s	-
Agent	appsec	1.217 s	176.447 ms (17.0%)
Agent	iast	1.172 s	131.817 ms (12.7%)
Agent	profiling	1.184 s	143.137 ms (13.8%)
Total	tracing	10.716 s	-
Total	appsec	10.768 s	51.429 ms (0.5%)
Total	iast	10.824 s	108.198 ms (1.0%)
Total	profiling	10.862 s	146.09 ms (1.4%)

gantt
    title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~d6ef7876f8, baseline=1.52.0-SNAPSHOT~9b8db749f5

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.434 ms) : 0, 1434
BytebuddyAgent [baseline] (728.293 ms) : 0, 728293
BytebuddyAgent [candidate] (730.919 ms) : 0, 730919
GlobalTracer [baseline] (240.078 ms) : 0, 240078
GlobalTracer [candidate] (241.301 ms) : 0, 241301
AppSec [baseline] (30.228 ms) : 0, 30228
AppSec [candidate] (30.432 ms) : 0, 30432
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (6.004 ms) : 0, 6004
Remote Config [baseline] (645.121 µs) : 0, 645
Remote Config [candidate] (644.609 µs) : 0, 645
Telemetry [baseline] (8.159 ms) : 0, 8159
Telemetry [candidate] (8.982 ms) : 0, 8982
section appsec
crashtracking [baseline] (1.426 ms) : 0, 1426
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (753.306 ms) : 0, 753306
BytebuddyAgent [candidate] (751.796 ms) : 0, 751796
GlobalTracer [baseline] (234.392 ms) : 0, 234392
GlobalTracer [candidate] (234.196 ms) : 0, 234196
IAST [baseline] (23.65 ms) : 0, 23650
IAST [candidate] (23.655 ms) : 0, 23655
AppSec [baseline] (168.989 ms) : 0, 168989
AppSec [candidate] (167.034 ms) : 0, 167034
Debugger [baseline] (7.17 ms) : 0, 7170
Debugger [candidate] (8.571 ms) : 0, 8571
Remote Config [baseline] (644.765 µs) : 0, 645
Remote Config [candidate] (604.971 µs) : 0, 605
Telemetry [baseline] (8.955 ms) : 0, 8955
Telemetry [candidate] (8.81 ms) : 0, 8810
section iast
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.427 ms) : 0, 1427
BytebuddyAgent [baseline] (846.722 ms) : 0, 846722
BytebuddyAgent [candidate] (847.625 ms) : 0, 847625
GlobalTracer [baseline] (230.648 ms) : 0, 230648
GlobalTracer [candidate] (230.519 ms) : 0, 230519
IAST [baseline] (29.045 ms) : 0, 29045
IAST [candidate] (30.618 ms) : 0, 30618
AppSec [baseline] (29.12 ms) : 0, 29120
AppSec [candidate] (27.235 ms) : 0, 27235
Debugger [baseline] (5.813 ms) : 0, 5813
Debugger [candidate] (5.776 ms) : 0, 5776
Remote Config [baseline] (588.981 µs) : 0, 589
Remote Config [candidate] (606.319 µs) : 0, 606
Telemetry [baseline] (7.983 ms) : 0, 7983
Telemetry [candidate] (7.879 ms) : 0, 7879
section profiling
crashtracking [baseline] (1.396 ms) : 0, 1396
crashtracking [candidate] (1.401 ms) : 0, 1401
BytebuddyAgent [baseline] (757.514 ms) : 0, 757514
BytebuddyAgent [candidate] (760.524 ms) : 0, 760524
GlobalTracer [baseline] (219.309 ms) : 0, 219309
GlobalTracer [candidate] (219.957 ms) : 0, 219957
AppSec [baseline] (30.218 ms) : 0, 30218
AppSec [candidate] (30.203 ms) : 0, 30203
Debugger [baseline] (6.233 ms) : 0, 6233
Debugger [candidate] (6.263 ms) : 0, 6263
Remote Config [baseline] (660.354 µs) : 0, 660
Remote Config [candidate] (657.149 µs) : 0, 657
Telemetry [baseline] (14.036 ms) : 0, 14036
Telemetry [candidate] (13.131 ms) : 0, 13131
ProfilingAgent [baseline] (102.656 ms) : 0, 102656
ProfilingAgent [candidate] (102.92 ms) : 0, 102920
Profiling [baseline] (102.679 ms) : 0, 102679
Profiling [candidate] (102.943 ms) : 0, 102943

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/environment
git_commit_date	1753085095	1753096878
git_commit_sha	`9b8db74`	`d6ef787`
release_version	1.52.0-SNAPSHOT~9b8db749f5	1.52.0-SNAPSHOT~d6ef7876f8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1753099167	1753099167
ci_job_id	1038381023	1038381023
ci_pipeline_id	71152669	71152669
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-chylf4yk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-chylf4yk 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load	better [-312.031µs; -184.079µs] or [-6.835%; -4.032%]	unstable [-67.184op/s; +180.246op/s] or [-6.676%; +17.912%]	4.317ms	1062.844op/s	4.565ms	1006.312op/s
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-734.298µs; -344.446µs] or [-6.955%; -3.262%]	unstable [-31.111op/s; +78.173op/s] or [-7.068%; +17.760%]	10.019ms	463.688op/s	10.558ms	440.156op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~d6ef7876f8, baseline=1.52.0-SNAPSHOT~9b8db749f5
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.565 ms) : 4505, 4625
.   : milestone, 4565,
iast (9.446 ms) : 9293, 9600
.   : milestone, 9446,
iast_FULL (14.276 ms) : 13992, 14561
.   : milestone, 14276,
iast_GLOBAL (10.558 ms) : 10373, 10743
.   : milestone, 10558,
profiling (9.028 ms) : 8877, 9179
.   : milestone, 9028,
tracing (7.592 ms) : 7482, 7701
.   : milestone, 7592,
section candidate
no_agent (4.317 ms) : 4258, 4376
.   : milestone, 4317,
iast (9.357 ms) : 9198, 9517
.   : milestone, 9357,
iast_FULL (14.603 ms) : 14313, 14893
.   : milestone, 14603,
iast_GLOBAL (10.019 ms) : 9841, 10196
.   : milestone, 10019,
profiling (8.756 ms) : 8620, 8892
.   : milestone, 8756,
tracing (7.547 ms) : 7432, 7662
.   : milestone, 7547,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.565 ms [4.505 ms, 4.625 ms]	-
iast	9.446 ms [9.293 ms, 9.6 ms]	4.881 ms (106.9%)
iast_FULL	14.276 ms [13.992 ms, 14.561 ms]	9.711 ms (212.7%)
iast_GLOBAL	10.558 ms [10.373 ms, 10.743 ms]	5.993 ms (131.3%)
profiling	9.028 ms [8.877 ms, 9.179 ms]	4.463 ms (97.8%)
tracing	7.592 ms [7.482 ms, 7.701 ms]	3.027 ms (66.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.317 ms [4.258 ms, 4.376 ms]	-
iast	9.357 ms [9.198 ms, 9.517 ms]	5.041 ms (116.8%)
iast_FULL	14.603 ms [14.313 ms, 14.893 ms]	10.286 ms (238.3%)
iast_GLOBAL	10.019 ms [9.841 ms, 10.196 ms]	5.702 ms (132.1%)
profiling	8.756 ms [8.62 ms, 8.892 ms]	4.439 ms (102.8%)
tracing	7.547 ms [7.432 ms, 7.662 ms]	3.23 ms (74.8%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~d6ef7876f8, baseline=1.52.0-SNAPSHOT~9b8db749f5
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.126 ms) : 36828, 37425
.   : milestone, 37126,
appsec (46.532 ms) : 46113, 46951
.   : milestone, 46532,
code_origins (44.962 ms) : 44583, 45341
.   : milestone, 44962,
iast (43.77 ms) : 43392, 44147
.   : milestone, 43770,
profiling (47.756 ms) : 47316, 48195
.   : milestone, 47756,
tracing (44.633 ms) : 44251, 45016
.   : milestone, 44633,
section candidate
no_agent (37.698 ms) : 37402, 37995
.   : milestone, 37698,
appsec (47.058 ms) : 46638, 47479
.   : milestone, 47058,
code_origins (44.514 ms) : 44127, 44901
.   : milestone, 44514,
iast (42.716 ms) : 42349, 43082
.   : milestone, 42716,
profiling (48.095 ms) : 47632, 48558
.   : milestone, 48095,
tracing (44.455 ms) : 44106, 44805
.   : milestone, 44455,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.126 ms [36.828 ms, 37.425 ms]	-
appsec	46.532 ms [46.113 ms, 46.951 ms]	9.406 ms (25.3%)
code_origins	44.962 ms [44.583 ms, 45.341 ms]	7.836 ms (21.1%)
iast	43.77 ms [43.392 ms, 44.147 ms]	6.644 ms (17.9%)
profiling	47.756 ms [47.316 ms, 48.195 ms]	10.63 ms (28.6%)
tracing	44.633 ms [44.251 ms, 45.016 ms]	7.507 ms (20.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.698 ms [37.402 ms, 37.995 ms]	-
appsec	47.058 ms [46.638 ms, 47.479 ms]	9.36 ms (24.8%)
code_origins	44.514 ms [44.127 ms, 44.901 ms]	6.815 ms (18.1%)
iast	42.716 ms [42.349 ms, 43.082 ms]	5.017 ms (13.3%)
profiling	48.095 ms [47.632 ms, 48.558 ms]	10.397 ms (27.6%)
tracing	44.455 ms [44.106 ms, 44.805 ms]	6.757 ms (17.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/environment
git_commit_date	1753085095	1753096878
git_commit_sha	`9b8db74`	`d6ef787`
release_version	1.52.0-SNAPSHOT~9b8db749f5	1.52.0-SNAPSHOT~d6ef7876f8

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1753099691	1753099691
ci_job_id	1038381024	1038381024
ci_pipeline_id	71152669	71152669
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-jeu12le4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-jeu12le4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~d6ef7876f8, baseline=1.52.0-SNAPSHOT~9b8db749f5
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (2.456 ms) : 2403, 2510
.   : milestone, 2456,
iast (2.2 ms) : 2137, 2262
.   : milestone, 2200,
iast_GLOBAL (2.24 ms) : 2177, 2302
.   : milestone, 2240,
profiling (2.062 ms) : 2011, 2114
.   : milestone, 2062,
tracing (2.012 ms) : 1963, 2061
.   : milestone, 2012,
section candidate
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.651 ms) : 3434, 3868
.   : milestone, 3651,
iast (2.203 ms) : 2140, 2266
.   : milestone, 2203,
iast_GLOBAL (2.245 ms) : 2182, 2308
.   : milestone, 2245,
profiling (2.056 ms) : 2005, 2108
.   : milestone, 2056,
tracing (2.023 ms) : 1975, 2072
.   : milestone, 2023,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.473 ms [1.462 ms, 1.485 ms]	-
appsec	2.456 ms [2.403 ms, 2.51 ms]	982.963 µs (66.7%)
iast	2.2 ms [2.137 ms, 2.262 ms]	726.13 µs (49.3%)
iast_GLOBAL	2.24 ms [2.177 ms, 2.302 ms]	766.361 µs (52.0%)
profiling	2.062 ms [2.011 ms, 2.114 ms]	588.975 µs (40.0%)
tracing	2.012 ms [1.963 ms, 2.061 ms]	538.482 µs (36.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.475 ms [1.464 ms, 1.487 ms]	-
appsec	3.651 ms [3.434 ms, 3.868 ms]	2.176 ms (147.4%)
iast	2.203 ms [2.14 ms, 2.266 ms]	727.84 µs (49.3%)
iast_GLOBAL	2.245 ms [2.182 ms, 2.308 ms]	769.73 µs (52.2%)
profiling	2.056 ms [2.005 ms, 2.108 ms]	580.618 µs (39.4%)
tracing	2.023 ms [1.975 ms, 2.072 ms]	547.897 µs (37.1%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~d6ef7876f8, baseline=1.52.0-SNAPSHOT~9b8db749f5
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.733 s) : 15733000, 15733000
.   : milestone, 15733000,
appsec (14.85 s) : 14850000, 14850000
.   : milestone, 14850000,
iast (18.436 s) : 18436000, 18436000
.   : milestone, 18436000,
iast_GLOBAL (17.868 s) : 17868000, 17868000
.   : milestone, 17868000,
profiling (15.084 s) : 15084000, 15084000
.   : milestone, 15084000,
tracing (14.866 s) : 14866000, 14866000
.   : milestone, 14866000,
section candidate
no_agent (15.28 s) : 15280000, 15280000
.   : milestone, 15280000,
appsec (14.89 s) : 14890000, 14890000
.   : milestone, 14890000,
iast (18.324 s) : 18324000, 18324000
.   : milestone, 18324000,
iast_GLOBAL (18.027 s) : 18027000, 18027000
.   : milestone, 18027000,
profiling (16.086 s) : 16086000, 16086000
.   : milestone, 16086000,
tracing (15.07 s) : 15070000, 15070000
.   : milestone, 15070000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.733 s [15.733 s, 15.733 s]	-
appsec	14.85 s [14.85 s, 14.85 s]	-883.0 ms (-5.6%)
iast	18.436 s [18.436 s, 18.436 s]	2.703 s (17.2%)
iast_GLOBAL	17.868 s [17.868 s, 17.868 s]	2.135 s (13.6%)
profiling	15.084 s [15.084 s, 15.084 s]	-649.0 ms (-4.1%)
tracing	14.866 s [14.866 s, 14.866 s]	-867.0 ms (-5.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.28 s [15.28 s, 15.28 s]	-
appsec	14.89 s [14.89 s, 14.89 s]	-390.0 ms (-2.6%)
iast	18.324 s [18.324 s, 18.324 s]	3.044 s (19.9%)
iast_GLOBAL	18.027 s [18.027 s, 18.027 s]	2.747 s (18.0%)
profiling	16.086 s [16.086 s, 16.086 s]	806.0 ms (5.3%)
tracing	15.07 s [15.07 s, 15.07 s]	-210.0 ms (-1.4%)

pr-commenter · 2025-07-18T09:18:56Z

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1753098245	1753098591
end_time	2025-07-21T11:45:26	2025-07-21T11:51:11
git_branch	master	bbujon/environment
git_commit_sha	`9b8db74`	`d6ef787`
start_time	2025-07-21T11:44:06	2025-07-21T11:49:51

See matching parameters

	Baseline	Candidate
ci_job_id	1038381029	1038381029
ci_pipeline_id	71152669	71152669
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1753096878	1753096878

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 7 unstable metrics.

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-41.467µs; +75.820µs] or [-14.663%; +26.810%]	unstable [-48.800µs; +95.607µs] or [-15.126%; +29.635%]	unstable [-62.154µs; +123.518µs] or [-18.402%; +36.569%]	unstable [-307.360µs; +793.334µs] or [-33.038%; +85.275%]	unstable [-128.354op/s; +128.354op/s] or [-5.198%; +5.198%]
scenario:basic	same	same	same	unstable [-128.385µs; +80.104µs] or [-17.047%; +10.636%]	unstable [-205.409op/s; +205.409op/s] or [-7.806%; +7.806%]
scenario:loop	unsure [+1.877µs; +12.655µs] or [+0.021%; +0.143%]	same	same	same	same

Request duration reports for reports

gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (322.618 µs) : 282, 363
.   : milestone, 323,
basic (277.085 µs) : 271, 283
.   : milestone, 277,
loop (8.966 ms) : 8961, 8971
.   : milestone, 8966,
section candidate
noprobe (346.021 µs) : 258, 435
.   : milestone, 346,
basic (283.809 µs) : 273, 295
.   : milestone, 284,
loop (8.968 ms) : 8961, 8976
.   : milestone, 8968,

baseline results

Scenario	Request median duration [CI 0.99]
noprobe	322.618 µs [282.373 µs, 362.862 µs]
basic	277.085 µs [271.241 µs, 282.929 µs]
loop	8.966 ms [8.961 ms, 8.971 ms]

candidate results

Scenario	Request median duration [CI 0.99]
noprobe	346.021 µs [257.536 µs, 434.506 µs]
basic	283.809 µs [272.828 µs, 294.789 µs]
loop	8.968 ms [8.961 ms, 8.976 ms]

PerfectSlayer added the tag: do not merge Do not merge changes label Jul 17, 2025

PerfectSlayer force-pushed the bbujon/environment branch from b14c998 to 292c581 Compare July 17, 2025 06:36

PerfectSlayer changed the title ~~Migrate agent and config to environment component~~ Environment component dev Jul 17, 2025

PerfectSlayer force-pushed the bbujon/environment branch 3 times, most recently from b2e7439 to 4192ec7 Compare July 18, 2025 08:56

PerfectSlayer force-pushed the bbujon/environment branch from 4192ec7 to 5ea434b Compare July 18, 2025 09:26

PerfectSlayer added 16 commits July 21, 2025 10:48

feat(env): Migrate ConfigProvider to environment component

8155c58

feat(env): Migrate agent bootstrap to environment component

83d9597

feat(env): Improve null values handling

9ae7f6a

feat(civis): Migrate CI Visibility to environment component

9002326

feat(env): Migrate communication to environment component

204799d

feat(env): Migrate communication to environment component

1e74f0a

feat(env): Migrate CI Visibility to environment component

3537dc6

feat(env): Migrate crash tracking to environment component

cbf905f

feat(env): Migrate debugger to environment component

fbaed32

feat(env): Migrate jmxfetch to environment component

eae6efa

feat(env): Migrate logging to environment component

13a4751

feat(env): Migrate profiling to environment component

1e89e69

feat(env): Migrate security libraries to environment component

1f73232

feat(env): Migrate intrumentations to environment component

54cfc57

feat(env): Migrate internal apis to environment component

23e5d49

WIP

d6ef787

PerfectSlayer force-pushed the bbujon/environment branch from 5ea434b to d6ef787 Compare July 21, 2025 11:31

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Environment component dev #9189

Environment component dev #9189

PerfectSlayer commented Jul 17, 2025

Uh oh!

pr-commenter bot commented Jul 17, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Jul 18, 2025 •

edited

Loading

Uh oh!

Uh oh!

Environment component dev #9189

Are you sure you want to change the base?

Environment component dev #9189

Conversation

PerfectSlayer commented Jul 17, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Jul 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

pr-commenter bot commented Jul 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Debugger benchmarks

Parameters

Summary

Uh oh!

Uh oh!

pr-commenter bot commented Jul 17, 2025 •

edited

Loading

pr-commenter bot commented Jul 18, 2025 •

edited

Loading