Skip to content

Conversation

@AlexeyKuznetsov-DD
Copy link
Contributor

DO NOT MERGE

What Does This Do

Motivation

Additional Notes

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Oct 29, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added tag: do not merge Do not merge changes comp: tooling Build & Tooling labels Oct 29, 2025
@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1761747514 1761747859
end_time 2025-10-29T14:19:55 2025-10-29T14:25:40
git_branch master alexeyk/spotless-attempt-2-applied
git_commit_sha 8747faa c8d5fd3
start_time 2025-10-29T14:18:35 2025-10-29T14:24:20
See matching parameters
Baseline Candidate
ci_job_id 1204341697 1204341697
ci_pipeline_id 80614037 80614037
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1761746905 1761746905

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-15.823µs; +25.288µs] or [-5.710%; +9.126%]
unstable
[-23.958µs; +38.712µs] or [-7.589%; +12.262%]
unstable
[-33.947µs; +51.772µs] or [-10.310%; +15.724%]
unstable
[-174.129µs; +45.320µs] or [-17.012%; +4.428%]
same
scenario:basic same same same unstable
[-217.927µs; -34.712µs] or [-26.855%; -4.278%]
unstable
[-189.031op/s; +189.031op/s] or [-7.372%; +7.372%]
scenario:loop same unsure
[-7.673µs; -0.130µs] or [-0.086%; -0.001%]
same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (315.691 µs) : 292, 339
.   : milestone, 316,
basic (291.655 µs) : 284, 299
.   : milestone, 292,
loop (8.96 ms) : 8956, 8964
.   : milestone, 8960,
section candidate
noprobe (323.068 µs) : 288, 358
.   : milestone, 323,
basic (289.96 µs) : 283, 297
.   : milestone, 290,
loop (8.956 ms) : 8953, 8959
.   : milestone, 8956,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 315.691 µs [292.103 µs, 339.28 µs]
basic 291.655 µs [284.356 µs, 298.953 µs]
loop 8.96 ms [8.956 ms, 8.964 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 323.068 µs [288.094 µs, 358.043 µs]
basic 289.96 µs [283.085 µs, 296.835 µs]
loop 8.956 ms [8.953 ms, 8.959 ms]

@datadog-official
Copy link

datadog-official bot commented Oct 29, 2025

🎯 Code Coverage
Patch Coverage: 0.00%
Total Coverage: 74.29% (+14.59%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: c8d5fd3 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/spotless-attempt-2-applied
git_commit_date 1761745018 1761746905
git_commit_sha 8747faa c8d5fd3
release_version 1.55.0-SNAPSHOT~8747faa1b4 1.55.0-SNAPSHOT~c8d5fd3206
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1761748767 1761748767
ci_job_id 1204341684 1204341684
ci_pipeline_id 80614037 80614037
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-tu0cnznd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-tu0cnznd 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 12 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.55.0-SNAPSHOT~c8d5fd3206, baseline=1.55.0-SNAPSHOT~8747faa1b4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.032 s) : 0, 1032322
Total [baseline] (10.827 s) : 0, 10827013
Agent [candidate] (1.027 s) : 0, 1027398
Total [candidate] (10.779 s) : 0, 10779025
section appsec
Agent [baseline] (1.213 s) : 0, 1212713
Total [baseline] (10.895 s) : 0, 10895147
Agent [candidate] (1.202 s) : 0, 1201765
Total [candidate] (10.966 s) : 0, 10965547
section iast
Agent [baseline] (1.16 s) : 0, 1160322
Total [baseline] (11.17 s) : 0, 11169841
Agent [candidate] (1.17 s) : 0, 1170304
Total [candidate] (11.238 s) : 0, 11237628
section profiling
Agent [baseline] (1.186 s) : 0, 1185695
Total [baseline] (10.991 s) : 0, 10990550
Agent [candidate] (1.178 s) : 0, 1177986
Total [candidate] (10.939 s) : 0, 10938720
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.032 s -
Agent appsec 1.213 s 180.39 ms (17.5%)
Agent iast 1.16 s 128.0 ms (12.4%)
Agent profiling 1.186 s 153.373 ms (14.9%)
Total tracing 10.827 s -
Total appsec 10.895 s 68.135 ms (0.6%)
Total iast 11.17 s 342.828 ms (3.2%)
Total profiling 10.991 s 163.538 ms (1.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent appsec 1.202 s 174.367 ms (17.0%)
Agent iast 1.17 s 142.907 ms (13.9%)
Agent profiling 1.178 s 150.589 ms (14.7%)
Total tracing 10.779 s -
Total appsec 10.966 s 186.522 ms (1.7%)
Total iast 11.238 s 458.603 ms (4.3%)
Total profiling 10.939 s 159.695 ms (1.5%)
gantt
    title petclinic - break down per module: candidate=1.55.0-SNAPSHOT~c8d5fd3206, baseline=1.55.0-SNAPSHOT~8747faa1b4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (702.519 ms) : 0, 702519
BytebuddyAgent [candidate] (700.513 ms) : 0, 700513
GlobalTracer [baseline] (246.314 ms) : 0, 246314
GlobalTracer [candidate] (244.243 ms) : 0, 244243
AppSec [baseline] (32.697 ms) : 0, 32697
AppSec [candidate] (32.2 ms) : 0, 32200
Debugger [baseline] (6.471 ms) : 0, 6471
Debugger [candidate] (6.353 ms) : 0, 6353
Remote Config [baseline] (682.205 µs) : 0, 682
Remote Config [candidate] (675.398 µs) : 0, 675
Telemetry [baseline] (14.412 ms) : 0, 14412
Telemetry [candidate] (13.713 ms) : 0, 13713
Flare Poller [baseline] (6.502 ms) : 0, 6502
Flare Poller [candidate] (7.062 ms) : 0, 7062
section appsec
crashtracking [baseline] (1.508 ms) : 0, 1508
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (733.088 ms) : 0, 733088
BytebuddyAgent [candidate] (726.289 ms) : 0, 726289
GlobalTracer [baseline] (237.81 ms) : 0, 237810
GlobalTracer [candidate] (235.484 ms) : 0, 235484
IAST [baseline] (25.319 ms) : 0, 25319
IAST [candidate] (24.703 ms) : 0, 24703
AppSec [baseline] (174.857 ms) : 0, 174857
AppSec [candidate] (173.93 ms) : 0, 173930
Debugger [baseline] (5.95 ms) : 0, 5950
Debugger [candidate] (5.882 ms) : 0, 5882
Remote Config [baseline] (628.409 µs) : 0, 628
Remote Config [candidate] (635.865 µs) : 0, 636
Telemetry [baseline] (8.361 ms) : 0, 8361
Telemetry [candidate] (8.488 ms) : 0, 8488
Flare Poller [baseline] (3.878 ms) : 0, 3878
Flare Poller [candidate] (3.847 ms) : 0, 3847
section iast
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.48 ms) : 0, 1480
BytebuddyAgent [baseline] (823.179 ms) : 0, 823179
BytebuddyAgent [candidate] (831.017 ms) : 0, 831017
GlobalTracer [baseline] (233.786 ms) : 0, 233786
GlobalTracer [candidate] (234.583 ms) : 0, 234583
IAST [baseline] (32.58 ms) : 0, 32580
IAST [candidate] (31.275 ms) : 0, 31275
AppSec [baseline] (28.753 ms) : 0, 28753
AppSec [candidate] (31.091 ms) : 0, 31091
Debugger [baseline] (6.108 ms) : 0, 6108
Debugger [candidate] (6.129 ms) : 0, 6129
Remote Config [baseline] (604.317 µs) : 0, 604
Remote Config [candidate] (596.117 µs) : 0, 596
Telemetry [baseline] (8.445 ms) : 0, 8445
Telemetry [candidate] (8.509 ms) : 0, 8509
Flare Poller [baseline] (4.137 ms) : 0, 4137
Flare Poller [candidate] (4.152 ms) : 0, 4152
section profiling
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.436 ms) : 0, 1436
BytebuddyAgent [baseline] (734.382 ms) : 0, 734382
BytebuddyAgent [candidate] (730.735 ms) : 0, 730735
GlobalTracer [baseline] (222.604 ms) : 0, 222604
GlobalTracer [candidate] (220.472 ms) : 0, 220472
AppSec [baseline] (32.784 ms) : 0, 32784
AppSec [candidate] (32.42 ms) : 0, 32420
Debugger [baseline] (13.131 ms) : 0, 13131
Debugger [candidate] (11.453 ms) : 0, 11453
Remote Config [baseline] (714.272 µs) : 0, 714
Remote Config [candidate] (722.754 µs) : 0, 723
Telemetry [baseline] (9.974 ms) : 0, 9974
Telemetry [candidate] (11.444 ms) : 0, 11444
Flare Poller [baseline] (4.244 ms) : 0, 4244
Flare Poller [candidate] (4.108 ms) : 0, 4108
ProfilingAgent [baseline] (110.443 ms) : 0, 110443
ProfilingAgent [candidate] (109.651 ms) : 0, 109651
Profiling [baseline] (111.069 ms) : 0, 111069
Profiling [candidate] (110.309 ms) : 0, 110309
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.55.0-SNAPSHOT~c8d5fd3206, baseline=1.55.0-SNAPSHOT~8747faa1b4

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.035 s) : 0, 1034979
Total [baseline] (8.681 s) : 0, 8680568
Agent [candidate] (1.031 s) : 0, 1031291
Total [candidate] (8.67 s) : 0, 8669572
section iast
Agent [baseline] (1.162 s) : 0, 1162179
Total [baseline] (9.34 s) : 0, 9340237
Agent [candidate] (1.165 s) : 0, 1164705
Total [candidate] (9.373 s) : 0, 9373451
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.035 s -
Agent iast 1.162 s 127.2 ms (12.3%)
Total tracing 8.681 s -
Total iast 9.34 s 659.668 ms (7.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.031 s -
Agent iast 1.165 s 133.414 ms (12.9%)
Total tracing 8.67 s -
Total iast 9.373 s 703.879 ms (8.1%)
gantt
    title insecure-bank - break down per module: candidate=1.55.0-SNAPSHOT~c8d5fd3206, baseline=1.55.0-SNAPSHOT~8747faa1b4

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.479 ms) : 0, 1479
crashtracking [candidate] (1.465 ms) : 0, 1465
BytebuddyAgent [baseline] (706.05 ms) : 0, 706050
BytebuddyAgent [candidate] (704.042 ms) : 0, 704042
GlobalTracer [baseline] (245.26 ms) : 0, 245260
GlobalTracer [candidate] (244.977 ms) : 0, 244977
AppSec [baseline] (32.663 ms) : 0, 32663
AppSec [candidate] (32.404 ms) : 0, 32404
Debugger [baseline] (6.439 ms) : 0, 6439
Debugger [candidate] (6.407 ms) : 0, 6407
Remote Config [baseline] (678.642 µs) : 0, 679
Remote Config [candidate] (673.621 µs) : 0, 674
Telemetry [baseline] (13.844 ms) : 0, 13844
Telemetry [candidate] (12.899 ms) : 0, 12899
Flare Poller [baseline] (7.325 ms) : 0, 7325
Flare Poller [candidate] (7.176 ms) : 0, 7176
section iast
crashtracking [baseline] (1.489 ms) : 0, 1489
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (824.694 ms) : 0, 824694
BytebuddyAgent [candidate] (825.985 ms) : 0, 825985
GlobalTracer [baseline] (233.741 ms) : 0, 233741
GlobalTracer [candidate] (234.877 ms) : 0, 234877
IAST [baseline] (33.538 ms) : 0, 33538
IAST [candidate] (33.579 ms) : 0, 33579
AppSec [baseline] (28.13 ms) : 0, 28130
AppSec [candidate] (28.257 ms) : 0, 28257
Debugger [baseline] (6.162 ms) : 0, 6162
Debugger [candidate] (6.17 ms) : 0, 6170
Remote Config [baseline] (607.596 µs) : 0, 608
Remote Config [candidate] (610.148 µs) : 0, 610
Telemetry [baseline] (8.469 ms) : 0, 8469
Telemetry [candidate] (8.522 ms) : 0, 8522
Flare Poller [baseline] (4.131 ms) : 0, 4131
Flare Poller [candidate] (4.12 ms) : 0, 4120
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/spotless-attempt-2-applied
git_commit_date 1761745018 1761746905
git_commit_sha 8747faa c8d5fd3
release_version 1.55.0-SNAPSHOT~8747faa1b4 1.55.0-SNAPSHOT~c8d5fd3206
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1761749257 1761749257
ci_job_id 1204341686 1204341686
ci_pipeline_id 80614037 80614037
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-sjcznovb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-sjcznovb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:appsec:high_load worse
[+0.856ms; +1.287ms] or [+4.413%; +6.634%]
unstable
[-36.502op/s; +11.502op/s] or [-15.166%; +4.779%]
20.466ms 228.188op/s 19.395ms 240.688op/s
scenario:load:petclinic:code_origins:high_load better
[-1.273ms; -0.889ms] or [-6.902%; -4.822%]
unstable
[-10.567op/s; +41.942op/s] or [-4.175%; +16.572%]
17.357ms 268.781op/s 18.438ms 253.094op/s
scenario:load:petclinic:tracing:high_load worse
[+1.023ms; +1.435ms] or [+5.529%; +7.759%]
unstable
[-40.671op/s; +9.421op/s] or [-16.119%; +3.734%]
19.727ms 236.688op/s 18.498ms 252.312op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~c8d5fd3206, baseline=1.55.0-SNAPSHOT~8747faa1b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.913 ms) : 18721, 19104
.   : milestone, 18913,
appsec (19.395 ms) : 19199, 19591
.   : milestone, 19395,
code_origins (18.438 ms) : 18254, 18622
.   : milestone, 18438,
iast (18.41 ms) : 18227, 18593
.   : milestone, 18410,
profiling (20.013 ms) : 19814, 20212
.   : milestone, 20013,
tracing (18.498 ms) : 18311, 18685
.   : milestone, 18498,
section candidate
no_agent (19.441 ms) : 19244, 19639
.   : milestone, 19441,
appsec (20.466 ms) : 20262, 20670
.   : milestone, 20466,
code_origins (17.357 ms) : 17185, 17529
.   : milestone, 17357,
iast (18.444 ms) : 18261, 18627
.   : milestone, 18444,
profiling (20.533 ms) : 20324, 20743
.   : milestone, 20533,
tracing (19.727 ms) : 19531, 19923
.   : milestone, 19727,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.913 ms [18.721 ms, 19.104 ms] -
appsec 19.395 ms [19.199 ms, 19.591 ms] 482.286 µs (2.6%)
code_origins 18.438 ms [18.254 ms, 18.622 ms] -474.805 µs (-2.5%)
iast 18.41 ms [18.227 ms, 18.593 ms] -502.181 µs (-2.7%)
profiling 20.013 ms [19.814 ms, 20.212 ms] 1.101 ms (5.8%)
tracing 18.498 ms [18.311 ms, 18.685 ms] -414.634 µs (-2.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.441 ms [19.244 ms, 19.639 ms] -
appsec 20.466 ms [20.262 ms, 20.67 ms] 1.025 ms (5.3%)
code_origins 17.357 ms [17.185 ms, 17.529 ms] -2.085 ms (-10.7%)
iast 18.444 ms [18.261 ms, 18.627 ms] -997.362 µs (-5.1%)
profiling 20.533 ms [20.324 ms, 20.743 ms] 1.092 ms (5.6%)
tracing 19.727 ms [19.531 ms, 19.923 ms] 285.445 µs (1.5%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.55.0-SNAPSHOT~c8d5fd3206, baseline=1.55.0-SNAPSHOT~8747faa1b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.225 ms) : 1213, 1236
.   : milestone, 1225,
iast (3.237 ms) : 3193, 3281
.   : milestone, 3237,
iast_FULL (5.946 ms) : 5885, 6007
.   : milestone, 5946,
iast_GLOBAL (3.662 ms) : 3597, 3726
.   : milestone, 3662,
profiling (2.189 ms) : 2169, 2209
.   : milestone, 2189,
tracing (1.748 ms) : 1734, 1761
.   : milestone, 1748,
section candidate
no_agent (1.197 ms) : 1185, 1209
.   : milestone, 1197,
iast (3.282 ms) : 3237, 3327
.   : milestone, 3282,
iast_FULL (5.888 ms) : 5830, 5947
.   : milestone, 5888,
iast_GLOBAL (3.662 ms) : 3601, 3723
.   : milestone, 3662,
profiling (2.141 ms) : 2121, 2161
.   : milestone, 2141,
tracing (1.783 ms) : 1768, 1797
.   : milestone, 1783,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.225 ms [1.213 ms, 1.236 ms] -
iast 3.237 ms [3.193 ms, 3.281 ms] 2.012 ms (164.3%)
iast_FULL 5.946 ms [5.885 ms, 6.007 ms] 4.721 ms (385.5%)
iast_GLOBAL 3.662 ms [3.597 ms, 3.726 ms] 2.437 ms (198.9%)
profiling 2.189 ms [2.169 ms, 2.209 ms] 963.871 µs (78.7%)
tracing 1.748 ms [1.734 ms, 1.761 ms] 523.015 µs (42.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.197 ms [1.185 ms, 1.209 ms] -
iast 3.282 ms [3.237 ms, 3.327 ms] 2.085 ms (174.2%)
iast_FULL 5.888 ms [5.83 ms, 5.947 ms] 4.691 ms (391.9%)
iast_GLOBAL 3.662 ms [3.601 ms, 3.723 ms] 2.465 ms (205.9%)
profiling 2.141 ms [2.121 ms, 2.161 ms] 944.296 µs (78.9%)
tracing 1.783 ms [1.768 ms, 1.797 ms] 585.803 µs (48.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/spotless-attempt-2-applied
git_commit_date 1761745018 1761746905
git_commit_sha 8747faa c8d5fd3
release_version 1.55.0-SNAPSHOT~8747faa1b4 1.55.0-SNAPSHOT~c8d5fd3206
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1761748969 1761748969
ci_job_id 1204341688 1204341688
ci_pipeline_id 80614037 80614037
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-2ap7hf81 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-2ap7hf81 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~c8d5fd3206, baseline=1.55.0-SNAPSHOT~8747faa1b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.977 s) : 14977000, 14977000
.   : milestone, 14977000,
appsec (14.769 s) : 14769000, 14769000
.   : milestone, 14769000,
iast (18.441 s) : 18441000, 18441000
.   : milestone, 18441000,
iast_GLOBAL (17.889 s) : 17889000, 17889000
.   : milestone, 17889000,
profiling (15.521 s) : 15521000, 15521000
.   : milestone, 15521000,
tracing (15.125 s) : 15125000, 15125000
.   : milestone, 15125000,
section candidate
no_agent (15.185 s) : 15185000, 15185000
.   : milestone, 15185000,
appsec (14.793 s) : 14793000, 14793000
.   : milestone, 14793000,
iast (18.722 s) : 18722000, 18722000
.   : milestone, 18722000,
iast_GLOBAL (17.802 s) : 17802000, 17802000
.   : milestone, 17802000,
profiling (15.226 s) : 15226000, 15226000
.   : milestone, 15226000,
tracing (15.125 s) : 15125000, 15125000
.   : milestone, 15125000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.977 s [14.977 s, 14.977 s] -
appsec 14.769 s [14.769 s, 14.769 s] -208.0 ms (-1.4%)
iast 18.441 s [18.441 s, 18.441 s] 3.464 s (23.1%)
iast_GLOBAL 17.889 s [17.889 s, 17.889 s] 2.912 s (19.4%)
profiling 15.521 s [15.521 s, 15.521 s] 544.0 ms (3.6%)
tracing 15.125 s [15.125 s, 15.125 s] 148.0 ms (1.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.185 s [15.185 s, 15.185 s] -
appsec 14.793 s [14.793 s, 14.793 s] -392.0 ms (-2.6%)
iast 18.722 s [18.722 s, 18.722 s] 3.537 s (23.3%)
iast_GLOBAL 17.802 s [17.802 s, 17.802 s] 2.617 s (17.2%)
profiling 15.226 s [15.226 s, 15.226 s] 41.0 ms (0.3%)
tracing 15.125 s [15.125 s, 15.125 s] -60.0 ms (-0.4%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.55.0-SNAPSHOT~c8d5fd3206, baseline=1.55.0-SNAPSHOT~8747faa1b4
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1496
.   : milestone, 1485,
appsec (2.523 ms) : 2469, 2577
.   : milestone, 2523,
iast (2.218 ms) : 2154, 2281
.   : milestone, 2218,
iast_GLOBAL (2.271 ms) : 2206, 2335
.   : milestone, 2271,
profiling (2.482 ms) : 2314, 2649
.   : milestone, 2482,
tracing (2.045 ms) : 1996, 2095
.   : milestone, 2045,
section candidate
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (3.669 ms) : 3455, 3882
.   : milestone, 3669,
iast (2.217 ms) : 2154, 2281
.   : milestone, 2217,
iast_GLOBAL (2.261 ms) : 2197, 2325
.   : milestone, 2261,
profiling (2.066 ms) : 2014, 2118
.   : milestone, 2066,
tracing (2.025 ms) : 1976, 2074
.   : milestone, 2025,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.496 ms] -
appsec 2.523 ms [2.469 ms, 2.577 ms] 1.039 ms (70.0%)
iast 2.218 ms [2.154 ms, 2.281 ms] 733.073 µs (49.4%)
iast_GLOBAL 2.271 ms [2.206 ms, 2.335 ms] 785.956 µs (52.9%)
profiling 2.482 ms [2.314 ms, 2.649 ms] 997.051 µs (67.2%)
tracing 2.045 ms [1.996 ms, 2.095 ms] 560.888 µs (37.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.493 ms] -
appsec 3.669 ms [3.455 ms, 3.882 ms] 2.188 ms (147.7%)
iast 2.217 ms [2.154 ms, 2.281 ms] 736.448 µs (49.7%)
iast_GLOBAL 2.261 ms [2.197 ms, 2.325 ms] 780.152 µs (52.7%)
profiling 2.066 ms [2.014 ms, 2.118 ms] 585.07 µs (39.5%)
tracing 2.025 ms [1.976 ms, 2.074 ms] 543.967 µs (36.7%)

@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/spotless-attempt-2-applied
git_commit_date 1761745018 1761746905
git_commit_sha 8747faa c8d5fd3
See matching parameters
Baseline Candidate
ci_job_date 1761748008 1761748008
ci_job_id 1204341694 1204341694
ci_pipeline_id 80614037 80614037
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce unsure
[+960.989op/s; +7199.036op/s] or [+0.612%; +4.581%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/spotless-attempt-2-applied
git_commit_date 1761745018 1761746905
git_commit_sha 8747faa c8d5fd3
See matching parameters
Baseline Candidate
ci_job_date 1761748052 1761748052
ci_job_id 1204341695 1204341695
ci_pipeline_id 80614037 80614037
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the alexeyk/spotless-attempt-2-applied branch October 29, 2025 19:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: do not merge Do not merge changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants