Skip to content

Default LLM Observability ML Application to Service Name #9415

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Sep 5, 2025
Merged

Default LLM Observability ML Application to Service Name #9415

merged 4 commits into from
Sep 5, 2025

Conversation

sabrenner
Copy link
Contributor

@sabrenner sabrenner commented Aug 23, 2025 •
edited
Loading

What Does This Do

Makes the -Ddd.llmobs.ml.app or DD_LLMOBS_ML_APP configurations optional by removing an IllegalArgumentException when it is either null or empty, instead defaulting to the service name.

Motivation

Easier onboarding for LLM Observability. Often, when there is no clear direction for an ML application configuration, and/or it aligns directly with the service itself, it's more friction to figure out what value ML application should take, especially after seeing a hard exception thrown during configuration when you just want to enable LLM Observability. This change seeks to reduce that friction by just defaulting it to the service name. A user can still set it to something better suited for an ML application description/name, especially if the service hosts multiple ML applications

Additional Notes

Contributor Checklist

Jira ticket: MLOB-3635

@sabrenner sabrenner added type: enhancement Enhancements and improvements comp: mlobs ML Observability (LLMObs) labels Aug 23, 2025
@pr-commenter
Copy link

pr-commenter bot commented Aug 23, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sabrenner/llmobs-ml-app-optional
git_commit_date 1756901714 1756904346
git_commit_sha 030f9bb f4fe857
release_version 1.53.0-SNAPSHOT~030f9bbb36 1.53.0-SNAPSHOT~f4fe857abf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756906213 1756906213
ci_job_id 1110984113 1110984113
ci_pipeline_id 75406650 75406650
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-glvn8iis 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-glvn8iis 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 13 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~f4fe857abf, baseline=1.53.0-SNAPSHOT~030f9bbb36

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053667
Total [baseline] (8.682 s) : 0, 8682133
Agent [candidate] (1.058 s) : 0, 1058155
Total [candidate] (8.644 s) : 0, 8644031
section iast
Agent [baseline] (1.192 s) : 0, 1191936
Total [baseline] (9.384 s) : 0, 9384234
Agent [candidate] (1.19 s) : 0, 1189673
Total [candidate] (9.401 s) : 0, 9401195
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent iast 1.192 s 138.27 ms (13.1%)
Total tracing 8.682 s -
Total iast 9.384 s 702.101 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.19 s 131.518 ms (12.4%)
Total tracing 8.644 s -
Total iast 9.401 s 757.163 ms (8.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~f4fe857abf, baseline=1.53.0-SNAPSHOT~030f9bbb36

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (736.064 ms) : 0, 736064
BytebuddyAgent [candidate] (740.221 ms) : 0, 740221
GlobalTracer [baseline] (244.12 ms) : 0, 244120
GlobalTracer [candidate] (245.027 ms) : 0, 245027
AppSec [baseline] (30.271 ms) : 0, 30271
AppSec [candidate] (30.312 ms) : 0, 30312
Debugger [baseline] (6.121 ms) : 0, 6121
Debugger [candidate] (6.083 ms) : 0, 6083
Remote Config [baseline] (681.634 µs) : 0, 682
Remote Config [candidate] (677.582 µs) : 0, 678
Telemetry [baseline] (13.871 ms) : 0, 13871
Telemetry [candidate] (13.199 ms) : 0, 13199
section iast
crashtracking [baseline] (1.485 ms) : 0, 1485
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (861.408 ms) : 0, 861408
BytebuddyAgent [candidate] (859.558 ms) : 0, 859558
GlobalTracer [baseline] (235.484 ms) : 0, 235484
GlobalTracer [candidate] (234.927 ms) : 0, 234927
IAST [baseline] (28.722 ms) : 0, 28722
IAST [candidate] (30.614 ms) : 0, 30614
AppSec [baseline] (27.913 ms) : 0, 27913
AppSec [candidate] (27.05 ms) : 0, 27050
Debugger [baseline] (6.65 ms) : 0, 6650
Debugger [candidate] (5.809 ms) : 0, 5809
Remote Config [baseline] (627.337 µs) : 0, 627
Remote Config [candidate] (616.953 µs) : 0, 617
Telemetry [baseline] (8.435 ms) : 0, 8435
Telemetry [candidate] (8.477 ms) : 0, 8477
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~f4fe857abf, baseline=1.53.0-SNAPSHOT~030f9bbb36

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051456
Total [baseline] (10.8 s) : 0, 10800222
Agent [candidate] (1.052 s) : 0, 1052205
Total [candidate] (10.699 s) : 0, 10698952
section appsec
Agent [baseline] (1.226 s) : 0, 1226103
Total [baseline] (10.866 s) : 0, 10865551
Agent [candidate] (1.23 s) : 0, 1229589
Total [candidate] (10.826 s) : 0, 10826282
section iast
Agent [baseline] (1.197 s) : 0, 1196816
Total [baseline] (11.099 s) : 0, 11099110
Agent [candidate] (1.188 s) : 0, 1187774
Total [candidate] (11.012 s) : 0, 11012447
section profiling
Agent [baseline] (1.201 s) : 0, 1200986
Total [baseline] (10.947 s) : 0, 10946932
Agent [candidate] (1.198 s) : 0, 1197580
Total [candidate] (10.88 s) : 0, 10879748
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent appsec 1.226 s 174.647 ms (16.6%)
Agent iast 1.197 s 145.36 ms (13.8%)
Agent profiling 1.201 s 149.53 ms (14.2%)
Total tracing 10.8 s -
Total appsec 10.866 s 65.329 ms (0.6%)
Total iast 11.099 s 298.888 ms (2.8%)
Total profiling 10.947 s 146.71 ms (1.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.23 s 177.384 ms (16.9%)
Agent iast 1.188 s 135.569 ms (12.9%)
Agent profiling 1.198 s 145.376 ms (13.8%)
Total tracing 10.699 s -
Total appsec 10.826 s 127.33 ms (1.2%)
Total iast 11.012 s 313.495 ms (2.9%)
Total profiling 10.88 s 180.795 ms (1.7%) 
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~f4fe857abf, baseline=1.53.0-SNAPSHOT~030f9bbb36

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (735.359 ms) : 0, 735359
BytebuddyAgent [candidate] (735.413 ms) : 0, 735413
GlobalTracer [baseline] (243.526 ms) : 0, 243526
GlobalTracer [candidate] (243.682 ms) : 0, 243682
AppSec [baseline] (30.24 ms) : 0, 30240
AppSec [candidate] (30.136 ms) : 0, 30136
Debugger [baseline] (6.067 ms) : 0, 6067
Debugger [candidate] (6.045 ms) : 0, 6045
Remote Config [baseline] (684.402 µs) : 0, 684
Remote Config [candidate] (663.889 µs) : 0, 664
Telemetry [baseline] (12.952 ms) : 0, 12952
Telemetry [candidate] (13.676 ms) : 0, 13676
section appsec
crashtracking [baseline] (1.453 ms) : 0, 1453
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (757.279 ms) : 0, 757279
BytebuddyAgent [candidate] (759.788 ms) : 0, 759788
GlobalTracer [baseline] (235.679 ms) : 0, 235679
GlobalTracer [candidate] (236.474 ms) : 0, 236474
IAST [baseline] (23.575 ms) : 0, 23575
IAST [candidate] (23.591 ms) : 0, 23591
AppSec [baseline] (171.958 ms) : 0, 171958
AppSec [candidate] (170.548 ms) : 0, 170548
Debugger [baseline] (5.821 ms) : 0, 5821
Debugger [candidate] (6.584 ms) : 0, 6584
Remote Config [baseline] (642.636 µs) : 0, 643
Remote Config [candidate] (646.054 µs) : 0, 646
Telemetry [baseline] (8.485 ms) : 0, 8485
Telemetry [candidate] (9.273 ms) : 0, 9273
section iast
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (865.139 ms) : 0, 865139
BytebuddyAgent [candidate] (857.273 ms) : 0, 857273
GlobalTracer [baseline] (235.68 ms) : 0, 235680
GlobalTracer [candidate] (234.125 ms) : 0, 234125
IAST [baseline] (28.263 ms) : 0, 28263
IAST [candidate] (30.64 ms) : 0, 30640
AppSec [baseline] (27.376 ms) : 0, 27376
AppSec [candidate] (28.026 ms) : 0, 28026
Debugger [baseline] (8.381 ms) : 0, 8381
Debugger [candidate] (5.843 ms) : 0, 5843
Remote Config [baseline] (632.068 µs) : 0, 632
Remote Config [candidate] (635.891 µs) : 0, 636
Telemetry [baseline] (8.5 ms) : 0, 8500
Telemetry [candidate] (8.503 ms) : 0, 8503
section profiling
crashtracking [baseline] (1.455 ms) : 0, 1455
crashtracking [candidate] (1.444 ms) : 0, 1444
BytebuddyAgent [baseline] (764.27 ms) : 0, 764270
BytebuddyAgent [candidate] (762.177 ms) : 0, 762177
GlobalTracer [baseline] (223.023 ms) : 0, 223023
GlobalTracer [candidate] (222.866 ms) : 0, 222866
AppSec [baseline] (30.127 ms) : 0, 30127
AppSec [candidate] (29.825 ms) : 0, 29825
Debugger [baseline] (6.304 ms) : 0, 6304
Debugger [candidate] (6.299 ms) : 0, 6299
Remote Config [baseline] (714.242 µs) : 0, 714
Remote Config [candidate] (688.196 µs) : 0, 688
Telemetry [baseline] (16.363 ms) : 0, 16363
Telemetry [candidate] (16.306 ms) : 0, 16306
ProfilingAgent [baseline] (108.191 ms) : 0, 108191
ProfilingAgent [candidate] (107.507 ms) : 0, 107507
Profiling [baseline] (108.862 ms) : 0, 108862
Profiling [candidate] (108.15 ms) : 0, 108150
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sabrenner/llmobs-ml-app-optional
git_commit_date 1756901714 1756904346
git_commit_sha 030f9bb f4fe857
release_version 1.53.0-SNAPSHOT~030f9bbb36 1.53.0-SNAPSHOT~f4fe857abf
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1756905944 1756905944
ci_job_id 1110984114 1110984114
ci_pipeline_id 75406650 75406650
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-ntq6074k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-ntq6074k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load better
[-393.898µs; -279.905µs] or [-8.603%; -6.114%]		 unstable
[-52.585op/s; +208.585op/s] or [-5.242%; +20.792%]		 4.241ms 1081.219op/s 4.578ms 1003.219op/s
scenario:load:petclinic:no_agent:high_load better
[-1.988ms; -1.321ms] or [-5.091%; -3.384%]		 unstable
[-3.063op/s; +13.513op/s] or [-2.556%; +11.278%]		 37.384ms 125.037op/s 39.038ms 119.812op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~f4fe857abf, baseline=1.53.0-SNAPSHOT~030f9bbb36
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.578 ms) : 4520, 4637
.   : milestone, 4578,
iast (9.465 ms) : 9301, 9629
.   : milestone, 9465,
iast_FULL (14.176 ms) : 13894, 14459
.   : milestone, 14176,
iast_GLOBAL (10.294 ms) : 10112, 10476
.   : milestone, 10294,
profiling (9.103 ms) : 8963, 9244
.   : milestone, 9103,
tracing (7.41 ms) : 7299, 7520
.   : milestone, 7410,
section candidate
no_agent (4.241 ms) : 4195, 4288
.   : milestone, 4241,
iast (9.507 ms) : 9346, 9668
.   : milestone, 9507,
iast_FULL (14.306 ms) : 14020, 14593
.   : milestone, 14306,
iast_GLOBAL (10.056 ms) : 9865, 10248
.   : milestone, 10056,
profiling (9.005 ms) : 8858, 9152
.   : milestone, 9005,
tracing (7.616 ms) : 7498, 7734
.   : milestone, 7616,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.578 ms [4.52 ms, 4.637 ms] -
iast 9.465 ms [9.301 ms, 9.629 ms] 4.886 ms (106.7%)
iast_FULL 14.176 ms [13.894 ms, 14.459 ms] 9.598 ms (209.6%)
iast_GLOBAL 10.294 ms [10.112 ms, 10.476 ms] 5.716 ms (124.8%)
profiling 9.103 ms [8.963 ms, 9.244 ms] 4.525 ms (98.8%)
tracing 7.41 ms [7.299 ms, 7.52 ms] 2.831 ms (61.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.241 ms [4.195 ms, 4.288 ms] -
iast 9.507 ms [9.346 ms, 9.668 ms] 5.265 ms (124.1%)
iast_FULL 14.306 ms [14.02 ms, 14.593 ms] 10.065 ms (237.3%)
iast_GLOBAL 10.056 ms [9.865 ms, 10.248 ms] 5.815 ms (137.1%)
profiling 9.005 ms [8.858 ms, 9.152 ms] 4.764 ms (112.3%)
tracing 7.616 ms [7.498 ms, 7.734 ms] 3.375 ms (79.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~f4fe857abf, baseline=1.53.0-SNAPSHOT~030f9bbb36
    dateFormat X
    axisFormat %s
section baseline
no_agent (39.038 ms) : 38728, 39349
.   : milestone, 39038,
appsec (47.192 ms) : 46789, 47595
.   : milestone, 47192,
code_origins (45.493 ms) : 45099, 45886
.   : milestone, 45493,
iast (44.945 ms) : 44544, 45346
.   : milestone, 44945,
profiling (47.77 ms) : 47323, 48216
.   : milestone, 47770,
tracing (45.652 ms) : 45265, 46039
.   : milestone, 45652,
section candidate
no_agent (37.384 ms) : 37075, 37693
.   : milestone, 37384,
appsec (48.251 ms) : 47823, 48678
.   : milestone, 48251,
code_origins (45.715 ms) : 45309, 46121
.   : milestone, 45715,
iast (45.23 ms) : 44837, 45623
.   : milestone, 45230,
profiling (48.89 ms) : 48466, 49315
.   : milestone, 48890,
tracing (45.982 ms) : 45585, 46378
.   : milestone, 45982,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 39.038 ms [38.728 ms, 39.349 ms] -
appsec 47.192 ms [46.789 ms, 47.595 ms] 8.154 ms (20.9%)
code_origins 45.493 ms [45.099 ms, 45.886 ms] 6.454 ms (16.5%)
iast 44.945 ms [44.544 ms, 45.346 ms] 5.907 ms (15.1%)
profiling 47.77 ms [47.323 ms, 48.216 ms] 8.731 ms (22.4%)
tracing 45.652 ms [45.265 ms, 46.039 ms] 6.614 ms (16.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.384 ms [37.075 ms, 37.693 ms] -
appsec 48.251 ms [47.823 ms, 48.678 ms] 10.866 ms (29.1%)
code_origins 45.715 ms [45.309 ms, 46.121 ms] 8.331 ms (22.3%)
iast 45.23 ms [44.837 ms, 45.623 ms] 7.846 ms (21.0%)
profiling 48.89 ms [48.466 ms, 49.315 ms] 11.506 ms (30.8%)
tracing 45.982 ms [45.585 ms, 46.378 ms] 8.597 ms (23.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sabrenner/llmobs-ml-app-optional
git_commit_date 1756901714 1756904346
git_commit_sha 030f9bb f4fe857
release_version 1.53.0-SNAPSHOT~030f9bbb36 1.53.0-SNAPSHOT~f4fe857abf
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1756906394 1756906394
ci_job_id 1110984115 1110984115
ci_pipeline_id 75406650 75406650
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gs7ohabc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gs7ohabc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~f4fe857abf, baseline=1.53.0-SNAPSHOT~030f9bbb36
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (3.663 ms) : 3446, 3881
.   : milestone, 3663,
iast (2.194 ms) : 2132, 2257
.   : milestone, 2194,
iast_GLOBAL (2.243 ms) : 2179, 2306
.   : milestone, 2243,
profiling (2.038 ms) : 1988, 2089
.   : milestone, 2038,
tracing (2.007 ms) : 1958, 2056
.   : milestone, 2007,
section candidate
no_agent (1.472 ms) : 1461, 1483
.   : milestone, 1472,
appsec (3.654 ms) : 3435, 3872
.   : milestone, 3654,
iast (2.196 ms) : 2133, 2259
.   : milestone, 2196,
iast_GLOBAL (2.236 ms) : 2173, 2300
.   : milestone, 2236,
profiling (2.488 ms) : 2321, 2656
.   : milestone, 2488,
tracing (2.012 ms) : 1963, 2061
.   : milestone, 2012,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 3.663 ms [3.446 ms, 3.881 ms] 2.196 ms (149.6%)
iast 2.194 ms [2.132 ms, 2.257 ms] 726.546 µs (49.5%)
iast_GLOBAL 2.243 ms [2.179 ms, 2.306 ms] 774.698 µs (52.8%)
profiling 2.038 ms [1.988 ms, 2.089 ms] 570.441 µs (38.9%)
tracing 2.007 ms [1.958 ms, 2.056 ms] 539.246 µs (36.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.483 ms] -
appsec 3.654 ms [3.435 ms, 3.872 ms] 2.182 ms (148.2%)
iast 2.196 ms [2.133 ms, 2.259 ms] 724.477 µs (49.2%)
iast_GLOBAL 2.236 ms [2.173 ms, 2.3 ms] 764.209 µs (51.9%)
profiling 2.488 ms [2.321 ms, 2.656 ms] 1.016 ms (69.1%)
tracing 2.012 ms [1.963 ms, 2.061 ms] 540.068 µs (36.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~f4fe857abf, baseline=1.53.0-SNAPSHOT~030f9bbb36
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.885 s) : 14885000, 14885000
.   : milestone, 14885000,
appsec (14.921 s) : 14921000, 14921000
.   : milestone, 14921000,
iast (18.447 s) : 18447000, 18447000
.   : milestone, 18447000,
iast_GLOBAL (17.761 s) : 17761000, 17761000
.   : milestone, 17761000,
profiling (15.666 s) : 15666000, 15666000
.   : milestone, 15666000,
tracing (15.13 s) : 15130000, 15130000
.   : milestone, 15130000,
section candidate
no_agent (15.496 s) : 15496000, 15496000
.   : milestone, 15496000,
appsec (14.804 s) : 14804000, 14804000
.   : milestone, 14804000,
iast (18.206 s) : 18206000, 18206000
.   : milestone, 18206000,
iast_GLOBAL (18.166 s) : 18166000, 18166000
.   : milestone, 18166000,
profiling (15.27 s) : 15270000, 15270000
.   : milestone, 15270000,
tracing (14.884 s) : 14884000, 14884000
.   : milestone, 14884000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.885 s [14.885 s, 14.885 s] -
appsec 14.921 s [14.921 s, 14.921 s] 36.0 ms (0.2%)
iast 18.447 s [18.447 s, 18.447 s] 3.562 s (23.9%)
iast_GLOBAL 17.761 s [17.761 s, 17.761 s] 2.876 s (19.3%)
profiling 15.666 s [15.666 s, 15.666 s] 781.0 ms (5.2%)
tracing 15.13 s [15.13 s, 15.13 s] 245.0 ms (1.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.496 s [15.496 s, 15.496 s] -
appsec 14.804 s [14.804 s, 14.804 s] -692.0 ms (-4.5%)
iast 18.206 s [18.206 s, 18.206 s] 2.71 s (17.5%)
iast_GLOBAL 18.166 s [18.166 s, 18.166 s] 2.67 s (17.2%)
profiling 15.27 s [15.27 s, 15.27 s] -226.0 ms (-1.5%)
tracing 14.884 s [14.884 s, 14.884 s] -612.0 ms (-3.9%)

@datadog-official Datadog Official
Copy link

datadog-official bot commented Sep 3, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 0.00%
• Total Coverage: 57.64% (+0.01%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: f4fe857 | Docs | Was this helpful? Give us feedback!

@sabrenner sabrenner marked this pull request as ready for review September 5, 2025 13:31
@sabrenner sabrenner requested a review from a team as a code owner September 5, 2025 13:31
@sabrenner sabrenner requested a review from mcculls September 5, 2025 13:31
@sabrenner sabrenner merged commit cb08250 into master Sep 5, 2025
831 of 847 checks passed
@sabrenner sabrenner deleted the sabrenner/llmobs-ml-app-optional branch September 5, 2025 14:12
@github-actions github-actions bot added this to the 1.54.0 milestone Sep 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@gary-huang gary-huang gary-huang approved these changes

@mcculls mcculls Awaiting requested review from mcculls mcculls is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: mlobs ML Observability (LLMObs) type: enhancement Enhancements and improvements
Projects
None yet
Milestone
1.54.0
Development

Successfully merging this pull request may close these issues.
2 participants
@sabrenner @gary-huang