Skip to content

fix(llmobs): trace batching and payload size telemetry #10395

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
ygree wants to merge 3 commits into
base: master
Choose a base branch
from
Open

fix(llmobs): trace batching and payload size telemetry #10395

ygree wants to merge 3 commits into from
+145 −23

Conversation

@ygree
Copy link
Contributor

@ygree ygree commented Jan 17, 2026 •
edited
Loading

What Does This Do

Fix sending multiple LLM Obs traces per request.
Previously, llm-obs-events-processor only recognized the first trace per request and ignored the rest.

Fix sizeInBytes calculation for metrics and logging.
Previously, it was the size of the entire buffer rather than of the actual number of bytes for the request

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

ygree added 3 commits January 16, 2026 16:44
@ygree
Reproduce the issue of serializing more than one LLM Obs trace into o…
8ccc540 
…ne request.
@ygree
Reproduce the issue of sizeInBytes calculation in LLMObsSpanMapper.
69155bf
@ygree
Fix sending multiple LLM Obs traces per request.
7746033 
Previously, llm-obs-events-processor only recognized the first trace per request and ignored the rest.

Fix sizeInBytes calculation for metrics and logging.
Previously, it was the size of the entire buffer rather than of the actual number of bytes for the request
@ygree ygree self-assigned this Jan 17, 2026
@ygree ygree added type: bug Bug report and fix comp: mlobs ML Observability (LLMObs) labels Jan 17, 2026
@ygree ygree changed the title fix(llmobs): trace batching fix(llmobs): trace batching and payload size stats Jan 17, 2026
@ygree ygree modified the milestones: 1.59.0, 1.58.2 Jan 17, 2026
@ygree ygree marked this pull request as ready for review January 17, 2026 01:30
@ygree ygree requested review from a team as code owners January 17, 2026 01:30
@ygree ygree requested a review from amarziali January 17, 2026 01:30
@ygree ygree enabled auto-merge (squash) January 17, 2026 01:30
@ygree ygree changed the title fix(llmobs): trace batching and payload size stats fix(llmobs): trace batching and payload size telemetry Jan 17, 2026
@pr-commenter
Copy link

pr-commenter bot commented Jan 17, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/fix-llmobs-trace-batching
git_commit_date 1768586118 1768612049
git_commit_sha 189c0b6 7746033
release_version 1.59.0-SNAPSHOT~189c0b6c76 1.59.0-SNAPSHOT~7746033211
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768614077 1768614077
ci_job_id 1357524199 1357524199
ci_pipeline_id 91220248 91220248
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qsq0g9ol 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qsq0g9ol 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 7 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~7746033211, baseline=1.59.0-SNAPSHOT~189c0b6c76

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.089 s) : 0, 1089404
Total [baseline] (10.779 s) : 0, 10778824
Agent [candidate] (1.089 s) : 0, 1088964
Total [candidate] (10.778 s) : 0, 10777551
section appsec
Agent [baseline] (1.266 s) : 0, 1265810
Total [baseline] (11.058 s) : 0, 11058434
Agent [candidate] (1.267 s) : 0, 1266683
Total [candidate] (11.056 s) : 0, 11055511
section iast
Agent [baseline] (1.223 s) : 0, 1223289
Total [baseline] (11.233 s) : 0, 11232563
Agent [candidate] (1.229 s) : 0, 1228911
Total [candidate] (11.126 s) : 0, 11126143
section profiling
Agent [baseline] (1.202 s) : 0, 1201853
Total [baseline] (10.997 s) : 0, 10997339
Agent [candidate] (1.206 s) : 0, 1205895
Total [candidate] (10.898 s) : 0, 10898397
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.089 s -
Agent appsec 1.266 s 176.406 ms (16.2%)
Agent iast 1.223 s 133.885 ms (12.3%)
Agent profiling 1.202 s 112.448 ms (10.3%)
Total tracing 10.779 s -
Total appsec 11.058 s 279.61 ms (2.6%)
Total iast 11.233 s 453.738 ms (4.2%)
Total profiling 10.997 s 218.514 ms (2.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.089 s -
Agent appsec 1.267 s 177.72 ms (16.3%)
Agent iast 1.229 s 139.948 ms (12.9%)
Agent profiling 1.206 s 116.932 ms (10.7%)
Total tracing 10.778 s -
Total appsec 11.056 s 277.96 ms (2.6%)
Total iast 11.126 s 348.592 ms (3.2%)
Total profiling 10.898 s 120.846 ms (1.1%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~7746033211, baseline=1.59.0-SNAPSHOT~189c0b6c76

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (653.126 ms) : 0, 653126
BytebuddyAgent [candidate] (653.095 ms) : 0, 653095
GlobalTracer [baseline] (284.075 ms) : 0, 284075
GlobalTracer [candidate] (284.352 ms) : 0, 284352
AppSec [baseline] (33.182 ms) : 0, 33182
AppSec [candidate] (32.897 ms) : 0, 32897
Debugger [baseline] (68.659 ms) : 0, 68659
Debugger [candidate] (68.162 ms) : 0, 68162
Remote Config [baseline] (643.425 µs) : 0, 643
Remote Config [candidate] (628.409 µs) : 0, 628
Telemetry [baseline] (9.082 ms) : 0, 9082
Telemetry [candidate] (9.054 ms) : 0, 9054
Flare Poller [baseline] (3.835 ms) : 0, 3835
Flare Poller [candidate] (3.876 ms) : 0, 3876
section appsec
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (691.108 ms) : 0, 691108
BytebuddyAgent [candidate] (691.556 ms) : 0, 691556
GlobalTracer [baseline] (258.503 ms) : 0, 258503
GlobalTracer [candidate] (259.019 ms) : 0, 259019
AppSec [baseline] (172.126 ms) : 0, 172126
AppSec [candidate] (172.756 ms) : 0, 172756
Debugger [baseline] (68.961 ms) : 0, 68961
Debugger [candidate] (67.933 ms) : 0, 67933
Remote Config [baseline] (782.289 µs) : 0, 782
Remote Config [candidate] (797.424 µs) : 0, 797
Telemetry [baseline] (9.344 ms) : 0, 9344
Telemetry [candidate] (9.381 ms) : 0, 9381
Flare Poller [baseline] (3.813 ms) : 0, 3813
Flare Poller [candidate] (3.796 ms) : 0, 3796
IAST [baseline] (24.511 ms) : 0, 24511
IAST [candidate] (24.69 ms) : 0, 24690
section iast
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (789.834 ms) : 0, 789834
BytebuddyAgent [candidate] (794.242 ms) : 0, 794242
GlobalTracer [baseline] (256.003 ms) : 0, 256003
GlobalTracer [candidate] (257.218 ms) : 0, 257218
AppSec [baseline] (34.673 ms) : 0, 34673
AppSec [candidate] (35.413 ms) : 0, 35413
Debugger [baseline] (66.306 ms) : 0, 66306
Debugger [candidate] (65.451 ms) : 0, 65451
Remote Config [baseline] (590.415 µs) : 0, 590
Remote Config [candidate] (567.157 µs) : 0, 567
Telemetry [baseline] (8.629 ms) : 0, 8629
Telemetry [candidate] (8.521 ms) : 0, 8521
Flare Poller [baseline] (3.612 ms) : 0, 3612
Flare Poller [candidate] (3.569 ms) : 0, 3569
IAST [baseline] (27.038 ms) : 0, 27038
IAST [candidate] (27.195 ms) : 0, 27195
section profiling
crashtracking [baseline] (1.215 ms) : 0, 1215
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (700.35 ms) : 0, 700350
BytebuddyAgent [candidate] (702.028 ms) : 0, 702028
GlobalTracer [baseline] (220.595 ms) : 0, 220595
GlobalTracer [candidate] (220.966 ms) : 0, 220966
AppSec [baseline] (32.29 ms) : 0, 32290
AppSec [candidate] (32.26 ms) : 0, 32260
Debugger [baseline] (67.782 ms) : 0, 67782
Debugger [candidate] (68.162 ms) : 0, 68162
Remote Config [baseline] (652.911 µs) : 0, 653
Remote Config [candidate] (670.807 µs) : 0, 671
Telemetry [baseline] (8.93 ms) : 0, 8930
Telemetry [candidate] (8.86 ms) : 0, 8860
Flare Poller [baseline] (3.748 ms) : 0, 3748
Flare Poller [candidate] (3.745 ms) : 0, 3745
ProfilingAgent [baseline] (96.542 ms) : 0, 96542
ProfilingAgent [candidate] (98.051 ms) : 0, 98051
Profiling [baseline] (97.124 ms) : 0, 97124
Profiling [candidate] (98.659 ms) : 0, 98659
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~7746033211, baseline=1.59.0-SNAPSHOT~189c0b6c76

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.087 s) : 0, 1087019
Total [baseline] (8.765 s) : 0, 8764562
Agent [candidate] (1.081 s) : 0, 1080922
Total [candidate] (8.774 s) : 0, 8774166
section iast
Agent [baseline] (1.227 s) : 0, 1226688
Total [baseline] (9.327 s) : 0, 9326551
Agent [candidate] (1.231 s) : 0, 1231391
Total [candidate] (9.377 s) : 0, 9377466
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.087 s -
Agent iast 1.227 s 139.669 ms (12.8%)
Total tracing 8.765 s -
Total iast 9.327 s 561.989 ms (6.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.081 s -
Agent iast 1.231 s 150.468 ms (13.9%)
Total tracing 8.774 s -
Total iast 9.377 s 603.3 ms (6.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~7746033211, baseline=1.59.0-SNAPSHOT~189c0b6c76

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (652.244 ms) : 0, 652244
BytebuddyAgent [candidate] (648.975 ms) : 0, 648975
GlobalTracer [baseline] (283.745 ms) : 0, 283745
GlobalTracer [candidate] (282.159 ms) : 0, 282159
AppSec [baseline] (32.824 ms) : 0, 32824
AppSec [candidate] (32.759 ms) : 0, 32759
Debugger [baseline] (67.753 ms) : 0, 67753
Debugger [candidate] (66.975 ms) : 0, 66975
Remote Config [baseline] (653.067 µs) : 0, 653
Remote Config [candidate] (668.06 µs) : 0, 668
Telemetry [baseline] (9.11 ms) : 0, 9110
Telemetry [candidate] (8.919 ms) : 0, 8919
Flare Poller [baseline] (3.855 ms) : 0, 3855
Flare Poller [candidate] (3.814 ms) : 0, 3814
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (794.576 ms) : 0, 794576
BytebuddyAgent [candidate] (796.408 ms) : 0, 796408
GlobalTracer [baseline] (256.059 ms) : 0, 256059
GlobalTracer [candidate] (258.521 ms) : 0, 258521
AppSec [baseline] (33.626 ms) : 0, 33626
AppSec [candidate] (35.562 ms) : 0, 35562
Debugger [baseline] (65.878 ms) : 0, 65878
Debugger [candidate] (64.154 ms) : 0, 64154
Remote Config [baseline] (600.959 µs) : 0, 601
Remote Config [candidate] (579.007 µs) : 0, 579
Telemetry [baseline] (8.564 ms) : 0, 8564
Telemetry [candidate] (8.554 ms) : 0, 8554
Flare Poller [baseline] (3.619 ms) : 0, 3619
Flare Poller [candidate] (3.62 ms) : 0, 3620
IAST [baseline] (27.033 ms) : 0, 27033
IAST [candidate] (27.27 ms) : 0, 27270
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/fix-llmobs-trace-batching
git_commit_date 1768586118 1768612049
git_commit_sha 189c0b6 7746033
release_version 1.59.0-SNAPSHOT~189c0b6c76 1.59.0-SNAPSHOT~7746033211
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768614732 1768614732
ci_job_id 1357524200 1357524200
ci_pipeline_id 91220248 91220248
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-kcfwzao3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-kcfwzao3 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load same
[-46.371µs; +256.259µs] or [-0.909%; +5.024%]		 worse
[+319.764µs; +1044.193µs] or [+2.665%; +8.701%]		 unstable
[-109.445op/s; +62.195op/s] or [-13.613%; +7.736%]		 5.205ms 12.683ms 780.375op/s 5.100ms 12.001ms 804.000op/s
scenario:load:insecure-bank:iast:high_load better
[-158.206µs; -56.407µs] or [-6.137%; -2.188%]		 same
[-359.087µs; +80.377µs] or [-4.757%; +1.065%]		 unstable
[-121.039op/s; +211.039op/s] or [-8.777%; +15.303%]		 2.471ms 7.410ms 1424.062op/s 2.578ms 7.549ms 1379.062op/s
scenario:load:petclinic:appsec:high_load better
[-1.709ms; -0.656ms] or [-8.734%; -3.355%]		 better
[-2.440ms; -0.686ms] or [-7.824%; -2.201%]		 unstable
[-13.327op/s; +37.390op/s] or [-5.616%; +15.755%]		 18.382ms 29.625ms 249.344op/s 19.565ms 31.189ms 237.312op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~7746033211, baseline=1.59.0-SNAPSHOT~189c0b6c76
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.106 ms) : 17923, 18290
.   : milestone, 18106,
appsec (19.673 ms) : 19471, 19874
.   : milestone, 19673,
code_origins (17.914 ms) : 17735, 18094
.   : milestone, 17914,
iast (17.742 ms) : 17568, 17916
.   : milestone, 17742,
profiling (18.485 ms) : 18298, 18672
.   : milestone, 18485,
tracing (17.588 ms) : 17415, 17760
.   : milestone, 17588,
section candidate
no_agent (17.273 ms) : 17099, 17447
.   : milestone, 17273,
appsec (18.72 ms) : 18532, 18908
.   : milestone, 18720,
code_origins (17.942 ms) : 17764, 18120
.   : milestone, 17942,
iast (18.071 ms) : 17888, 18253
.   : milestone, 18071,
profiling (18.614 ms) : 18428, 18801
.   : milestone, 18614,
tracing (17.741 ms) : 17564, 17918
.   : milestone, 17741,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.106 ms [17.923 ms, 18.29 ms] -
appsec 19.673 ms [19.471 ms, 19.874 ms] 1.566 ms (8.7%)
code_origins 17.914 ms [17.735 ms, 18.094 ms] -192.203 µs (-1.1%)
iast 17.742 ms [17.568 ms, 17.916 ms] -364.33 µs (-2.0%)
profiling 18.485 ms [18.298 ms, 18.672 ms] 378.84 µs (2.1%)
tracing 17.588 ms [17.415 ms, 17.76 ms] -518.418 µs (-2.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.273 ms [17.099 ms, 17.447 ms] -
appsec 18.72 ms [18.532 ms, 18.908 ms] 1.447 ms (8.4%)
code_origins 17.942 ms [17.764 ms, 18.12 ms] 669.126 µs (3.9%)
iast 18.071 ms [17.888 ms, 18.253 ms] 797.766 µs (4.6%)
profiling 18.614 ms [18.428 ms, 18.801 ms] 1.342 ms (7.8%)
tracing 17.741 ms [17.564 ms, 17.918 ms] 467.862 µs (2.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~7746033211, baseline=1.59.0-SNAPSHOT~189c0b6c76
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.19 ms) : 1178, 1202
.   : milestone, 1190,
iast (3.319 ms) : 3272, 3367
.   : milestone, 3319,
iast_FULL (5.749 ms) : 5692, 5806
.   : milestone, 5749,
iast_GLOBAL (3.651 ms) : 3598, 3704
.   : milestone, 3651,
profiling (2.084 ms) : 2066, 2102
.   : milestone, 2084,
tracing (1.812 ms) : 1796, 1827
.   : milestone, 1812,
section candidate
no_agent (1.183 ms) : 1172, 1195
.   : milestone, 1183,
iast (3.212 ms) : 3170, 3254
.   : milestone, 3212,
iast_FULL (5.926 ms) : 5866, 5986
.   : milestone, 5926,
iast_GLOBAL (3.552 ms) : 3495, 3608
.   : milestone, 3552,
profiling (1.997 ms) : 1979, 2014
.   : milestone, 1997,
tracing (1.789 ms) : 1774, 1804
.   : milestone, 1789,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.19 ms [1.178 ms, 1.202 ms] -
iast 3.319 ms [3.272 ms, 3.367 ms] 2.129 ms (178.9%)
iast_FULL 5.749 ms [5.692 ms, 5.806 ms] 4.559 ms (383.2%)
iast_GLOBAL 3.651 ms [3.598 ms, 3.704 ms] 2.461 ms (206.8%)
profiling 2.084 ms [2.066 ms, 2.102 ms] 894.242 µs (75.1%)
tracing 1.812 ms [1.796 ms, 1.827 ms] 621.88 µs (52.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.183 ms [1.172 ms, 1.195 ms] -
iast 3.212 ms [3.17 ms, 3.254 ms] 2.029 ms (171.5%)
iast_FULL 5.926 ms [5.866 ms, 5.986 ms] 4.742 ms (400.8%)
iast_GLOBAL 3.552 ms [3.495 ms, 3.608 ms] 2.368 ms (200.1%)
profiling 1.997 ms [1.979 ms, 2.014 ms] 813.555 µs (68.8%)
tracing 1.789 ms [1.774 ms, 1.804 ms] 605.663 µs (51.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/fix-llmobs-trace-batching
git_commit_date 1768586118 1768612049
git_commit_sha 189c0b6 7746033
release_version 1.59.0-SNAPSHOT~189c0b6c76 1.59.0-SNAPSHOT~7746033211
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1768614218 1768614218
ci_job_id 1357524201 1357524201
ci_pipeline_id 91220248 91220248
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-3jgtz10v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-3jgtz10v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~7746033211, baseline=1.59.0-SNAPSHOT~189c0b6c76
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.933 s) : 14933000, 14933000
.   : milestone, 14933000,
appsec (14.595 s) : 14595000, 14595000
.   : milestone, 14595000,
iast (18.219 s) : 18219000, 18219000
.   : milestone, 18219000,
iast_GLOBAL (18.045 s) : 18045000, 18045000
.   : milestone, 18045000,
profiling (14.718 s) : 14718000, 14718000
.   : milestone, 14718000,
tracing (14.711 s) : 14711000, 14711000
.   : milestone, 14711000,
section candidate
no_agent (15.434 s) : 15434000, 15434000
.   : milestone, 15434000,
appsec (14.533 s) : 14533000, 14533000
.   : milestone, 14533000,
iast (17.721 s) : 17721000, 17721000
.   : milestone, 17721000,
iast_GLOBAL (17.882 s) : 17882000, 17882000
.   : milestone, 17882000,
profiling (14.944 s) : 14944000, 14944000
.   : milestone, 14944000,
tracing (14.649 s) : 14649000, 14649000
.   : milestone, 14649000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.933 s [14.933 s, 14.933 s] -
appsec 14.595 s [14.595 s, 14.595 s] -338.0 ms (-2.3%)
iast 18.219 s [18.219 s, 18.219 s] 3.286 s (22.0%)
iast_GLOBAL 18.045 s [18.045 s, 18.045 s] 3.112 s (20.8%)
profiling 14.718 s [14.718 s, 14.718 s] -215.0 ms (-1.4%)
tracing 14.711 s [14.711 s, 14.711 s] -222.0 ms (-1.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.434 s [15.434 s, 15.434 s] -
appsec 14.533 s [14.533 s, 14.533 s] -901.0 ms (-5.8%)
iast 17.721 s [17.721 s, 17.721 s] 2.287 s (14.8%)
iast_GLOBAL 17.882 s [17.882 s, 17.882 s] 2.448 s (15.9%)
profiling 14.944 s [14.944 s, 14.944 s] -490.0 ms (-3.2%)
tracing 14.649 s [14.649 s, 14.649 s] -785.0 ms (-5.1%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~7746033211, baseline=1.59.0-SNAPSHOT~189c0b6c76
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (3.686 ms) : 3467, 3905
.   : milestone, 3686,
iast (2.202 ms) : 2137, 2266
.   : milestone, 2202,
iast_GLOBAL (2.244 ms) : 2179, 2308
.   : milestone, 2244,
profiling (2.045 ms) : 1994, 2097
.   : milestone, 2045,
tracing (2.042 ms) : 1991, 2093
.   : milestone, 2042,
section candidate
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (3.636 ms) : 3422, 3850
.   : milestone, 3636,
iast (2.205 ms) : 2140, 2269
.   : milestone, 2205,
iast_GLOBAL (2.248 ms) : 2183, 2314
.   : milestone, 2248,
profiling (2.455 ms) : 2297, 2614
.   : milestone, 2455,
tracing (2.034 ms) : 1983, 2085
.   : milestone, 2034,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.456 ms, 1.479 ms] -
appsec 3.686 ms [3.467 ms, 3.905 ms] 2.219 ms (151.2%)
iast 2.202 ms [2.137 ms, 2.266 ms] 734.403 µs (50.1%)
iast_GLOBAL 2.244 ms [2.179 ms, 2.308 ms] 776.536 µs (52.9%)
profiling 2.045 ms [1.994 ms, 2.097 ms] 578.295 µs (39.4%)
tracing 2.042 ms [1.991 ms, 2.093 ms] 574.889 µs (39.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 3.636 ms [3.422 ms, 3.85 ms] 2.168 ms (147.7%)
iast 2.205 ms [2.14 ms, 2.269 ms] 736.871 µs (50.2%)
iast_GLOBAL 2.248 ms [2.183 ms, 2.314 ms] 780.774 µs (53.2%)
profiling 2.455 ms [2.297 ms, 2.614 ms] 987.783 µs (67.3%)
tracing 2.034 ms [1.983 ms, 2.085 ms] 565.862 µs (38.6%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali Awaiting requested review from amarziali amarziali is a code owner automatically assigned from DataDog/apm-java

At least 1 approving review is required to merge this pull request.

Assignees

@ygree ygree

Labels

comp: mlobs ML Observability (LLMObs) type: bug Bug report and fix

Projects

None yet

Milestone

1.59.0

Development

Successfully merging this pull request may close these issues.

2 participants

@ygree