Skip to content

Temporary limited latest tyrus-container-inmemory to fix issue with invalid grizzly-bom.#10846

Open
AlexeyKuznetsov-DD wants to merge 1 commit intomasterfrom
alexeyk/fixed-invalid-grizzly-bom
Open

Temporary limited latest tyrus-container-inmemory to fix issue with invalid grizzly-bom.#10846
AlexeyKuznetsov-DD wants to merge 1 commit intomasterfrom
alexeyk/fixed-invalid-grizzly-bom

Conversation

@AlexeyKuznetsov-DD
Copy link
Contributor

What Does This Do

Pins jakarta-websocket-2.0 latestDepTest away from tyrus 2.3.0-M1, which was published on 2026-03-13 and is currently broken. tyrus 2.3.0-M1 transitively resolves to a Grizzly POM that imports a non-existent BOM: org.glassfish.grizzly:grizzly-bom:5.0.0-SNAPSHOT
Upstream issue: eclipse-ee4j/glassfish-grizzly#2278

Motivation

Our weekly GitHub Actions dependency-resolution workflow failed because Gradle could not resolve the missing Grizzly BOM.

Additional Notes

* What went wrong:
Execution failed for task ':dd-java-agent:instrumentation:websocket:jakarta-websocket-2.0:resolveAndLockAll'.
> Could not resolve all files for configuration ':dd-java-agent:instrumentation:websocket:jakarta-websocket-2.0:latestDepTestCompileClasspath'.
   > Could not resolve org.glassfish.grizzly:grizzly-framework:5.0.0.
     Required by:
         project :dd-java-agent:instrumentation:websocket:jakarta-websocket-2.0 > org.glassfish.tyrus:tyrus-container-inmemory:2.3.0-M1 > org.glassfish.tyrus:tyrus-server:2.3.0-M1 > org.glassfish.tyrus:tyrus-container-grizzly-client:2.3.0-M1
      > Could not resolve org.glassfish.grizzly:grizzly-framework:5.0.0.
         > Could not parse POM https://repo.maven.apache.org/maven2/org/glassfish/grizzly/grizzly-framework/5.0.0/grizzly-framework-5.0.0.pom
            > Could not resolve org.glassfish.grizzly:grizzly-project:5.0.0.
               > Could not resolve org.glassfish.grizzly:grizzly-project:5.0.0.
                  > Could not parse POM https://repo.maven.apache.org/maven2/org/glassfish/grizzly/grizzly-project/5.0.0/grizzly-project-5.0.0.pom
                     > Could not find org.glassfish.grizzly:grizzly-bom:5.0.0-SNAPSHOT.
                       Searched in the following locations:
                         - file:/Users/.../.m2/repository/org/glassfish/grizzly/grizzly-bom/5.0.0-SNAPSHOT/maven-metadata.xml
                         - file:/Users/.../.m2/repository/org/glassfish/grizzly/grizzly-bom/5.0.0-SNAPSHOT/grizzly-bom-5.0.0-SNAPSHOT.pom
                         - https://repo.maven.apache.org/maven2/org/glassfish/grizzly/grizzly-bom/5.0.0-SNAPSHOT/maven-metadata.xml
                         - https://repo.maven.apache.org/maven2/org/glassfish/grizzly/grizzly-bom/5.0.0-SNAPSHOT/grizzly-bom-5.0.0-SNAPSHOT.pom
> There is 1 more failure with an identical cause.

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Mar 15, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added type: bug Bug report and fix comp: testing Testing tag: no release notes Changes to exclude from release notes labels Mar 15, 2026
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD marked this pull request as ready for review March 15, 2026 16:07
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD requested a review from a team as a code owner March 15, 2026 16:07
@pr-commenter
Copy link

pr-commenter bot commented Mar 15, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/fixed-invalid-grizzly-bom
git_commit_date 1773590956 1773590291
git_commit_sha 185dcf699b 03c0f2d
release_version 1.61.0-SNAPSHOT~8185dcf699b 1.61.0-SNAPSHOT~03c0f2d06b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773592252 1773592252
ci_job_id 1506967909 1506967909
ci_pipeline_id 102567810 102567810
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5jtyi4p4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5jtyi4p4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~03c0f2d06b, baseline=1.61.0-SNAPSHOT~8185dcf699b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063636
Total [baseline] (8.881 s) : 0, 8881110
Agent [candidate] (1.064 s) : 0, 1063797
Total [candidate] (8.831 s) : 0, 8831209
section iast
Agent [baseline] (1.226 s) : 0, 1226174
Total [baseline] (9.592 s) : 0, 9591578
Agent [candidate] (1.226 s) : 0, 1226493
Total [candidate] (9.578 s) : 0, 9577843
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.226 s 162.537 ms (15.3%)
Total tracing 8.881 s -
Total iast 9.592 s 710.469 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.226 s 162.696 ms (15.3%)
Total tracing 8.831 s -
Total iast 9.578 s 746.634 ms (8.5%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~03c0f2d06b, baseline=1.61.0-SNAPSHOT~8185dcf699b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (633.543 ms) : 0, 633543
BytebuddyAgent [candidate] (631.527 ms) : 0, 631527
AgentMeter [baseline] (29.379 ms) : 0, 29379
AgentMeter [candidate] (28.991 ms) : 0, 28991
GlobalTracer [baseline] (257.97 ms) : 0, 257970
GlobalTracer [candidate] (257.003 ms) : 0, 257003
AppSec [baseline] (31.768 ms) : 0, 31768
AppSec [candidate] (31.522 ms) : 0, 31522
Debugger [baseline] (59.158 ms) : 0, 59158
Debugger [candidate] (58.609 ms) : 0, 58609
Remote Config [baseline] (627.224 µs) : 0, 627
Remote Config [candidate] (624.072 µs) : 0, 624
Telemetry [baseline] (8.781 ms) : 0, 8781
Telemetry [candidate] (8.71 ms) : 0, 8710
Flare Poller [baseline] (5.016 ms) : 0, 5016
Flare Poller [candidate] (9.412 ms) : 0, 9412
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (795.955 ms) : 0, 795955
BytebuddyAgent [candidate] (796.103 ms) : 0, 796103
AgentMeter [baseline] (11.342 ms) : 0, 11342
AgentMeter [candidate] (11.333 ms) : 0, 11333
GlobalTracer [baseline] (247.597 ms) : 0, 247597
GlobalTracer [candidate] (247.66 ms) : 0, 247660
IAST [baseline] (25.085 ms) : 0, 25085
IAST [candidate] (25.159 ms) : 0, 25159
AppSec [baseline] (26.285 ms) : 0, 26285
AppSec [candidate] (26.384 ms) : 0, 26384
Debugger [baseline] (62.588 ms) : 0, 62588
Debugger [candidate] (62.361 ms) : 0, 62361
Remote Config [baseline] (515.938 µs) : 0, 516
Remote Config [candidate] (514.621 µs) : 0, 515
Telemetry [baseline] (14.719 ms) : 0, 14719
Telemetry [candidate] (14.815 ms) : 0, 14815
Flare Poller [baseline] (4.86 ms) : 0, 4860
Flare Poller [candidate] (4.829 ms) : 0, 4829
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~03c0f2d06b, baseline=1.61.0-SNAPSHOT~8185dcf699b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1059469
Total [baseline] (11.083 s) : 0, 11083065
Agent [candidate] (1.066 s) : 0, 1065942
Total [candidate] (11.145 s) : 0, 11145453
section appsec
Agent [baseline] (1.251 s) : 0, 1250908
Total [baseline] (11.114 s) : 0, 11113552
Agent [candidate] (1.249 s) : 0, 1249076
Total [candidate] (11.223 s) : 0, 11223260
section iast
Agent [baseline] (1.227 s) : 0, 1227428
Total [baseline] (11.348 s) : 0, 11347766
Agent [candidate] (1.236 s) : 0, 1236445
Total [candidate] (11.392 s) : 0, 11391880
section profiling
Agent [baseline] (1.189 s) : 0, 1188925
Total [baseline] (11.046 s) : 0, 11046356
Agent [candidate] (1.191 s) : 0, 1190744
Total [candidate] (11.07 s) : 0, 11070380
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.251 s 191.44 ms (18.1%)
Agent iast 1.227 s 167.96 ms (15.9%)
Agent profiling 1.189 s 129.456 ms (12.2%)
Total tracing 11.083 s -
Total appsec 11.114 s 30.487 ms (0.3%)
Total iast 11.348 s 264.701 ms (2.4%)
Total profiling 11.046 s -36.71 ms (-0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.249 s 183.134 ms (17.2%)
Agent iast 1.236 s 170.503 ms (16.0%)
Agent profiling 1.191 s 124.802 ms (11.7%)
Total tracing 11.145 s -
Total appsec 11.223 s 77.808 ms (0.7%)
Total iast 11.392 s 246.428 ms (2.2%)
Total profiling 11.07 s -75.073 ms (-0.7%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~03c0f2d06b, baseline=1.61.0-SNAPSHOT~8185dcf699b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.234 ms) : 0, 1234
BytebuddyAgent [baseline] (626.373 ms) : 0, 626373
BytebuddyAgent [candidate] (632.298 ms) : 0, 632298
AgentMeter [baseline] (29.249 ms) : 0, 29249
AgentMeter [candidate] (29.318 ms) : 0, 29318
GlobalTracer [baseline] (257.554 ms) : 0, 257554
GlobalTracer [candidate] (259.472 ms) : 0, 259472
AppSec [baseline] (31.642 ms) : 0, 31642
AppSec [candidate] (31.919 ms) : 0, 31919
Debugger [baseline] (59.402 ms) : 0, 59402
Debugger [candidate] (60.177 ms) : 0, 60177
Remote Config [baseline] (614.692 µs) : 0, 615
Remote Config [candidate] (608.109 µs) : 0, 608
Telemetry [baseline] (8.68 ms) : 0, 8680
Telemetry [candidate] (8.822 ms) : 0, 8822
Flare Poller [baseline] (8.752 ms) : 0, 8752
Flare Poller [candidate] (5.902 ms) : 0, 5902
section appsec
crashtracking [baseline] (1.209 ms) : 0, 1209
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (660.436 ms) : 0, 660436
BytebuddyAgent [candidate] (659.973 ms) : 0, 659973
AgentMeter [baseline] (12.16 ms) : 0, 12160
AgentMeter [candidate] (12.04 ms) : 0, 12040
GlobalTracer [baseline] (259.092 ms) : 0, 259092
GlobalTracer [candidate] (258.463 ms) : 0, 258463
IAST [baseline] (24.117 ms) : 0, 24117
IAST [candidate] (24.029 ms) : 0, 24029
AppSec [baseline] (178.124 ms) : 0, 178124
AppSec [candidate] (177.78 ms) : 0, 177780
Debugger [baseline] (66.225 ms) : 0, 66225
Debugger [candidate] (65.095 ms) : 0, 65095
Remote Config [baseline] (568.762 µs) : 0, 569
Remote Config [candidate] (588.554 µs) : 0, 589
Telemetry [baseline] (8.962 ms) : 0, 8962
Telemetry [candidate] (9.89 ms) : 0, 9890
Flare Poller [baseline] (3.599 ms) : 0, 3599
Flare Poller [candidate] (3.708 ms) : 0, 3708
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.21 ms) : 0, 1210
BytebuddyAgent [baseline] (795.241 ms) : 0, 795241
BytebuddyAgent [candidate] (803.138 ms) : 0, 803138
AgentMeter [baseline] (11.349 ms) : 0, 11349
AgentMeter [candidate] (11.654 ms) : 0, 11654
GlobalTracer [baseline] (247.715 ms) : 0, 247715
GlobalTracer [candidate] (248.911 ms) : 0, 248911
IAST [baseline] (25.143 ms) : 0, 25143
IAST [candidate] (25.201 ms) : 0, 25201
AppSec [baseline] (26.509 ms) : 0, 26509
AppSec [candidate] (26.466 ms) : 0, 26466
Debugger [baseline] (68.044 ms) : 0, 68044
Debugger [candidate] (64.07 ms) : 0, 64070
Remote Config [baseline] (529.887 µs) : 0, 530
Remote Config [candidate] (508.009 µs) : 0, 508
Telemetry [baseline] (11.758 ms) : 0, 11758
Telemetry [candidate] (14.35 ms) : 0, 14350
Flare Poller [baseline] (3.952 ms) : 0, 3952
Flare Poller [candidate] (4.694 ms) : 0, 4694
section profiling
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (687.152 ms) : 0, 687152
BytebuddyAgent [candidate] (687.453 ms) : 0, 687453
AgentMeter [baseline] (8.674 ms) : 0, 8674
AgentMeter [candidate] (8.726 ms) : 0, 8726
GlobalTracer [baseline] (216.453 ms) : 0, 216453
GlobalTracer [candidate] (216.766 ms) : 0, 216766
AppSec [baseline] (32.228 ms) : 0, 32228
AppSec [candidate] (32.222 ms) : 0, 32222
Debugger [baseline] (63.48 ms) : 0, 63480
Debugger [candidate] (65.106 ms) : 0, 65106
Remote Config [baseline] (585.717 µs) : 0, 586
Remote Config [candidate] (592.697 µs) : 0, 593
Telemetry [baseline] (9.728 ms) : 0, 9728
Telemetry [candidate] (9.002 ms) : 0, 9002
Flare Poller [baseline] (4.308 ms) : 0, 4308
Flare Poller [candidate] (3.574 ms) : 0, 3574
ProfilingAgent [baseline] (93.911 ms) : 0, 93911
ProfilingAgent [candidate] (94.874 ms) : 0, 94874
Profiling [baseline] (94.48 ms) : 0, 94480
Profiling [candidate] (95.451 ms) : 0, 95451
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/fixed-invalid-grizzly-bom
git_commit_date 1773590956 1773590291
git_commit_sha 185dcf699b 03c0f2d
release_version 1.61.0-SNAPSHOT~8185dcf699b 1.61.0-SNAPSHOT~03c0f2d06b
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773592726 1773592726
ci_job_id 1506967910 1506967910
ci_pipeline_id 102567810 102567810
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tartr3ny 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tartr3ny 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:code_origins:high_load worse
[+399.564µs; +832.246µs] or [+2.305%; +4.801%]
same
[-21.088µs; +1317.629µs] or [-0.074%; +4.620%]
unstable
[-35.854op/s; +19.417op/s] or [-13.630%; +7.381%]
17.949ms 29.165ms 254.844op/s 17.333ms 28.517ms 263.062op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~03c0f2d06b, baseline=1.61.0-SNAPSHOT~8185dcf699b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.18 ms) : 1169, 1192
.   : milestone, 1180,
iast (3.167 ms) : 3124, 3210
.   : milestone, 3167,
iast_FULL (5.902 ms) : 5843, 5961
.   : milestone, 5902,
iast_GLOBAL (3.55 ms) : 3489, 3610
.   : milestone, 3550,
profiling (2.122 ms) : 2104, 2140
.   : milestone, 2122,
tracing (1.797 ms) : 1783, 1812
.   : milestone, 1797,
section candidate
no_agent (1.18 ms) : 1169, 1191
.   : milestone, 1180,
iast (3.106 ms) : 3062, 3149
.   : milestone, 3106,
iast_FULL (5.755 ms) : 5698, 5812
.   : milestone, 5755,
iast_GLOBAL (3.521 ms) : 3470, 3573
.   : milestone, 3521,
profiling (2.117 ms) : 2096, 2138
.   : milestone, 2117,
tracing (1.826 ms) : 1810, 1842
.   : milestone, 1826,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.18 ms [1.169 ms, 1.192 ms] -
iast 3.167 ms [3.124 ms, 3.21 ms] 1.987 ms (168.4%)
iast_FULL 5.902 ms [5.843 ms, 5.961 ms] 4.722 ms (400.1%)
iast_GLOBAL 3.55 ms [3.489 ms, 3.61 ms] 2.37 ms (200.8%)
profiling 2.122 ms [2.104 ms, 2.14 ms] 941.491 µs (79.8%)
tracing 1.797 ms [1.783 ms, 1.812 ms] 617.19 µs (52.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.18 ms [1.169 ms, 1.191 ms] -
iast 3.106 ms [3.062 ms, 3.149 ms] 1.926 ms (163.2%)
iast_FULL 5.755 ms [5.698 ms, 5.812 ms] 4.575 ms (387.7%)
iast_GLOBAL 3.521 ms [3.47 ms, 3.573 ms] 2.341 ms (198.4%)
profiling 2.117 ms [2.096 ms, 2.138 ms] 936.981 µs (79.4%)
tracing 1.826 ms [1.81 ms, 1.842 ms] 646.118 µs (54.8%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~03c0f2d06b, baseline=1.61.0-SNAPSHOT~8185dcf699b
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.963 ms) : 17780, 18145
.   : milestone, 17963,
appsec (18.648 ms) : 18456, 18840
.   : milestone, 18648,
code_origins (17.733 ms) : 17554, 17913
.   : milestone, 17733,
iast (17.751 ms) : 17574, 17927
.   : milestone, 17751,
profiling (19.023 ms) : 18828, 19217
.   : milestone, 19023,
tracing (17.735 ms) : 17560, 17909
.   : milestone, 17735,
section candidate
no_agent (18.432 ms) : 18247, 18617
.   : milestone, 18432,
appsec (18.779 ms) : 18587, 18971
.   : milestone, 18779,
code_origins (18.313 ms) : 18132, 18494
.   : milestone, 18313,
iast (18.009 ms) : 17830, 18187
.   : milestone, 18009,
profiling (18.583 ms) : 18402, 18764
.   : milestone, 18583,
tracing (18.072 ms) : 17892, 18252
.   : milestone, 18072,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.963 ms [17.78 ms, 18.145 ms] -
appsec 18.648 ms [18.456 ms, 18.84 ms] 685.169 µs (3.8%)
code_origins 17.733 ms [17.554 ms, 17.913 ms] -229.257 µs (-1.3%)
iast 17.751 ms [17.574 ms, 17.927 ms] -212.048 µs (-1.2%)
profiling 19.023 ms [18.828 ms, 19.217 ms] 1.06 ms (5.9%)
tracing 17.735 ms [17.56 ms, 17.909 ms] -227.848 µs (-1.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.432 ms [18.247 ms, 18.617 ms] -
appsec 18.779 ms [18.587 ms, 18.971 ms] 347.492 µs (1.9%)
code_origins 18.313 ms [18.132 ms, 18.494 ms] -119.219 µs (-0.6%)
iast 18.009 ms [17.83 ms, 18.187 ms] -423.211 µs (-2.3%)
profiling 18.583 ms [18.402 ms, 18.764 ms] 150.966 µs (0.8%)
tracing 18.072 ms [17.892 ms, 18.252 ms] -359.996 µs (-2.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/fixed-invalid-grizzly-bom
git_commit_date 1773591123 1773590291
git_commit_sha 185dcf699b 03c0f2d
release_version 1.61.0-SNAPSHOT~8185dcf699b 1.61.0-SNAPSHOT~03c0f2d06b
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773592733 1773592733
ci_job_id 1506967911 1506967911
ci_pipeline_id 102567810 102567810
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-26wwpvx7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-26wwpvx7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.618ms; -1.203ms] or [-37.771%; -28.077%]
2.873ms 4.283ms
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~03c0f2d06b, baseline=1.61.0-SNAPSHOT~8185dcf699b
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.709 s) : 14709000, 14709000
.   : milestone, 14709000,
appsec (14.199 s) : 14199000, 14199000
.   : milestone, 14199000,
iast (17.46 s) : 17460000, 17460000
.   : milestone, 17460000,
iast_GLOBAL (16.99 s) : 16990000, 16990000
.   : milestone, 16990000,
profiling (14.256 s) : 14256000, 14256000
.   : milestone, 14256000,
tracing (14.683 s) : 14683000, 14683000
.   : milestone, 14683000,
section candidate
no_agent (15.248 s) : 15248000, 15248000
.   : milestone, 15248000,
appsec (14.644 s) : 14644000, 14644000
.   : milestone, 14644000,
iast (17.462 s) : 17462000, 17462000
.   : milestone, 17462000,
iast_GLOBAL (17.098 s) : 17098000, 17098000
.   : milestone, 17098000,
profiling (14.841 s) : 14841000, 14841000
.   : milestone, 14841000,
tracing (14.734 s) : 14734000, 14734000
.   : milestone, 14734000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.709 s [14.709 s, 14.709 s] -
appsec 14.199 s [14.199 s, 14.199 s] -510.0 ms (-3.5%)
iast 17.46 s [17.46 s, 17.46 s] 2.751 s (18.7%)
iast_GLOBAL 16.99 s [16.99 s, 16.99 s] 2.281 s (15.5%)
profiling 14.256 s [14.256 s, 14.256 s] -453.0 ms (-3.1%)
tracing 14.683 s [14.683 s, 14.683 s] -26.0 ms (-0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.248 s [15.248 s, 15.248 s] -
appsec 14.644 s [14.644 s, 14.644 s] -604.0 ms (-4.0%)
iast 17.462 s [17.462 s, 17.462 s] 2.214 s (14.5%)
iast_GLOBAL 17.098 s [17.098 s, 17.098 s] 1.85 s (12.1%)
profiling 14.841 s [14.841 s, 14.841 s] -407.0 ms (-2.7%)
tracing 14.734 s [14.734 s, 14.734 s] -514.0 ms (-3.4%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~03c0f2d06b, baseline=1.61.0-SNAPSHOT~8185dcf699b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (4.283 ms) : 4025, 4541
.   : milestone, 4283,
iast (2.659 ms) : 2549, 2768
.   : milestone, 2659,
iast_GLOBAL (2.687 ms) : 2578, 2796
.   : milestone, 2687,
profiling (2.439 ms) : 2348, 2531
.   : milestone, 2439,
tracing (2.409 ms) : 2321, 2496
.   : milestone, 2409,
section candidate
no_agent (1.482 ms) : 1470, 1494
.   : milestone, 1482,
appsec (2.873 ms) : 2783, 2962
.   : milestone, 2873,
iast (2.641 ms) : 2533, 2750
.   : milestone, 2641,
iast_GLOBAL (2.689 ms) : 2579, 2798
.   : milestone, 2689,
profiling (2.422 ms) : 2333, 2511
.   : milestone, 2422,
tracing (2.398 ms) : 2310, 2486
.   : milestone, 2398,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.487 ms [1.475 ms, 1.498 ms] -
appsec 4.283 ms [4.025 ms, 4.541 ms] 2.796 ms (188.1%)
iast 2.659 ms [2.549 ms, 2.768 ms] 1.172 ms (78.8%)
iast_GLOBAL 2.687 ms [2.578 ms, 2.796 ms] 1.2 ms (80.7%)
profiling 2.439 ms [2.348 ms, 2.531 ms] 952.899 µs (64.1%)
tracing 2.409 ms [2.321 ms, 2.496 ms] 922.056 µs (62.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.494 ms] -
appsec 2.873 ms [2.783 ms, 2.962 ms] 1.391 ms (93.8%)
iast 2.641 ms [2.533 ms, 2.75 ms] 1.159 ms (78.2%)
iast_GLOBAL 2.689 ms [2.579 ms, 2.798 ms] 1.207 ms (81.4%)
profiling 2.422 ms [2.333 ms, 2.511 ms] 939.572 µs (63.4%)
tracing 2.398 ms [2.31 ms, 2.486 ms] 915.764 µs (61.8%)

Copy link
Contributor

@vandonr vandonr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you create a PR to revert this now, as a reminder that it needs to be addressed in the future ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testing Testing tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants