Skip to content

Make test-suites creation lazy #10381

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
bric3 merged 1 commit into from
Jan 15, 2026
Merged

Make test-suites creation lazy #10381

bric3 merged 1 commit into from
Jan 15, 2026
+3 −3

Conversation

@bric3
Copy link
Contributor

@bric3 bric3 commented Jan 14, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@bric3 bric3 requested a review from a team as a code owner January 14, 2026 17:01
@bric3 bric3 requested a review from amarziali January 14, 2026 17:01
@bric3 bric3 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jan 14, 2026
@pr-commenter
Copy link

pr-commenter bot commented Jan 14, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/make-test-suite-creation-lazy
git_commit_date 1768407425 1768410048
git_commit_sha 84954e9 6d358cf
release_version 1.59.0-SNAPSHOT~84954e9d9a 1.59.0-SNAPSHOT~6d358cf6a6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768412243 1768412243
ci_job_id 1350609845 1350609845
ci_pipeline_id 90727730 90727730
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-2uc679vz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-2uc679vz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 8 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~6d358cf6a6, baseline=1.59.0-SNAPSHOT~84954e9d9a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1085455
Total [baseline] (10.846 s) : 0, 10845615
Agent [candidate] (1.091 s) : 0, 1091114
Total [candidate] (10.847 s) : 0, 10847096
section appsec
Agent [baseline] (1.273 s) : 0, 1273249
Total [baseline] (11.077 s) : 0, 11076732
Agent [candidate] (1.275 s) : 0, 1274546
Total [candidate] (11.17 s) : 0, 11169900
section iast
Agent [baseline] (1.234 s) : 0, 1233695
Total [baseline] (11.226 s) : 0, 11226329
Agent [candidate] (1.233 s) : 0, 1232591
Total [candidate] (11.134 s) : 0, 11133871
section profiling
Agent [baseline] (1.209 s) : 0, 1209376
Total [baseline] (10.844 s) : 0, 10843666
Agent [candidate] (1.203 s) : 0, 1202702
Total [candidate] (10.86 s) : 0, 10859522
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent appsec 1.273 s 187.794 ms (17.3%)
Agent iast 1.234 s 148.24 ms (13.7%)
Agent profiling 1.209 s 123.921 ms (11.4%)
Total tracing 10.846 s -
Total appsec 11.077 s 231.117 ms (2.1%)
Total iast 11.226 s 380.714 ms (3.5%)
Total profiling 10.844 s -1.948 ms (-0.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent appsec 1.275 s 183.432 ms (16.8%)
Agent iast 1.233 s 141.477 ms (13.0%)
Agent profiling 1.203 s 111.588 ms (10.2%)
Total tracing 10.847 s -
Total appsec 11.17 s 322.804 ms (3.0%)
Total iast 11.134 s 286.775 ms (2.6%)
Total profiling 10.86 s 12.426 ms (0.1%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~6d358cf6a6, baseline=1.59.0-SNAPSHOT~84954e9d9a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (651.775 ms) : 0, 651775
BytebuddyAgent [candidate] (656.257 ms) : 0, 656257
GlobalTracer [baseline] (282.803 ms) : 0, 282803
GlobalTracer [candidate] (284.376 ms) : 0, 284376
AppSec [baseline] (32.652 ms) : 0, 32652
AppSec [candidate] (32.945 ms) : 0, 32945
Debugger [baseline] (68.046 ms) : 0, 68046
Debugger [candidate] (67.205 ms) : 0, 67205
Remote Config [baseline] (631.946 µs) : 0, 632
Remote Config [candidate] (623.439 µs) : 0, 623
Telemetry [baseline] (8.931 ms) : 0, 8931
Telemetry [candidate] (9.006 ms) : 0, 9006
Flare Poller [baseline] (3.802 ms) : 0, 3802
Flare Poller [candidate] (3.905 ms) : 0, 3905
section appsec
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.186 ms) : 0, 1186
BytebuddyAgent [baseline] (697.826 ms) : 0, 697826
BytebuddyAgent [candidate] (696.448 ms) : 0, 696448
GlobalTracer [baseline] (259.286 ms) : 0, 259286
GlobalTracer [candidate] (260.948 ms) : 0, 260948
IAST [baseline] (24.557 ms) : 0, 24557
IAST [candidate] (24.723 ms) : 0, 24723
AppSec [baseline] (173.768 ms) : 0, 173768
AppSec [candidate] (173.74 ms) : 0, 173740
Debugger [baseline] (67.081 ms) : 0, 67081
Debugger [candidate] (67.931 ms) : 0, 67931
Remote Config [baseline] (773.802 µs) : 0, 774
Remote Config [candidate] (790.366 µs) : 0, 790
Telemetry [baseline] (9.385 ms) : 0, 9385
Telemetry [candidate] (9.444 ms) : 0, 9444
Flare Poller [baseline] (3.724 ms) : 0, 3724
Flare Poller [candidate] (3.735 ms) : 0, 3735
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (797.686 ms) : 0, 797686
BytebuddyAgent [candidate] (797.817 ms) : 0, 797817
GlobalTracer [baseline] (257.911 ms) : 0, 257911
GlobalTracer [candidate] (256.661 ms) : 0, 256661
IAST [baseline] (27.266 ms) : 0, 27266
IAST [candidate] (27.163 ms) : 0, 27163
AppSec [baseline] (34.557 ms) : 0, 34557
AppSec [candidate] (34.96 ms) : 0, 34960
Debugger [baseline] (66.595 ms) : 0, 66595
Debugger [candidate] (66.235 ms) : 0, 66235
Remote Config [baseline] (586.366 µs) : 0, 586
Remote Config [candidate] (619.794 µs) : 0, 620
Telemetry [baseline] (8.626 ms) : 0, 8626
Telemetry [candidate] (8.676 ms) : 0, 8676
Flare Poller [baseline] (3.641 ms) : 0, 3641
Flare Poller [candidate] (3.65 ms) : 0, 3650
section profiling
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.22 ms) : 0, 1220
BytebuddyAgent [baseline] (705.143 ms) : 0, 705143
BytebuddyAgent [candidate] (700.982 ms) : 0, 700982
GlobalTracer [baseline] (221.664 ms) : 0, 221664
GlobalTracer [candidate] (220.566 ms) : 0, 220566
AppSec [baseline] (32.298 ms) : 0, 32298
AppSec [candidate] (31.96 ms) : 0, 31960
Debugger [baseline] (68.19 ms) : 0, 68190
Debugger [candidate] (68.343 ms) : 0, 68343
Remote Config [baseline] (632.85 µs) : 0, 633
Remote Config [candidate] (648.132 µs) : 0, 648
Telemetry [baseline] (8.954 ms) : 0, 8954
Telemetry [candidate] (8.818 ms) : 0, 8818
Flare Poller [baseline] (3.786 ms) : 0, 3786
Flare Poller [candidate] (3.699 ms) : 0, 3699
ProfilingAgent [baseline] (97.378 ms) : 0, 97378
ProfilingAgent [candidate] (96.559 ms) : 0, 96559
Profiling [baseline] (97.952 ms) : 0, 97952
Profiling [candidate] (97.136 ms) : 0, 97136
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~6d358cf6a6, baseline=1.59.0-SNAPSHOT~84954e9d9a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.086 s) : 0, 1085942
Total [baseline] (8.767 s) : 0, 8766874
Agent [candidate] (1.086 s) : 0, 1086308
Total [candidate] (8.756 s) : 0, 8756144
section iast
Agent [baseline] (1.225 s) : 0, 1225319
Total [baseline] (9.312 s) : 0, 9312475
Agent [candidate] (1.246 s) : 0, 1245707
Total [candidate] (9.388 s) : 0, 9387550
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent iast 1.225 s 139.377 ms (12.8%)
Total tracing 8.767 s -
Total iast 9.312 s 545.601 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent iast 1.246 s 159.399 ms (14.7%)
Total tracing 8.756 s -
Total iast 9.388 s 631.406 ms (7.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~6d358cf6a6, baseline=1.59.0-SNAPSHOT~84954e9d9a

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.201 ms) : 0, 1201
BytebuddyAgent [baseline] (652.652 ms) : 0, 652652
BytebuddyAgent [candidate] (651.715 ms) : 0, 651715
GlobalTracer [baseline] (283.207 ms) : 0, 283207
GlobalTracer [candidate] (284.583 ms) : 0, 284583
AppSec [baseline] (32.6 ms) : 0, 32600
AppSec [candidate] (32.715 ms) : 0, 32715
Debugger [baseline] (67.136 ms) : 0, 67136
Debugger [candidate] (67.207 ms) : 0, 67207
Remote Config [baseline] (658.759 µs) : 0, 659
Remote Config [candidate] (645.977 µs) : 0, 646
Telemetry [baseline] (8.96 ms) : 0, 8960
Telemetry [candidate] (8.979 ms) : 0, 8979
Flare Poller [baseline] (3.804 ms) : 0, 3804
Flare Poller [candidate] (3.731 ms) : 0, 3731
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (793.334 ms) : 0, 793334
BytebuddyAgent [candidate] (807.415 ms) : 0, 807415
GlobalTracer [baseline] (256.692 ms) : 0, 256692
GlobalTracer [candidate] (260.995 ms) : 0, 260995
IAST [baseline] (27.108 ms) : 0, 27108
IAST [candidate] (27.455 ms) : 0, 27455
AppSec [baseline] (35.138 ms) : 0, 35138
AppSec [candidate] (33.945 ms) : 0, 33945
Debugger [baseline] (63.733 ms) : 0, 63733
Debugger [candidate] (65.996 ms) : 0, 65996
Remote Config [baseline] (569.282 µs) : 0, 569
Remote Config [candidate] (595.896 µs) : 0, 596
Telemetry [baseline] (8.501 ms) : 0, 8501
Telemetry [candidate] (8.6 ms) : 0, 8600
Flare Poller [baseline] (3.543 ms) : 0, 3543
Flare Poller [candidate] (3.602 ms) : 0, 3602
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/make-test-suite-creation-lazy
git_commit_date 1768407425 1768410048
git_commit_sha 84954e9 6d358cf
release_version 1.59.0-SNAPSHOT~84954e9d9a 1.59.0-SNAPSHOT~6d358cf6a6
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1768412649 1768412649
ci_job_id 1350609846 1350609846
ci_pipeline_id 90727730 90727730
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-t9llsm4c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-t9llsm4c 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-383.063µs; -191.753µs] or [-7.038%; -3.523%]		 better
[-942.556µs; -390.203µs] or [-7.265%; -3.008%]		 unstable
[-55.394op/s; +128.894op/s] or [-7.312%; +17.014%]		 5.155ms 12.308ms 794.344op/s 5.443ms 12.974ms 757.594op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~6d358cf6a6, baseline=1.59.0-SNAPSHOT~84954e9d9a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.192 ms) : 1180, 1204
.   : milestone, 1192,
iast (3.223 ms) : 3173, 3272
.   : milestone, 3223,
iast_FULL (6.107 ms) : 6045, 6169
.   : milestone, 6107,
iast_GLOBAL (3.577 ms) : 3517, 3636
.   : milestone, 3577,
profiling (1.927 ms) : 1911, 1943
.   : milestone, 1927,
tracing (1.813 ms) : 1798, 1829
.   : milestone, 1813,
section candidate
no_agent (1.197 ms) : 1185, 1209
.   : milestone, 1197,
iast (3.19 ms) : 3151, 3229
.   : milestone, 3190,
iast_FULL (5.819 ms) : 5761, 5877
.   : milestone, 5819,
iast_GLOBAL (3.692 ms) : 3634, 3750
.   : milestone, 3692,
profiling (1.964 ms) : 1946, 1983
.   : milestone, 1964,
tracing (1.808 ms) : 1792, 1824
.   : milestone, 1808,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.192 ms [1.18 ms, 1.204 ms] -
iast 3.223 ms [3.173 ms, 3.272 ms] 2.031 ms (170.4%)
iast_FULL 6.107 ms [6.045 ms, 6.169 ms] 4.915 ms (412.4%)
iast_GLOBAL 3.577 ms [3.517 ms, 3.636 ms] 2.385 ms (200.1%)
profiling 1.927 ms [1.911 ms, 1.943 ms] 735.483 µs (61.7%)
tracing 1.813 ms [1.798 ms, 1.829 ms] 621.733 µs (52.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.197 ms [1.185 ms, 1.209 ms] -
iast 3.19 ms [3.151 ms, 3.229 ms] 1.993 ms (166.5%)
iast_FULL 5.819 ms [5.761 ms, 5.877 ms] 4.622 ms (386.0%)
iast_GLOBAL 3.692 ms [3.634 ms, 3.75 ms] 2.494 ms (208.3%)
profiling 1.964 ms [1.946 ms, 1.983 ms] 766.884 µs (64.1%)
tracing 1.808 ms [1.792 ms, 1.824 ms] 611.105 µs (51.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~6d358cf6a6, baseline=1.59.0-SNAPSHOT~84954e9d9a
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.259 ms) : 18069, 18449
.   : milestone, 18259,
appsec (18.506 ms) : 18318, 18695
.   : milestone, 18506,
code_origins (17.791 ms) : 17613, 17969
.   : milestone, 17791,
iast (17.585 ms) : 17408, 17763
.   : milestone, 17585,
profiling (18.783 ms) : 18593, 18973
.   : milestone, 18783,
tracing (17.7 ms) : 17526, 17874
.   : milestone, 17700,
section candidate
no_agent (17.854 ms) : 17675, 18033
.   : milestone, 17854,
appsec (18.455 ms) : 18267, 18643
.   : milestone, 18455,
code_origins (17.978 ms) : 17800, 18156
.   : milestone, 17978,
iast (17.749 ms) : 17570, 17928
.   : milestone, 17749,
profiling (18.433 ms) : 18251, 18615
.   : milestone, 18433,
tracing (17.723 ms) : 17550, 17897
.   : milestone, 17723,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.259 ms [18.069 ms, 18.449 ms] -
appsec 18.506 ms [18.318 ms, 18.695 ms] 247.244 µs (1.4%)
code_origins 17.791 ms [17.613 ms, 17.969 ms] -467.826 µs (-2.6%)
iast 17.585 ms [17.408 ms, 17.763 ms] -673.663 µs (-3.7%)
profiling 18.783 ms [18.593 ms, 18.973 ms] 524.217 µs (2.9%)
tracing 17.7 ms [17.526 ms, 17.874 ms] -559.261 µs (-3.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.854 ms [17.675 ms, 18.033 ms] -
appsec 18.455 ms [18.267 ms, 18.643 ms] 601.078 µs (3.4%)
code_origins 17.978 ms [17.8 ms, 18.156 ms] 124.067 µs (0.7%)
iast 17.749 ms [17.57 ms, 17.928 ms] -104.661 µs (-0.6%)
profiling 18.433 ms [18.251 ms, 18.615 ms] 579.346 µs (3.2%)
tracing 17.723 ms [17.55 ms, 17.897 ms] -130.345 µs (-0.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/make-test-suite-creation-lazy
git_commit_date 1768407425 1768410048
git_commit_sha 84954e9 6d358cf
release_version 1.59.0-SNAPSHOT~84954e9d9a 1.59.0-SNAPSHOT~6d358cf6a6
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1768412393 1768412393
ci_job_id 1350609847 1350609847
ci_pipeline_id 90727730 90727730
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-skmg9l2m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-skmg9l2m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~6d358cf6a6, baseline=1.59.0-SNAPSHOT~84954e9d9a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1468, 1491
.   : milestone, 1480,
appsec (2.525 ms) : 2469, 2580
.   : milestone, 2525,
iast (2.221 ms) : 2156, 2287
.   : milestone, 2221,
iast_GLOBAL (2.249 ms) : 2183, 2314
.   : milestone, 2249,
profiling (2.057 ms) : 2005, 2110
.   : milestone, 2057,
tracing (2.056 ms) : 2004, 2109
.   : milestone, 2056,
section candidate
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (3.745 ms) : 3524, 3965
.   : milestone, 3745,
iast (2.217 ms) : 2152, 2282
.   : milestone, 2217,
iast_GLOBAL (2.252 ms) : 2187, 2318
.   : milestone, 2252,
profiling (2.077 ms) : 2023, 2132
.   : milestone, 2077,
tracing (2.049 ms) : 1997, 2100
.   : milestone, 2049,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.468 ms, 1.491 ms] -
appsec 2.525 ms [2.469 ms, 2.58 ms] 1.045 ms (70.6%)
iast 2.221 ms [2.156 ms, 2.287 ms] 741.661 µs (50.1%)
iast_GLOBAL 2.249 ms [2.183 ms, 2.314 ms] 768.917 µs (52.0%)
profiling 2.057 ms [2.005 ms, 2.11 ms] 577.503 µs (39.0%)
tracing 2.056 ms [2.004 ms, 2.109 ms] 576.627 µs (39.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 3.745 ms [3.524 ms, 3.965 ms] 2.27 ms (153.9%)
iast 2.217 ms [2.152 ms, 2.282 ms] 742.33 µs (50.3%)
iast_GLOBAL 2.252 ms [2.187 ms, 2.318 ms] 777.575 µs (52.7%)
profiling 2.077 ms [2.023 ms, 2.132 ms] 602.598 µs (40.9%)
tracing 2.049 ms [1.997 ms, 2.1 ms] 574.029 µs (38.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~6d358cf6a6, baseline=1.59.0-SNAPSHOT~84954e9d9a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.873 s) : 14873000, 14873000
.   : milestone, 14873000,
appsec (14.686 s) : 14686000, 14686000
.   : milestone, 14686000,
iast (18.324 s) : 18324000, 18324000
.   : milestone, 18324000,
iast_GLOBAL (17.832 s) : 17832000, 17832000
.   : milestone, 17832000,
profiling (15.123 s) : 15123000, 15123000
.   : milestone, 15123000,
tracing (14.858 s) : 14858000, 14858000
.   : milestone, 14858000,
section candidate
no_agent (14.737 s) : 14737000, 14737000
.   : milestone, 14737000,
appsec (14.874 s) : 14874000, 14874000
.   : milestone, 14874000,
iast (18.096 s) : 18096000, 18096000
.   : milestone, 18096000,
iast_GLOBAL (17.751 s) : 17751000, 17751000
.   : milestone, 17751000,
profiling (15.114 s) : 15114000, 15114000
.   : milestone, 15114000,
tracing (14.63 s) : 14630000, 14630000
.   : milestone, 14630000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.873 s [14.873 s, 14.873 s] -
appsec 14.686 s [14.686 s, 14.686 s] -187.0 ms (-1.3%)
iast 18.324 s [18.324 s, 18.324 s] 3.451 s (23.2%)
iast_GLOBAL 17.832 s [17.832 s, 17.832 s] 2.959 s (19.9%)
profiling 15.123 s [15.123 s, 15.123 s] 250.0 ms (1.7%)
tracing 14.858 s [14.858 s, 14.858 s] -15.0 ms (-0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.737 s [14.737 s, 14.737 s] -
appsec 14.874 s [14.874 s, 14.874 s] 137.0 ms (0.9%)
iast 18.096 s [18.096 s, 18.096 s] 3.359 s (22.8%)
iast_GLOBAL 17.751 s [17.751 s, 17.751 s] 3.014 s (20.5%)
profiling 15.114 s [15.114 s, 15.114 s] 377.0 ms (2.6%)
tracing 14.63 s [14.63 s, 14.63 s] -107.0 ms (-0.7%)

@bric3 bric3 enabled auto-merge (squash) January 14, 2026 18:11
@bric3 bric3 changed the title Make test-suite creation lazy Make test-suites creation lazy Jan 15, 2026
@bric3 bric3 merged commit 288e1bb into master Jan 15, 2026
571 checks passed
@bric3 bric3 deleted the bdu/make-test-suite-creation-lazy branch January 15, 2026 09:28
@github-actions github-actions bot added this to the 1.59.0 milestone Jan 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@amarziali amarziali Awaiting requested review from amarziali amarziali is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.59.0

Development

Successfully merging this pull request may close these issues.

3 participants

@bric3 @AlexeyKuznetsov-DD