Skip to content

Add additional debug logging related to JPS #8718

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 5 commits into
base: master
Choose a base branch
from
Open

Add additional debug logging related to JPS #8718

wants to merge 5 commits into from

Conversation

MattAlp
Copy link
Contributor

@MattAlp MattAlp commented Apr 22, 2025 •
edited by jira bot
Loading

What Does This Do

Records via telemetry if the jvmstat module isn't found, for observability across different JVM distributions

Jira ticket: PROF-11678

@MattAlp MattAlp added comp: core Tracer core comp: profiling Profiling comp: telemetry Telemetry labels Apr 22, 2025
@MattAlp MattAlp requested a review from a team as a code owner April 22, 2025 13:32
@MattAlp MattAlp requested a review from amarziali April 22, 2025 13:32
@DataDog DataDog deleted a comment from github-actions bot Apr 22, 2025
@MattAlp MattAlp requested a review from jbachorik April 22, 2025 14:05
@pr-commenter
Copy link

pr-commenter bot commented Apr 22, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/additional-jvmstat-telemetry
git_commit_date 1746263227 1746465586
git_commit_sha 12da6fe c06bf67
release_version 1.49.0-SNAPSHOT~12da6fe499 1.49.0-SNAPSHOT~c06bf67bf3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746468696 1746468696
ci_job_id 924176143 924176143
ci_pipeline_id 64149122 64149122
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-a5c54cuo-project-304-concurrent-1-kvabgn6f 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-a5c54cuo-project-304-concurrent-1-kvabgn6f 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 68 metrics, 3 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.49.0-SNAPSHOT~c06bf67bf3, baseline=1.49.0-SNAPSHOT~12da6fe499

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.008 s) : 0, 1008228
Total [baseline] (8.641 s) : 0, 8641291
Agent [candidate] (1.004 s) : 0, 1003834
Total [candidate] (8.612 s) : 0, 8612365
section iast
Agent [baseline] (1.132 s) : 0, 1132408
Total [baseline] (9.189 s) : 0, 9188674
Agent [candidate] (1.147 s) : 0, 1147046
Total [candidate] (9.204 s) : 0, 9204269
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.137 s) : 0, 1136656
Total [baseline] (9.192 s) : 0, 9191543
Agent [candidate] (1.147 s) : 0, 1146782
Total [candidate] (9.197 s) : 0, 9196689
section iast_TELEMETRY_OFF
Agent [baseline] (1.136 s) : 0, 1135731
Total [baseline] (9.179 s) : 0, 9179008
Agent [candidate] (1.148 s) : 0, 1148157
Total [candidate] (9.2 s) : 0, 9200368
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.008 s -
Agent iast 1.132 s 124.18 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.137 s 128.428 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.136 s 127.503 ms (12.6%)
Total tracing 8.641 s -
Total iast 9.189 s 547.383 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.192 s 550.252 ms (6.4%)
Total iast_TELEMETRY_OFF 9.179 s 537.717 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.004 s -
Agent iast 1.147 s 143.212 ms (14.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.147 s 142.948 ms (14.2%)
Agent iast_TELEMETRY_OFF 1.148 s 144.324 ms (14.4%)
Total tracing 8.612 s -
Total iast 9.204 s 591.903 ms (6.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.197 s 584.324 ms (6.8%)
Total iast_TELEMETRY_OFF 9.2 s 588.002 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.49.0-SNAPSHOT~c06bf67bf3, baseline=1.49.0-SNAPSHOT~12da6fe499

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (672.089 ms) : 0, 672089
BytebuddyAgent [candidate] (669.258 ms) : 0, 669258
GlobalTracer [baseline] (240.394 ms) : 0, 240394
GlobalTracer [candidate] (239.328 ms) : 0, 239328
AppSec [baseline] (54.776 ms) : 0, 54776
AppSec [candidate] (54.466 ms) : 0, 54466
Debugger [baseline] (6.17 ms) : 0, 6170
Debugger [candidate] (6.158 ms) : 0, 6158
Remote Config [baseline] (704.621 µs) : 0, 705
Remote Config [candidate] (696.18 µs) : 0, 696
Telemetry [baseline] (10.728 ms) : 0, 10728
Telemetry [candidate] (10.564 ms) : 0, 10564
section iast
BytebuddyAgent [baseline] (786.904 ms) : 0, 786904
BytebuddyAgent [candidate] (797.709 ms) : 0, 797709
GlobalTracer [baseline] (229.234 ms) : 0, 229234
GlobalTracer [candidate] (231.653 ms) : 0, 231653
IAST [baseline] (22.626 ms) : 0, 22626
IAST [candidate] (22.994 ms) : 0, 22994
AppSec [baseline] (56.169 ms) : 0, 56169
AppSec [candidate] (56.723 ms) : 0, 56723
Debugger [baseline] (5.805 ms) : 0, 5805
Debugger [candidate] (5.9 ms) : 0, 5900
Remote Config [baseline] (586.713 µs) : 0, 587
Remote Config [candidate] (597.887 µs) : 0, 598
Telemetry [baseline] (7.805 ms) : 0, 7805
Telemetry [candidate] (7.96 ms) : 0, 7960
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (789.165 ms) : 0, 789165
BytebuddyAgent [candidate] (797.157 ms) : 0, 797157
GlobalTracer [baseline] (230.104 ms) : 0, 230104
GlobalTracer [candidate] (231.699 ms) : 0, 231699
IAST [baseline] (22.921 ms) : 0, 22921
IAST [candidate] (23.127 ms) : 0, 23127
AppSec [baseline] (56.63 ms) : 0, 56630
AppSec [candidate] (56.549 ms) : 0, 56549
Debugger [baseline] (5.904 ms) : 0, 5904
Debugger [candidate] (5.951 ms) : 0, 5951
Remote Config [baseline] (596.494 µs) : 0, 596
Remote Config [candidate] (605.5 µs) : 0, 606
Telemetry [baseline] (7.904 ms) : 0, 7904
Telemetry [candidate] (7.964 ms) : 0, 7964
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (790.008 ms) : 0, 790008
BytebuddyAgent [candidate] (799.626 ms) : 0, 799626
GlobalTracer [baseline] (229.526 ms) : 0, 229526
GlobalTracer [candidate] (231.867 ms) : 0, 231867
IAST [baseline] (22.227 ms) : 0, 22227
IAST [candidate] (22.482 ms) : 0, 22482
AppSec [baseline] (56.218 ms) : 0, 56218
AppSec [candidate] (56.276 ms) : 0, 56276
Debugger [baseline] (5.961 ms) : 0, 5961
Debugger [candidate] (5.874 ms) : 0, 5874
Remote Config [baseline] (600.266 µs) : 0, 600
Remote Config [candidate] (589.49 µs) : 0, 589
Telemetry [baseline] (7.712 ms) : 0, 7712
Telemetry [candidate] (7.778 ms) : 0, 7778
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.49.0-SNAPSHOT~c06bf67bf3, baseline=1.49.0-SNAPSHOT~12da6fe499

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.011 s) : 0, 1010555
Total [baseline] (10.509 s) : 0, 10509027
Agent [candidate] (1.013 s) : 0, 1013021
Total [candidate] (10.491 s) : 0, 10490810
section appsec
Agent [baseline] (1.15 s) : 0, 1149878
Total [baseline] (10.688 s) : 0, 10687648
Agent [candidate] (1.162 s) : 0, 1161951
Total [candidate] (10.774 s) : 0, 10773731
section iast
Agent [baseline] (1.137 s) : 0, 1136672
Total [baseline] (10.869 s) : 0, 10868505
Agent [candidate] (1.136 s) : 0, 1135998
Total [candidate] (10.807 s) : 0, 10806652
section profiling
Agent [baseline] (1.255 s) : 0, 1255102
Total [baseline] (10.777 s) : 0, 10776942
Agent [candidate] (1.255 s) : 0, 1255322
Total [candidate] (10.847 s) : 0, 10847265
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.011 s -
Agent appsec 1.15 s 139.323 ms (13.8%)
Agent iast 1.137 s 126.117 ms (12.5%)
Agent profiling 1.255 s 244.547 ms (24.2%)
Total tracing 10.509 s -
Total appsec 10.688 s 178.621 ms (1.7%)
Total iast 10.869 s 359.478 ms (3.4%)
Total profiling 10.777 s 267.916 ms (2.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.013 s -
Agent appsec 1.162 s 148.93 ms (14.7%)
Agent iast 1.136 s 122.978 ms (12.1%)
Agent profiling 1.255 s 242.301 ms (23.9%)
Total tracing 10.491 s -
Total appsec 10.774 s 282.921 ms (2.7%)
Total iast 10.807 s 315.842 ms (3.0%)
Total profiling 10.847 s 356.455 ms (3.4%) 
gantt
    title petclinic - break down per module: candidate=1.49.0-SNAPSHOT~c06bf67bf3, baseline=1.49.0-SNAPSHOT~12da6fe499

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (674.258 ms) : 0, 674258
BytebuddyAgent [candidate] (674.683 ms) : 0, 674683
GlobalTracer [baseline] (241.102 ms) : 0, 241102
GlobalTracer [candidate] (241.349 ms) : 0, 241349
AppSec [baseline] (54.875 ms) : 0, 54875
AppSec [candidate] (55.049 ms) : 0, 55049
Debugger [baseline] (6.227 ms) : 0, 6227
Debugger [candidate] (6.208 ms) : 0, 6208
Remote Config [baseline] (711.156 µs) : 0, 711
Remote Config [candidate] (713.996 µs) : 0, 714
Telemetry [baseline] (9.887 ms) : 0, 9887
Telemetry [candidate] (11.292 ms) : 0, 11292
section appsec
BytebuddyAgent [baseline] (688.873 ms) : 0, 688873
BytebuddyAgent [candidate] (696.59 ms) : 0, 696590
GlobalTracer [baseline] (236.94 ms) : 0, 236940
GlobalTracer [candidate] (239.239 ms) : 0, 239239
IAST [baseline] (21.774 ms) : 0, 21774
IAST [candidate] (22.372 ms) : 0, 22372
AppSec [baseline] (174.71 ms) : 0, 174710
AppSec [candidate] (176.835 ms) : 0, 176835
Debugger [baseline] (5.894 ms) : 0, 5894
Debugger [candidate] (5.938 ms) : 0, 5938
Remote Config [baseline] (629.406 µs) : 0, 629
Remote Config [candidate] (647.597 µs) : 0, 648
Telemetry [baseline] (8.543 ms) : 0, 8543
Telemetry [candidate] (7.856 ms) : 0, 7856
section iast
BytebuddyAgent [baseline] (790.09 ms) : 0, 790090
BytebuddyAgent [candidate] (789.057 ms) : 0, 789057
GlobalTracer [baseline] (229.96 ms) : 0, 229960
GlobalTracer [candidate] (230.031 ms) : 0, 230031
IAST [baseline] (22.864 ms) : 0, 22864
IAST [candidate] (22.73 ms) : 0, 22730
AppSec [baseline] (55.97 ms) : 0, 55970
AppSec [candidate] (56.397 ms) : 0, 56397
Debugger [baseline] (5.908 ms) : 0, 5908
Debugger [candidate] (5.908 ms) : 0, 5908
Remote Config [baseline] (601.35 µs) : 0, 601
Remote Config [candidate] (577.927 µs) : 0, 578
Telemetry [baseline] (7.873 ms) : 0, 7873
Telemetry [candidate] (7.85 ms) : 0, 7850
section profiling
BytebuddyAgent [baseline] (661.231 ms) : 0, 661231
BytebuddyAgent [candidate] (661.187 ms) : 0, 661187
GlobalTracer [baseline] (378.067 ms) : 0, 378067
GlobalTracer [candidate] (378.091 ms) : 0, 378091
AppSec [baseline] (54.681 ms) : 0, 54681
AppSec [candidate] (53.996 ms) : 0, 53996
Debugger [baseline] (6.115 ms) : 0, 6115
Debugger [candidate] (6.141 ms) : 0, 6141
Remote Config [baseline] (640.727 µs) : 0, 641
Remote Config [candidate] (650.917 µs) : 0, 651
Telemetry [baseline] (8.124 ms) : 0, 8124
Telemetry [candidate] (8.161 ms) : 0, 8161
ProfilingAgent [baseline] (95.983 ms) : 0, 95983
ProfilingAgent [candidate] (96.233 ms) : 0, 96233
Profiling [baseline] (96.008 ms) : 0, 96008
Profiling [candidate] (96.256 ms) : 0, 96256
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-05T17:41:55 2025-05-05T17:49:42
git_branch master mattalp/additional-jvmstat-telemetry
git_commit_date 1746263227 1746465586
git_commit_sha 12da6fe c06bf67
release_version 1.49.0-SNAPSHOT~12da6fe499 1.49.0-SNAPSHOT~c06bf67bf3
start_time 2025-05-05T17:41:41 2025-05-05T17:49:28
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1746467783 1746467783
ci_job_id 924176144 924176144
ci_pipeline_id 64149122 64149122
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-yl2rg8ey-project-304-concurrent-0-axlnakcp 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-yl2rg8ey-project-304-concurrent-0-axlnakcp 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~c06bf67bf3, baseline=1.49.0-SNAPSHOT~12da6fe499
    dateFormat X
    axisFormat %s
section baseline
no_agent (385.2 µs) : 365, 405
.   : milestone, 385,
iast (527.234 µs) : 504, 551
.   : milestone, 527,
iast_FULL (739.119 µs) : 716, 763
.   : milestone, 739,
iast_GLOBAL (584.848 µs) : 561, 609
.   : milestone, 585,
iast_HARDCODED_SECRET_DISABLED (533.546 µs) : 511, 556
.   : milestone, 534,
iast_INACTIVE (479.967 µs) : 457, 503
.   : milestone, 480,
iast_TELEMETRY_OFF (512.072 µs) : 489, 535
.   : milestone, 512,
tracing (471.028 µs) : 449, 493
.   : milestone, 471,
section candidate
no_agent (388.311 µs) : 368, 408
.   : milestone, 388,
iast (525.828 µs) : 503, 549
.   : milestone, 526,
iast_FULL (743.83 µs) : 720, 767
.   : milestone, 744,
iast_GLOBAL (568.948 µs) : 546, 592
.   : milestone, 569,
iast_HARDCODED_SECRET_DISABLED (518.738 µs) : 496, 542
.   : milestone, 519,
iast_INACTIVE (478.406 µs) : 456, 501
.   : milestone, 478,
iast_TELEMETRY_OFF (510.156 µs) : 487, 533
.   : milestone, 510,
tracing (469.269 µs) : 447, 491
.   : milestone, 469,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.2 µs [365.407 µs, 404.992 µs] -
iast 527.234 µs [503.634 µs, 550.834 µs] 142.034 µs (36.9%)
iast_FULL 739.119 µs [715.729 µs, 762.509 µs] 353.919 µs (91.9%)
iast_GLOBAL 584.848 µs [561.133 µs, 608.564 µs] 199.649 µs (51.8%)
iast_HARDCODED_SECRET_DISABLED 533.546 µs [510.801 µs, 556.291 µs] 148.347 µs (38.5%)
iast_INACTIVE 479.967 µs [456.755 µs, 503.178 µs] 94.767 µs (24.6%)
iast_TELEMETRY_OFF 512.072 µs [489.082 µs, 535.062 µs] 126.872 µs (32.9%)
tracing 471.028 µs [448.925 µs, 493.132 µs] 85.829 µs (22.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 388.311 µs [368.448 µs, 408.175 µs] -
iast 525.828 µs [502.669 µs, 548.987 µs] 137.517 µs (35.4%)
iast_FULL 743.83 µs [720.447 µs, 767.214 µs] 355.519 µs (91.6%)
iast_GLOBAL 568.948 µs [545.531 µs, 592.364 µs] 180.636 µs (46.5%)
iast_HARDCODED_SECRET_DISABLED 518.738 µs [495.875 µs, 541.602 µs] 130.427 µs (33.6%)
iast_INACTIVE 478.406 µs [455.547 µs, 501.264 µs] 90.094 µs (23.2%)
iast_TELEMETRY_OFF 510.156 µs [486.954 µs, 533.357 µs] 121.845 µs (31.4%)
tracing 469.269 µs [447.098 µs, 491.44 µs] 80.958 µs (20.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~c06bf67bf3, baseline=1.49.0-SNAPSHOT~12da6fe499
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.37 ms) : 1350, 1391
.   : milestone, 1370,
appsec (1.748 ms) : 1725, 1772
.   : milestone, 1748,
appsec_no_iast (1.748 ms) : 1723, 1772
.   : milestone, 1748,
code_origins (1.672 ms) : 1645, 1699
.   : milestone, 1672,
iast (1.532 ms) : 1509, 1556
.   : milestone, 1532,
profiling (1.524 ms) : 1501, 1547
.   : milestone, 1524,
tracing (1.508 ms) : 1483, 1533
.   : milestone, 1508,
section candidate
no_agent (1.391 ms) : 1372, 1410
.   : milestone, 1391,
appsec (1.754 ms) : 1730, 1778
.   : milestone, 1754,
appsec_no_iast (1.738 ms) : 1715, 1762
.   : milestone, 1738,
code_origins (1.714 ms) : 1686, 1743
.   : milestone, 1714,
iast (1.528 ms) : 1504, 1553
.   : milestone, 1528,
profiling (1.569 ms) : 1544, 1593
.   : milestone, 1569,
tracing (1.507 ms) : 1482, 1533
.   : milestone, 1507,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.35 ms, 1.391 ms] -
appsec 1.748 ms [1.725 ms, 1.772 ms] 377.695 µs (27.6%)
appsec_no_iast 1.748 ms [1.723 ms, 1.772 ms] 377.066 µs (27.5%)
code_origins 1.672 ms [1.645 ms, 1.699 ms] 301.323 µs (22.0%)
iast 1.532 ms [1.509 ms, 1.556 ms] 161.851 µs (11.8%)
profiling 1.524 ms [1.501 ms, 1.547 ms] 153.522 µs (11.2%)
tracing 1.508 ms [1.483 ms, 1.533 ms] 137.568 µs (10.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.391 ms [1.372 ms, 1.41 ms] -
appsec 1.754 ms [1.73 ms, 1.778 ms] 362.837 µs (26.1%)
appsec_no_iast 1.738 ms [1.715 ms, 1.762 ms] 347.216 µs (25.0%)
code_origins 1.714 ms [1.686 ms, 1.743 ms] 323.258 µs (23.2%)
iast 1.528 ms [1.504 ms, 1.553 ms] 137.2 µs (9.9%)
profiling 1.569 ms [1.544 ms, 1.593 ms] 177.759 µs (12.8%)
tracing 1.507 ms [1.482 ms, 1.533 ms] 116.42 µs (8.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/additional-jvmstat-telemetry
git_commit_date 1746263227 1746465586
git_commit_sha 12da6fe c06bf67
release_version 1.49.0-SNAPSHOT~12da6fe499 1.49.0-SNAPSHOT~c06bf67bf3
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1746468274 1746468274
ci_job_id 924176146 924176146
ci_pipeline_id 64149122 64149122
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-a5c54cuo-project-304-concurrent-2-y1c5nn3n 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-a5c54cuo-project-304-concurrent-2-y1c5nn3n 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~c06bf67bf3, baseline=1.49.0-SNAPSHOT~12da6fe499
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (2.394 ms) : 2346, 2442
.   : milestone, 2394,
iast (2.171 ms) : 2111, 2231
.   : milestone, 2171,
iast_GLOBAL (2.22 ms) : 2159, 2281
.   : milestone, 2220,
profiling (2.043 ms) : 1994, 2092
.   : milestone, 2043,
tracing (1.991 ms) : 1944, 2037
.   : milestone, 1991,
section candidate
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (2.401 ms) : 2353, 2449
.   : milestone, 2401,
iast (2.169 ms) : 2109, 2229
.   : milestone, 2169,
iast_GLOBAL (2.215 ms) : 2155, 2276
.   : milestone, 2215,
profiling (2.018 ms) : 1970, 2065
.   : milestone, 2018,
tracing (1.991 ms) : 1945, 2037
.   : milestone, 1991,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 2.394 ms [2.346 ms, 2.442 ms] 912.533 µs (61.6%)
iast 2.171 ms [2.111 ms, 2.231 ms] 689.023 µs (46.5%)
iast_GLOBAL 2.22 ms [2.159 ms, 2.281 ms] 738.222 µs (49.8%)
profiling 2.043 ms [1.994 ms, 2.092 ms] 561.456 µs (37.9%)
tracing 1.991 ms [1.944 ms, 2.037 ms] 508.806 µs (34.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 2.401 ms [2.353 ms, 2.449 ms] 923.469 µs (62.5%)
iast 2.169 ms [2.109 ms, 2.229 ms] 691.82 µs (46.8%)
iast_GLOBAL 2.215 ms [2.155 ms, 2.276 ms] 737.976 µs (50.0%)
profiling 2.018 ms [1.97 ms, 2.065 ms] 540.182 µs (36.6%)
tracing 1.991 ms [1.945 ms, 2.037 ms] 513.801 µs (34.8%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~c06bf67bf3, baseline=1.49.0-SNAPSHOT~12da6fe499
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.669 s) : 14669000, 14669000
.   : milestone, 14669000,
appsec (15.048 s) : 15048000, 15048000
.   : milestone, 15048000,
iast (19.271 s) : 19271000, 19271000
.   : milestone, 19271000,
iast_GLOBAL (17.809 s) : 17809000, 17809000
.   : milestone, 17809000,
profiling (14.95 s) : 14950000, 14950000
.   : milestone, 14950000,
tracing (15.145 s) : 15145000, 15145000
.   : milestone, 15145000,
section candidate
no_agent (15.591 s) : 15591000, 15591000
.   : milestone, 15591000,
appsec (14.991 s) : 14991000, 14991000
.   : milestone, 14991000,
iast (19.14 s) : 19140000, 19140000
.   : milestone, 19140000,
iast_GLOBAL (17.952 s) : 17952000, 17952000
.   : milestone, 17952000,
profiling (14.952 s) : 14952000, 14952000
.   : milestone, 14952000,
tracing (15.029 s) : 15029000, 15029000
.   : milestone, 15029000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.669 s [14.669 s, 14.669 s] -
appsec 15.048 s [15.048 s, 15.048 s] 379.0 ms (2.6%)
iast 19.271 s [19.271 s, 19.271 s] 4.602 s (31.4%)
iast_GLOBAL 17.809 s [17.809 s, 17.809 s] 3.14 s (21.4%)
profiling 14.95 s [14.95 s, 14.95 s] 281.0 ms (1.9%)
tracing 15.145 s [15.145 s, 15.145 s] 476.0 ms (3.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.591 s [15.591 s, 15.591 s] -
appsec 14.991 s [14.991 s, 14.991 s] -600.0 ms (-3.8%)
iast 19.14 s [19.14 s, 19.14 s] 3.549 s (22.8%)
iast_GLOBAL 17.952 s [17.952 s, 17.952 s] 2.361 s (15.1%)
profiling 14.952 s [14.952 s, 14.952 s] -639.0 ms (-4.1%)
tracing 15.029 s [15.029 s, 15.029 s] -562.0 ms (-3.6%)

@MattAlp
Copy link
Contributor Author

MattAlp commented Apr 22, 2025

Re-associating this with PROF-11678

@MattAlp MattAlp mentioned this pull request Apr 22, 2025
Merged
7 tasks
@PerfectSlayer PerfectSlayer added tag: diagnostics Diagnostics related changes and removed comp: core Tracer core comp: telemetry Telemetry labels May 2, 2025
@MattAlp MattAlp force-pushed the mattalp/additional-jvmstat-telemetry branch from 76ce22c to c06bf67 Compare May 5, 2025 17:19
@MattAlp MattAlp requested a review from smola May 5, 2025 17:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@smola smola smola approved these changes

@jbachorik jbachorik jbachorik approved these changes

@amarziali amarziali amarziali approved these changes

Assignees
No one assigned
Labels
comp: profiling Profiling tag: diagnostics Diagnostics related changes type: enhancement
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@MattAlp @smola @jbachorik @amarziali @PerfectSlayer