Skip to content

Conversation

avara1986
Copy link
Member

Description

Skip flaky test on python 3.8

Testing

Risks

Additional Notes

@avara1986 avara1986 added changelog/no-changelog A changelog entry is not required for this PR. ASM Application Security Monitoring labels Oct 7, 2025
Copy link
Contributor

github-actions bot commented Oct 7, 2025

CODEOWNERS have been resolved as:

tests/appsec/integrations/flask_tests/test_iast_flask_testagent.py      @DataDog/asm-python

Copy link
Contributor

github-actions bot commented Oct 7, 2025

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 240 ± 2 ms.

The average import time from base is: 243 ± 2 ms.

The import time difference between this PR and base is: -2.46 ± 0.1 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.014 ms (0.84%)
ddtrace.bootstrap.sitecustomize 1.334 ms (0.56%)
ddtrace.bootstrap.preload 1.334 ms (0.56%)
ddtrace.internal.remoteconfig.client 0.654 ms (0.27%)
ddtrace 0.680 ms (0.28%)
ddtrace.internal._unpatched 0.029 ms (0.01%)
json 0.029 ms (0.01%)
json.decoder 0.029 ms (0.01%)
re 0.029 ms (0.01%)
enum 0.029 ms (0.01%)
types 0.029 ms (0.01%)

@pr-commenter
Copy link

pr-commenter bot commented Oct 7, 2025

Performance SLOs

Comparing candidate avara1986/skip_py38_test (d05d831) with baseline main (57b137d)

📈 Performance Regressions (2 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.1%


✅ add_inplace_aspect

Time: ✅ 0.408µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -0.7%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.9%


✅ add_inplace_noaspect

Time: ✅ 0.322µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +1.5%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.8%


✅ add_noaspect

Time: ✅ 0.277µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.3%


✅ bytearray_aspect

Time: ✅ 1.352µs (SLO: <10.000µs 📉 -86.5%) vs baseline: +1.3%

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.7%


✅ bytearray_extend_aspect

Time: ✅ 1.522µs (SLO: <10.000µs 📉 -84.8%) vs baseline: +0.3%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.1%


✅ bytearray_extend_noaspect

Time: ✅ 0.610µs (SLO: <10.000µs 📉 -93.9%) vs baseline: -0.8%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.8%


✅ bytearray_noaspect

Time: ✅ 0.482µs (SLO: <10.000µs 📉 -95.2%) vs baseline: +0.7%

Memory: ✅ 37.749MB (SLO: <39.000MB -3.2%) vs baseline: +4.1%


✅ bytes_aspect

Time: ✅ 1.284µs (SLO: <10.000µs 📉 -87.2%) vs baseline: -1.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.0%


✅ bytes_noaspect

Time: ✅ 0.495µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.5%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%


✅ bytesio_aspect

Time: ✅ 1.364µs (SLO: <10.000µs 📉 -86.4%) vs baseline: +0.2%

Memory: ✅ 37.965MB (SLO: <39.000MB -2.7%) vs baseline: +4.5%


✅ bytesio_noaspect

Time: ✅ 0.503µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +1.1%

Memory: ✅ 38.103MB (SLO: <39.000MB -2.3%) vs baseline: +4.9%


✅ capitalize_aspect

Time: ✅ 0.733µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -1.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +3.8%


✅ capitalize_noaspect

Time: ✅ 0.436µs (SLO: <10.000µs 📉 -95.6%) vs baseline: +0.2%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +3.8%


✅ casefold_aspect

Time: ✅ 0.730µs (SLO: <10.000µs 📉 -92.7%) vs baseline: -0.6%

Memory: ✅ 38.004MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%


✅ casefold_noaspect

Time: ✅ 0.368µs (SLO: <10.000µs 📉 -96.3%) vs baseline: ~same

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%


✅ decode_aspect

Time: ✅ 0.724µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.9%


✅ decode_noaspect

Time: ✅ 0.417µs (SLO: <10.000µs 📉 -95.8%) vs baseline: -0.3%

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.7%


✅ encode_aspect

Time: ✅ 0.714µs (SLO: <10.000µs 📉 -92.9%) vs baseline: +0.9%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.8%


✅ encode_noaspect

Time: ✅ 0.401µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.4%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.8%


✅ format_aspect

Time: ✅ 3.389µs (SLO: <10.000µs 📉 -66.1%) vs baseline: +0.5%

Memory: ✅ 37.945MB (SLO: <39.000MB -2.7%) vs baseline: +4.6%


✅ format_map_aspect

Time: ✅ 3.703µs (SLO: <10.000µs 📉 -63.0%) vs baseline: +3.0%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.9%


✅ format_map_noaspect

Time: ✅ 0.792µs (SLO: <10.000µs 📉 -92.1%) vs baseline: +2.4%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.0%


✅ format_noaspect

Time: ✅ 0.594µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.7%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%


✅ index_aspect

Time: ✅ 0.360µs (SLO: <10.000µs 📉 -96.4%) vs baseline: -0.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.2%


✅ index_noaspect

Time: ✅ 0.279µs (SLO: <10.000µs 📉 -97.2%) vs baseline: +0.6%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%


✅ join_aspect

Time: ✅ 1.363µs (SLO: <10.000µs 📉 -86.4%) vs baseline: +0.4%

Memory: ✅ 37.965MB (SLO: <39.000MB -2.7%) vs baseline: +4.5%


✅ join_noaspect

Time: ✅ 0.490µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -1.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.0%


✅ ljust_aspect

Time: ✅ 2.555µs (SLO: <20.000µs 📉 -87.2%) vs baseline: -0.8%

Memory: ✅ 37.827MB (SLO: <39.000MB -3.0%) vs baseline: +4.2%


✅ ljust_noaspect

Time: ✅ 0.404µs (SLO: <10.000µs 📉 -96.0%) vs baseline: +0.4%

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.7%


✅ lower_aspect

Time: ✅ 2.295µs (SLO: <10.000µs 📉 -77.1%) vs baseline: +4.9%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%


✅ lower_noaspect

Time: ✅ 0.366µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.8%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.9%


✅ lstrip_aspect

Time: ✅ 2.500µs (SLO: <20.000µs 📉 -87.5%) vs baseline: 📈 +13.9%

Memory: ✅ 37.926MB (SLO: <39.000MB -2.8%) vs baseline: +4.4%


✅ lstrip_noaspect

Time: ✅ 0.381µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.2%

Memory: ✅ 38.063MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%


✅ modulo_aspect

Time: ✅ 0.987µs (SLO: <10.000µs 📉 -90.1%) vs baseline: ~same

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +3.5%


✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.533µs (SLO: <10.000µs 📉 -84.7%) vs baseline: -0.6%

Memory: ✅ 37.886MB (SLO: <39.000MB -2.9%) vs baseline: +4.3%


✅ modulo_aspect_for_bytes

Time: ✅ 0.977µs (SLO: <10.000µs 📉 -90.2%) vs baseline: -0.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +3.9%


✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.238µs (SLO: <10.000µs 📉 -87.6%) vs baseline: -0.6%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +3.9%


✅ modulo_noaspect

Time: ✅ 0.626µs (SLO: <10.000µs 📉 -93.7%) vs baseline: -0.5%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +5.0%


✅ replace_aspect

Time: ✅ 4.829µs (SLO: <10.000µs 📉 -51.7%) vs baseline: +0.1%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ replace_noaspect

Time: ✅ 0.460µs (SLO: <10.000µs 📉 -95.4%) vs baseline: -0.7%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.9%


✅ repr_aspect

Time: ✅ 0.906µs (SLO: <10.000µs 📉 -90.9%) vs baseline: ~same

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.9%


✅ repr_noaspect

Time: ✅ 0.413µs (SLO: <10.000µs 📉 -95.9%) vs baseline: -1.0%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.3%


✅ rstrip_aspect

Time: ✅ 1.919µs (SLO: <20.000µs 📉 -90.4%) vs baseline: +0.8%

Memory: ✅ 37.926MB (SLO: <39.000MB -2.8%) vs baseline: +4.4%


✅ rstrip_noaspect

Time: ✅ 0.377µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -0.6%

Memory: ✅ 38.083MB (SLO: <39.000MB -2.4%) vs baseline: +4.8%


✅ slice_aspect

Time: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.9%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.2%


✅ slice_noaspect

Time: ✅ 0.449µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +1.0%

Memory: ✅ 37.985MB (SLO: <39.000MB -2.6%) vs baseline: +4.6%


✅ stringio_aspect

Time: ✅ 1.569µs (SLO: <10.000µs 📉 -84.3%) vs baseline: +0.6%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.7%


✅ stringio_noaspect

Time: ✅ 0.716µs (SLO: <10.000µs 📉 -92.8%) vs baseline: -1.0%

Memory: ✅ 37.945MB (SLO: <39.000MB -2.7%) vs baseline: +4.5%


✅ strip_aspect

Time: ✅ 2.181µs (SLO: <20.000µs 📉 -89.1%) vs baseline: +0.2%

Memory: ✅ 37.945MB (SLO: <39.000MB -2.7%) vs baseline: +4.5%


✅ strip_noaspect

Time: ✅ 0.386µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -1.1%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.6%


✅ swapcase_aspect

Time: ✅ 2.401µs (SLO: <10.000µs 📉 -76.0%) vs baseline: ~same

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.6%


✅ swapcase_noaspect

Time: ✅ 0.539µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +0.6%

Memory: ✅ 38.024MB (SLO: <39.000MB -2.5%) vs baseline: +4.7%


✅ title_aspect

Time: ✅ 2.335µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -0.3%

Memory: ✅ 37.906MB (SLO: <39.000MB -2.8%) vs baseline: +4.6%


✅ title_noaspect

Time: ✅ 0.507µs (SLO: <10.000µs 📉 -94.9%) vs baseline: +0.2%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.8%


✅ translate_aspect

Time: ✅ 3.242µs (SLO: <10.000µs 📉 -67.6%) vs baseline: +0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.5%


✅ translate_noaspect

Time: ✅ 1.046µs (SLO: <10.000µs 📉 -89.5%) vs baseline: +0.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +3.9%


✅ upper_aspect

Time: ✅ 2.209µs (SLO: <10.000µs 📉 -77.9%) vs baseline: +1.0%

Memory: ✅ 37.768MB (SLO: <39.000MB -3.2%) vs baseline: +4.0%


✅ upper_noaspect

Time: ✅ 0.367µs (SLO: <10.000µs 📉 -96.3%) vs baseline: -0.8%

Memory: ✅ 38.044MB (SLO: <39.000MB -2.5%) vs baseline: +4.6%


📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.182µs (SLO: <20.000µs 📉 -84.1%) vs baseline: +3.8%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%


✅ 1-count-metrics-100-times

Time: ✅ 213.102µs (SLO: <250.000µs 📉 -14.8%) vs baseline: +1.0%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +5.0%


✅ 1-distribution-metric-1-times

Time: ✅ 3.248µs (SLO: <20.000µs 📉 -83.8%) vs baseline: 📈 +13.1%

Memory: ✅ 32.086MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%


✅ 1-distribution-metrics-100-times

Time: ✅ 190.063µs (SLO: <220.000µs 📉 -13.6%) vs baseline: -0.3%

Memory: ✅ 32.185MB (SLO: <34.000MB -5.3%) vs baseline: +4.9%


✅ 1-gauge-metric-1-times

Time: ✅ 2.143µs (SLO: <20.000µs 📉 -89.3%) vs baseline: +4.7%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%


✅ 1-gauge-metrics-100-times

Time: ✅ 124.897µs (SLO: <150.000µs 📉 -16.7%) vs baseline: +1.0%

Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.5%


✅ 1-rate-metric-1-times

Time: ✅ 3.242µs (SLO: <20.000µs 📉 -83.8%) vs baseline: +4.4%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.9%


✅ 1-rate-metrics-100-times

Time: ✅ 212.801µs (SLO: <250.000µs 📉 -14.9%) vs baseline: +0.4%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.1%


✅ 100-count-metrics-100-times

Time: ✅ 21.859ms (SLO: <23.500ms -7.0%) vs baseline: +1.5%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%


✅ 100-distribution-metrics-100-times

Time: ✅ 2.004ms (SLO: <2.250ms 📉 -10.9%) vs baseline: +1.6%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +5.3%


✅ 100-gauge-metrics-100-times

Time: ✅ 1.287ms (SLO: <1.550ms 📉 -17.0%) vs baseline: -0.9%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +5.1%


✅ 100-rate-metrics-100-times

Time: ✅ 2.196ms (SLO: <2.550ms 📉 -13.9%) vs baseline: -0.4%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.2%


✅ flush-1-metric

Time: ✅ 4.179µs (SLO: <20.000µs 📉 -79.1%) vs baseline: +2.2%

Memory: ✅ 32.027MB (SLO: <34.000MB -5.8%) vs baseline: +4.6%


✅ flush-100-metrics

Time: ✅ 182.113µs (SLO: <250.000µs 📉 -27.2%) vs baseline: +0.6%

Memory: ✅ 32.204MB (SLO: <34.000MB -5.3%) vs baseline: +5.2%


✅ flush-1000-metrics

Time: ✅ 2.209ms (SLO: <2.500ms 📉 -11.6%) vs baseline: ~same

Memory: ✅ 32.932MB (SLO: <34.500MB -4.5%) vs baseline: +4.7%

🟡 Near SLO Breach (4 suites)
🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 20.516ms (SLO: <22.300ms -8.0%) vs baseline: +0.4%

Memory: ✅ 65.475MB (SLO: <67.000MB -2.3%) vs baseline: +5.0%


✅ exception-replay-enabled

Time: ✅ 1.347ms (SLO: <1.450ms -7.1%) vs baseline: -0.3%

Memory: ✅ 64.446MB (SLO: <67.000MB -3.8%) vs baseline: +4.7%


✅ iast

Time: ✅ 20.531ms (SLO: <22.250ms -7.7%) vs baseline: ~same

Memory: ✅ 65.493MB (SLO: <67.000MB -2.2%) vs baseline: +5.0%


✅ profiler

Time: ✅ 15.327ms (SLO: <16.550ms -7.4%) vs baseline: +0.3%

Memory: ✅ 53.707MB (SLO: <54.500MB 🟡 -1.5%) vs baseline: +4.7%


✅ resource-renaming

Time: ✅ 20.559ms (SLO: <21.750ms -5.5%) vs baseline: ~same

Memory: ✅ 65.464MB (SLO: <67.000MB -2.3%) vs baseline: +4.8%


✅ span-code-origin

Time: ✅ 26.184ms (SLO: <28.200ms -7.2%) vs baseline: +0.3%

Memory: ✅ 67.583MB (SLO: <69.500MB -2.8%) vs baseline: +4.8%


✅ tracer

Time: ✅ 20.477ms (SLO: <21.750ms -5.9%) vs baseline: ~same

Memory: ✅ 65.538MB (SLO: <67.000MB -2.2%) vs baseline: +5.1%


✅ tracer-and-profiler

Time: ✅ 22.039ms (SLO: <23.500ms -6.2%) vs baseline: ~same

Memory: ✅ 66.598MB (SLO: <67.500MB 🟡 -1.3%) vs baseline: +4.8%


✅ tracer-dont-create-db-spans

Time: ✅ 19.380ms (SLO: <21.500ms -9.9%) vs baseline: +0.2%

Memory: ✅ 65.497MB (SLO: <66.000MB 🟡 -0.8%) vs baseline: +4.8%


✅ tracer-minimal

Time: ✅ 16.628ms (SLO: <17.500ms -5.0%) vs baseline: +0.5%

Memory: ✅ 65.497MB (SLO: <66.000MB 🟡 -0.8%) vs baseline: +5.1%


✅ tracer-native

Time: ✅ 20.546ms (SLO: <21.750ms -5.5%) vs baseline: +0.2%

Memory: ✅ 71.362MB (SLO: <72.500MB 🟡 -1.6%) vs baseline: +4.8%


✅ tracer-no-caches

Time: ✅ 18.479ms (SLO: <19.650ms -6.0%) vs baseline: +0.1%

Memory: ✅ 65.559MB (SLO: <67.000MB -2.2%) vs baseline: +5.0%


✅ tracer-no-databases

Time: ✅ 18.778ms (SLO: <20.100ms -6.6%) vs baseline: -0.1%

Memory: ✅ 65.225MB (SLO: <67.000MB -2.6%) vs baseline: +4.6%


✅ tracer-no-middleware

Time: ✅ 20.155ms (SLO: <21.500ms -6.3%) vs baseline: +0.1%

Memory: ✅ 65.459MB (SLO: <67.000MB -2.3%) vs baseline: +4.9%


✅ tracer-no-templates

Time: ✅ 20.334ms (SLO: <22.000ms -7.6%) vs baseline: ~same

Memory: ✅ 65.449MB (SLO: <67.000MB -2.3%) vs baseline: +5.0%


🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 18.096ms (SLO: <19.850ms -8.8%) vs baseline: ~same

Memory: ✅ 65.352MB (SLO: <66.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ errortracking-enabled-user

Time: ✅ 18.227ms (SLO: <19.400ms -6.0%) vs baseline: +0.8%

Memory: ✅ 65.372MB (SLO: <66.500MB 🟡 -1.7%) vs baseline: +4.9%


✅ tracer-enabled

Time: ✅ 18.075ms (SLO: <19.450ms -7.1%) vs baseline: ~same

Memory: ✅ 65.274MB (SLO: <66.500MB 🟡 -1.8%) vs baseline: +4.9%


🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 4.588ms (SLO: <4.750ms -3.4%) vs baseline: +0.3%

Memory: ✅ 61.951MB (SLO: <65.000MB -4.7%) vs baseline: +4.8%


✅ appsec-post

Time: ✅ 6.582ms (SLO: <6.750ms -2.5%) vs baseline: +0.3%

Memory: ✅ 61.991MB (SLO: <65.000MB -4.6%) vs baseline: +4.9%


✅ appsec-telemetry

Time: ✅ 4.580ms (SLO: <4.750ms -3.6%) vs baseline: +0.3%

Memory: ✅ 61.912MB (SLO: <65.000MB -4.8%) vs baseline: +4.9%


✅ debugger

Time: ✅ 1.857ms (SLO: <2.000ms -7.2%) vs baseline: -0.1%

Memory: ✅ 45.377MB (SLO: <47.000MB -3.5%) vs baseline: +4.8%


✅ iast-get

Time: ✅ 1.863ms (SLO: <2.000ms -6.9%) vs baseline: +0.1%

Memory: ✅ 42.330MB (SLO: <49.000MB 📉 -13.6%) vs baseline: +4.9%


✅ profiler

Time: ✅ 1.906ms (SLO: <2.100ms -9.3%) vs baseline: -0.4%

Memory: ✅ 46.399MB (SLO: <47.000MB 🟡 -1.3%) vs baseline: +4.8%


✅ resource-renaming

Time: ✅ 3.382ms (SLO: <3.650ms -7.3%) vs baseline: ~same

Memory: ✅ 52.160MB (SLO: <53.500MB -2.5%) vs baseline: +4.7%


✅ tracer

Time: ✅ 3.374ms (SLO: <3.650ms -7.6%) vs baseline: +0.2%

Memory: ✅ 52.219MB (SLO: <53.500MB -2.4%) vs baseline: +4.8%


✅ tracer-native

Time: ✅ 3.376ms (SLO: <3.650ms -7.5%) vs baseline: +0.3%

Memory: ✅ 58.288MB (SLO: <60.000MB -2.9%) vs baseline: +4.7%


🟡 otelspan - 22/22

✅ add-event

Time: ✅ 45.131ms (SLO: <47.150ms -4.3%) vs baseline: -0.1%

Memory: ✅ 45.306MB (SLO: <47.000MB -3.6%) vs baseline: +4.9%


✅ add-metrics

Time: ✅ 321.880ms (SLO: <344.800ms -6.6%) vs baseline: +1.0%

Memory: ✅ 553.796MB (SLO: <562.000MB 🟡 -1.5%) vs baseline: +5.0%


✅ add-tags

Time: ✅ 292.255ms (SLO: <314.000ms -6.9%) vs baseline: -0.3%

Memory: ✅ 554.824MB (SLO: <563.500MB 🟡 -1.5%) vs baseline: +5.0%


✅ get-context

Time: ✅ 83.832ms (SLO: <92.350ms -9.2%) vs baseline: +0.4%

Memory: ✅ 40.299MB (SLO: <46.500MB 📉 -13.3%) vs baseline: +4.8%


✅ is-recording

Time: ✅ 43.877ms (SLO: <44.500ms 🟡 -1.4%) vs baseline: +2.2%

Memory: ✅ 44.575MB (SLO: <47.500MB -6.2%) vs baseline: +4.7%


✅ record-exception

Time: ✅ 61.619ms (SLO: <67.650ms -8.9%) vs baseline: ~same

Memory: ✅ 40.532MB (SLO: <47.000MB 📉 -13.8%) vs baseline: +4.4%


✅ set-status

Time: ✅ 48.607ms (SLO: <50.400ms -3.6%) vs baseline: -0.4%

Memory: ✅ 44.608MB (SLO: <47.000MB -5.1%) vs baseline: +4.9%


✅ start

Time: ✅ 42.098ms (SLO: <43.450ms -3.1%) vs baseline: -0.4%

Memory: ✅ 44.618MB (SLO: <47.000MB -5.1%) vs baseline: +4.9%


✅ start-finish

Time: ✅ 85.005ms (SLO: <88.000ms -3.4%) vs baseline: +0.5%

Memory: ✅ 34.623MB (SLO: <46.500MB 📉 -25.5%) vs baseline: +5.0%


✅ start-finish-telemetry

Time: ✅ 86.429ms (SLO: <89.000ms -2.9%) vs baseline: ~same

Memory: ✅ 34.583MB (SLO: <46.500MB 📉 -25.6%) vs baseline: +4.8%


✅ update-name

Time: ✅ 44.391ms (SLO: <45.150ms 🟡 -1.7%) vs baseline: +0.5%

Memory: ✅ 45.003MB (SLO: <47.000MB -4.2%) vs baseline: +4.8%

⚠️ Unstable Tests (1 suite)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.277µs (SLO: <20.000µs 📉 -33.6%) vs baseline: +0.2%

Memory: ✅ 32.067MB (SLO: <33.500MB -4.3%) vs baseline: +4.6%


✅ context_with_data_no_listeners

Time: ✅ 3.297µs (SLO: <10.000µs 📉 -67.0%) vs baseline: +1.7%

Memory: ✅ 32.067MB (SLO: <33.500MB -4.3%) vs baseline: +4.6%


✅ get_item_exists

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: -0.9%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +5.2%


✅ get_item_missing

Time: ✅ 0.638µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.9%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%


✅ set_item

Time: ✅ 24.392µs (SLO: <30.000µs 📉 -18.7%) vs baseline: +0.6%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.8%

✅ All Tests Passing (17 suites)
errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.088ms (SLO: <2.300ms -9.2%) vs baseline: ~same

Memory: ✅ 52.003MB (SLO: <53.500MB -2.8%) vs baseline: +4.5%


✅ errortracking-enabled-user

Time: ✅ 2.102ms (SLO: <2.250ms -6.6%) vs baseline: +1.1%

Memory: ✅ 52.022MB (SLO: <53.500MB -2.8%) vs baseline: +4.5%


✅ tracer-enabled

Time: ✅ 2.090ms (SLO: <2.300ms -9.1%) vs baseline: +0.1%

Memory: ✅ 52.062MB (SLO: <53.500MB -2.7%) vs baseline: +4.7%


flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 3.933ms (SLO: <4.200ms -6.3%) vs baseline: +0.1%

Memory: ✅ 62.167MB (SLO: <66.000MB -5.8%) vs baseline: +4.8%


✅ iast-enabled

Time: ✅ 2.450ms (SLO: <2.800ms 📉 -12.5%) vs baseline: -1.0%

Memory: ✅ 58.707MB (SLO: <60.000MB -2.2%) vs baseline: +5.1%


✅ tracer-enabled

Time: ✅ 2.071ms (SLO: <2.250ms -7.9%) vs baseline: -0.2%

Memory: ✅ 52.239MB (SLO: <54.500MB -4.1%) vs baseline: +4.8%


httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 80.967µs (SLO: <100.000µs 📉 -19.0%) vs baseline: +0.1%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%


✅ b3_headers

Time: ✅ 14.560µs (SLO: <20.000µs 📉 -27.2%) vs baseline: +1.8%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%


✅ b3_single_headers

Time: ✅ 13.453µs (SLO: <20.000µs 📉 -32.7%) vs baseline: +0.6%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 63.681µs (SLO: <80.000µs 📉 -20.4%) vs baseline: +1.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 65.582µs (SLO: <80.000µs 📉 -18.0%) vs baseline: +0.3%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%


✅ empty_headers

Time: ✅ 1.586µs (SLO: <10.000µs 📉 -84.1%) vs baseline: -0.7%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ full_t_id_datadog_headers

Time: ✅ 22.936µs (SLO: <30.000µs 📉 -23.5%) vs baseline: -0.2%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.6%


✅ invalid_priority_header

Time: ✅ 6.498µs (SLO: <10.000µs 📉 -35.0%) vs baseline: -0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.1%


✅ invalid_span_id_header

Time: ✅ 6.648µs (SLO: <10.000µs 📉 -33.5%) vs baseline: +1.3%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.7%


✅ invalid_tags_header

Time: ✅ 6.555µs (SLO: <10.000µs 📉 -34.4%) vs baseline: +0.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ invalid_trace_id_header

Time: ✅ 6.538µs (SLO: <10.000µs 📉 -34.6%) vs baseline: +0.1%

Memory: ✅ 32.126MB (SLO: <33.500MB -4.1%) vs baseline: +4.7%


✅ large_header_no_matches

Time: ✅ 27.601µs (SLO: <30.000µs -8.0%) vs baseline: +0.2%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%


✅ large_valid_headers_all

Time: ✅ 28.693µs (SLO: <40.000µs 📉 -28.3%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ medium_header_no_matches

Time: ✅ 9.886µs (SLO: <20.000µs 📉 -50.6%) vs baseline: +0.6%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ medium_valid_headers_all

Time: ✅ 11.356µs (SLO: <20.000µs 📉 -43.2%) vs baseline: +0.2%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%


✅ none_propagation_style

Time: ✅ 1.688µs (SLO: <10.000µs 📉 -83.1%) vs baseline: -0.8%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ tracecontext_headers

Time: ✅ 34.440µs (SLO: <40.000µs 📉 -13.9%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


✅ valid_headers_all

Time: ✅ 6.544µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.1%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +5.1%


✅ valid_headers_basic

Time: ✅ 6.077µs (SLO: <10.000µs 📉 -39.2%) vs baseline: -0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.8%


✅ wsgi_empty_headers

Time: ✅ 1.604µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.8%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.8%


✅ wsgi_invalid_priority_header

Time: ✅ 6.568µs (SLO: <10.000µs 📉 -34.3%) vs baseline: -0.2%

Memory: ✅ 32.145MB (SLO: <33.500MB -4.0%) vs baseline: +4.7%


✅ wsgi_invalid_span_id_header

Time: ✅ 1.597µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -0.2%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%


✅ wsgi_invalid_tags_header

Time: ✅ 6.595µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.3%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%


✅ wsgi_invalid_trace_id_header

Time: ✅ 6.647µs (SLO: <10.000µs 📉 -33.5%) vs baseline: +0.6%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%


✅ wsgi_large_header_no_matches

Time: ✅ 28.749µs (SLO: <40.000µs 📉 -28.1%) vs baseline: +0.1%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +5.0%


✅ wsgi_large_valid_headers_all

Time: ✅ 29.730µs (SLO: <40.000µs 📉 -25.7%) vs baseline: +0.1%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.1%


✅ wsgi_medium_header_no_matches

Time: ✅ 10.100µs (SLO: <20.000µs 📉 -49.5%) vs baseline: +0.1%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


✅ wsgi_medium_valid_headers_all

Time: ✅ 11.457µs (SLO: <20.000µs 📉 -42.7%) vs baseline: -1.1%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ wsgi_valid_headers_all

Time: ✅ 6.561µs (SLO: <10.000µs 📉 -34.4%) vs baseline: -0.1%

Memory: ✅ 32.165MB (SLO: <33.500MB -4.0%) vs baseline: +4.9%


✅ wsgi_valid_headers_basic

Time: ✅ 6.161µs (SLO: <10.000µs 📉 -38.4%) vs baseline: ~same

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.693µs (SLO: <30.000µs 📉 -27.7%) vs baseline: -0.2%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%


✅ with_all

Time: ✅ 28.851µs (SLO: <40.000µs 📉 -27.9%) vs baseline: -0.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.7%


✅ with_dd_origin

Time: ✅ 25.319µs (SLO: <30.000µs 📉 -15.6%) vs baseline: -0.5%

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ with_priority_and_origin

Time: ✅ 24.804µs (SLO: <40.000µs 📉 -38.0%) vs baseline: ~same

Memory: ✅ 32.224MB (SLO: <33.500MB -3.8%) vs baseline: +5.0%


✅ with_sampling_priority

Time: ✅ 22.484µs (SLO: <30.000µs 📉 -25.1%) vs baseline: +4.3%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ with_tags

Time: ✅ 27.122µs (SLO: <40.000µs 📉 -32.2%) vs baseline: +0.4%

Memory: ✅ 32.204MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ with_tags_invalid

Time: ✅ 28.652µs (SLO: <40.000µs 📉 -28.4%) vs baseline: +1.0%

Memory: ✅ 32.185MB (SLO: <33.500MB -3.9%) vs baseline: +4.9%


✅ with_tags_max_size

Time: ✅ 27.504µs (SLO: <40.000µs 📉 -31.2%) vs baseline: +0.4%

Memory: ✅ 32.244MB (SLO: <33.500MB -3.8%) vs baseline: +5.2%


iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 32.257µs (SLO: <40.000µs 📉 -19.4%) vs baseline: -0.3%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ re_expand_noaspect

Time: ✅ 30.096µs (SLO: <40.000µs 📉 -24.8%) vs baseline: +5.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ re_findall_aspect

Time: ✅ 2.907µs (SLO: <10.000µs 📉 -70.9%) vs baseline: -0.5%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.6%


✅ re_findall_noaspect

Time: ✅ 1.425µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +0.7%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ re_finditer_aspect

Time: ✅ 4.444µs (SLO: <10.000µs 📉 -55.6%) vs baseline: +0.7%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ re_finditer_noaspect

Time: ✅ 1.413µs (SLO: <10.000µs 📉 -85.9%) vs baseline: -0.5%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ re_fullmatch_aspect

Time: ✅ 2.937µs (SLO: <10.000µs 📉 -70.6%) vs baseline: +9.9%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ re_fullmatch_noaspect

Time: ✅ 1.297µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ re_group_aspect

Time: ✅ 2.939µs (SLO: <10.000µs 📉 -70.6%) vs baseline: -3.0%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ re_group_noaspect

Time: ✅ 1.616µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.6%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%


✅ re_groups_aspect

Time: ✅ 3.082µs (SLO: <10.000µs 📉 -69.2%) vs baseline: -5.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ re_groups_noaspect

Time: ✅ 1.704µs (SLO: <10.000µs 📉 -83.0%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.7%


✅ re_match_aspect

Time: ✅ 2.717µs (SLO: <10.000µs 📉 -72.8%) vs baseline: -2.9%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ re_match_noaspect

Time: ✅ 1.292µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -0.6%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ re_search_aspect

Time: ✅ 2.544µs (SLO: <10.000µs 📉 -74.6%) vs baseline: -1.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ re_search_noaspect

Time: ✅ 1.197µs (SLO: <10.000µs 📉 -88.0%) vs baseline: -0.6%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ re_sub_aspect

Time: ✅ 3.398µs (SLO: <10.000µs 📉 -66.0%) vs baseline: -0.3%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%


✅ re_sub_noaspect

Time: ✅ 1.533µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +0.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ re_subn_aspect

Time: ✅ 3.858µs (SLO: <10.000µs 📉 -61.4%) vs baseline: +4.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ re_subn_noaspect

Time: ✅ 1.605µs (SLO: <10.000µs 📉 -84.0%) vs baseline: -1.8%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.4%


iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 4.203µs (SLO: <10.000µs 📉 -58.0%) vs baseline: +0.5%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ ospathbasename_noaspect

Time: ✅ 1.078µs (SLO: <10.000µs 📉 -89.2%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%


✅ ospathjoin_aspect

Time: ✅ 6.096µs (SLO: <10.000µs 📉 -39.0%) vs baseline: +0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ ospathjoin_noaspect

Time: ✅ 2.305µs (SLO: <10.000µs 📉 -77.0%) vs baseline: ~same

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ ospathnormcase_aspect

Time: ✅ 3.472µs (SLO: <10.000µs 📉 -65.3%) vs baseline: -0.3%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


✅ ospathnormcase_noaspect

Time: ✅ 0.568µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.7%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.5%


✅ ospathsplit_aspect

Time: ✅ 4.731µs (SLO: <10.000µs 📉 -52.7%) vs baseline: +0.6%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ ospathsplit_noaspect

Time: ✅ 1.600µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ ospathsplitdrive_aspect

Time: ✅ 3.661µs (SLO: <10.000µs 📉 -63.4%) vs baseline: +0.3%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%


✅ ospathsplitdrive_noaspect

Time: ✅ 0.696µs (SLO: <10.000µs 📉 -93.0%) vs baseline: +0.2%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ ospathsplitext_aspect

Time: ✅ 4.494µs (SLO: <10.000µs 📉 -55.1%) vs baseline: ~same

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +5.2%


✅ ospathsplitext_noaspect

Time: ✅ 1.380µs (SLO: <10.000µs 📉 -86.2%) vs baseline: -0.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.405µs (SLO: <10.000µs 📉 -85.9%) vs baseline: +0.6%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%


✅ rsplit_noaspect

Time: ✅ 0.587µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.9%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +5.0%


✅ split_aspect

Time: ✅ 1.387µs (SLO: <10.000µs 📉 -86.1%) vs baseline: +0.4%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ split_noaspect

Time: ✅ 0.570µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.1%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.9%


✅ splitlines_aspect

Time: ✅ 1.381µs (SLO: <10.000µs 📉 -86.2%) vs baseline: +0.2%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.9%


✅ splitlines_noaspect

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.6%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%


iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.402µs (SLO: <60.000µs 📉 -17.7%) vs baseline: -0.1%

Memory: ✅ 37.709MB (SLO: <39.000MB -3.3%) vs baseline: +5.0%


✅ propagation_enabled

Time: ✅ 171.351µs (SLO: <190.000µs -9.8%) vs baseline: -0.4%

Memory: ✅ 37.729MB (SLO: <39.000MB -3.3%) vs baseline: +4.8%


✅ propagation_enabled_100

Time: ✅ 1.952ms (SLO: <2.300ms 📉 -15.1%) vs baseline: +3.2%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


✅ propagation_enabled_1000

Time: ✅ 32.291ms (SLO: <34.550ms -6.5%) vs baseline: +0.4%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%


otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.265ms (SLO: <42.000ms -4.1%) vs baseline: -0.2%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.1%


✅ add-link

Time: ✅ 36.434ms (SLO: <38.550ms -5.5%) vs baseline: -0.2%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.1%


✅ add-metrics

Time: ✅ 218.407ms (SLO: <232.000ms -5.9%) vs baseline: -0.2%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%


✅ add-tags

Time: ✅ 211.567ms (SLO: <221.600ms -4.5%) vs baseline: -0.7%

Memory: ✅ 34.505MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.4%


✅ get-context

Time: ✅ 29.164ms (SLO: <31.300ms -6.8%) vs baseline: +0.3%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.7%


✅ is-recording

Time: ✅ 29.161ms (SLO: <31.000ms -5.9%) vs baseline: +0.3%

Memory: ✅ 34.544MB (SLO: <39.000MB 📉 -11.4%) vs baseline: +4.9%


✅ record-exception

Time: ✅ 62.901ms (SLO: <65.850ms -4.5%) vs baseline: -0.9%

Memory: ✅ 34.878MB (SLO: <39.000MB 📉 -10.6%) vs baseline: +4.8%


✅ set-status

Time: ✅ 31.843ms (SLO: <34.150ms -6.8%) vs baseline: -1.0%

Memory: ✅ 34.603MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.1%


✅ start

Time: ✅ 28.813ms (SLO: <30.150ms -4.4%) vs baseline: -0.3%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +4.7%


✅ start-finish

Time: ✅ 33.695ms (SLO: <35.350ms -4.7%) vs baseline: -1.0%

Memory: ✅ 34.485MB (SLO: <39.000MB 📉 -11.6%) vs baseline: +4.7%


✅ start-finish-telemetry

Time: ✅ 34.042ms (SLO: <35.450ms -4.0%) vs baseline: ~same

Memory: ✅ 34.603MB (SLO: <39.000MB 📉 -11.3%) vs baseline: +5.2%


✅ update-name

Time: ✅ 31.040ms (SLO: <33.400ms -7.1%) vs baseline: +0.1%

Memory: ✅ 34.524MB (SLO: <39.000MB 📉 -11.5%) vs baseline: +4.8%


packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 341.974ms (SLO: <354.300ms -3.5%) vs baseline: -0.5%

Memory: ✅ 38.087MB (SLO: <40.000MB -4.8%) vs baseline: +5.2%


✅ cache_on

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.1%) vs baseline: +0.8%

Memory: ✅ 37.540MB (SLO: <39.000MB -3.7%) vs baseline: +4.7%


packagesupdateimporteddependencies - 24/24

✅ import_many

Time: ✅ 156.019µs (SLO: <170.000µs -8.2%) vs baseline: +0.4%

Memory: ✅ 37.279MB (SLO: <38.500MB -3.2%) vs baseline: +5.4%


✅ import_many_cached

Time: ✅ 120.750µs (SLO: <130.000µs -7.1%) vs baseline: -0.1%

Memory: ✅ 37.183MB (SLO: <38.500MB -3.4%) vs baseline: +4.6%


✅ import_many_stdlib

Time: ✅ 1.637ms (SLO: <1.750ms -6.5%) vs baseline: ~same

Memory: ✅ 37.400MB (SLO: <38.500MB -2.9%) vs baseline: +4.7%


✅ import_many_stdlib_cached

Time: ✅ 0.977ms (SLO: <1.100ms 📉 -11.2%) vs baseline: -1.0%

Memory: ✅ 37.437MB (SLO: <38.500MB -2.8%) vs baseline: +5.0%


✅ import_many_unknown

Time: ✅ 824.447µs (SLO: <890.000µs -7.4%) vs baseline: -1.2%

Memory: ✅ 37.453MB (SLO: <38.500MB -2.7%) vs baseline: +5.0%


✅ import_many_unknown_cached

Time: ✅ 790.484µs (SLO: <870.000µs -9.1%) vs baseline: -0.7%

Memory: ✅ 37.481MB (SLO: <38.500MB -2.6%) vs baseline: +5.3%


✅ import_one

Time: ✅ 19.673µs (SLO: <30.000µs 📉 -34.4%) vs baseline: -0.9%

Memory: ✅ 37.191MB (SLO: <39.000MB -4.6%) vs baseline: +5.1%


✅ import_one_cache

Time: ✅ 6.263µs (SLO: <10.000µs 📉 -37.4%) vs baseline: -0.7%

Memory: ✅ 37.149MB (SLO: <38.500MB -3.5%) vs baseline: +4.5%


✅ import_one_stdlib

Time: ✅ 18.671µs (SLO: <20.000µs -6.6%) vs baseline: -0.4%

Memory: ✅ 37.236MB (SLO: <38.500MB -3.3%) vs baseline: +4.8%


✅ import_one_stdlib_cache

Time: ✅ 6.284µs (SLO: <10.000µs 📉 -37.2%) vs baseline: +0.1%

Memory: ✅ 37.178MB (SLO: <38.500MB -3.4%) vs baseline: +5.3%


✅ import_one_unknown

Time: ✅ 45.547µs (SLO: <50.000µs -8.9%) vs baseline: +0.2%

Memory: ✅ 37.142MB (SLO: <38.500MB -3.5%) vs baseline: +5.0%


✅ import_one_unknown_cache

Time: ✅ 6.274µs (SLO: <10.000µs 📉 -37.3%) vs baseline: ~same

Memory: ✅ 37.219MB (SLO: <38.500MB -3.3%) vs baseline: +5.4%


ratelimiter - 12/12

✅ defaults

Time: ✅ 2.368µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +1.7%

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +5.0%


✅ high_rate_limit

Time: ✅ 2.409µs (SLO: <10.000µs 📉 -75.9%) vs baseline: +0.5%

Memory: ✅ 31.733MB (SLO: <34.000MB -6.7%) vs baseline: +4.7%


✅ long_window

Time: ✅ 2.373µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +1.5%

Memory: ✅ 31.713MB (SLO: <34.000MB -6.7%) vs baseline: +4.7%


✅ low_rate_limit

Time: ✅ 2.365µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +1.0%

Memory: ✅ 31.752MB (SLO: <34.000MB -6.6%) vs baseline: +4.7%


✅ no_rate_limit

Time: ✅ 0.833µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +1.3%

Memory: ✅ 31.811MB (SLO: <34.000MB -6.4%) vs baseline: +5.1%


✅ short_window

Time: ✅ 2.513µs (SLO: <10.000µs 📉 -74.9%) vs baseline: +2.0%

Memory: ✅ 31.772MB (SLO: <34.000MB -6.6%) vs baseline: +5.0%


recursivecomputation - 8/8

✅ deep

Time: ✅ 308.904ms (SLO: <320.950ms -3.8%) vs baseline: ~same

Memory: ✅ 32.814MB (SLO: <34.500MB -4.9%) vs baseline: +4.5%


✅ deep-profiled

Time: ✅ 326.758ms (SLO: <359.150ms -9.0%) vs baseline: -0.4%

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +5.2%


✅ medium

Time: ✅ 7.054ms (SLO: <7.400ms -4.7%) vs baseline: ~same

Memory: ✅ 32.008MB (SLO: <34.000MB -5.9%) vs baseline: +4.3%


✅ shallow

Time: ✅ 0.956ms (SLO: <1.050ms -8.9%) vs baseline: ~same

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +5.0%


samplingrules - 8/8

✅ average_match

Time: ✅ 148.853µs (SLO: <290.000µs 📉 -48.7%) vs baseline: +0.8%

Memory: ✅ 32.126MB (SLO: <34.000MB -5.5%) vs baseline: +4.7%


✅ high_match

Time: ✅ 194.779µs (SLO: <480.000µs 📉 -59.4%) vs baseline: -0.3%

Memory: ✅ 32.047MB (SLO: <34.000MB -5.7%) vs baseline: +4.9%


✅ low_match

Time: ✅ 99.281µs (SLO: <120.000µs 📉 -17.3%) vs baseline: -0.4%

Memory: ✅ 632.623MB (SLO: <700.000MB -9.6%) vs baseline: +4.9%


✅ very_low_match

Time: ✅ 2.906ms (SLO: <8.500ms 📉 -65.8%) vs baseline: +0.6%

Memory: ✅ 70.349MB (SLO: <75.000MB -6.2%) vs baseline: +4.9%


sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.511µs (SLO: <20.000µs 📉 -47.4%) vs baseline: +0.2%

Memory: ✅ 32.578MB (SLO: <34.000MB -4.2%) vs baseline: +4.8%


✅ all-enabled

Time: ✅ 39.748µs (SLO: <50.000µs 📉 -20.5%) vs baseline: -0.6%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.7%


✅ collectipvariant_exists

Time: ✅ 40.763µs (SLO: <50.000µs 📉 -18.5%) vs baseline: -0.5%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.9%


✅ no-collectipvariant

Time: ✅ 39.923µs (SLO: <50.000µs 📉 -20.2%) vs baseline: ~same

Memory: ✅ 32.617MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%


✅ no-useragentvariant

Time: ✅ 38.722µs (SLO: <50.000µs 📉 -22.6%) vs baseline: -0.3%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +4.9%


✅ obfuscation-no-query

Time: ✅ 40.500µs (SLO: <50.000µs 📉 -19.0%) vs baseline: +0.2%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.1%


✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.910µs (SLO: <90.000µs 📉 -15.7%) vs baseline: +0.3%

Memory: ✅ 32.971MB (SLO: <34.000MB -3.0%) vs baseline: +4.9%


✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.111µs (SLO: <90.000µs 📉 -15.4%) vs baseline: +0.1%

Memory: ✅ 32.912MB (SLO: <34.000MB -3.2%) vs baseline: +4.7%


✅ obfuscation-send-querystring-disabled

Time: ✅ 153.565µs (SLO: <170.000µs -9.7%) vs baseline: -0.1%

Memory: ✅ 32.971MB (SLO: <34.500MB -4.4%) vs baseline: +4.7%


✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.513µs (SLO: <160.000µs -7.2%) vs baseline: +0.4%

Memory: ✅ 33.010MB (SLO: <34.500MB -4.3%) vs baseline: +4.9%


✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.457µs (SLO: <170.000µs -9.1%) vs baseline: +0.1%

Memory: ✅ 33.010MB (SLO: <34.500MB -4.3%) vs baseline: +4.9%


✅ useragentvariant_exists_1

Time: ✅ 39.328µs (SLO: <50.000µs 📉 -21.3%) vs baseline: -0.1%

Memory: ✅ 32.598MB (SLO: <34.000MB -4.1%) vs baseline: +5.0%


✅ useragentvariant_exists_2

Time: ✅ 40.397µs (SLO: <50.000µs 📉 -19.2%) vs baseline: -0.1%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.7%


✅ useragentvariant_exists_3

Time: ✅ 39.959µs (SLO: <50.000µs 📉 -20.1%) vs baseline: +0.3%

Memory: ✅ 32.558MB (SLO: <34.000MB -4.2%) vs baseline: +4.7%


✅ useragentvariant_not_exists_1

Time: ✅ 39.302µs (SLO: <50.000µs 📉 -21.4%) vs baseline: ~same

Memory: ✅ 32.539MB (SLO: <34.000MB -4.3%) vs baseline: +4.8%


✅ useragentvariant_not_exists_2

Time: ✅ 39.206µs (SLO: <50.000µs 📉 -21.6%) vs baseline: -0.4%

Memory: ✅ 32.637MB (SLO: <34.000MB -4.0%) vs baseline: +5.0%


span - 26/26

✅ add-event

Time: ✅ 24.199ms (SLO: <26.200ms -7.6%) vs baseline: ~same

Memory: ✅ 51.620MB (SLO: <53.000MB -2.6%) vs baseline: +4.7%


✅ add-metrics

Time: ✅ 92.522ms (SLO: <98.350ms -5.9%) vs baseline: -1.1%

Memory: ✅ 605.682MB (SLO: <961.000MB 📉 -37.0%) vs baseline: +4.8%


✅ add-tags

Time: ✅ 150.575ms (SLO: <168.550ms 📉 -10.7%) vs baseline: -0.4%

Memory: ✅ 605.525MB (SLO: <962.500MB 📉 -37.1%) vs baseline: +4.5%


✅ get-context

Time: ✅ 22.406ms (SLO: <23.700ms -5.5%) vs baseline: +0.1%

Memory: ✅ 50.502MB (SLO: <53.000MB -4.7%) vs baseline: +4.7%


✅ is-recording

Time: ✅ 22.657ms (SLO: <23.900ms -5.2%) vs baseline: ~same

Memory: ✅ 50.458MB (SLO: <53.000MB -4.8%) vs baseline: +4.8%


✅ record-exception

Time: ✅ 42.276ms (SLO: <44.500ms -5.0%) vs baseline: ~same

Memory: ✅ 43.404MB (SLO: <53.000MB 📉 -18.1%) vs baseline: +4.9%


✅ set-status

Time: ✅ 24.451ms (SLO: <26.000ms -6.0%) vs baseline: ~same

Memory: ✅ 50.462MB (SLO: <53.000MB -4.8%) vs baseline: +4.9%


✅ start

Time: ✅ 22.293ms (SLO: <23.500ms -5.1%) vs baseline: +0.8%

Memory: ✅ 50.569MB (SLO: <53.000MB -4.6%) vs baseline: +5.1%


✅ start-finish

Time: ✅ 54.165ms (SLO: <55.500ms -2.4%) vs baseline: +0.7%

Memory: ✅ 32.067MB (SLO: <34.000MB -5.7%) vs baseline: +4.5%


✅ start-finish-telemetry

Time: ✅ 55.495ms (SLO: <58.300ms -4.8%) vs baseline: +0.4%

Memory: ✅ 32.106MB (SLO: <34.000MB -5.6%) vs baseline: +4.7%


✅ start-finish-traceid128

Time: ✅ 57.130ms (SLO: <60.050ms -4.9%) vs baseline: -0.4%

Memory: ✅ 32.145MB (SLO: <34.000MB -5.5%) vs baseline: +4.9%


✅ start-traceid128

Time: ✅ 22.764ms (SLO: <24.600ms -7.5%) vs baseline: +1.1%

Memory: ✅ 50.518MB (SLO: <53.000MB -4.7%) vs baseline: +4.9%


✅ update-name

Time: ✅ 23.267ms (SLO: <24.100ms -3.5%) vs baseline: +0.1%

Memory: ✅ 51.150MB (SLO: <53.000MB -3.5%) vs baseline: +4.8%


tracer - 6/6

✅ large

Time: ✅ 30.146ms (SLO: <32.950ms -8.5%) vs baseline: -0.2%

Memory: ✅ 33.305MB (SLO: <34.500MB -3.5%) vs baseline: +5.0%


✅ medium

Time: ✅ 2.944ms (SLO: <3.200ms -8.0%) vs baseline: +0.4%

Memory: ✅ 31.674MB (SLO: <34.000MB -6.8%) vs baseline: +3.7%


✅ small

Time: ✅ 335.536µs (SLO: <370.000µs -9.3%) vs baseline: -0.3%

Memory: ✅ 32.165MB (SLO: <34.000MB -5.4%) vs baseline: +5.3%

ℹ️ Scenarios Missing SLO Configuration (9 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline

@avara1986 avara1986 marked this pull request as ready for review October 7, 2025 10:58
@avara1986 avara1986 requested a review from a team as a code owner October 7, 2025 10:58
@avara1986 avara1986 merged commit d033f37 into main Oct 7, 2025
970 checks passed
@avara1986 avara1986 deleted the avara1986/skip_py38_test branch October 7, 2025 12:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ASM Application Security Monitoring changelog/no-changelog A changelog entry is not required for this PR.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants