ci(profiling): fuzz image to v105197721-08581d9#17207
ci(profiling): fuzz image to v105197721-08581d9#17207gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomainfrom
Conversation
|
/remove |
|
View all feedbacks in Devflow UI.
|
This comment has been minimized.
This comment has been minimized.
Performance SLOsComparing candidate edouard/bump-base-image (71786d2) with baseline main (08b8a88) 📈 Performance Regressions (2 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 103.513µs (SLO: <130.000µs 📉 -20.4%) vs baseline: +3.8% Memory: ✅ 44.071MB (SLO: <46.000MB -4.2%) vs baseline: +5.2% ✅ add_inplace_aspectTime: ✅ 102.387µs (SLO: <130.000µs 📉 -21.2%) vs baseline: -0.3% Memory: ✅ 43.915MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ add_inplace_noaspectTime: ✅ 28.238µs (SLO: <40.000µs 📉 -29.4%) vs baseline: +0.2% Memory: ✅ 44.159MB (SLO: <46.000MB -4.0%) vs baseline: +5.2% ✅ add_noaspectTime: ✅ 49.058µs (SLO: <70.000µs 📉 -29.9%) vs baseline: +0.2% Memory: ✅ 44.224MB (SLO: <46.000MB -3.9%) vs baseline: +5.5% ✅ bytearray_aspectTime: ✅ 249.726µs (SLO: <400.000µs 📉 -37.6%) vs baseline: -1.7% Memory: ✅ 44.072MB (SLO: <46.000MB -4.2%) vs baseline: +5.3% ✅ bytearray_extend_aspectTime: ✅ 647.367µs (SLO: <800.000µs 📉 -19.1%) vs baseline: -2.2% Memory: ✅ 44.020MB (SLO: <46.000MB -4.3%) vs baseline: +5.1% ✅ bytearray_extend_noaspectTime: ✅ 265.622µs (SLO: <400.000µs 📉 -33.6%) vs baseline: ~same Memory: ✅ 43.966MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ bytearray_noaspectTime: ✅ 139.243µs (SLO: <300.000µs 📉 -53.6%) vs baseline: +0.9% Memory: ✅ 43.984MB (SLO: <46.000MB -4.4%) vs baseline: +5.2% ✅ bytes_aspectTime: ✅ 218.677µs (SLO: <300.000µs 📉 -27.1%) vs baseline: -1.0% Memory: ✅ 44.075MB (SLO: <46.000MB -4.2%) vs baseline: +5.5% ✅ bytes_noaspectTime: ✅ 133.727µs (SLO: <200.000µs 📉 -33.1%) vs baseline: +0.2% Memory: ✅ 44.135MB (SLO: <46.000MB -4.1%) vs baseline: +5.3% ✅ bytesio_aspectTime: ✅ 3.765ms (SLO: <5.000ms 📉 -24.7%) vs baseline: -0.3% Memory: ✅ 44.034MB (SLO: <46.000MB -4.3%) vs baseline: +5.2% ✅ bytesio_noaspectTime: ✅ 314.660µs (SLO: <420.000µs 📉 -25.1%) vs baseline: -0.5% Memory: ✅ 44.158MB (SLO: <46.000MB -4.0%) vs baseline: +5.4% ✅ capitalize_aspectTime: ✅ 88.256µs (SLO: <300.000µs 📉 -70.6%) vs baseline: -0.5% Memory: ✅ 44.157MB (SLO: <46.000MB -4.0%) vs baseline: +5.1% ✅ capitalize_noaspectTime: ✅ 245.732µs (SLO: <300.000µs 📉 -18.1%) vs baseline: -0.6% Memory: ✅ 43.992MB (SLO: <46.000MB -4.4%) vs baseline: +5.4% ✅ casefold_aspectTime: ✅ 88.084µs (SLO: <500.000µs 📉 -82.4%) vs baseline: ~same Memory: ✅ 44.004MB (SLO: <46.000MB -4.3%) vs baseline: +4.9% ✅ casefold_noaspectTime: ✅ 302.290µs (SLO: <500.000µs 📉 -39.5%) vs baseline: -0.2% Memory: ✅ 44.052MB (SLO: <46.000MB -4.2%) vs baseline: +5.0% ✅ decode_aspectTime: ✅ 87.119µs (SLO: <100.000µs 📉 -12.9%) vs baseline: +0.6% Memory: ✅ 43.999MB (SLO: <46.000MB -4.3%) vs baseline: +5.1% ✅ decode_noaspectTime: ✅ 154.249µs (SLO: <210.000µs 📉 -26.5%) vs baseline: -0.8% Memory: ✅ 44.050MB (SLO: <46.000MB -4.2%) vs baseline: +5.3% ✅ encode_aspectTime: ✅ 84.661µs (SLO: <200.000µs 📉 -57.7%) vs baseline: +0.3% Memory: ✅ 44.017MB (SLO: <46.000MB -4.3%) vs baseline: +5.0% ✅ encode_noaspectTime: ✅ 141.447µs (SLO: <200.000µs 📉 -29.3%) vs baseline: ~same Memory: ✅ 44.025MB (SLO: <46.000MB -4.3%) vs baseline: +5.4% ✅ format_aspectTime: ✅ 14.587ms (SLO: <19.200ms 📉 -24.0%) vs baseline: -0.1% Memory: ✅ 44.349MB (SLO: <46.000MB -3.6%) vs baseline: +5.3% ✅ format_map_aspectTime: ✅ 16.439ms (SLO: <21.500ms 📉 -23.5%) vs baseline: +0.4% Memory: ✅ 44.277MB (SLO: <46.000MB -3.7%) vs baseline: +5.1% ✅ format_map_noaspectTime: ✅ 376.781µs (SLO: <500.000µs 📉 -24.6%) vs baseline: +1.7% Memory: ✅ 44.141MB (SLO: <46.000MB -4.0%) vs baseline: +5.4% ✅ format_noaspectTime: ✅ 305.114µs (SLO: <500.000µs 📉 -39.0%) vs baseline: +0.2% Memory: ✅ 44.148MB (SLO: <46.000MB -4.0%) vs baseline: +5.3% ✅ index_aspectTime: ✅ 137.443µs (SLO: <300.000µs 📉 -54.2%) vs baseline: 📈 +10.8% Memory: ✅ 43.962MB (SLO: <46.000MB -4.4%) vs baseline: +4.8% ✅ index_noaspectTime: ✅ 40.702µs (SLO: <300.000µs 📉 -86.4%) vs baseline: -0.6% Memory: ✅ 44.005MB (SLO: <46.000MB -4.3%) vs baseline: +4.7% ✅ join_aspectTime: ✅ 211.370µs (SLO: <300.000µs 📉 -29.5%) vs baseline: -0.3% Memory: ✅ 44.063MB (SLO: <46.000MB -4.2%) vs baseline: +5.4% ✅ join_noaspectTime: ✅ 144.804µs (SLO: <300.000µs 📉 -51.7%) vs baseline: +1.2% Memory: ✅ 43.975MB (SLO: <46.000MB -4.4%) vs baseline: +5.2% ✅ ljust_aspectTime: ✅ 575.263µs (SLO: <700.000µs 📉 -17.8%) vs baseline: 📈 +14.7% Memory: ✅ 44.026MB (SLO: <46.000MB -4.3%) vs baseline: +5.0% ✅ ljust_noaspectTime: ✅ 255.731µs (SLO: <300.000µs 📉 -14.8%) vs baseline: +0.9% Memory: ✅ 44.113MB (SLO: <46.000MB -4.1%) vs baseline: +5.4% ✅ lower_aspectTime: ✅ 298.902µs (SLO: <500.000µs 📉 -40.2%) vs baseline: +1.4% Memory: ✅ 44.060MB (SLO: <46.000MB -4.2%) vs baseline: +5.2% ✅ lower_noaspectTime: ✅ 231.459µs (SLO: <300.000µs 📉 -22.8%) vs baseline: -1.3% Memory: ✅ 44.222MB (SLO: <46.000MB -3.9%) vs baseline: +5.7% ✅ lstrip_aspectTime: ✅ 0.274ms (SLO: <3.000ms 📉 -90.9%) vs baseline: -1.6% Memory: ✅ 43.971MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ lstrip_noaspectTime: ✅ 0.176ms (SLO: <3.000ms 📉 -94.1%) vs baseline: -0.6% Memory: ✅ 44.108MB (SLO: <46.000MB -4.1%) vs baseline: +5.3% ✅ modulo_aspectTime: ✅ 14.196ms (SLO: <18.750ms 📉 -24.3%) vs baseline: -0.4% Memory: ✅ 44.115MB (SLO: <46.000MB -4.1%) vs baseline: +5.2% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.790ms (SLO: <19.350ms 📉 -23.6%) vs baseline: -0.1% Memory: ✅ 44.090MB (SLO: <46.000MB -4.2%) vs baseline: +4.8% ✅ modulo_aspect_for_bytesTime: ✅ 14.377ms (SLO: <18.900ms 📉 -23.9%) vs baseline: -0.3% Memory: ✅ 44.306MB (SLO: <46.000MB -3.7%) vs baseline: +5.3% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.632ms (SLO: <19.150ms 📉 -23.6%) vs baseline: ~same Memory: ✅ 44.170MB (SLO: <46.000MB -4.0%) vs baseline: +5.2% ✅ modulo_noaspectTime: ✅ 0.356ms (SLO: <3.000ms 📉 -88.1%) vs baseline: -0.2% Memory: ✅ 44.092MB (SLO: <46.000MB -4.1%) vs baseline: +5.4% ✅ replace_aspectTime: ✅ 18.437ms (SLO: <24.000ms 📉 -23.2%) vs baseline: +0.3% Memory: ✅ 44.197MB (SLO: <46.000MB -3.9%) vs baseline: +5.4% ✅ replace_noaspectTime: ✅ 282.026µs (SLO: <400.000µs 📉 -29.5%) vs baseline: -0.6% Memory: ✅ 43.899MB (SLO: <46.000MB -4.6%) vs baseline: +4.7% ✅ repr_aspectTime: ✅ 321.216µs (SLO: <420.000µs 📉 -23.5%) vs baseline: -0.7% Memory: ✅ 43.960MB (SLO: <46.000MB -4.4%) vs baseline: +4.7% ✅ repr_noaspectTime: ✅ 47.001µs (SLO: <90.000µs 📉 -47.8%) vs baseline: +0.9% Memory: ✅ 43.998MB (SLO: <46.000MB -4.4%) vs baseline: +5.3% ✅ rstrip_aspectTime: ✅ 386.365µs (SLO: <500.000µs 📉 -22.7%) vs baseline: -0.5% Memory: ✅ 44.197MB (SLO: <46.000MB -3.9%) vs baseline: +5.4% ✅ rstrip_noaspectTime: ✅ 182.975µs (SLO: <300.000µs 📉 -39.0%) vs baseline: +1.3% Memory: ✅ 44.044MB (SLO: <46.000MB -4.3%) vs baseline: +5.2% ✅ slice_aspectTime: ✅ 185.295µs (SLO: <300.000µs 📉 -38.2%) vs baseline: -0.1% Memory: ✅ 43.993MB (SLO: <46.000MB -4.4%) vs baseline: +4.9% ✅ slice_noaspectTime: ✅ 54.624µs (SLO: <90.000µs 📉 -39.3%) vs baseline: +0.6% Memory: ✅ 44.050MB (SLO: <46.000MB -4.2%) vs baseline: +5.2% ✅ stringio_aspectTime: ✅ 4.398ms (SLO: <5.000ms 📉 -12.0%) vs baseline: 📈 +15.8% Memory: ✅ 43.996MB (SLO: <46.000MB -4.4%) vs baseline: +4.8% ✅ stringio_noaspectTime: ✅ 345.736µs (SLO: <500.000µs 📉 -30.9%) vs baseline: +0.6% Memory: ✅ 44.128MB (SLO: <46.000MB -4.1%) vs baseline: +5.3% ✅ strip_aspectTime: ✅ 276.250µs (SLO: <350.000µs 📉 -21.1%) vs baseline: -1.5% Memory: ✅ 44.075MB (SLO: <46.000MB -4.2%) vs baseline: +5.1% ✅ strip_noaspectTime: ✅ 176.174µs (SLO: <240.000µs 📉 -26.6%) vs baseline: -0.2% Memory: ✅ 43.920MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ swapcase_aspectTime: ✅ 332.830µs (SLO: <500.000µs 📉 -33.4%) vs baseline: ~same Memory: ✅ 44.076MB (SLO: <46.000MB -4.2%) vs baseline: +5.1% ✅ swapcase_noaspectTime: ✅ 268.025µs (SLO: <400.000µs 📉 -33.0%) vs baseline: +0.2% Memory: ✅ 43.890MB (SLO: <46.000MB -4.6%) vs baseline: +4.9% ✅ title_aspectTime: ✅ 320.182µs (SLO: <500.000µs 📉 -36.0%) vs baseline: -1.2% Memory: ✅ 44.019MB (SLO: <46.000MB -4.3%) vs baseline: +5.3% ✅ title_noaspectTime: ✅ 255.149µs (SLO: <400.000µs 📉 -36.2%) vs baseline: -0.6% Memory: ✅ 44.007MB (SLO: <46.000MB -4.3%) vs baseline: +5.0% ✅ translate_aspectTime: ✅ 491.850µs (SLO: <700.000µs 📉 -29.7%) vs baseline: ~same Memory: ✅ 44.028MB (SLO: <46.000MB -4.3%) vs baseline: +5.2% ✅ translate_noaspectTime: ✅ 422.210µs (SLO: <500.000µs 📉 -15.6%) vs baseline: -1.3% Memory: ✅ 43.992MB (SLO: <46.000MB -4.4%) vs baseline: +5.0% ✅ upper_aspectTime: ✅ 295.140µs (SLO: <500.000µs 📉 -41.0%) vs baseline: -0.9% Memory: ✅ 43.934MB (SLO: <46.000MB -4.5%) vs baseline: +5.1% ✅ upper_noaspectTime: ✅ 231.099µs (SLO: <400.000µs 📉 -42.2%) vs baseline: ~same Memory: ✅ 44.074MB (SLO: <46.000MB -4.2%) vs baseline: +5.3% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 508.106µs (SLO: <700.000µs 📉 -27.4%) vs baseline: 📈 +19.2% Memory: ✅ 43.846MB (SLO: <46.000MB -4.7%) vs baseline: +5.0% ✅ ospathbasename_noaspectTime: ✅ 430.796µs (SLO: <700.000µs 📉 -38.5%) vs baseline: +0.3% Memory: ✅ 43.829MB (SLO: <46.000MB -4.7%) vs baseline: +5.0% ✅ ospathjoin_aspectTime: ✅ 626.216µs (SLO: <700.000µs 📉 -10.5%) vs baseline: ~same Memory: ✅ 43.956MB (SLO: <46.000MB -4.4%) vs baseline: +5.1% ✅ ospathjoin_noaspectTime: ✅ 636.615µs (SLO: <700.000µs -9.1%) vs baseline: +0.4% Memory: ✅ 43.821MB (SLO: <46.000MB -4.7%) vs baseline: +4.5% ✅ ospathnormcase_aspectTime: ✅ 352.437µs (SLO: <700.000µs 📉 -49.7%) vs baseline: +0.5% Memory: ✅ 43.830MB (SLO: <46.000MB -4.7%) vs baseline: +4.8% ✅ ospathnormcase_noaspectTime: ✅ 357.555µs (SLO: <700.000µs 📉 -48.9%) vs baseline: ~same Memory: ✅ 43.941MB (SLO: <46.000MB -4.5%) vs baseline: +5.0% ✅ ospathsplit_aspectTime: ✅ 486.126µs (SLO: <700.000µs 📉 -30.6%) vs baseline: +0.8% Memory: ✅ 43.879MB (SLO: <46.000MB -4.6%) vs baseline: +4.8% ✅ ospathsplit_noaspectTime: ✅ 497.003µs (SLO: <700.000µs 📉 -29.0%) vs baseline: -0.1% Memory: ✅ 43.867MB (SLO: <46.000MB -4.6%) vs baseline: +4.8% ✅ ospathsplitdrive_aspectTime: ✅ 378.013µs (SLO: <700.000µs 📉 -46.0%) vs baseline: +0.8% Memory: ✅ 43.911MB (SLO: <46.000MB -4.5%) vs baseline: +4.9% ✅ ospathsplitdrive_noaspectTime: ✅ 73.283µs (SLO: <700.000µs 📉 -89.5%) vs baseline: +0.7% Memory: ✅ 43.858MB (SLO: <46.000MB -4.7%) vs baseline: +5.1% ✅ ospathsplitext_aspectTime: ✅ 458.924µs (SLO: <700.000µs 📉 -34.4%) vs baseline: +0.5% Memory: ✅ 43.872MB (SLO: <46.000MB -4.6%) vs baseline: +4.9% ✅ ospathsplitext_noaspectTime: ✅ 464.144µs (SLO: <700.000µs 📉 -33.7%) vs baseline: +0.3% Memory: ✅ 44.013MB (SLO: <46.000MB -4.3%) vs baseline: +5.3% 🟡 Near SLO Breach (3 suites)🟡 djangosimple - 30/30✅ appsecTime: ✅ 19.627ms (SLO: <22.300ms 📉 -12.0%) vs baseline: -0.2% Memory: ✅ 69.281MB (SLO: <73.500MB -5.7%) vs baseline: +4.7% ✅ exception-replay-enabledTime: ✅ 1.324ms (SLO: <1.450ms -8.7%) vs baseline: +0.3% Memory: ✅ 67.550MB (SLO: <71.500MB -5.5%) vs baseline: +4.9% ✅ iastTime: ✅ 19.726ms (SLO: <22.250ms 📉 -11.3%) vs baseline: ~same Memory: ✅ 69.304MB (SLO: <75.000MB -7.6%) vs baseline: +4.8% ✅ profilerTime: ✅ 15.065ms (SLO: <16.550ms -9.0%) vs baseline: -0.2% Memory: ✅ 60.396MB (SLO: <61.000MB 🟡 -1.0%) vs baseline: +4.7% ✅ resource-renamingTime: ✅ 19.628ms (SLO: <21.750ms -9.8%) vs baseline: ~same Memory: ✅ 69.297MB (SLO: <73.500MB -5.7%) vs baseline: +4.8% ✅ span-code-originTime: ✅ 20.352ms (SLO: <28.200ms 📉 -27.8%) vs baseline: +2.0% Memory: ✅ 69.617MB (SLO: <75.000MB -7.2%) vs baseline: +5.0% ✅ tracerTime: ✅ 19.579ms (SLO: <21.750ms -10.0%) vs baseline: -0.6% Memory: ✅ 69.373MB (SLO: <75.000MB -7.5%) vs baseline: +4.9% ✅ tracer-and-profilerTime: ✅ 21.062ms (SLO: <23.500ms 📉 -10.4%) vs baseline: -0.3% Memory: ✅ 71.272MB (SLO: <75.000MB -5.0%) vs baseline: +4.8% ✅ tracer-dont-create-db-spansTime: ✅ 19.702ms (SLO: <21.500ms -8.4%) vs baseline: -0.3% Memory: ✅ 69.348MB (SLO: <75.000MB -7.5%) vs baseline: +5.0% ✅ tracer-minimalTime: ✅ 16.822ms (SLO: <17.500ms -3.9%) vs baseline: -0.2% Memory: ✅ 69.278MB (SLO: <75.000MB -7.6%) vs baseline: +4.7% ✅ tracer-nativeTime: ✅ 19.703ms (SLO: <21.750ms -9.4%) vs baseline: +0.2% Memory: ✅ 69.307MB (SLO: <72.500MB -4.4%) vs baseline: +4.8% ✅ tracer-no-cachesTime: ✅ 17.581ms (SLO: <19.650ms 📉 -10.5%) vs baseline: -0.8% Memory: ✅ 69.277MB (SLO: <75.000MB -7.6%) vs baseline: +4.7% ✅ tracer-no-databasesTime: ✅ 19.421ms (SLO: <20.100ms -3.4%) vs baseline: +0.3% Memory: ✅ 69.308MB (SLO: <75.000MB -7.6%) vs baseline: +4.8% ✅ tracer-no-middlewareTime: ✅ 19.349ms (SLO: <21.500ms 📉 -10.0%) vs baseline: +0.4% Memory: ✅ 69.317MB (SLO: <75.000MB -7.6%) vs baseline: +4.9% ✅ tracer-no-templatesTime: ✅ 19.649ms (SLO: <22.000ms 📉 -10.7%) vs baseline: -0.2% Memory: ✅ 69.363MB (SLO: <73.500MB -5.6%) vs baseline: +4.9% 🟡 flasksimple - 18/18✅ appsec-getTime: ✅ 3.368ms (SLO: <4.750ms 📉 -29.1%) vs baseline: -0.2% Memory: ✅ 56.531MB (SLO: <66.500MB 📉 -15.0%) vs baseline: +4.8% ✅ appsec-postTime: ✅ 2.870ms (SLO: <6.750ms 📉 -57.5%) vs baseline: ~same Memory: ✅ 56.587MB (SLO: <66.500MB 📉 -14.9%) vs baseline: +4.8% ✅ appsec-telemetryTime: ✅ 3.385ms (SLO: <4.750ms 📉 -28.7%) vs baseline: +0.4% Memory: ✅ 56.428MB (SLO: <66.500MB 📉 -15.1%) vs baseline: +4.7% ✅ debuggerTime: ✅ 1.876ms (SLO: <2.000ms -6.2%) vs baseline: ~same Memory: ✅ 49.154MB (SLO: <51.500MB -4.6%) vs baseline: +4.5% ✅ iast-getTime: ✅ 1.875ms (SLO: <2.000ms -6.2%) vs baseline: +0.3% Memory: ✅ 45.852MB (SLO: <49.000MB -6.4%) vs baseline: +4.6% ✅ profilerTime: ✅ 1.905ms (SLO: <2.100ms -9.3%) vs baseline: ~same Memory: ✅ 52.637MB (SLO: <53.500MB 🟡 -1.6%) vs baseline: +4.9% ✅ resource-renamingTime: ✅ 3.342ms (SLO: <3.650ms -8.4%) vs baseline: ~same Memory: ✅ 56.561MB (SLO: <60.000MB -5.7%) vs baseline: +4.9% ✅ tracerTime: ✅ 3.364ms (SLO: <3.650ms -7.8%) vs baseline: +0.3% Memory: ✅ 56.506MB (SLO: <60.000MB -5.8%) vs baseline: +5.0% ✅ tracer-nativeTime: ✅ 3.360ms (SLO: <3.650ms -7.9%) vs baseline: +0.3% Memory: ✅ 56.493MB (SLO: <60.000MB -5.8%) vs baseline: +4.8% 🟡 recursivecomputation - 8/8✅ deepTime: ✅ 311.359ms (SLO: <320.950ms -3.0%) vs baseline: +0.2% Memory: ✅ 37.473MB (SLO: <38.750MB -3.3%) vs baseline: +5.0% ✅ deep-profiledTime: ✅ 328.556ms (SLO: <359.150ms -8.5%) vs baseline: -0.2% Memory: ✅ 43.804MB (SLO: <46.000MB -4.8%) vs baseline: +4.6% ✅ mediumTime: ✅ 7.281ms (SLO: <7.400ms 🟡 -1.6%) vs baseline: -0.2% Memory: ✅ 36.608MB (SLO: <38.000MB -3.7%) vs baseline: +4.6% ✅ shallowTime: ✅ 1.015ms (SLO: <1.050ms -3.4%) vs baseline: +1.6% Memory: ✅ 36.648MB (SLO: <38.000MB -3.6%) vs baseline: +4.7%
|
99e8f9c
into
main
Codeowners resolved as |
Description
Bump fuzz base image to get the fuzzydog version bump.
Tag from: (build (#1553232310) · Jobs · datadog / images · GitLab)
Testing
N/A
Risks
Additional Notes