Skip to content

wip: fsst dedup#6919

Draft
joseph-isaacs wants to merge 5 commits intodevelopfrom
ji/fsst-dedup
Draft

wip: fsst dedup#6919
joseph-isaacs wants to merge 5 commits intodevelopfrom
ji/fsst-dedup

Conversation

@joseph-isaacs
Copy link
Contributor

Summary

Closes: #000

Testing

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
@codspeed-hq
Copy link

codspeed-hq bot commented Mar 12, 2026

Merging this PR will not alter performance

✅ 994 untouched benchmarks
⏩ 1515 skipped benchmarks1


Comparing ji/fsst-dedup (5126025) with develop (6982389)

Open in CodSpeed

Footnotes

  1. 1515 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 5126025 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 79fd820 1 Explore Profiling Data
🟢 Done dc7c5af 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: TPC-H SF=1 on NVME

Summary

  • Overall: 0.966x ➖
  • Vortex: 0.964x ➖
  • Parquet: 0.982x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -2.1%
  • Confidence: environment too noisy
  • Environment shift: -1.8%

Statistical Summary

  • Systemic shift (parquet controls): -1.8%
  • Control sigma: +7.0%
  • Residual noise: +2.9%
  • Median polish overall: -3.4%
datafusion / vortex-file-compressed (0.955x ➖, 1↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51029771 54356312 0.94
tpch_q02/datafusion:vortex-file-compressed 49255985 51976829 0.95
tpch_q03/datafusion:vortex-file-compressed 27514574 28751266 0.96
tpch_q04/datafusion:vortex-file-compressed 18435341 19181773 0.96
tpch_q05/datafusion:vortex-file-compressed 76397652 80808739 0.95
tpch_q06/datafusion:vortex-file-compressed 10023727 10615464 0.94
tpch_q07/datafusion:vortex-file-compressed 90794634 93169645 0.97
tpch_q08/datafusion:vortex-file-compressed 65236721 67586089 0.97
tpch_q09/datafusion:vortex-file-compressed 86756591 88938338 0.98
tpch_q10/datafusion:vortex-file-compressed 73851517 81381245 0.91
tpch_q11/datafusion:vortex-file-compressed 18641336 19690513 0.95
tpch_q12/datafusion:vortex-file-compressed 33696161 35752983 0.94
tpch_q13/datafusion:vortex-file-compressed 🚀 28024412 31246320 0.90
tpch_q14/datafusion:vortex-file-compressed 28057599 28115877 1.00
tpch_q15/datafusion:vortex-file-compressed 25043844 25394346 0.99
tpch_q16/datafusion:vortex-file-compressed 34825101 34671578 1.00
tpch_q17/datafusion:vortex-file-compressed 76737760 78864889 0.97
tpch_q18/datafusion:vortex-file-compressed 100874861 105968667 0.95
tpch_q19/datafusion:vortex-file-compressed 34651747 35963272 0.96
tpch_q20/datafusion:vortex-file-compressed 48083203 51165545 0.94
tpch_q21/datafusion:vortex-file-compressed 91004307 97998629 0.93
tpch_q22/datafusion:vortex-file-compressed 15914512 16482844 0.97
datafusion / vortex-compact (0.959x ➖, 0↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 61262018 62020186 0.99
tpch_q02/datafusion:vortex-compact 54494890 55429382 0.98
tpch_q03/datafusion:vortex-compact 32220817 32931196 0.98
tpch_q04/datafusion:vortex-compact 23304444 24740684 0.94
tpch_q05/datafusion:vortex-compact 81675635 88255518 0.93
tpch_q06/datafusion:vortex-compact 14486706 14818891 0.98
tpch_q07/datafusion:vortex-compact 94763374 98342061 0.96
tpch_q08/datafusion:vortex-compact 72309193 73583967 0.98
tpch_q09/datafusion:vortex-compact 91082567 100030597 0.91
tpch_q10/datafusion:vortex-compact 76790480 81668497 0.94
tpch_q11/datafusion:vortex-compact 20425911 21106477 0.97
tpch_q12/datafusion:vortex-compact 42231050 45307367 0.93
tpch_q13/datafusion:vortex-compact 36356117 38546637 0.94
tpch_q14/datafusion:vortex-compact 31321457 32656695 0.96
tpch_q15/datafusion:vortex-compact 33155806 35173365 0.94
tpch_q16/datafusion:vortex-compact 39670234 40442681 0.98
tpch_q17/datafusion:vortex-compact 79762796 81669663 0.98
tpch_q18/datafusion:vortex-compact 107768942 115220873 0.94
tpch_q19/datafusion:vortex-compact 49448084 48385444 1.02
tpch_q20/datafusion:vortex-compact 55563464 57697907 0.96
tpch_q21/datafusion:vortex-compact 106218464 110602079 0.96
tpch_q22/datafusion:vortex-compact 16091703 17466415 0.92
datafusion / parquet (0.976x ➖, 1↑ 1↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 108351037 154478114 0.70
tpch_q02/datafusion:parquet 80659896 84558412 0.95
tpch_q03/datafusion:parquet 85370936 77782198 1.10
tpch_q04/datafusion:parquet 53655724 55130171 0.97
tpch_q05/datafusion:parquet 160651734 164189957 0.98
tpch_q06/datafusion:parquet 47976211 46507034 1.03
tpch_q07/datafusion:parquet 175517312 183551583 0.96
tpch_q08/datafusion:parquet 163380545 157688238 1.04
tpch_q09/datafusion:parquet 210270306 228913656 0.92
tpch_q10/datafusion:parquet 189204301 191741966 0.99
tpch_q11/datafusion:parquet 60477101 62402282 0.97
tpch_q12/datafusion:parquet 126004558 123953670 1.02
tpch_q13/datafusion:parquet 202280495 203711811 0.99
tpch_q14/datafusion:parquet 78954238 78455289 1.01
tpch_q15/datafusion:parquet 66913289 72263663 0.93
tpch_q16/datafusion:parquet 54561948 55895385 0.98
tpch_q17/datafusion:parquet 169050626 181846709 0.93
tpch_q18/datafusion:parquet 230286433 230086895 1.00
tpch_q19/datafusion:parquet 🚨 94837238 84563632 1.12
tpch_q20/datafusion:parquet 124717122 120788659 1.03
tpch_q21/datafusion:parquet 176441980 177082388 1.00
tpch_q22/datafusion:parquet 39653447 41505604 0.96
datafusion / arrow (0.939x ➖, 1↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 64111957 70081864 0.91
tpch_q02/datafusion:arrow 22799882 24086724 0.95
tpch_q03/datafusion:arrow 37082004 40088795 0.92
tpch_q04/datafusion:arrow 30379907 33576239 0.90
tpch_q05/datafusion:arrow 94824245 98244192 0.97
tpch_q06/datafusion:arrow 23232574 23623125 0.98
tpch_q07/datafusion:arrow 177851155 189524428 0.94
tpch_q08/datafusion:arrow 53905407 50603044 1.07
tpch_q09/datafusion:arrow 78989216 83860707 0.94
tpch_q10/datafusion:arrow 58620560 63707077 0.92
tpch_q11/datafusion:arrow 11846957 12843928 0.92
tpch_q12/datafusion:arrow 56028453 61308171 0.91
tpch_q13/datafusion:arrow 51327393 51123388 1.00
tpch_q14/datafusion:arrow 25721431 28353155 0.91
tpch_q15/datafusion:arrow 51389714 54073710 0.95
tpch_q16/datafusion:arrow 22806486 25219222 0.90
tpch_q17/datafusion:arrow 🚀 75659613 88278993 0.86
tpch_q18/datafusion:arrow 158127193 168295858 0.94
tpch_q19/datafusion:arrow 41215994 43357638 0.95
tpch_q20/datafusion:arrow 41178154 44395662 0.93
tpch_q21/datafusion:arrow 235535457 258551994 0.91
tpch_q22/datafusion:arrow 21690791 21794668 1.00
duckdb / vortex-file-compressed (0.973x ➖, 0↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32997497 32700049 1.01
tpch_q02/duckdb:vortex-file-compressed 27637461 27060199 1.02
tpch_q03/duckdb:vortex-file-compressed 29507426 30757453 0.96
tpch_q04/duckdb:vortex-file-compressed 28630302 31078281 0.92
tpch_q05/duckdb:vortex-file-compressed 32760714 34107966 0.96
tpch_q06/duckdb:vortex-file-compressed 11057503 11442158 0.97
tpch_q07/duckdb:vortex-file-compressed 37599945 37734714 1.00
tpch_q08/duckdb:vortex-file-compressed 40668628 42732401 0.95
tpch_q09/duckdb:vortex-file-compressed 78172718 80745142 0.97
tpch_q10/duckdb:vortex-file-compressed 35455913 37850942 0.94
tpch_q11/duckdb:vortex-file-compressed 16010533 15759911 1.02
tpch_q12/duckdb:vortex-file-compressed 22543618 23654389 0.95
tpch_q13/duckdb:vortex-file-compressed 36954281 38567355 0.96
tpch_q14/duckdb:vortex-file-compressed 23427796 22977261 1.02
tpch_q15/duckdb:vortex-file-compressed 16759478 16043985 1.04
tpch_q16/duckdb:vortex-file-compressed 30608971 30946642 0.99
tpch_q17/duckdb:vortex-file-compressed 24076661 25186968 0.96
tpch_q18/duckdb:vortex-file-compressed 47596616 51007417 0.93
tpch_q19/duckdb:vortex-file-compressed 32864591 34149224 0.96
tpch_q20/duckdb:vortex-file-compressed 34728077 35870102 0.97
tpch_q21/duckdb:vortex-file-compressed 102720198 106238376 0.97
tpch_q22/duckdb:vortex-file-compressed 18318588 19118052 0.96
duckdb / vortex-compact (0.970x ➖, 0↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39730680 39386284 1.01
tpch_q02/duckdb:vortex-compact 36143882 37536866 0.96
tpch_q03/duckdb:vortex-compact 32051604 34495334 0.93
tpch_q04/duckdb:vortex-compact 33410306 34853536 0.96
tpch_q05/duckdb:vortex-compact 38468519 39707518 0.97
tpch_q06/duckdb:vortex-compact 14799195 15176876 0.98
tpch_q07/duckdb:vortex-compact 45753829 45141993 1.01
tpch_q08/duckdb:vortex-compact 45283500 46502731 0.97
tpch_q09/duckdb:vortex-compact 89253993 93745620 0.95
tpch_q10/duckdb:vortex-compact 40888112 42011475 0.97
tpch_q11/duckdb:vortex-compact 19018013 21029016 0.90
tpch_q12/duckdb:vortex-compact 36692428 38695772 0.95
tpch_q13/duckdb:vortex-compact 45383968 48442408 0.94
tpch_q14/duckdb:vortex-compact 31664144 30446613 1.04
tpch_q15/duckdb:vortex-compact 19784756 20270024 0.98
tpch_q16/duckdb:vortex-compact 35424443 36967696 0.96
tpch_q17/duckdb:vortex-compact 32544307 31961978 1.02
tpch_q18/duckdb:vortex-compact 50577142 52831853 0.96
tpch_q19/duckdb:vortex-compact 36979093 39170766 0.94
tpch_q20/duckdb:vortex-compact 43922082 44161467 0.99
tpch_q21/duckdb:vortex-compact 113983903 115384892 0.99
tpch_q22/duckdb:vortex-compact 20384704 21178987 0.96
duckdb / parquet (0.987x ➖, 2↑ 2↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 76341389 89462077 0.85
tpch_q02/duckdb:parquet 38967231 39712975 0.98
tpch_q03/duckdb:parquet 68873113 75385299 0.91
tpch_q04/duckdb:parquet 46804488 49307857 0.95
tpch_q05/duckdb:parquet 67257220 72773118 0.92
tpch_q06/duckdb:parquet 29795717 30486234 0.98
tpch_q07/duckdb:parquet 🚨 82378862 68797719 1.20
tpch_q08/duckdb:parquet 87510126 82373122 1.06
tpch_q09/duckdb:parquet 133240122 135339274 0.98
tpch_q10/duckdb:parquet 🚀 124370844 142081800 0.88
tpch_q11/duckdb:parquet 22521200 23130527 0.97
tpch_q12/duckdb:parquet 45317951 46466047 0.98
tpch_q13/duckdb:parquet 261979218 278170819 0.94
tpch_q14/duckdb:parquet 48234036 49103284 0.98
tpch_q15/duckdb:parquet 🚨 32008999 25138924 1.27
tpch_q16/duckdb:parquet 54340329 56596796 0.96
tpch_q17/duckdb:parquet 61009428 58030624 1.05
tpch_q18/duckdb:parquet 118187774 121766426 0.97
tpch_q19/duckdb:parquet 86430124 83278385 1.04
tpch_q20/duckdb:parquet 63784337 63665982 1.00
tpch_q21/duckdb:parquet 172323376 184759769 0.93
tpch_q22/duckdb:parquet 51676777 52945446 0.98
duckdb / duckdb (0.973x ➖, 3↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16290301 16317617 1.00
tpch_q02/duckdb:duckdb 13139061 12600856 1.04
tpch_q03/duckdb:duckdb 19421181 19980054 0.97
tpch_q04/duckdb:duckdb 18381973 19761174 0.93
tpch_q05/duckdb:duckdb 20399493 20120686 1.01
tpch_q06/duckdb:duckdb 5333040 5293967 1.01
tpch_q07/duckdb:duckdb 22942113 22114184 1.04
tpch_q08/duckdb:duckdb 20990972 21007654 1.00
tpch_q09/duckdb:duckdb 🚀 52608508 59465185 0.88
tpch_q10/duckdb:duckdb 🚀 39381263 44069200 0.89
tpch_q11/duckdb:duckdb 🚀 5529612 6242553 0.89
tpch_q12/duckdb:duckdb 14060078 14363059 0.98
tpch_q13/duckdb:duckdb 37482231 37206906 1.01
tpch_q14/duckdb:duckdb 16603196 17972594 0.92
tpch_q15/duckdb:duckdb 11476070 11963850 0.96
tpch_q16/duckdb:duckdb 23454549 23528113 1.00
tpch_q17/duckdb:duckdb 13523974 14047397 0.96
tpch_q18/duckdb:duckdb 38780723 38609558 1.00
tpch_q19/duckdb:duckdb 27503089 28278691 0.97
tpch_q20/duckdb:duckdb 22918059 22493858 1.02
tpch_q21/duckdb:duckdb 55612044 57352793 0.97
tpch_q22/duckdb:duckdb 24479358 25018579 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -8.5% -22.6% +18.2% +26.9% ➖ noise
1 datafusion:vortex-compact -1.2% -22.6% +27.7% +23.8% 🚨 regression
1 datafusion:vortex-file-compressed -6.1% -22.6% +21.3% +27.4% ➖ noise
1 duckdb:duckdb -0.2% -22.6% +29.0% +24.5% 🚨 regression
1 duckdb:vortex-compact +0.9% -22.6% +30.4% +24.1% 🚨 regression
1 duckdb:vortex-file-compressed +0.9% -22.6% +30.4% +24.0% 🚨 regression
2 datafusion:arrow -5.3% -3.3% -2.2% +19.1% ➖ noise
2 datafusion:vortex-compact -1.7% -3.3% +1.6% +19.1% ➖ noise
2 datafusion:vortex-file-compressed -5.2% -3.3% -2.0% +19.1% ➖ noise
2 duckdb:duckdb +4.3% -3.3% +7.8% +19.1% ➖ noise
2 duckdb:vortex-compact -3.7% -3.3% -0.5% +19.1% ➖ noise
2 duckdb:vortex-file-compressed +2.1% -3.3% +5.6% +19.1% ➖ noise
3 datafusion:arrow -7.5% +0.1% -7.6% +19.1% ➖ noise
3 datafusion:vortex-compact -2.2% +0.1% -2.3% +19.1% ➖ noise
3 datafusion:vortex-file-compressed -4.3% +0.1% -4.4% +19.1% ➖ noise
3 duckdb:duckdb -2.8% +0.1% -2.9% +24.5% ➖ noise
3 duckdb:vortex-compact -7.1% +0.1% -7.2% +19.1% ➖ noise
3 duckdb:vortex-file-compressed -4.1% +0.1% -4.2% +19.1% ➖ noise
4 datafusion:arrow -9.5% -3.9% -5.9% +19.1% ➖ noise
4 datafusion:vortex-compact -5.8% -3.9% -2.0% +19.1% ➖ noise
4 datafusion:vortex-file-compressed -3.9% -3.9% -0.0% +19.1% ➖ noise
4 duckdb:duckdb -7.0% -3.9% -3.2% +19.1% ➖ noise
4 duckdb:vortex-compact -4.1% -3.9% -0.3% +19.1% ➖ noise
4 duckdb:vortex-file-compressed -7.9% -3.9% -4.2% +19.1% ➖ noise
5 datafusion:arrow -3.5% -4.9% +1.5% +19.1% ➖ noise
5 datafusion:vortex-compact -7.5% -4.9% -2.7% +19.1% ➖ noise
5 datafusion:vortex-file-compressed -5.5% -4.9% -0.6% +19.1% ➖ noise
5 duckdb:duckdb +1.4% -4.9% +6.6% +19.1% ➖ noise
5 duckdb:vortex-compact -3.1% -4.9% +1.9% +19.1% ➖ noise
5 duckdb:vortex-file-compressed -3.9% -4.9% +1.0% +19.1% ➖ noise
6 datafusion:arrow -1.7% +0.4% -2.1% +21.6% ➖ noise
6 datafusion:vortex-compact -2.2% +0.4% -2.6% +22.0% ➖ noise
6 datafusion:vortex-file-compressed -5.6% +0.4% -6.0% +24.7% ➖ noise
6 duckdb:duckdb +0.7% +0.4% +0.3% +26.3% ➖ noise
6 duckdb:vortex-compact -2.5% +0.4% -2.9% +22.4% ➖ noise
6 duckdb:vortex-file-compressed -3.4% +0.4% -3.8% +23.6% ➖ noise
7 datafusion:arrow -6.2% +7.0% -12.3% +19.1% ➖ noise
7 datafusion:vortex-compact -3.6% +7.0% -9.9% +19.1% ➖ noise
7 datafusion:vortex-file-compressed -2.5% +7.0% -8.9% +19.1% ➖ noise
7 duckdb:duckdb +3.7% +7.0% -3.0% +19.1% ➖ noise
7 duckdb:vortex-compact +1.4% +7.0% -5.3% +19.1% ➖ noise
7 duckdb:vortex-file-compressed -0.4% +7.0% -6.9% +19.1% ➖ noise
8 datafusion:arrow +6.5% +4.9% +1.5% +19.1% ➖ noise
8 datafusion:vortex-compact -1.7% +4.9% -6.3% +19.1% ➖ noise
8 datafusion:vortex-file-compressed -3.5% +4.9% -8.0% +19.1% ➖ noise
8 duckdb:duckdb -0.1% +4.9% -4.8% +19.1% ➖ noise
8 duckdb:vortex-compact -2.6% +4.9% -7.2% +19.1% ➖ noise
8 duckdb:vortex-file-compressed -4.8% +4.9% -9.3% +19.1% ➖ noise
9 datafusion:arrow -5.8% -4.9% -1.0% +19.1% ➖ noise
9 datafusion:vortex-compact -8.9% -4.9% -4.2% +19.1% ➖ noise
9 datafusion:vortex-file-compressed -2.5% -4.9% +2.6% +19.1% ➖ noise
9 duckdb:duckdb -11.5% -4.9% -7.0% +19.1% ➖ noise
9 duckdb:vortex-compact -4.8% -4.9% +0.1% +19.1% ➖ noise
9 duckdb:vortex-file-compressed -3.2% -4.9% +1.8% +19.1% ➖ noise
10 datafusion:arrow -8.0% -7.1% -1.0% +19.1% ➖ noise
10 datafusion:vortex-compact -6.0% -7.1% +1.2% +19.1% ➖ noise
10 datafusion:vortex-file-compressed -9.3% -7.1% -2.4% +19.1% ➖ noise
10 duckdb:duckdb -10.6% -7.1% -3.8% +19.1% ➖ noise
10 duckdb:vortex-compact -2.7% -7.1% +4.7% +19.1% ➖ noise
10 duckdb:vortex-file-compressed -6.3% -7.1% +0.8% +19.1% ➖ noise
11 datafusion:arrow -7.8% -2.9% -5.0% +19.1% ➖ noise
11 datafusion:vortex-compact -3.2% -2.9% -0.4% +19.1% ➖ noise
11 datafusion:vortex-file-compressed -5.3% -2.9% -2.5% +19.1% ➖ noise
11 duckdb:duckdb -11.4% -2.9% -8.8% +19.1% ➖ noise
11 duckdb:vortex-compact -9.6% -2.9% -6.9% +19.1% ➖ noise
11 duckdb:vortex-file-compressed +1.6% -2.9% +4.6% +19.1% ➖ noise
12 datafusion:arrow -8.6% -0.4% -8.2% +19.1% ➖ noise
12 datafusion:vortex-compact -6.8% -0.4% -6.4% +19.1% ➖ noise
12 datafusion:vortex-file-compressed -5.8% -0.4% -5.3% +19.1% ➖ noise
12 duckdb:duckdb -2.1% -0.4% -1.7% +19.1% ➖ noise
12 duckdb:vortex-compact -5.2% -0.4% -4.8% +19.1% ➖ noise
12 duckdb:vortex-file-compressed -4.7% -0.4% -4.3% +19.1% ➖ noise
13 datafusion:arrow +0.4% -3.3% +3.8% +19.1% ➖ noise
13 datafusion:vortex-compact -5.7% -3.3% -2.5% +19.1% ➖ noise
13 datafusion:vortex-file-compressed -10.3% -3.3% -7.3% +19.1% ➖ noise
13 duckdb:duckdb +0.7% -3.3% +4.2% +19.1% ➖ noise
13 duckdb:vortex-compact -6.3% -3.3% -3.1% +19.1% ➖ noise
13 duckdb:vortex-file-compressed -4.2% -3.3% -0.9% +19.1% ➖ noise
14 datafusion:arrow -9.3% -0.6% -8.8% +19.1% ➖ noise
14 datafusion:vortex-compact -4.1% -0.6% -3.5% +19.1% ➖ noise
14 datafusion:vortex-file-compressed -0.2% -0.6% +0.4% +19.1% ➖ noise
14 duckdb:duckdb -7.6% -0.6% -7.1% +19.1% ➖ noise
14 duckdb:vortex-compact +4.0% -0.6% +4.6% +19.1% ➖ noise
14 duckdb:vortex-file-compressed +2.0% -0.6% +2.5% +19.1% ➖ noise
15 datafusion:arrow -5.0% +8.6% -12.5% +19.1% ➖ noise
15 datafusion:vortex-compact -5.7% +8.6% -13.2% +19.1% ➖ noise
15 datafusion:vortex-file-compressed -1.4% +8.6% -9.2% +19.1% ➖ noise
15 duckdb:duckdb -4.1% +8.6% -11.7% +19.1% ➖ noise
15 duckdb:vortex-compact -2.4% +8.6% -10.1% +19.1% ➖ noise
15 duckdb:vortex-file-compressed +4.5% +8.6% -3.8% +19.1% ➖ noise
16 datafusion:arrow -9.6% -3.2% -6.6% +19.1% ➖ noise
16 datafusion:vortex-compact -1.9% -3.2% +1.3% +19.1% ➖ noise
16 datafusion:vortex-file-compressed +0.4% -3.2% +3.8% +19.1% ➖ noise
16 duckdb:duckdb -0.3% -3.2% +3.0% +19.1% ➖ noise
16 duckdb:vortex-compact -4.2% -3.2% -1.0% +19.1% ➖ noise
16 duckdb:vortex-file-compressed -1.1% -3.2% +2.2% +19.1% ➖ noise
17 datafusion:arrow -14.3% -1.1% -13.3% +19.1% ➖ noise
17 datafusion:vortex-compact -2.3% -1.1% -1.2% +19.1% ➖ noise
17 datafusion:vortex-file-compressed -2.7% -1.1% -1.6% +19.1% ➖ noise
17 duckdb:duckdb -3.7% -1.1% -2.6% +19.1% ➖ noise
17 duckdb:vortex-compact +1.8% -1.1% +3.0% +19.1% ➖ noise
17 duckdb:vortex-file-compressed -4.4% -1.1% -3.3% +19.1% ➖ noise
18 datafusion:arrow -6.0% -1.4% -4.7% +19.1% ➖ noise
18 datafusion:vortex-compact -6.5% -1.4% -5.1% +19.1% ➖ noise
18 datafusion:vortex-file-compressed -4.8% -1.4% -3.4% +19.1% ➖ noise
18 duckdb:duckdb +0.4% -1.4% +1.9% +19.1% ➖ noise
18 duckdb:vortex-compact -4.3% -1.4% -2.9% +19.1% ➖ noise
18 duckdb:vortex-file-compressed -6.7% -1.4% -5.3% +19.1% ➖ noise
19 datafusion:arrow -4.9% +7.9% -11.9% +19.6% ➖ noise
19 datafusion:vortex-compact +2.2% +7.9% -5.3% +19.9% ➖ noise
19 datafusion:vortex-file-compressed -3.6% +7.9% -10.7% +19.1% ➖ noise
19 duckdb:duckdb -2.7% +7.9% -9.9% +20.3% ➖ noise
19 duckdb:vortex-compact -5.6% +7.9% -12.5% +19.1% ➖ noise
19 duckdb:vortex-file-compressed -3.8% +7.9% -10.8% +19.1% ➖ noise
20 datafusion:arrow -7.2% +1.7% -8.8% +19.1% ➖ noise
20 datafusion:vortex-compact -3.7% +1.7% -5.3% +19.1% ➖ noise
20 datafusion:vortex-file-compressed -6.0% +1.7% -7.6% +19.1% ➖ noise
20 duckdb:duckdb +1.9% +1.7% +0.2% +19.1% ➖ noise
20 duckdb:vortex-compact -0.5% +1.7% -2.2% +19.1% ➖ noise
20 duckdb:vortex-file-compressed -3.2% +1.7% -4.8% +19.1% ➖ noise
21 datafusion:arrow -8.9% -3.6% -5.5% +19.1% ➖ noise
21 datafusion:vortex-compact -4.0% -3.6% -0.4% +19.1% ➖ noise
21 datafusion:vortex-file-compressed -7.1% -3.6% -3.7% +19.1% ➖ noise
21 duckdb:duckdb -3.0% -3.6% +0.6% +19.1% ➖ noise
21 duckdb:vortex-compact -1.2% -3.6% +2.5% +19.1% ➖ noise
21 duckdb:vortex-file-compressed -3.3% -3.6% +0.3% +19.1% ➖ noise
22 datafusion:arrow -0.5% -3.4% +3.1% +19.1% ➖ noise
22 datafusion:vortex-compact -7.9% -3.4% -4.6% +19.1% ➖ noise
22 datafusion:vortex-file-compressed -3.4% -3.4% -0.0% +19.1% ➖ noise
22 duckdb:duckdb -2.2% -3.4% +1.3% +19.1% ➖ noise
22 duckdb:vortex-compact -3.8% -3.4% -0.3% +19.1% ➖ noise
22 duckdb:vortex-file-compressed -4.2% -3.4% -0.8% +19.1% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: TPC-H SF=1 on S3

Summary

  • Overall: 1.054x ➖
  • Vortex: 1.065x ➖
  • Parquet: 1.033x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +3.1%
  • Confidence: environment too noisy
  • Environment shift: +3.3%

Statistical Summary

  • Systemic shift (parquet controls): +3.3%
  • Control sigma: +12.0%
  • Residual noise: +6.6%
  • Median polish overall: +4.8%
datafusion / vortex-file-compressed (1.137x ➖, 0↑ 5↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 208366647 184744509 1.13
tpch_q02/datafusion:vortex-file-compressed 453401149 448953869 1.01
tpch_q03/datafusion:vortex-file-compressed 401414666 398114831 1.01
tpch_q04/datafusion:vortex-file-compressed 273363319 243027978 1.12
tpch_q05/datafusion:vortex-file-compressed 467069355 476804532 0.98
tpch_q06/datafusion:vortex-file-compressed 338184864 299058898 1.13
tpch_q07/datafusion:vortex-file-compressed 411158055 524585666 0.78
tpch_q08/datafusion:vortex-file-compressed 🚨 852865534 622374825 1.37
tpch_q09/datafusion:vortex-file-compressed 510819385 513083294 1.00
tpch_q10/datafusion:vortex-file-compressed 🚨 813069510 481531203 1.69
tpch_q11/datafusion:vortex-file-compressed 447853753 392100879 1.14
tpch_q12/datafusion:vortex-file-compressed 528529007 460723129 1.15
tpch_q13/datafusion:vortex-file-compressed 218984809 219639831 1.00
tpch_q14/datafusion:vortex-file-compressed 🚨 354446327 187648268 1.89
tpch_q15/datafusion:vortex-file-compressed 🚨 461661205 291161184 1.59
tpch_q16/datafusion:vortex-file-compressed 215398891 195326057 1.10
tpch_q17/datafusion:vortex-file-compressed 341957336 286440444 1.19
tpch_q18/datafusion:vortex-file-compressed 374837737 334066238 1.12
tpch_q19/datafusion:vortex-file-compressed 🚨 520783587 375368658 1.39
tpch_q20/datafusion:vortex-file-compressed 399154765 424971134 0.94
tpch_q21/datafusion:vortex-file-compressed 515881048 541403750 0.95
tpch_q22/datafusion:vortex-file-compressed 172465313 189884305 0.91
datafusion / vortex-compact (1.096x ➖, 0↑ 2↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 294159942 306341407 0.96
tpch_q02/datafusion:vortex-compact 🚨 696271960 471503841 1.48
tpch_q03/datafusion:vortex-compact 439630301 343599838 1.28
tpch_q04/datafusion:vortex-compact 301757189 247530748 1.22
tpch_q05/datafusion:vortex-compact 418698263 378755163 1.11
tpch_q06/datafusion:vortex-compact 415577944 335304857 1.24
tpch_q07/datafusion:vortex-compact 416140931 472728944 0.88
tpch_q08/datafusion:vortex-compact 562573706 464510705 1.21
tpch_q09/datafusion:vortex-compact 397286496 527334346 0.75
tpch_q10/datafusion:vortex-compact 451339692 436474231 1.03
tpch_q11/datafusion:vortex-compact 276397753 255070396 1.08
tpch_q12/datafusion:vortex-compact 472902486 374497206 1.26
tpch_q13/datafusion:vortex-compact 204843718 208119195 0.98
tpch_q14/datafusion:vortex-compact 266429971 245454606 1.09
tpch_q15/datafusion:vortex-compact 455018478 441818322 1.03
tpch_q16/datafusion:vortex-compact 174236896 173737001 1.00
tpch_q17/datafusion:vortex-compact 355036587 328232894 1.08
tpch_q18/datafusion:vortex-compact 342293364 323315647 1.06
tpch_q19/datafusion:vortex-compact 478041904 432515198 1.11
tpch_q20/datafusion:vortex-compact 499544218 455827318 1.10
tpch_q21/datafusion:vortex-compact 575843779 563705484 1.02
tpch_q22/datafusion:vortex-compact 🚨 197951512 140584977 1.41
datafusion / parquet (1.062x ➖, 0↑ 1↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 241763414 242964387 1.00
tpch_q02/datafusion:parquet 471203026 562283222 0.84
tpch_q03/datafusion:parquet 374155753 308918558 1.21
tpch_q04/datafusion:parquet 147882419 144787507 1.02
tpch_q05/datafusion:parquet 652347971 572787605 1.14
tpch_q06/datafusion:parquet 🚨 201620249 133084368 1.51
tpch_q07/datafusion:parquet 639799580 576821489 1.11
tpch_q08/datafusion:parquet 817925299 705337901 1.16
tpch_q09/datafusion:parquet 560214365 564810233 0.99
tpch_q10/datafusion:parquet 618621781 688192175 0.90
tpch_q11/datafusion:parquet 433337846 352939459 1.23
tpch_q12/datafusion:parquet 322603247 392613840 0.82
tpch_q13/datafusion:parquet 452617612 518049134 0.87
tpch_q14/datafusion:parquet 214768417 204847770 1.05
tpch_q15/datafusion:parquet 327839249 302092322 1.09
tpch_q16/datafusion:parquet 183720329 176784028 1.04
tpch_q17/datafusion:parquet 397816407 413488726 0.96
tpch_q18/datafusion:parquet 489490618 544688758 0.90
tpch_q19/datafusion:parquet 377874408 315514781 1.20
tpch_q20/datafusion:parquet 412839951 360197264 1.15
tpch_q21/datafusion:parquet 609348341 528761363 1.15
tpch_q22/datafusion:parquet 155715391 120094213 1.30
duckdb / vortex-file-compressed (1.025x ➖, 0↑ 1↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 250717539 306639124 0.82
tpch_q02/duckdb:vortex-file-compressed 883276594 867884652 1.02
tpch_q03/duckdb:vortex-file-compressed 507899634 542787281 0.94
tpch_q04/duckdb:vortex-file-compressed 🚨 421750722 316150869 1.33
tpch_q05/duckdb:vortex-file-compressed 807197986 811957827 0.99
tpch_q06/duckdb:vortex-file-compressed 397296547 361917973 1.10
tpch_q07/duckdb:vortex-file-compressed 626863828 651045634 0.96
tpch_q08/duckdb:vortex-file-compressed 880232325 824598109 1.07
tpch_q09/duckdb:vortex-file-compressed 970590952 856081565 1.13
tpch_q10/duckdb:vortex-file-compressed 677018187 694745248 0.97
tpch_q11/duckdb:vortex-file-compressed 502527570 482889928 1.04
tpch_q12/duckdb:vortex-file-compressed 431455025 504632088 0.85
tpch_q13/duckdb:vortex-file-compressed 469411906 481709586 0.97
tpch_q14/duckdb:vortex-file-compressed 480938504 422509383 1.14
tpch_q15/duckdb:vortex-file-compressed 286813796 234975457 1.22
tpch_q16/duckdb:vortex-file-compressed 346013926 332300444 1.04
tpch_q17/duckdb:vortex-file-compressed 605248421 628133813 0.96
tpch_q18/duckdb:vortex-file-compressed 551676676 509897104 1.08
tpch_q19/duckdb:vortex-file-compressed 474934479 456222761 1.04
tpch_q20/duckdb:vortex-file-compressed 643585814 811033185 0.79
tpch_q21/duckdb:vortex-file-compressed 1152159312 1054367273 1.09
tpch_q22/duckdb:vortex-file-compressed 352670975 311991846 1.13
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 279244850 279651777 1.00
tpch_q02/duckdb:vortex-compact 845731216 806547012 1.05
tpch_q03/duckdb:vortex-compact 498720042 511543049 0.97
tpch_q04/duckdb:vortex-compact 331016477 329905723 1.00
tpch_q05/duckdb:vortex-compact 798750833 771519088 1.04
tpch_q06/duckdb:vortex-compact 365347236 415009908 0.88
tpch_q07/duckdb:vortex-compact 653937328 622986826 1.05
tpch_q08/duckdb:vortex-compact 769793801 868282640 0.89
tpch_q09/duckdb:vortex-compact 886757398 911442397 0.97
tpch_q10/duckdb:vortex-compact 662727922 698153387 0.95
tpch_q11/duckdb:vortex-compact 519727199 498615006 1.04
tpch_q12/duckdb:vortex-compact 405787688 402555382 1.01
tpch_q13/duckdb:vortex-compact 429565693 445705362 0.96
tpch_q14/duckdb:vortex-compact 446735882 450266571 0.99
tpch_q15/duckdb:vortex-compact 299333057 310530561 0.96
tpch_q16/duckdb:vortex-compact 369621899 370384787 1.00
tpch_q17/duckdb:vortex-compact 679011959 621920800 1.09
tpch_q18/duckdb:vortex-compact 553390295 505444158 1.09
tpch_q19/duckdb:vortex-compact 460362877 444112152 1.04
tpch_q20/duckdb:vortex-compact 738117826 719855442 1.03
tpch_q21/duckdb:vortex-compact 1051110834 952860941 1.10
tpch_q22/duckdb:vortex-compact 339154792 329983867 1.03
duckdb / parquet (1.004x ➖, 0↑ 1↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 464776077 475144209 0.98
tpch_q02/duckdb:parquet 1230967639 1272047627 0.97
tpch_q03/duckdb:parquet 972192099 956953386 1.02
tpch_q04/duckdb:parquet 638469129 635005902 1.01
tpch_q05/duckdb:parquet 1450773926 1413523306 1.03
tpch_q06/duckdb:parquet 441179882 366954833 1.20
tpch_q07/duckdb:parquet 1188861323 1192553611 1.00
tpch_q08/duckdb:parquet 1526166881 1561371353 0.98
tpch_q09/duckdb:parquet 1262864523 1362778028 0.93
tpch_q10/duckdb:parquet 1164319779 1243601770 0.94
tpch_q11/duckdb:parquet 796278493 789232986 1.01
tpch_q12/duckdb:parquet 588728431 563465563 1.04
tpch_q13/duckdb:parquet 846080532 891509786 0.95
tpch_q14/duckdb:parquet 🚨 1007417803 643158222 1.57
tpch_q15/duckdb:parquet 441298889 454823294 0.97
tpch_q16/duckdb:parquet 454067142 548759799 0.83
tpch_q17/duckdb:parquet 857045990 732255872 1.17
tpch_q18/duckdb:parquet 800537584 1031102307 0.78
tpch_q19/duckdb:parquet 804010298 777484779 1.03
tpch_q20/duckdb:parquet 947211111 981262313 0.97
tpch_q21/duckdb:parquet 1070238485 1085258146 0.99
tpch_q22/duckdb:parquet 502586492 523490223 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -4.0% -1.3% -2.7% +187.0% ➖ noise
1 datafusion:vortex-file-compressed +12.8% -1.3% +14.3% +151.6% ➖ noise
1 duckdb:vortex-compact -0.1% -1.3% +1.2% +35.0% ➖ noise
1 duckdb:vortex-file-compressed -18.2% -1.3% -17.1% +55.1% ➖ noise
2 datafusion:vortex-compact +47.7% -9.9% +64.0% +64.5% ➖ noise
2 datafusion:vortex-file-compressed +1.0% -9.9% +12.1% +44.2% ➖ noise
2 duckdb:vortex-compact +4.9% -9.9% +16.4% +34.0% ➖ noise
2 duckdb:vortex-file-compressed +1.8% -9.9% +13.0% +34.0% ➖ noise
3 datafusion:vortex-compact +27.9% +10.9% +15.3% +123.6% ➖ noise
3 datafusion:vortex-file-compressed +0.8% +10.9% -9.1% +82.8% ➖ noise
3 duckdb:vortex-compact -2.5% +10.9% -12.1% +43.2% ➖ noise
3 duckdb:vortex-file-compressed -6.4% +10.9% -15.6% +94.0% ➖ noise
4 datafusion:vortex-compact +21.9% +1.3% +20.3% +56.4% ➖ noise
4 datafusion:vortex-file-compressed +12.5% +1.3% +11.0% +34.0% ➖ noise
4 duckdb:vortex-compact +0.3% +1.3% -1.0% +34.0% ➖ noise
4 duckdb:vortex-file-compressed +33.4% +1.3% +31.6% +41.7% ➖ noise
5 datafusion:vortex-compact +10.5% +8.1% +2.2% +34.0% ➖ noise
5 datafusion:vortex-file-compressed -2.0% +8.1% -9.4% +39.3% ➖ noise
5 duckdb:vortex-compact +3.5% +8.1% -4.2% +34.0% ➖ noise
5 duckdb:vortex-file-compressed -0.6% +8.1% -8.0% +34.0% ➖ noise
6 datafusion:vortex-compact +23.9% +35.0% -8.2% +44.0% ➖ noise
6 datafusion:vortex-file-compressed +13.1% +35.0% -16.2% +41.4% ➖ noise
6 duckdb:vortex-compact -12.0% +35.0% -34.8% +34.0% ✅ faster
6 duckdb:vortex-file-compressed +9.8% +35.0% -18.7% +34.0% ➖ noise
7 datafusion:vortex-compact -12.0% +5.2% -16.3% +34.0% ➖ noise
7 datafusion:vortex-file-compressed -21.6% +5.2% -25.5% +34.0% ✅ faster
7 duckdb:vortex-compact +5.0% +5.2% -0.2% +34.0% ➖ noise
7 duckdb:vortex-file-compressed -3.7% +5.2% -8.4% +34.0% ➖ noise
8 datafusion:vortex-compact +21.1% +6.5% +13.8% +34.0% ➖ noise
8 datafusion:vortex-file-compressed +37.0% +6.5% +28.7% +39.7% ➖ noise
8 duckdb:vortex-compact -11.3% +6.5% -16.7% +34.0% ➖ noise
8 duckdb:vortex-file-compressed +6.7% +6.5% +0.3% +34.0% ➖ noise
9 datafusion:vortex-compact -24.7% -4.1% -21.4% +50.4% ➖ noise
9 datafusion:vortex-file-compressed -0.4% -4.1% +3.8% +34.0% ➖ noise
9 duckdb:vortex-compact -2.7% -4.1% +1.5% +34.0% ➖ noise
9 duckdb:vortex-file-compressed +13.4% -4.1% +18.3% +34.0% ➖ noise
10 datafusion:vortex-compact +3.4% -8.3% +12.7% +34.0% ➖ noise
10 datafusion:vortex-file-compressed +68.9% -8.3% +84.1% +45.0% 🚨 regression
10 duckdb:vortex-compact -5.1% -8.3% +3.5% +34.0% ➖ noise
10 duckdb:vortex-file-compressed -2.6% -8.3% +6.2% +34.0% ➖ noise
11 datafusion:vortex-compact +8.4% +11.3% -2.6% +42.1% ➖ noise
11 datafusion:vortex-file-compressed +14.2% +11.3% +2.6% +48.3% ➖ noise
11 duckdb:vortex-compact +4.2% +11.3% -6.3% +34.0% ➖ noise
11 duckdb:vortex-file-compressed +4.1% +11.3% -6.5% +34.0% ➖ noise
12 datafusion:vortex-compact +26.3% -7.3% +36.3% +36.1% 🚨 regression
12 datafusion:vortex-file-compressed +14.7% -7.3% +23.8% +37.2% ➖ noise
12 duckdb:vortex-compact +0.8% -7.3% +8.8% +34.9% ➖ noise
12 duckdb:vortex-file-compressed -14.5% -7.3% -7.7% +34.0% ➖ noise
13 datafusion:vortex-compact -1.6% -8.9% +8.1% +59.5% ➖ noise
13 datafusion:vortex-file-compressed -0.3% -8.9% +9.5% +52.1% ➖ noise
13 duckdb:vortex-compact -3.6% -8.9% +5.8% +34.0% ➖ noise
13 duckdb:vortex-file-compressed -2.6% -8.9% +7.0% +34.0% ➖ noise
14 datafusion:vortex-compact +8.5% +28.1% -15.3% +34.0% ➖ noise
14 datafusion:vortex-file-compressed +88.9% +28.1% +47.4% +34.0% 🚨 regression
14 duckdb:vortex-compact -0.8% +28.1% -22.6% +39.5% ➖ noise
14 duckdb:vortex-file-compressed +13.8% +28.1% -11.2% +34.0% ➖ noise
15 datafusion:vortex-compact +3.0% +2.6% +0.4% +34.0% ➖ noise
15 datafusion:vortex-file-compressed +58.6% +2.6% +54.5% +53.8% 🚨 regression
15 duckdb:vortex-compact -3.6% +2.6% -6.1% +34.0% ➖ noise
15 duckdb:vortex-file-compressed +22.1% +2.6% +19.0% +34.0% ➖ noise
16 datafusion:vortex-compact +0.3% -7.3% +8.1% +34.0% ➖ noise
16 datafusion:vortex-file-compressed +10.3% -7.3% +18.9% +34.0% ➖ noise
16 duckdb:vortex-compact -0.2% -7.3% +7.6% +34.0% ➖ noise
16 duckdb:vortex-file-compressed +4.1% -7.3% +12.3% +34.0% ➖ noise
17 datafusion:vortex-compact +8.2% +6.1% +1.9% +34.0% ➖ noise
17 datafusion:vortex-file-compressed +19.4% +6.1% +12.5% +39.3% ➖ noise
17 duckdb:vortex-compact +9.2% +6.1% +2.9% +34.0% ➖ noise
17 duckdb:vortex-file-compressed -3.6% +6.1% -9.2% +34.0% ➖ noise
18 datafusion:vortex-compact +5.9% -16.5% +26.7% +34.0% ➖ noise
18 datafusion:vortex-file-compressed +12.2% -16.5% +34.3% +34.0% 🚨 regression
18 duckdb:vortex-compact +9.5% -16.5% +31.1% +34.0% ➖ noise
18 duckdb:vortex-file-compressed +8.2% -16.5% +29.5% +34.0% ➖ noise
19 datafusion:vortex-compact +10.5% +11.3% -0.7% +34.0% ➖ noise
19 datafusion:vortex-file-compressed +38.7% +11.3% +24.7% +34.0% ➖ noise
19 duckdb:vortex-compact +3.7% +11.3% -6.9% +34.0% ➖ noise
19 duckdb:vortex-file-compressed +4.1% +11.3% -6.5% +34.0% ➖ noise
20 datafusion:vortex-compact +9.6% +5.2% +4.2% +34.0% ➖ noise
20 datafusion:vortex-file-compressed -6.1% +5.2% -10.7% +34.0% ➖ noise
20 duckdb:vortex-compact +2.5% +5.2% -2.5% +34.0% ➖ noise
20 duckdb:vortex-file-compressed -20.6% +5.2% -24.6% +34.0% ➖ noise
21 datafusion:vortex-compact +2.2% +6.6% -4.2% +34.0% ➖ noise
21 datafusion:vortex-file-compressed -4.7% +6.6% -10.6% +34.0% ➖ noise
21 duckdb:vortex-compact +10.3% +6.6% +3.5% +34.0% ➖ noise
21 duckdb:vortex-file-compressed +9.3% +6.6% +2.5% +34.0% ➖ noise
22 datafusion:vortex-compact +40.8% +11.6% +26.2% +34.0% ➖ noise
22 datafusion:vortex-file-compressed -9.2% +11.6% -18.6% +34.0% ➖ noise
22 duckdb:vortex-compact +2.8% +11.6% -7.9% +34.0% ➖ noise
22 duckdb:vortex-file-compressed +13.0% +11.6% +1.3% +34.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: TPC-DS SF=1 on NVME

Summary

  • Overall: 0.992x ➖
  • Vortex: 0.991x ➖
  • Parquet: 0.994x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -0.3%
  • Confidence: low
  • Environment shift: -0.6%

Statistical Summary

  • Systemic shift (parquet controls): -0.6%
  • Control sigma: +2.5%
  • Residual noise: +2.3%
  • Median polish overall: -0.7%
datafusion / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 27432519 27980343 0.98
tpcds_q02/datafusion:vortex-file-compressed 74805331 76724574 0.97
tpcds_q03/datafusion:vortex-file-compressed 25905638 26938901 0.96
tpcds_q04/datafusion:vortex-file-compressed 374890363 381820608 0.98
tpcds_q05/datafusion:vortex-file-compressed 68990217 72159060 0.96
tpcds_q06/datafusion:vortex-file-compressed 74381388 73559553 1.01
tpcds_q07/datafusion:vortex-file-compressed 76406935 77452337 0.99
tpcds_q08/datafusion:vortex-file-compressed 39348463 39966287 0.98
tpcds_q09/datafusion:vortex-file-compressed 45711122 47255267 0.97
tpcds_q10/datafusion:vortex-file-compressed 47193735 50537297 0.93
tpcds_q11/datafusion:vortex-file-compressed 223874180 225315239 0.99
tpcds_q12/datafusion:vortex-file-compressed 35575263 35139600 1.01
tpcds_q13/datafusion:vortex-file-compressed 78059650 77326292 1.01
tpcds_q14/datafusion:vortex-file-compressed 208425651 207728932 1.00
tpcds_q15/datafusion:vortex-file-compressed 49219585 49828465 0.99
tpcds_q16/datafusion:vortex-file-compressed 28197942 28604312 0.99
tpcds_q17/datafusion:vortex-file-compressed 108437331 108447096 1.00
tpcds_q18/datafusion:vortex-file-compressed 95690953 101042525 0.95
tpcds_q19/datafusion:vortex-file-compressed 47289783 45100538 1.05
tpcds_q20/datafusion:vortex-file-compressed 40489573 38932115 1.04
tpcds_q21/datafusion:vortex-file-compressed 178518889 179588584 0.99
tpcds_q22/datafusion:vortex-file-compressed 69189864 69163969 1.00
tpcds_q23/datafusion:vortex-file-compressed 182248550 184855671 0.99
tpcds_q24/datafusion:vortex-file-compressed 174566188 177505601 0.98
tpcds_q25/datafusion:vortex-file-compressed 109668146 109713094 1.00
tpcds_q26/datafusion:vortex-file-compressed 59878855 58291285 1.03
tpcds_q27/datafusion:vortex-file-compressed 164822155 169213127 0.97
tpcds_q28/datafusion:vortex-file-compressed 48758152 49689471 0.98
tpcds_q29/datafusion:vortex-file-compressed 107813659 108729698 0.99
tpcds_q30/datafusion:vortex-file-compressed 28437148 29043551 0.98
tpcds_q31/datafusion:vortex-file-compressed 172134471 170382499 1.01
tpcds_q32/datafusion:vortex-file-compressed 23122205 23429272 0.99
tpcds_q33/datafusion:vortex-file-compressed 35647656 36003002 0.99
tpcds_q34/datafusion:vortex-file-compressed 36610532 36521457 1.00
tpcds_q35/datafusion:vortex-file-compressed 58658356 60774247 0.97
tpcds_q36/datafusion:vortex-file-compressed 105165537 103456088 1.02
tpcds_q37/datafusion:vortex-file-compressed 36295255 37108725 0.98
tpcds_q38/datafusion:vortex-file-compressed 84286591 87393338 0.96
tpcds_q39/datafusion:vortex-file-compressed 205575761 204564011 1.00
tpcds_q40/datafusion:vortex-file-compressed 54027778 56647262 0.95
tpcds_q41/datafusion:vortex-file-compressed 13927338 13786899 1.01
tpcds_q42/datafusion:vortex-file-compressed 29507641 29101111 1.01
tpcds_q43/datafusion:vortex-file-compressed 48420815 45862500 1.06
tpcds_q44/datafusion:vortex-file-compressed 41123451 40464301 1.02
tpcds_q45/datafusion:vortex-file-compressed 48676441 49515105 0.98
tpcds_q46/datafusion:vortex-file-compressed 62659845 63951511 0.98
tpcds_q47/datafusion:vortex-file-compressed 275103597 268456201 1.02
tpcds_q48/datafusion:vortex-file-compressed 65655405 66432400 0.99
tpcds_q49/datafusion:vortex-file-compressed 67540819 69719270 0.97
tpcds_q50/datafusion:vortex-file-compressed 71064547 73463852 0.97
tpcds_q51/datafusion:vortex-file-compressed 98524662 92229503 1.07
tpcds_q52/datafusion:vortex-file-compressed 30446170 28806471 1.06
tpcds_q53/datafusion:vortex-file-compressed 28601052 28494016 1.00
tpcds_q54/datafusion:vortex-file-compressed 46761988 46768777 1.00
tpcds_q55/datafusion:vortex-file-compressed 30858312 29604594 1.04
tpcds_q56/datafusion:vortex-file-compressed 45186911 45815287 0.99
tpcds_q57/datafusion:vortex-file-compressed 176040985 181765340 0.97
tpcds_q58/datafusion:vortex-file-compressed 109680859 106784472 1.03
tpcds_q59/datafusion:vortex-file-compressed 89146817 90946106 0.98
tpcds_q60/datafusion:vortex-file-compressed 45592357 45331328 1.01
tpcds_q61/datafusion:vortex-file-compressed 56494665 56307535 1.00
tpcds_q62/datafusion:vortex-file-compressed 42045614 45358289 0.93
tpcds_q63/datafusion:vortex-file-compressed 28862628 28041965 1.03
tpcds_q64/datafusion:vortex-file-compressed 688468515 693397067 0.99
tpcds_q65/datafusion:vortex-file-compressed 50487632 50593696 1.00
tpcds_q66/datafusion:vortex-file-compressed 105169874 103282860 1.02
tpcds_q67/datafusion:vortex-file-compressed 143883658 148015362 0.97
tpcds_q68/datafusion:vortex-file-compressed 64952062 66514946 0.98
tpcds_q69/datafusion:vortex-file-compressed 46100852 46123573 1.00
tpcds_q70/datafusion:vortex-file-compressed 123483834 126294250 0.98
tpcds_q71/datafusion:vortex-file-compressed 29328057 29164058 1.01
tpcds_q72/datafusion:vortex-file-compressed 3289647582 3327202430 0.99
tpcds_q73/datafusion:vortex-file-compressed 36964888 38734965 0.95
tpcds_q74/datafusion:vortex-file-compressed 164046935 161159922 1.02
tpcds_q75/datafusion:vortex-file-compressed 130304214 132719610 0.98
tpcds_q76/datafusion:vortex-file-compressed 62791232 66886529 0.94
tpcds_q77/datafusion:vortex-file-compressed 53329661 53423500 1.00
tpcds_q78/datafusion:vortex-file-compressed 178073583 174718635 1.02
tpcds_q79/datafusion:vortex-file-compressed 40901572 41465480 0.99
tpcds_q80/datafusion:vortex-file-compressed 115077208 114075676 1.01
tpcds_q81/datafusion:vortex-file-compressed 36205948 35447633 1.02
tpcds_q82/datafusion:vortex-file-compressed 39160031 38881809 1.01
tpcds_q83/datafusion:vortex-file-compressed 64150641 66239347 0.97
tpcds_q84/datafusion:vortex-file-compressed 15256024 16326385 0.93
tpcds_q85/datafusion:vortex-file-compressed 130172518 134592646 0.97
tpcds_q86/datafusion:vortex-file-compressed 30196771 31338367 0.96
tpcds_q87/datafusion:vortex-file-compressed 87348795 86383754 1.01
tpcds_q88/datafusion:vortex-file-compressed 79914585 80566613 0.99
tpcds_q89/datafusion:vortex-file-compressed 56528350 56281956 1.00
tpcds_q90/datafusion:vortex-file-compressed 16099182 16196860 0.99
tpcds_q91/datafusion:vortex-file-compressed 24795404 27014730 0.92
tpcds_q92/datafusion:vortex-file-compressed 18989393 19904283 0.95
tpcds_q93/datafusion:vortex-file-compressed 35585729 36270864 0.98
tpcds_q94/datafusion:vortex-file-compressed 25902235 26607826 0.97
tpcds_q95/datafusion:vortex-file-compressed 87650777 90547304 0.97
tpcds_q96/datafusion:vortex-file-compressed 15583362 14620270 1.07
tpcds_q97/datafusion:vortex-file-compressed 30655812 31739000 0.97
tpcds_q98/datafusion:vortex-file-compressed 48005347 49093833 0.98
tpcds_q99/datafusion:vortex-file-compressed 57987771 59608114 0.97
datafusion / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 36060208 33742533 1.07
tpcds_q02/datafusion:vortex-compact 81926878 82199693 1.00
tpcds_q03/datafusion:vortex-compact 33731578 32467044 1.04
tpcds_q04/datafusion:vortex-compact 428082579 431094836 0.99
tpcds_q05/datafusion:vortex-compact 81163111 83236162 0.98
tpcds_q06/datafusion:vortex-compact 82696700 81432073 1.02
tpcds_q07/datafusion:vortex-compact 90413330 94602776 0.96
tpcds_q08/datafusion:vortex-compact 48326904 49702082 0.97
tpcds_q09/datafusion:vortex-compact 99143208 99217082 1.00
tpcds_q10/datafusion:vortex-compact 66244965 65014966 1.02
tpcds_q11/datafusion:vortex-compact 252095311 256181859 0.98
tpcds_q12/datafusion:vortex-compact 37508021 38040764 0.99
tpcds_q13/datafusion:vortex-compact 150204293 139290734 1.08
tpcds_q14/datafusion:vortex-compact 266068036 266530478 1.00
tpcds_q15/datafusion:vortex-compact 52797919 53942888 0.98
tpcds_q16/datafusion:vortex-compact 39692119 39951706 0.99
tpcds_q17/datafusion:vortex-compact 126049118 127798407 0.99
tpcds_q18/datafusion:vortex-compact 112803139 116485854 0.97
tpcds_q19/datafusion:vortex-compact 61566647 60415678 1.02
tpcds_q20/datafusion:vortex-compact 44303169 44863288 0.99
tpcds_q21/datafusion:vortex-compact 173335970 178664672 0.97
tpcds_q22/datafusion:vortex-compact 75402856 76306223 0.99
tpcds_q23/datafusion:vortex-compact 222460347 224919510 0.99
tpcds_q24/datafusion:vortex-compact 199451714 210364070 0.95
tpcds_q25/datafusion:vortex-compact 128207883 125652958 1.02
tpcds_q26/datafusion:vortex-compact 68089165 66534891 1.02
tpcds_q27/datafusion:vortex-compact 203134598 206766856 0.98
tpcds_q28/datafusion:vortex-compact 101701449 101916054 1.00
tpcds_q29/datafusion:vortex-compact 123829560 125668755 0.99
tpcds_q30/datafusion:vortex-compact 33974771 34838415 0.98
tpcds_q31/datafusion:vortex-compact 209750480 207644992 1.01
tpcds_q32/datafusion:vortex-compact 29219182 29500715 0.99
tpcds_q33/datafusion:vortex-compact 50256290 51634177 0.97
tpcds_q34/datafusion:vortex-compact 55525070 56543973 0.98
tpcds_q35/datafusion:vortex-compact 73412365 74715547 0.98
tpcds_q36/datafusion:vortex-compact 128838232 129514800 0.99
tpcds_q37/datafusion:vortex-compact 47550924 47728308 1.00
tpcds_q38/datafusion:vortex-compact 99190952 101658624 0.98
tpcds_q39/datafusion:vortex-compact 202672267 194902823 1.04
tpcds_q40/datafusion:vortex-compact 60350758 61084756 0.99
tpcds_q41/datafusion:vortex-compact 14605363 15368428 0.95
tpcds_q42/datafusion:vortex-compact 35345255 33389827 1.06
tpcds_q43/datafusion:vortex-compact 54372532 53095830 1.02
tpcds_q44/datafusion:vortex-compact 70975390 70674885 1.00
tpcds_q45/datafusion:vortex-compact 51201010 50837768 1.01
tpcds_q46/datafusion:vortex-compact 88788095 90561927 0.98
tpcds_q47/datafusion:vortex-compact 293364413 293653433 1.00
tpcds_q48/datafusion:vortex-compact 109188400 110049838 0.99
tpcds_q49/datafusion:vortex-compact 94625323 100039841 0.95
tpcds_q50/datafusion:vortex-compact 93871697 91334831 1.03
tpcds_q51/datafusion:vortex-compact 101566136 101646705 1.00
tpcds_q52/datafusion:vortex-compact 37108220 35427599 1.05
tpcds_q53/datafusion:vortex-compact 37222514 38721171 0.96
tpcds_q54/datafusion:vortex-compact 63770290 62868343 1.01
tpcds_q55/datafusion:vortex-compact 35850091 35886259 1.00
tpcds_q56/datafusion:vortex-compact 58648870 57341388 1.02
tpcds_q57/datafusion:vortex-compact 195225180 191181740 1.02
tpcds_q58/datafusion:vortex-compact 115789259 117483541 0.99
tpcds_q59/datafusion:vortex-compact 105072110 109336788 0.96
tpcds_q60/datafusion:vortex-compact 59627189 59035113 1.01
tpcds_q61/datafusion:vortex-compact 80382707 80968586 0.99
tpcds_q62/datafusion:vortex-compact 44818175 44832930 1.00
tpcds_q63/datafusion:vortex-compact 37859221 41236337 0.92
tpcds_q64/datafusion:vortex-compact 785026965 805707149 0.97
tpcds_q65/datafusion:vortex-compact 72561798 71077790 1.02
tpcds_q66/datafusion:vortex-compact 115943790 107756998 1.08
tpcds_q67/datafusion:vortex-compact 145874239 149507994 0.98
tpcds_q68/datafusion:vortex-compact 91913125 89158101 1.03
tpcds_q69/datafusion:vortex-compact 62446039 62160543 1.00
tpcds_q70/datafusion:vortex-compact 139538694 141477416 0.99
tpcds_q71/datafusion:vortex-compact 44881902 43173085 1.04
tpcds_q72/datafusion:vortex-compact 3341817776 3394029113 0.98
tpcds_q73/datafusion:vortex-compact 56811320 57576422 0.99
tpcds_q74/datafusion:vortex-compact 181119854 183114782 0.99
tpcds_q75/datafusion:vortex-compact 173442160 176087118 0.98
tpcds_q76/datafusion:vortex-compact 77419700 78680792 0.98
tpcds_q77/datafusion:vortex-compact 67400976 68010652 0.99
tpcds_q78/datafusion:vortex-compact 201800534 199771211 1.01
tpcds_q79/datafusion:vortex-compact 65867825 66986498 0.98
tpcds_q80/datafusion:vortex-compact 139915719 139167709 1.01
tpcds_q81/datafusion:vortex-compact 41241930 40695543 1.01
tpcds_q82/datafusion:vortex-compact 51212112 51420578 1.00
tpcds_q83/datafusion:vortex-compact 64313745 66406878 0.97
tpcds_q84/datafusion:vortex-compact 17943001 17586846 1.02
tpcds_q85/datafusion:vortex-compact 156084104 156189140 1.00
tpcds_q86/datafusion:vortex-compact 31300933 32560575 0.96
tpcds_q87/datafusion:vortex-compact 102896527 100307429 1.03
tpcds_q88/datafusion:vortex-compact 129584706 129609595 1.00
tpcds_q89/datafusion:vortex-compact 64760528 66390709 0.98
tpcds_q90/datafusion:vortex-compact 21716973 21808095 1.00
tpcds_q91/datafusion:vortex-compact 40690351 41380957 0.98
tpcds_q92/datafusion:vortex-compact 21480313 21042512 1.02
tpcds_q93/datafusion:vortex-compact 51223798 53541413 0.96
tpcds_q94/datafusion:vortex-compact 32959867 33122642 1.00
tpcds_q95/datafusion:vortex-compact 98020296 96488767 1.02
tpcds_q96/datafusion:vortex-compact 25441426 24955057 1.02
tpcds_q97/datafusion:vortex-compact 44235395 46572482 0.95
tpcds_q98/datafusion:vortex-compact 53455183 58520077 0.91
tpcds_q99/datafusion:vortex-compact 65482023 70524202 0.93
datafusion / parquet (0.990x ➖, 2↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 37399287 39331332 0.95
tpcds_q02/datafusion:parquet 49168055 52425828 0.94
tpcds_q03/datafusion:parquet 16795197 16900053 0.99
tpcds_q04/datafusion:parquet 356503901 369450289 0.96
tpcds_q05/datafusion:parquet 90840680 92486286 0.98
tpcds_q06/datafusion:parquet 95342777 93331148 1.02
tpcds_q07/datafusion:parquet 135673521 131930460 1.03
tpcds_q08/datafusion:parquet 40613054 39539070 1.03
tpcds_q09/datafusion:parquet 53663809 52992303 1.01
tpcds_q10/datafusion:parquet 100126256 100408159 1.00
tpcds_q11/datafusion:parquet 222182011 222636268 1.00
tpcds_q12/datafusion:parquet 29451885 30910201 0.95
tpcds_q13/datafusion:parquet 137955391 138316515 1.00
tpcds_q14/datafusion:parquet 210256315 213669045 0.98
tpcds_q15/datafusion:parquet 57234298 54638646 1.05
tpcds_q16/datafusion:parquet 33017636 33620408 0.98
tpcds_q17/datafusion:parquet 173159538 174183304 0.99
tpcds_q18/datafusion:parquet 175504429 177939933 0.99
tpcds_q19/datafusion:parquet 35287431 37351314 0.94
tpcds_q20/datafusion:parquet 🚀 23336312 26550459 0.88
tpcds_q21/datafusion:parquet 28156656 27765296 1.01
tpcds_q22/datafusion:parquet 159928120 170342437 0.94
tpcds_q23/datafusion:parquet 185699963 191232380 0.97
tpcds_q24/datafusion:parquet 213156294 214894330 0.99
tpcds_q25/datafusion:parquet 175202770 178744231 0.98
tpcds_q26/datafusion:parquet 117882715 114577953 1.03
tpcds_q27/datafusion:parquet 251298378 248421495 1.01
tpcds_q28/datafusion:parquet 51482920 51374956 1.00
tpcds_q29/datafusion:parquet 174632335 177784893 0.98
tpcds_q30/datafusion:parquet 42549963 43108357 0.99
tpcds_q31/datafusion:parquet 105262278 106113641 0.99
tpcds_q32/datafusion:parquet 28553506 28554838 1.00
tpcds_q33/datafusion:parquet 36929168 37620503 0.98
tpcds_q34/datafusion:parquet 36944943 35280376 1.05
tpcds_q35/datafusion:parquet 95303059 94481153 1.01
tpcds_q36/datafusion:parquet 83437450 83432644 1.00
tpcds_q37/datafusion:parquet 26837603 26442612 1.01
tpcds_q38/datafusion:parquet 62746511 63674767 0.99
tpcds_q39/datafusion:parquet 97159566 101580335 0.96
tpcds_q40/datafusion:parquet 34107323 35288140 0.97
tpcds_q41/datafusion:parquet 12622583 12877203 0.98
tpcds_q42/datafusion:parquet 16441333 16113136 1.02
tpcds_q43/datafusion:parquet 25472708 27215863 0.94
tpcds_q44/datafusion:parquet 39824187 40987343 0.97
tpcds_q45/datafusion:parquet 67889007 70815639 0.96
tpcds_q46/datafusion:parquet 51440797 51542777 1.00
tpcds_q47/datafusion:parquet 181949789 185075914 0.98
tpcds_q48/datafusion:parquet 131273939 133008383 0.99
tpcds_q49/datafusion:parquet 73179188 74443627 0.98
tpcds_q50/datafusion:parquet 109626257 107621574 1.02
tpcds_q51/datafusion:parquet 96632875 96720792 1.00
tpcds_q52/datafusion:parquet 14841014 15745509 0.94
tpcds_q53/datafusion:parquet 31069495 30429115 1.02
tpcds_q54/datafusion:parquet 47829208 49079114 0.97
tpcds_q55/datafusion:parquet 15675039 15939322 0.98
tpcds_q56/datafusion:parquet 36830637 36557671 1.01
tpcds_q57/datafusion:parquet 139458826 137657333 1.01
tpcds_q58/datafusion:parquet 75292709 75589648 1.00
tpcds_q59/datafusion:parquet 68390636 66909381 1.02
tpcds_q60/datafusion:parquet 35457678 37844985 0.94
tpcds_q61/datafusion:parquet 66074339 67500835 0.98
tpcds_q62/datafusion:parquet 🚀 39341846 47120563 0.83
tpcds_q63/datafusion:parquet 31139796 32304964 0.96
tpcds_q64/datafusion:parquet 983639124 1001517709 0.98
tpcds_q65/datafusion:parquet 49193548 50751816 0.97
tpcds_q66/datafusion:parquet 86875101 92457416 0.94
tpcds_q67/datafusion:parquet 176577673 177150461 1.00
tpcds_q68/datafusion:parquet 53304573 49121072 1.09
tpcds_q69/datafusion:parquet 91999518 91003247 1.01
tpcds_q70/datafusion:parquet 108281443 107580344 1.01
tpcds_q71/datafusion:parquet 28828239 30074473 0.96
tpcds_q72/datafusion:parquet 848257374 865740022 0.98
tpcds_q73/datafusion:parquet 35058291 37109489 0.94
tpcds_q74/datafusion:parquet 127083131 127392551 1.00
tpcds_q75/datafusion:parquet 134163912 134653252 1.00
tpcds_q76/datafusion:parquet 95546542 93500528 1.02
tpcds_q77/datafusion:parquet 59321535 60036793 0.99
tpcds_q78/datafusion:parquet 178611713 189684070 0.94
tpcds_q79/datafusion:parquet 41238764 41160538 1.00
tpcds_q80/datafusion:parquet 110240932 114257161 0.96
tpcds_q81/datafusion:parquet 42281546 41106942 1.03
tpcds_q82/datafusion:parquet 29099053 28463071 1.02
tpcds_q83/datafusion:parquet 53529513 53215513 1.01
tpcds_q84/datafusion:parquet 49738144 47398386 1.05
tpcds_q85/datafusion:parquet 243931615 244695623 1.00
tpcds_q86/datafusion:parquet 21841491 22306199 0.98
tpcds_q87/datafusion:parquet 63464673 64464035 0.98
tpcds_q88/datafusion:parquet 79457330 77909010 1.02
tpcds_q89/datafusion:parquet 37547125 36977560 1.02
tpcds_q90/datafusion:parquet 18619610 18578487 1.00
tpcds_q91/datafusion:parquet 78183738 78262311 1.00
tpcds_q92/datafusion:parquet 24777835 24068154 1.03
tpcds_q93/datafusion:parquet 39103783 38066397 1.03
tpcds_q94/datafusion:parquet 29239700 27920350 1.05
tpcds_q95/datafusion:parquet 127372692 133532240 0.95
tpcds_q96/datafusion:parquet 14708117 14485124 1.02
tpcds_q97/datafusion:parquet 36906462 34459823 1.07
tpcds_q98/datafusion:parquet 38093816 37386039 1.02
tpcds_q99/datafusion:parquet 44739177 44890107 1.00
duckdb / vortex-file-compressed (0.986x ➖, 2↑ 2↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 25255852 26132356 0.97
tpcds_q02/duckdb:vortex-file-compressed 80679917 82625104 0.98
tpcds_q03/duckdb:vortex-file-compressed 21930671 22848756 0.96
tpcds_q04/duckdb:vortex-file-compressed 104189906 103429523 1.01
tpcds_q05/duckdb:vortex-file-compressed 95583488 99139639 0.96
tpcds_q06/duckdb:vortex-file-compressed 35123395 34449033 1.02
tpcds_q07/duckdb:vortex-file-compressed 23824479 22907333 1.04
tpcds_q08/duckdb:vortex-file-compressed 22878154 22525293 1.02
tpcds_q09/duckdb:vortex-file-compressed 39067920 38479767 1.02
tpcds_q10/duckdb:vortex-file-compressed 35862782 35587370 1.01
tpcds_q11/duckdb:vortex-file-compressed 60935443 60817834 1.00
tpcds_q12/duckdb:vortex-file-compressed 13854311 14519528 0.95
tpcds_q13/duckdb:vortex-file-compressed 32618580 32410445 1.01
tpcds_q14/duckdb:vortex-file-compressed 🚨 199034396 178392146 1.12
tpcds_q15/duckdb:vortex-file-compressed 40352888 40623760 0.99
tpcds_q16/duckdb:vortex-file-compressed 28481026 30564353 0.93
tpcds_q17/duckdb:vortex-file-compressed 37245893 38571912 0.97
tpcds_q18/duckdb:vortex-file-compressed 45330932 45943983 0.99
tpcds_q19/duckdb:vortex-file-compressed 32384444 32722094 0.99
tpcds_q20/duckdb:vortex-file-compressed 🚀 14285433 15878837 0.90
tpcds_q21/duckdb:vortex-file-compressed 19879715 20673786 0.96
tpcds_q22/duckdb:vortex-file-compressed 103100028 105209108 0.98
tpcds_q23/duckdb:vortex-file-compressed 128406764 124531503 1.03
tpcds_q24/duckdb:vortex-file-compressed 53707059 53103375 1.01
tpcds_q25/duckdb:vortex-file-compressed 35772093 37776558 0.95
tpcds_q26/duckdb:vortex-file-compressed 39722056 39886756 1.00
tpcds_q27/duckdb:vortex-file-compressed 84934387 87731902 0.97
tpcds_q28/duckdb:vortex-file-compressed 36850098 37287971 0.99
tpcds_q29/duckdb:vortex-file-compressed 36372623 36611198 0.99
tpcds_q30/duckdb:vortex-file-compressed 28739667 28860561 1.00
tpcds_q31/duckdb:vortex-file-compressed 26563039 25286808 1.05
tpcds_q32/duckdb:vortex-file-compressed 17516484 16755349 1.05
tpcds_q33/duckdb:vortex-file-compressed 65144928 63653892 1.02
tpcds_q34/duckdb:vortex-file-compressed 18234266 18975819 0.96
tpcds_q35/duckdb:vortex-file-compressed 62779430 63372301 0.99
tpcds_q36/duckdb:vortex-file-compressed 27374423 27263558 1.00
tpcds_q37/duckdb:vortex-file-compressed 21275527 23323320 0.91
tpcds_q38/duckdb:vortex-file-compressed 36548511 37842000 0.97
tpcds_q39/duckdb:vortex-file-compressed 46505333 45732170 1.02
tpcds_q40/duckdb:vortex-file-compressed 23153465 23208446 1.00
tpcds_q41/duckdb:vortex-file-compressed 13164472 13283914 0.99
tpcds_q42/duckdb:vortex-file-compressed 11479042 11921271 0.96
tpcds_q43/duckdb:vortex-file-compressed 19426240 21141585 0.92
tpcds_q44/duckdb:vortex-file-compressed 25276099 24116162 1.05
tpcds_q45/duckdb:vortex-file-compressed 26081469 27670052 0.94
tpcds_q46/duckdb:vortex-file-compressed 46593710 47738810 0.98
tpcds_q47/duckdb:vortex-file-compressed 48284096 49303167 0.98
tpcds_q48/duckdb:vortex-file-compressed 30369779 30631401 0.99
tpcds_q49/duckdb:vortex-file-compressed 31224206 31909476 0.98
tpcds_q50/duckdb:vortex-file-compressed 33931211 34097091 1.00
tpcds_q51/duckdb:vortex-file-compressed 99152344 98244042 1.01
tpcds_q52/duckdb:vortex-file-compressed 11706166 12380968 0.95
tpcds_q53/duckdb:vortex-file-compressed 17742585 17283455 1.03
tpcds_q54/duckdb:vortex-file-compressed 48042329 48063119 1.00
tpcds_q55/duckdb:vortex-file-compressed 11731801 12575653 0.93
tpcds_q56/duckdb:vortex-file-compressed 64169538 66067882 0.97
tpcds_q57/duckdb:vortex-file-compressed 44063432 43340936 1.02
tpcds_q58/duckdb:vortex-file-compressed 31928202 33871711 0.94
tpcds_q59/duckdb:vortex-file-compressed 55401145 57283677 0.97
tpcds_q60/duckdb:vortex-file-compressed 69864223 69270345 1.01
tpcds_q61/duckdb:vortex-file-compressed 37389669 38159264 0.98
tpcds_q62/duckdb:vortex-file-compressed 17500383 17873922 0.98
tpcds_q63/duckdb:vortex-file-compressed 17296130 18042317 0.96
tpcds_q64/duckdb:vortex-file-compressed 76546581 78601933 0.97
tpcds_q65/duckdb:vortex-file-compressed 23264249 24547299 0.95
tpcds_q66/duckdb:vortex-file-compressed 56738880 60859496 0.93
tpcds_q67/duckdb:vortex-file-compressed 146156084 143992362 1.02
tpcds_q68/duckdb:vortex-file-compressed 38988051 40008142 0.97
tpcds_q69/duckdb:vortex-file-compressed 38109028 37911126 1.01
tpcds_q70/duckdb:vortex-file-compressed 26171623 25413706 1.03
tpcds_q71/duckdb:vortex-file-compressed 20090900 21146741 0.95
tpcds_q72/duckdb:vortex-file-compressed 171456805 175452838 0.98
tpcds_q73/duckdb:vortex-file-compressed 19257491 19660412 0.98
tpcds_q74/duckdb:vortex-file-compressed 51616546 51486274 1.00
tpcds_q75/duckdb:vortex-file-compressed 56981120 60195498 0.95
tpcds_q76/duckdb:vortex-file-compressed 61941770 64532871 0.96
tpcds_q77/duckdb:vortex-file-compressed 🚨 71884375 64813430 1.11
tpcds_q78/duckdb:vortex-file-compressed 77038755 80160691 0.96
tpcds_q79/duckdb:vortex-file-compressed 33808071 35265484 0.96
tpcds_q80/duckdb:vortex-file-compressed 90839955 91865871 0.99
tpcds_q81/duckdb:vortex-file-compressed 34784440 33003099 1.05
tpcds_q82/duckdb:vortex-file-compressed 22340304 22088664 1.01
tpcds_q83/duckdb:vortex-file-compressed 28038216 27337318 1.03
tpcds_q84/duckdb:vortex-file-compressed 17148434 17319305 0.99
tpcds_q85/duckdb:vortex-file-compressed 44124561 44825955 0.98
tpcds_q86/duckdb:vortex-file-compressed 18228405 19523906 0.93
tpcds_q87/duckdb:vortex-file-compressed 40616335 41148091 0.99
tpcds_q88/duckdb:vortex-file-compressed 42788535 41195774 1.04
tpcds_q89/duckdb:vortex-file-compressed 18283962 17953327 1.02
tpcds_q90/duckdb:vortex-file-compressed 15071038 15587879 0.97
tpcds_q91/duckdb:vortex-file-compressed 27458070 27994791 0.98
tpcds_q92/duckdb:vortex-file-compressed 14290348 14726081 0.97
tpcds_q93/duckdb:vortex-file-compressed 30433296 30377882 1.00
tpcds_q94/duckdb:vortex-file-compressed 21716974 21444164 1.01
tpcds_q95/duckdb:vortex-file-compressed 🚀 136266852 154051974 0.88
tpcds_q96/duckdb:vortex-file-compressed 18626013 17522262 1.06
tpcds_q97/duckdb:vortex-file-compressed 36843076 38213256 0.96
tpcds_q98/duckdb:vortex-file-compressed 17688214 19088567 0.93
tpcds_q99/duckdb:vortex-file-compressed 33387946 34988205 0.95
duckdb / vortex-compact (0.993x ➖, 1↑ 1↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 36461910 36847093 0.99
tpcds_q02/duckdb:vortex-compact 122324616 125904391 0.97
tpcds_q03/duckdb:vortex-compact 48379754 50205306 0.96
tpcds_q04/duckdb:vortex-compact 125133061 122783600 1.02
tpcds_q05/duckdb:vortex-compact 167734280 176066283 0.95
tpcds_q06/duckdb:vortex-compact 40597895 39908551 1.02
tpcds_q07/duckdb:vortex-compact 37802807 38617468 0.98
tpcds_q08/duckdb:vortex-compact 29528412 29653413 1.00
tpcds_q09/duckdb:vortex-compact 111215698 110464912 1.01
tpcds_q10/duckdb:vortex-compact 47944834 48122480 1.00
tpcds_q11/duckdb:vortex-compact 76213767 75825552 1.01
tpcds_q12/duckdb:vortex-compact 18114755 19571240 0.93
tpcds_q13/duckdb:vortex-compact 54531051 53698003 1.02
tpcds_q14/duckdb:vortex-compact 297324770 296389261 1.00
tpcds_q15/duckdb:vortex-compact 45157247 44614432 1.01
tpcds_q16/duckdb:vortex-compact 37055877 37269759 0.99
tpcds_q17/duckdb:vortex-compact 51480010 51963788 0.99
tpcds_q18/duckdb:vortex-compact 66269494 66971793 0.99
tpcds_q19/duckdb:vortex-compact 41180422 41940762 0.98
tpcds_q20/duckdb:vortex-compact 20925203 20450213 1.02
tpcds_q21/duckdb:vortex-compact 27766339 26832300 1.03
tpcds_q22/duckdb:vortex-compact 110678893 112735140 0.98
tpcds_q23/duckdb:vortex-compact 154504318 166104372 0.93
tpcds_q24/duckdb:vortex-compact 77388697 77384038 1.00
tpcds_q25/duckdb:vortex-compact 49821113 53891039 0.92
tpcds_q26/duckdb:vortex-compact 55132103 51085527 1.08
tpcds_q27/duckdb:vortex-compact 140442992 147679799 0.95
tpcds_q28/duckdb:vortex-compact 107313780 107775707 1.00
tpcds_q29/duckdb:vortex-compact 50127184 50810825 0.99
tpcds_q30/duckdb:vortex-compact 34523836 34490366 1.00
tpcds_q31/duckdb:vortex-compact 31522506 31899087 0.99
tpcds_q32/duckdb:vortex-compact 22444700 23999113 0.94
tpcds_q33/duckdb:vortex-compact 148414675 142355225 1.04
tpcds_q34/duckdb:vortex-compact 30067851 30147774 1.00
tpcds_q35/duckdb:vortex-compact 67726371 69233332 0.98
tpcds_q36/duckdb:vortex-compact 34907107 35588373 0.98
tpcds_q37/duckdb:vortex-compact 30612685 29467377 1.04
tpcds_q38/duckdb:vortex-compact 42403990 40531432 1.05
tpcds_q39/duckdb:vortex-compact 52452423 53171933 0.99
tpcds_q40/duckdb:vortex-compact 30114013 31895189 0.94
tpcds_q41/duckdb:vortex-compact 16667447 16631205 1.00
tpcds_q42/duckdb:vortex-compact 14549333 14721545 0.99
tpcds_q43/duckdb:vortex-compact 24043661 24075890 1.00
tpcds_q44/duckdb:vortex-compact 35611265 34789634 1.02
tpcds_q45/duckdb:vortex-compact 33404094 33105128 1.01
tpcds_q46/duckdb:vortex-compact 61898123 61960565 1.00
tpcds_q47/duckdb:vortex-compact 54390508 54759001 0.99
tpcds_q48/duckdb:vortex-compact 45599681 44900790 1.02
tpcds_q49/duckdb:vortex-compact 46891546 48723093 0.96
tpcds_q50/duckdb:vortex-compact 55117830 54097622 1.02
tpcds_q51/duckdb:vortex-compact 104658718 114617048 0.91
tpcds_q52/duckdb:vortex-compact 15487718 15537174 1.00
tpcds_q53/duckdb:vortex-compact 22212165 22806382 0.97
tpcds_q54/duckdb:vortex-compact 85840817 85921589 1.00
tpcds_q55/duckdb:vortex-compact 14888974 14570990 1.02
tpcds_q56/duckdb:vortex-compact 144579985 145735917 0.99
tpcds_q57/duckdb:vortex-compact 47105779 46585557 1.01
tpcds_q58/duckdb:vortex-compact 38478640 41045984 0.94
tpcds_q59/duckdb:vortex-compact 68452670 66098928 1.04
tpcds_q60/duckdb:vortex-compact 142441311 147760219 0.96
tpcds_q61/duckdb:vortex-compact 52708263 54113294 0.97
tpcds_q62/duckdb:vortex-compact 🚨 26658955 21483897 1.24
tpcds_q63/duckdb:vortex-compact 22988615 23194406 0.99
tpcds_q64/duckdb:vortex-compact 103739459 106580854 0.97
tpcds_q65/duckdb:vortex-compact 27640069 28092362 0.98
tpcds_q66/duckdb:vortex-compact 94171131 95610049 0.98
tpcds_q67/duckdb:vortex-compact 150741565 150819314 1.00
tpcds_q68/duckdb:vortex-compact 58055393 57141649 1.02
tpcds_q69/duckdb:vortex-compact 48634111 49435445 0.98
tpcds_q70/duckdb:vortex-compact 29550556 29374339 1.01
tpcds_q71/duckdb:vortex-compact 26739341 25688355 1.04
tpcds_q72/duckdb:vortex-compact 191925945 195322742 0.98
tpcds_q73/duckdb:vortex-compact 28788174 29161321 0.99
tpcds_q74/duckdb:vortex-compact 58192048 58479795 1.00
tpcds_q75/duckdb:vortex-compact 71915840 70320950 1.02
tpcds_q76/duckdb:vortex-compact 135211119 133012034 1.02
tpcds_q77/duckdb:vortex-compact 134081583 136264415 0.98
tpcds_q78/duckdb:vortex-compact 85689291 85773698 1.00
tpcds_q79/duckdb:vortex-compact 61570472 62454354 0.99
tpcds_q80/duckdb:vortex-compact 165717471 168551315 0.98
tpcds_q81/duckdb:vortex-compact 39127575 39487109 0.99
tpcds_q82/duckdb:vortex-compact 31318602 31846226 0.98
tpcds_q83/duckdb:vortex-compact 44765838 45841567 0.98
tpcds_q84/duckdb:vortex-compact 21338423 20448138 1.04
tpcds_q85/duckdb:vortex-compact 58967466 62243700 0.95
tpcds_q86/duckdb:vortex-compact 🚀 19024114 21310508 0.89
tpcds_q87/duckdb:vortex-compact 41527995 44270911 0.94
tpcds_q88/duckdb:vortex-compact 43874642 43324512 1.01
tpcds_q89/duckdb:vortex-compact 24288135 23364110 1.04
tpcds_q90/duckdb:vortex-compact 15981230 16175721 0.99
tpcds_q91/duckdb:vortex-compact 44562315 43953571 1.01
tpcds_q92/duckdb:vortex-compact 19500711 20066805 0.97
tpcds_q93/duckdb:vortex-compact 36302782 36444317 1.00
tpcds_q94/duckdb:vortex-compact 27843497 27042011 1.03
tpcds_q95/duckdb:vortex-compact 151862977 162374591 0.94
tpcds_q96/duckdb:vortex-compact 18151988 17957974 1.01
tpcds_q97/duckdb:vortex-compact 40827367 41373193 0.99
tpcds_q98/duckdb:vortex-compact 22682668 22745582 1.00
tpcds_q99/duckdb:vortex-compact 34704108 37613157 0.92
duckdb / parquet (0.998x ➖, 0↑ 2↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 42492198 45898143 0.93
tpcds_q02/duckdb:parquet 60611245 61585965 0.98
tpcds_q03/duckdb:parquet 12221931 12562982 0.97
tpcds_q04/duckdb:parquet 124839373 138018868 0.90
tpcds_q05/duckdb:parquet 71998031 75646526 0.95
tpcds_q06/duckdb:parquet 29085942 29674120 0.98
tpcds_q07/duckdb:parquet 23391916 23392239 1.00
tpcds_q08/duckdb:parquet 28537356 28385662 1.01
tpcds_q09/duckdb:parquet 39322823 39768767 0.99
tpcds_q10/duckdb:parquet 34015157 34222848 0.99
tpcds_q11/duckdb:parquet 83875346 89157830 0.94
tpcds_q12/duckdb:parquet 14276878 14631514 0.98
tpcds_q13/duckdb:parquet 34078568 33726761 1.01
tpcds_q14/duckdb:parquet 162655467 164125393 0.99
tpcds_q15/duckdb:parquet 29509649 29429027 1.00
tpcds_q16/duckdb:parquet 22406499 21596315 1.04
tpcds_q17/duckdb:parquet 38100984 38363997 0.99
tpcds_q18/duckdb:parquet 46819870 46545828 1.01
tpcds_q19/duckdb:parquet 29201476 28679059 1.02
tpcds_q20/duckdb:parquet 15324824 14877118 1.03
tpcds_q21/duckdb:parquet 12331900 11858261 1.04
tpcds_q22/duckdb:parquet 63745279 66758333 0.95
tpcds_q23/duckdb:parquet 116784352 118271328 0.99
tpcds_q24/duckdb:parquet 44571368 43985604 1.01
tpcds_q25/duckdb:parquet 32519761 33033650 0.98
tpcds_q26/duckdb:parquet 35510089 38448995 0.92
tpcds_q27/duckdb:parquet 87713369 87374761 1.00
tpcds_q28/duckdb:parquet 36531106 37271408 0.98
tpcds_q29/duckdb:parquet 35698177 36133185 0.99
tpcds_q30/duckdb:parquet 40281807 40085756 1.00
tpcds_q31/duckdb:parquet 22338619 23171880 0.96
tpcds_q32/duckdb:parquet 11446178 11298900 1.01
tpcds_q33/duckdb:parquet 71219625 70728468 1.01
tpcds_q34/duckdb:parquet 20658783 20837303 0.99
tpcds_q35/duckdb:parquet 57568775 61064384 0.94
tpcds_q36/duckdb:parquet 20804070 20224669 1.03
tpcds_q37/duckdb:parquet 12617545 13029250 0.97
tpcds_q38/duckdb:parquet 32682778 32855921 0.99
tpcds_q39/duckdb:parquet 32152405 31444238 1.02
tpcds_q40/duckdb:parquet 17336812 18292974 0.95
tpcds_q41/duckdb:parquet 7415558 7867294 0.94
tpcds_q42/duckdb:parquet 9941736 10511348 0.95
tpcds_q43/duckdb:parquet 15509691 15272935 1.02
tpcds_q44/duckdb:parquet 22666333 22224183 1.02
tpcds_q45/duckdb:parquet 25860323 25966948 1.00
tpcds_q46/duckdb:parquet 46876257 44454020 1.05
tpcds_q47/duckdb:parquet 46486685 45427491 1.02
tpcds_q48/duckdb:parquet 30254640 30888229 0.98
tpcds_q49/duckdb:parquet 24412840 25691805 0.95
tpcds_q50/duckdb:parquet 24583333 24252360 1.01
tpcds_q51/duckdb:parquet 95116336 93786650 1.01
tpcds_q52/duckdb:parquet 10989956 11067856 0.99
tpcds_q53/duckdb:parquet 16170319 16002118 1.01
tpcds_q54/duckdb:parquet 42167557 39938629 1.06
tpcds_q55/duckdb:parquet 10839192 11062118 0.98
tpcds_q56/duckdb:parquet 67889938 70508665 0.96
tpcds_q57/duckdb:parquet 36375635 35473686 1.03
tpcds_q58/duckdb:parquet 20716568 20982141 0.99
tpcds_q59/duckdb:parquet 36189231 36720874 0.99
tpcds_q60/duckdb:parquet 72828129 71572672 1.02
tpcds_q61/duckdb:parquet 30417012 30735587 0.99
tpcds_q62/duckdb:parquet 12193373 11380568 1.07
tpcds_q63/duckdb:parquet 15017739 15234490 0.99
tpcds_q64/duckdb:parquet 72930767 74073651 0.98
tpcds_q65/duckdb:parquet 20048141 20818347 0.96
tpcds_q66/duckdb:parquet 🚨 60459113 53500404 1.13
tpcds_q67/duckdb:parquet 134513440 137712552 0.98
tpcds_q68/duckdb:parquet 38213512 37989461 1.01
tpcds_q69/duckdb:parquet 37176487 36949508 1.01
tpcds_q70/duckdb:parquet 20896463 19812169 1.05
tpcds_q71/duckdb:parquet 19533599 18547546 1.05
tpcds_q72/duckdb:parquet 160804400 165315490 0.97
tpcds_q73/duckdb:parquet 17707214 18133684 0.98
tpcds_q74/duckdb:parquet 50902558 48199158 1.06
tpcds_q75/duckdb:parquet 52938729 53616414 0.99
tpcds_q76/duckdb:parquet 69108311 68076650 1.02
tpcds_q77/duckdb:parquet 59579399 61020461 0.98
tpcds_q78/duckdb:parquet 74179273 73130810 1.01
tpcds_q79/duckdb:parquet 27653999 26946331 1.03
tpcds_q80/duckdb:parquet 86445540 81918598 1.06
tpcds_q81/duckdb:parquet 46395612 46614900 1.00
tpcds_q82/duckdb:parquet 🚨 16999912 14819988 1.15
tpcds_q83/duckdb:parquet 15862202 16000113 0.99
tpcds_q84/duckdb:parquet 18890866 18921367 1.00
tpcds_q85/duckdb:parquet 39367168 39949374 0.99
tpcds_q86/duckdb:parquet 12360233 11759121 1.05
tpcds_q87/duckdb:parquet 36074397 37344780 0.97
tpcds_q88/duckdb:parquet 29135823 28708918 1.01
tpcds_q89/duckdb:parquet 17104363 17053811 1.00
tpcds_q90/duckdb:parquet 7102024 7254818 0.98
tpcds_q91/duckdb:parquet 22824447 22792694 1.00
tpcds_q92/duckdb:parquet 11210225 11974280 0.94
tpcds_q93/duckdb:parquet 29701920 28338477 1.05
tpcds_q94/duckdb:parquet 16323031 17193753 0.95
tpcds_q95/duckdb:parquet 125301437 116688598 1.07
tpcds_q96/duckdb:parquet 9180458 9124576 1.01
tpcds_q97/duckdb:parquet 33512217 34087027 0.98
tpcds_q98/duckdb:parquet 18106149 17452414 1.04
tpcds_q99/duckdb:parquet 19412589 19232877 1.01
duckdb / duckdb (0.993x ➖, 4↑ 1↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19279601 20118166 0.96
tpcds_q02/duckdb:duckdb 17627617 17912991 0.98
tpcds_q03/duckdb:duckdb 7981730 8182961 0.98
tpcds_q04/duckdb:duckdb 162687657 160457345 1.01
tpcds_q05/duckdb:duckdb 17623574 17859817 0.99
tpcds_q06/duckdb:duckdb 21102347 22630477 0.93
tpcds_q07/duckdb:duckdb 37141729 38381699 0.97
tpcds_q08/duckdb:duckdb 118973904 118632726 1.00
tpcds_q09/duckdb:duckdb 19943273 19580944 1.02
tpcds_q10/duckdb:duckdb 22695075 22419097 1.01
tpcds_q11/duckdb:duckdb 140030028 140085096 1.00
tpcds_q12/duckdb:duckdb 10732677 11631827 0.92
tpcds_q13/duckdb:duckdb 23236984 23788945 0.98
tpcds_q14/duckdb:duckdb 92997239 91829005 1.01
tpcds_q15/duckdb:duckdb 23967739 23450103 1.02
tpcds_q16/duckdb:duckdb 16655812 17592356 0.95
tpcds_q17/duckdb:duckdb 20750049 20783228 1.00
tpcds_q18/duckdb:duckdb 42222102 44026567 0.96
tpcds_q19/duckdb:duckdb 15864738 15791509 1.00
tpcds_q20/duckdb:duckdb 11485789 11696034 0.98
tpcds_q21/duckdb:duckdb 6252144 6640560 0.94
tpcds_q22/duckdb:duckdb 59795169 60798142 0.98
tpcds_q23/duckdb:duckdb 80482550 75283633 1.07
tpcds_q24/duckdb:duckdb 22245373 21703465 1.02
tpcds_q25/duckdb:duckdb 17191797 17664028 0.97
tpcds_q26/duckdb:duckdb 26442603 25390607 1.04
tpcds_q27/duckdb:duckdb 35710625 39172060 0.91
tpcds_q28/duckdb:duckdb 21067020 21145909 1.00
tpcds_q29/duckdb:duckdb 19806072 19911730 0.99
tpcds_q30/duckdb:duckdb 28025002 28486033 0.98
tpcds_q31/duckdb:duckdb 19221127 18936513 1.02
tpcds_q32/duckdb:duckdb 7269055 6962214 1.04
tpcds_q33/duckdb:duckdb 12746213 12378706 1.03
tpcds_q34/duckdb:duckdb 14433805 14370470 1.00
tpcds_q35/duckdb:duckdb 31828915 31619081 1.01
tpcds_q36/duckdb:duckdb 68943644 69915433 0.99
tpcds_q37/duckdb:duckdb 6993154 7404448 0.94
tpcds_q38/duckdb:duckdb 30592287 29667076 1.03
tpcds_q39/duckdb:duckdb 25343673 25798306 0.98
tpcds_q40/duckdb:duckdb 13430046 13187063 1.02
tpcds_q41/duckdb:duckdb 8187335 7943606 1.03
tpcds_q42/duckdb:duckdb 6192625 6329225 0.98
tpcds_q43/duckdb:duckdb 10882784 10994506 0.99
tpcds_q44/duckdb:duckdb 13803272 13447087 1.03
tpcds_q45/duckdb:duckdb 16762131 16430414 1.02
tpcds_q46/duckdb:duckdb 36070445 35347664 1.02
tpcds_q47/duckdb:duckdb 41445194 40118975 1.03
tpcds_q48/duckdb:duckdb 21354861 21357758 1.00
tpcds_q49/duckdb:duckdb 15529534 16357886 0.95
tpcds_q50/duckdb:duckdb 13392757 13629790 0.98
tpcds_q51/duckdb:duckdb 88842212 88568556 1.00
tpcds_q52/duckdb:duckdb 7164996 7314968 0.98
tpcds_q53/duckdb:duckdb 11841232 11696086 1.01
tpcds_q54/duckdb:duckdb 16297729 17095672 0.95
tpcds_q55/duckdb:duckdb 6799477 6595285 1.03
tpcds_q56/duckdb:duckdb 13957842 12843019 1.09
tpcds_q57/duckdb:duckdb 30706070 30326329 1.01
tpcds_q58/duckdb:duckdb 11327782 11923701 0.95
tpcds_q59/duckdb:duckdb 33735139 35180393 0.96
tpcds_q60/duckdb:duckdb 14691328 14773202 0.99
tpcds_q61/duckdb:duckdb 13887261 13461555 1.03
tpcds_q62/duckdb:duckdb 9324309 8989045 1.04
tpcds_q63/duckdb:duckdb 10756857 11058431 0.97
tpcds_q64/duckdb:duckdb 51783062 50248785 1.03
tpcds_q65/duckdb:duckdb 🚀 31155888 34728088 0.90
tpcds_q66/duckdb:duckdb 23991404 24591735 0.98
tpcds_q67/duckdb:duckdb 128478661 128273174 1.00
tpcds_q68/duckdb:duckdb 24544880 24325732 1.01
tpcds_q69/duckdb:duckdb 22954269 22933378 1.00
tpcds_q70/duckdb:duckdb 13788356 13652151 1.01
tpcds_q71/duckdb:duckdb 🚨 12763591 11547592 1.11
tpcds_q72/duckdb:duckdb 42577483 41086078 1.04
tpcds_q73/duckdb:duckdb 9944968 10258353 0.97
tpcds_q74/duckdb:duckdb 97285261 95647194 1.02
tpcds_q75/duckdb:duckdb 41095337 40635732 1.01
tpcds_q76/duckdb:duckdb 11757219 12026476 0.98
tpcds_q77/duckdb:duckdb 11753448 11790344 1.00
tpcds_q78/duckdb:duckdb 62657544 60019978 1.04
tpcds_q79/duckdb:duckdb 17214661 17063816 1.01
tpcds_q80/duckdb:duckdb 28451961 26476812 1.07
tpcds_q81/duckdb:duckdb 36875246 37650811 0.98
tpcds_q82/duckdb:duckdb 7687835 8274826 0.93
tpcds_q83/duckdb:duckdb 8845908 8777909 1.01
tpcds_q84/duckdb:duckdb 🚀 12825859 14520746 0.88
tpcds_q85/duckdb:duckdb 23456452 23200666 1.01
tpcds_q86/duckdb:duckdb 10220448 10354218 0.99
tpcds_q87/duckdb:duckdb 33493750 32503155 1.03
tpcds_q88/duckdb:duckdb 23710367 23602144 1.00
tpcds_q89/duckdb:duckdb 13308594 12591554 1.06
tpcds_q90/duckdb:duckdb 5477599 5448115 1.01
tpcds_q91/duckdb:duckdb 12570653 12399399 1.01
tpcds_q92/duckdb:duckdb 8550800 8589433 1.00
tpcds_q93/duckdb:duckdb 🚀 19742422 22808650 0.87
tpcds_q94/duckdb:duckdb 12845855 13073587 0.98
tpcds_q95/duckdb:duckdb 🚀 105479980 127592112 0.83
tpcds_q96/duckdb:duckdb 4381216 4555687 0.96
tpcds_q97/duckdb:duckdb 30103662 29199031 1.03
tpcds_q98/duckdb:duckdb 12775874 13243858 0.96
tpcds_q99/duckdb:duckdb 16475441 16254109 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +6.9% -6.2% +13.9% +11.1% 🚨 regression
1 datafusion:vortex-file-compressed -2.0% -6.2% +4.5% +14.9% ➖ noise
1 duckdb:duckdb -4.2% -6.2% +2.1% +11.3% ➖ noise
1 duckdb:vortex-compact -1.0% -6.2% +5.5% +12.5% ➖ noise
1 duckdb:vortex-file-compressed -3.4% -6.2% +3.0% +10.5% ➖ noise
2 datafusion:vortex-compact -0.3% -3.9% +3.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.5% -3.9% +1.5% +10.0% ➖ noise
2 duckdb:duckdb -1.6% -3.9% +2.4% +12.0% ➖ noise
2 duckdb:vortex-compact -2.8% -3.9% +1.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.4% -3.9% +1.6% +13.7% ➖ noise
3 datafusion:vortex-compact +3.9% -1.7% +5.7% +11.0% ➖ noise
3 datafusion:vortex-file-compressed -3.8% -1.7% -2.2% +10.0% ➖ noise
3 duckdb:duckdb -2.5% -1.7% -0.8% +17.5% ➖ noise
3 duckdb:vortex-compact -3.6% -1.7% -2.0% +13.2% ➖ noise
3 duckdb:vortex-file-compressed -4.0% -1.7% -2.4% +13.9% ➖ noise
4 datafusion:vortex-compact -0.7% -6.6% +6.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.8% -6.6% +5.1% +10.0% ➖ noise
4 duckdb:duckdb +1.4% -6.6% +8.5% +10.0% ➖ noise
4 duckdb:vortex-compact +1.9% -6.6% +9.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.7% -6.6% +7.8% +10.0% ➖ noise
5 datafusion:vortex-compact -2.5% -3.3% +0.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -4.4% -3.3% -1.1% +10.0% ➖ noise
5 duckdb:duckdb -1.3% -3.3% +2.1% +12.4% ➖ noise
5 duckdb:vortex-compact -4.7% -3.3% -1.5% +11.5% ➖ noise
5 duckdb:vortex-file-compressed -3.6% -3.3% -0.3% +13.2% ➖ noise
6 datafusion:vortex-compact +1.6% +0.1% +1.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.1% +0.1% +1.1% +10.0% ➖ noise
6 duckdb:duckdb -6.8% +0.1% -6.8% +15.6% ➖ noise
6 duckdb:vortex-compact +1.7% +0.1% +1.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.0% +0.1% +1.9% +10.0% ➖ noise
7 datafusion:vortex-compact -4.4% +1.4% -5.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.3% +1.4% -2.7% +10.0% ➖ noise
7 duckdb:duckdb -3.2% +1.4% -4.6% +15.6% ➖ noise
7 duckdb:vortex-compact -2.1% +1.4% -3.5% +14.0% ➖ noise
7 duckdb:vortex-file-compressed +4.0% +1.4% +2.6% +13.1% ➖ noise
8 datafusion:vortex-compact -2.8% +1.6% -4.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.5% +1.6% -3.1% +11.2% ➖ noise
8 duckdb:duckdb +0.3% +1.6% -1.3% +10.0% ➖ noise
8 duckdb:vortex-compact -0.4% +1.6% -2.0% +10.7% ➖ noise
8 duckdb:vortex-file-compressed +1.6% +1.6% -0.1% +10.0% ➖ noise
9 datafusion:vortex-compact -0.1% +0.1% -0.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -3.3% +0.1% -3.3% +10.0% ➖ noise
9 duckdb:duckdb +1.9% +0.1% +1.8% +10.0% ➖ noise
9 duckdb:vortex-compact +0.7% +0.1% +0.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.5% +0.1% +1.5% +10.0% ➖ noise
10 datafusion:vortex-compact +1.9% -0.4% +2.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -6.6% -0.4% -6.2% +10.0% ➖ noise
10 duckdb:duckdb +1.2% -0.4% +1.7% +10.0% ➖ noise
10 duckdb:vortex-compact -0.4% -0.4% +0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.8% -0.4% +1.2% +10.0% ➖ noise
11 datafusion:vortex-compact -1.6% -3.1% +1.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.6% -3.1% +2.5% +10.0% ➖ noise
11 duckdb:duckdb -0.0% -3.1% +3.2% +10.0% ➖ noise
11 duckdb:vortex-compact +0.5% -3.1% +3.7% +13.0% ➖ noise
11 duckdb:vortex-file-compressed +0.2% -3.1% +3.4% +11.2% ➖ noise
12 datafusion:vortex-compact -1.4% -3.6% +2.3% +11.3% ➖ noise
12 datafusion:vortex-file-compressed +1.2% -3.6% +5.0% +10.0% ➖ noise
12 duckdb:duckdb -7.7% -3.6% -4.3% +13.1% ➖ noise
12 duckdb:vortex-compact -7.4% -3.6% -4.0% +14.7% ➖ noise
12 duckdb:vortex-file-compressed -4.6% -3.6% -1.0% +10.6% ➖ noise
13 datafusion:vortex-compact +7.8% +0.4% +7.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.9% +0.4% +0.6% +10.0% ➖ noise
13 duckdb:duckdb -2.3% +0.4% -2.7% +10.0% ➖ noise
13 duckdb:vortex-compact +1.6% +0.4% +1.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.6% +0.4% +0.3% +10.0% ➖ noise
14 datafusion:vortex-compact -0.2% -1.2% +1.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.3% -1.2% +1.6% +10.0% ➖ noise
14 duckdb:duckdb +1.3% -1.2% +2.6% +10.0% ➖ noise
14 duckdb:vortex-compact +0.3% -1.2% +1.6% +11.5% ➖ noise
14 duckdb:vortex-file-compressed +11.6% -1.2% +13.0% +12.3% 🚨 regression
15 datafusion:vortex-compact -2.1% +2.5% -4.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.2% +2.5% -3.6% +10.0% ➖ noise
15 duckdb:duckdb +2.2% +2.5% -0.3% +13.3% ➖ noise
15 duckdb:vortex-compact +1.2% +2.5% -1.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.7% +2.5% -3.1% +10.0% ➖ noise
16 datafusion:vortex-compact -0.6% +0.9% -1.6% +10.8% ➖ noise
16 datafusion:vortex-file-compressed -1.4% +0.9% -2.3% +10.9% ➖ noise
16 duckdb:duckdb -5.3% +0.9% -6.2% +11.0% ➖ noise
16 duckdb:vortex-compact -0.6% +0.9% -1.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -6.8% +0.9% -7.7% +12.0% ➖ noise
17 datafusion:vortex-compact -1.4% -0.6% -0.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -0.0% -0.6% +0.6% +10.0% ➖ noise
17 duckdb:duckdb -0.2% -0.6% +0.5% +13.5% ➖ noise
17 duckdb:vortex-compact -0.9% -0.6% -0.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -3.4% -0.6% -2.8% +10.0% ➖ noise
18 datafusion:vortex-compact -3.2% -0.4% -2.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -5.3% -0.4% -4.9% +10.0% ➖ noise
18 duckdb:duckdb -4.1% -0.4% -3.7% +12.0% ➖ noise
18 duckdb:vortex-compact -1.0% -0.4% -0.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.3% -0.4% -0.9% +10.0% ➖ noise
19 datafusion:vortex-compact +1.9% -1.9% +3.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +4.9% -1.9% +6.9% +10.9% ➖ noise
19 duckdb:duckdb +0.5% -1.9% +2.4% +12.2% ➖ noise
19 duckdb:vortex-compact -1.8% -1.9% +0.1% +13.1% ➖ noise
19 duckdb:vortex-file-compressed -1.0% -1.9% +0.9% +10.0% ➖ noise
20 datafusion:vortex-compact -1.2% -4.8% +3.8% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +4.0% -4.8% +9.3% +10.0% ➖ noise
20 duckdb:duckdb -1.8% -4.8% +3.2% +10.0% ➖ noise
20 duckdb:vortex-compact +2.3% -4.8% +7.5% +17.5% ➖ noise
20 duckdb:vortex-file-compressed -10.0% -4.8% -5.5% +13.0% ➖ noise
21 datafusion:vortex-compact -3.0% +2.7% -5.5% +11.5% ➖ noise
21 datafusion:vortex-file-compressed -0.6% +2.7% -3.2% +12.4% ➖ noise
21 duckdb:duckdb -5.8% +2.7% -8.3% +22.0% ➖ noise
21 duckdb:vortex-compact +3.5% +2.7% +0.8% +13.3% ➖ noise
21 duckdb:vortex-file-compressed -3.8% +2.7% -6.4% +15.1% ➖ noise
22 datafusion:vortex-compact -1.2% -5.3% +4.4% +11.6% ➖ noise
22 datafusion:vortex-file-compressed +0.0% -5.3% +5.7% +14.1% ➖ noise
22 duckdb:duckdb -1.6% -5.3% +3.9% +12.9% ➖ noise
22 duckdb:vortex-compact -1.8% -5.3% +3.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -2.0% -5.3% +3.5% +10.0% ➖ noise
23 datafusion:vortex-compact -1.1% -2.1% +1.0% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -1.4% -2.1% +0.7% +10.0% ➖ noise
23 duckdb:duckdb +6.9% -2.1% +9.2% +14.9% ➖ noise
23 duckdb:vortex-compact -7.0% -2.1% -5.0% +11.2% ➖ noise
23 duckdb:vortex-file-compressed +3.1% -2.1% +5.3% +10.0% ➖ noise
24 datafusion:vortex-compact -5.2% +0.3% -5.4% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -1.7% +0.3% -1.9% +10.0% ➖ noise
24 duckdb:duckdb +2.5% +0.3% +2.2% +21.4% ➖ noise
24 duckdb:vortex-compact +0.0% +0.3% -0.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.1% +0.3% +0.9% +10.0% ➖ noise
25 datafusion:vortex-compact +2.0% -1.8% +3.9% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -0.0% -1.8% +1.8% +10.0% ➖ noise
25 duckdb:duckdb -2.7% -1.8% -0.9% +17.1% ➖ noise
25 duckdb:vortex-compact -7.6% -1.8% -5.9% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -5.3% -1.8% -3.6% +10.0% ➖ noise
26 datafusion:vortex-compact +2.3% -2.5% +5.0% +10.8% ➖ noise
26 datafusion:vortex-file-compressed +2.7% -2.5% +5.4% +10.0% ➖ noise
26 duckdb:duckdb +4.1% -2.5% +6.8% +17.1% ➖ noise
26 duckdb:vortex-compact +7.9% -2.5% +10.7% +15.5% ➖ noise
26 duckdb:vortex-file-compressed -0.4% -2.5% +2.2% +10.4% ➖ noise
27 datafusion:vortex-compact -1.8% +0.8% -2.5% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -2.6% +0.8% -3.3% +10.0% ➖ noise
27 duckdb:duckdb -8.8% +0.8% -9.5% +15.3% ➖ noise
27 duckdb:vortex-compact -4.9% +0.8% -5.6% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -3.2% +0.8% -3.9% +10.0% ➖ noise
28 datafusion:vortex-compact -0.2% -0.9% +0.7% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.9% -0.9% -1.0% +10.0% ➖ noise
28 duckdb:duckdb -0.4% -0.9% +0.5% +10.0% ➖ noise
28 duckdb:vortex-compact -0.4% -0.9% +0.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -1.2% -0.9% -0.3% +10.0% ➖ noise
29 datafusion:vortex-compact -1.5% -1.5% +0.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.8% -1.5% +0.7% +10.0% ➖ noise
29 duckdb:duckdb -0.5% -1.5% +1.0% +10.0% ➖ noise
29 duckdb:vortex-compact -1.3% -1.5% +0.1% +10.7% ➖ noise
29 duckdb:vortex-file-compressed -0.7% -1.5% +0.8% +10.0% ➖ noise
30 datafusion:vortex-compact -2.5% -0.4% -2.1% +13.4% ➖ noise
30 datafusion:vortex-file-compressed -2.1% -0.4% -1.7% +10.0% ➖ noise
30 duckdb:duckdb -1.6% -0.4% -1.2% +10.0% ➖ noise
30 duckdb:vortex-compact +0.1% -0.4% +0.5% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.4% -0.4% -0.0% +10.1% ➖ noise
31 datafusion:vortex-compact +1.0% -2.2% +3.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +1.0% -2.2% +3.3% +10.0% ➖ noise
31 duckdb:duckdb +1.5% -2.2% +3.8% +13.8% ➖ noise
31 duckdb:vortex-compact -1.2% -2.2% +1.1% +14.4% ➖ noise
31 duckdb:vortex-file-compressed +5.0% -2.2% +7.4% +10.0% ➖ noise
32 datafusion:vortex-compact -1.0% +0.6% -1.6% +11.1% ➖ noise
32 datafusion:vortex-file-compressed -1.3% +0.6% -1.9% +10.0% ➖ noise
32 duckdb:duckdb +4.4% +0.6% +3.7% +17.8% ➖ noise
32 duckdb:vortex-compact -6.5% +0.6% -7.1% +10.2% ➖ noise
32 duckdb:vortex-file-compressed +4.5% +0.6% +3.9% +12.1% ➖ noise
33 datafusion:vortex-compact -2.7% -0.6% -2.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.0% -0.6% -0.4% +10.0% ➖ noise
33 duckdb:duckdb +3.0% -0.6% +3.6% +11.2% ➖ noise
33 duckdb:vortex-compact +4.3% -0.6% +4.9% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +2.3% -0.6% +2.9% +14.1% ➖ noise
34 datafusion:vortex-compact -1.8% +1.9% -3.6% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.2% +1.9% -1.6% +10.0% ➖ noise
34 duckdb:duckdb +0.4% +1.9% -1.4% +10.6% ➖ noise
34 duckdb:vortex-compact -0.3% +1.9% -2.1% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -3.9% +1.9% -5.7% +10.0% ➖ noise
35 datafusion:vortex-compact -1.7% -2.5% +0.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -3.5% -2.5% -1.0% +10.0% ➖ noise
35 duckdb:duckdb +0.7% -2.5% +3.2% +10.0% ➖ noise
35 duckdb:vortex-compact -2.2% -2.5% +0.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.9% -2.5% +1.6% +10.4% ➖ noise
36 datafusion:vortex-compact -0.5% +1.4% -1.9% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.7% +1.4% +0.2% +10.0% ➖ noise
36 duckdb:duckdb -1.4% +1.4% -2.8% +13.0% ➖ noise
36 duckdb:vortex-compact -1.9% +1.4% -3.3% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +0.4% +1.4% -1.0% +12.3% ➖ noise
37 datafusion:vortex-compact -0.4% -0.9% +0.5% +15.3% ➖ noise
37 datafusion:vortex-file-compressed -2.2% -0.9% -1.3% +14.5% ➖ noise
37 duckdb:duckdb -5.6% -0.9% -4.7% +17.1% ➖ noise
37 duckdb:vortex-compact +3.9% -0.9% +4.8% +11.1% ➖ noise
37 duckdb:vortex-file-compressed -8.8% -0.9% -8.0% +15.0% ➖ noise
38 datafusion:vortex-compact -2.4% -1.0% -1.4% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -3.6% -1.0% -2.6% +10.0% ➖ noise
38 duckdb:duckdb +3.1% -1.0% +4.2% +18.6% ➖ noise
38 duckdb:vortex-compact +4.6% -1.0% +5.7% +14.2% ➖ noise
38 duckdb:vortex-file-compressed -3.4% -1.0% -2.4% +14.7% ➖ noise
39 datafusion:vortex-compact +4.0% -1.1% +5.1% +14.8% ➖ noise
39 datafusion:vortex-file-compressed +0.5% -1.1% +1.6% +18.2% ➖ noise
39 duckdb:duckdb -1.8% -1.1% -0.7% +10.0% ➖ noise
39 duckdb:vortex-compact -1.4% -1.1% -0.3% +10.0% ➖ noise
39 duckdb:vortex-file-compressed +1.7% -1.1% +2.8% +23.9% ➖ noise
40 datafusion:vortex-compact -1.2% -4.3% +3.2% +11.2% ➖ noise
40 datafusion:vortex-file-compressed -4.6% -4.3% -0.3% +10.0% ➖ noise
40 duckdb:duckdb +1.8% -4.3% +6.4% +19.8% ➖ noise
40 duckdb:vortex-compact -5.6% -4.3% -1.4% +11.6% ➖ noise
40 duckdb:vortex-file-compressed -0.2% -4.3% +4.2% +15.4% ➖ noise
41 datafusion:vortex-compact -5.0% -3.9% -1.1% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +1.0% -3.9% +5.1% +21.9% ➖ noise
41 duckdb:duckdb +3.1% -3.9% +7.2% +11.6% ➖ noise
41 duckdb:vortex-compact +0.2% -3.9% +4.3% +10.1% ➖ noise
41 duckdb:vortex-file-compressed -0.9% -3.9% +3.1% +12.7% ➖ noise
42 datafusion:vortex-compact +5.9% -1.8% +7.8% +11.5% ➖ noise
42 datafusion:vortex-file-compressed +1.4% -1.8% +3.2% +10.6% ➖ noise
42 duckdb:duckdb -2.2% -1.8% -0.4% +17.0% ➖ noise
42 duckdb:vortex-compact -1.2% -1.8% +0.6% +14.3% ➖ noise
42 duckdb:vortex-file-compressed -3.7% -1.8% -2.0% +14.9% ➖ noise
43 datafusion:vortex-compact +2.4% -2.5% +5.0% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +5.6% -2.5% +8.3% +10.0% ➖ noise
43 duckdb:duckdb -1.0% -2.5% +1.5% +10.7% ➖ noise
43 duckdb:vortex-compact -0.1% -2.5% +2.4% +11.2% ➖ noise
43 duckdb:vortex-file-compressed -8.1% -2.5% -5.7% +10.0% ➖ noise
44 datafusion:vortex-compact +0.4% -0.5% +0.9% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +1.6% -0.5% +2.1% +10.2% ➖ noise
44 duckdb:duckdb +2.6% -0.5% +3.1% +17.8% ➖ noise
44 duckdb:vortex-compact +2.4% -0.5% +2.8% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +4.8% -0.5% +5.3% +23.0% ➖ noise
45 datafusion:vortex-compact +0.7% -2.3% +3.1% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -1.7% -2.3% +0.6% +10.0% ➖ noise
45 duckdb:duckdb +2.0% -2.3% +4.4% +10.9% ➖ noise
45 duckdb:vortex-compact +0.9% -2.3% +3.3% +11.6% ➖ noise
45 duckdb:vortex-file-compressed -5.7% -2.3% -3.5% +10.0% ➖ noise
46 datafusion:vortex-compact -2.0% +2.6% -4.4% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -2.0% +2.6% -4.5% +10.0% ➖ noise
46 duckdb:duckdb +2.0% +2.6% -0.5% +10.0% ➖ noise
46 duckdb:vortex-compact -0.1% +2.6% -2.6% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -2.4% +2.6% -4.9% +10.0% ➖ noise
47 datafusion:vortex-compact -0.1% +0.3% -0.4% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +2.5% +0.3% +2.2% +10.0% ➖ noise
47 duckdb:duckdb +3.3% +0.3% +3.0% +10.0% ➖ noise
47 duckdb:vortex-compact -0.7% +0.3% -1.0% +14.8% ➖ noise
47 duckdb:vortex-file-compressed -2.1% +0.3% -2.4% +10.0% ➖ noise
48 datafusion:vortex-compact -0.8% -1.7% +0.9% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -1.2% -1.7% +0.5% +10.0% ➖ noise
48 duckdb:duckdb -0.0% -1.7% +1.7% +10.0% ➖ noise
48 duckdb:vortex-compact +1.6% -1.7% +3.3% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -0.9% -1.7% +0.8% +10.0% ➖ noise
49 datafusion:vortex-compact -5.4% -3.4% -2.1% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -3.1% -3.4% +0.2% +10.6% ➖ noise
49 duckdb:duckdb -5.1% -3.4% -1.8% +13.0% ➖ noise
49 duckdb:vortex-compact -3.8% -3.4% -0.4% +12.5% ➖ noise
49 duckdb:vortex-file-compressed -2.1% -3.4% +1.2% +14.5% ➖ noise
50 datafusion:vortex-compact +2.8% +1.6% +1.1% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -3.3% +1.6% -4.8% +10.0% ➖ noise
50 duckdb:duckdb -1.7% +1.6% -3.3% +10.0% ➖ noise
50 duckdb:vortex-compact +1.9% +1.6% +0.3% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -0.5% +1.6% -2.1% +10.0% ➖ noise
51 datafusion:vortex-compact -0.1% +0.7% -0.7% +14.3% ➖ noise
51 datafusion:vortex-file-compressed +6.8% +0.7% +6.1% +14.3% ➖ noise
51 duckdb:duckdb +0.3% +0.7% -0.3% +12.3% ➖ noise
51 duckdb:vortex-compact -8.7% +0.7% -9.3% +16.6% ➖ noise
51 duckdb:vortex-file-compressed +0.9% +0.7% +0.3% +19.7% ➖ noise
52 datafusion:vortex-compact +4.7% -3.3% +8.3% +11.2% ➖ noise
52 datafusion:vortex-file-compressed +5.7% -3.3% +9.3% +11.3% ➖ noise
52 duckdb:duckdb -2.1% -3.3% +1.2% +14.9% ➖ noise
52 duckdb:vortex-compact -0.3% -3.3% +3.0% +16.0% ➖ noise
52 duckdb:vortex-file-compressed -5.5% -3.3% -2.3% +17.0% ➖ noise
53 datafusion:vortex-compact -3.9% +1.6% -5.4% +10.9% ➖ noise
53 datafusion:vortex-file-compressed +0.4% +1.6% -1.2% +15.1% ➖ noise
53 duckdb:duckdb +1.2% +1.6% -0.3% +12.1% ➖ noise
53 duckdb:vortex-compact -2.6% +1.6% -4.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +2.7% +1.6% +1.1% +10.7% ➖ noise
54 datafusion:vortex-compact +1.4% +1.4% -0.0% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -0.0% +1.4% -1.4% +10.0% ➖ noise
54 duckdb:duckdb -4.7% +1.4% -6.0% +10.9% ➖ noise
54 duckdb:vortex-compact -0.1% +1.4% -1.5% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -0.0% +1.4% -1.5% +10.0% ➖ noise
55 datafusion:vortex-compact -0.1% -1.8% +1.8% +13.6% ➖ noise
55 datafusion:vortex-file-compressed +4.2% -1.8% +6.2% +11.3% ➖ noise
55 duckdb:duckdb +3.1% -1.8% +5.0% +13.6% ➖ noise
55 duckdb:vortex-compact +2.2% -1.8% +4.1% +13.0% ➖ noise
55 duckdb:vortex-file-compressed -6.7% -1.8% -5.0% +18.5% ➖ noise
56 datafusion:vortex-compact +2.3% -1.5% +3.8% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -1.4% -1.5% +0.1% +10.0% ➖ noise
56 duckdb:duckdb +8.7% -1.5% +10.3% +13.0% ➖ noise
56 duckdb:vortex-compact -0.8% -1.5% +0.7% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -2.9% -1.5% -1.4% +10.0% ➖ noise
57 datafusion:vortex-compact +2.1% +1.9% +0.2% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -3.1% +1.9% -5.0% +10.0% ➖ noise
57 duckdb:duckdb +1.3% +1.9% -0.7% +11.1% ➖ noise
57 duckdb:vortex-compact +1.1% +1.9% -0.8% +12.2% ➖ noise
57 duckdb:vortex-file-compressed +1.7% +1.9% -0.3% +10.1% ➖ noise
58 datafusion:vortex-compact -1.4% -0.8% -0.6% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +2.7% -0.8% +3.6% +10.0% ➖ noise
58 duckdb:duckdb -5.0% -0.8% -4.2% +14.8% ➖ noise
58 duckdb:vortex-compact -6.3% -0.8% -5.5% +15.0% ➖ noise
58 duckdb:vortex-file-compressed -5.7% -0.8% -4.9% +14.2% ➖ noise
59 datafusion:vortex-compact -3.9% +0.4% -4.3% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -2.0% +0.4% -2.3% +10.0% ➖ noise
59 duckdb:duckdb -4.1% +0.4% -4.5% +10.0% ➖ noise
59 duckdb:vortex-compact +3.6% +0.4% +3.2% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -3.3% +0.4% -3.6% +10.0% ➖ noise
60 datafusion:vortex-compact +1.0% -2.4% +3.4% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +0.6% -2.4% +3.0% +10.0% ➖ noise
60 duckdb:duckdb -0.6% -2.4% +1.8% +10.0% ➖ noise
60 duckdb:vortex-compact -3.6% -2.4% -1.3% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +0.9% -2.4% +3.3% +11.7% ➖ noise
61 datafusion:vortex-compact -0.7% -1.6% +0.9% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +0.3% -1.6% +1.9% +10.0% ➖ noise
61 duckdb:duckdb +3.2% -1.6% +4.8% +10.0% ➖ noise
61 duckdb:vortex-compact -2.6% -1.6% -1.0% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -2.0% -1.6% -0.4% +12.2% ➖ noise
62 datafusion:vortex-compact -0.0% -5.4% +5.7% +10.0% ➖ noise
62 datafusion:vortex-file-compressed -7.3% -5.4% -2.0% +12.1% ➖ noise
62 duckdb:duckdb +3.7% -5.4% +9.7% +19.5% ➖ noise
62 duckdb:vortex-compact +24.1% -5.4% +31.2% +19.3% 🚨 regression
62 duckdb:vortex-file-compressed -2.1% -5.4% +3.5% +15.4% ➖ noise
63 datafusion:vortex-compact -8.2% -2.5% -5.8% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +2.9% -2.5% +5.6% +10.0% ➖ noise
63 duckdb:duckdb -2.7% -2.5% -0.2% +10.0% ➖ noise
63 duckdb:vortex-compact -0.9% -2.5% +1.7% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -4.1% -2.5% -1.7% +10.1% ➖ noise
64 datafusion:vortex-compact -2.6% -1.7% -0.9% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -0.7% -1.7% +1.0% +10.0% ➖ noise
64 duckdb:duckdb +3.1% -1.7% +4.8% +10.0% ➖ noise
64 duckdb:vortex-compact -2.7% -1.7% -1.0% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -2.6% -1.7% -1.0% +10.0% ➖ noise
65 datafusion:vortex-compact +2.1% -3.4% +5.7% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -0.2% -3.4% +3.3% +11.4% ➖ noise
65 duckdb:duckdb -10.3% -3.4% -7.1% +12.4% ➖ noise
65 duckdb:vortex-compact -1.6% -3.4% +1.8% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -5.2% -3.4% -1.9% +10.2% ➖ noise
66 datafusion:vortex-compact +7.6% +3.0% +4.4% +11.8% ➖ noise
66 datafusion:vortex-file-compressed +1.8% +3.0% -1.2% +10.7% ➖ noise
66 duckdb:duckdb -2.4% +3.0% -5.3% +11.4% ➖ noise
66 duckdb:vortex-compact -1.5% +3.0% -4.4% +18.0% ➖ noise
66 duckdb:vortex-file-compressed -6.8% +3.0% -9.5% +11.0% ➖ noise
67 datafusion:vortex-compact -2.4% -1.3% -1.1% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -2.8% -1.3% -1.5% +10.0% ➖ noise
67 duckdb:duckdb +0.2% -1.3% +1.5% +10.0% ➖ noise
67 duckdb:vortex-compact -0.1% -1.3% +1.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +1.5% -1.3% +2.9% +10.0% ➖ noise
68 datafusion:vortex-compact +3.1% +4.5% -1.3% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -2.3% +4.5% -6.5% +10.0% ➖ noise
68 duckdb:duckdb +0.9% +4.5% -3.4% +10.5% ➖ noise
68 duckdb:vortex-compact +1.6% +4.5% -2.8% +11.6% ➖ noise
68 duckdb:vortex-file-compressed -2.5% +4.5% -6.7% +10.0% ➖ noise
69 datafusion:vortex-compact +0.5% +0.9% -0.4% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -0.0% +0.9% -0.9% +10.0% ➖ noise
69 duckdb:duckdb +0.1% +0.9% -0.8% +10.0% ➖ noise
69 duckdb:vortex-compact -1.6% +0.9% -2.5% +11.0% ➖ noise
69 duckdb:vortex-file-compressed +0.5% +0.9% -0.3% +10.0% ➖ noise
70 datafusion:vortex-compact -1.4% +3.0% -4.3% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -2.2% +3.0% -5.1% +10.0% ➖ noise
70 duckdb:duckdb +1.0% +3.0% -2.0% +13.7% ➖ noise
70 duckdb:vortex-compact +0.6% +3.0% -2.4% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +3.0% +3.0% -0.1% +11.8% ➖ noise
71 datafusion:vortex-compact +4.0% +0.5% +3.5% +10.3% ➖ noise
71 datafusion:vortex-file-compressed +0.6% +0.5% +0.1% +10.1% ➖ noise
71 duckdb:duckdb +10.5% +0.5% +10.0% +17.4% ➖ noise
71 duckdb:vortex-compact +4.1% +0.5% +3.6% +11.8% ➖ noise
71 duckdb:vortex-file-compressed -5.0% +0.5% -5.4% +14.6% ➖ noise
72 datafusion:vortex-compact -1.5% -2.4% +0.9% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -1.1% -2.4% +1.3% +10.0% ➖ noise
72 duckdb:duckdb +3.6% -2.4% +6.2% +14.2% ➖ noise
72 duckdb:vortex-compact -1.7% -2.4% +0.7% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -2.3% -2.4% +0.1% +10.0% ➖ noise
73 datafusion:vortex-compact -1.3% -4.0% +2.7% +14.9% ➖ noise
73 datafusion:vortex-file-compressed -4.6% -4.0% -0.6% +12.7% ➖ noise
73 duckdb:duckdb -3.1% -4.0% +0.9% +11.0% ➖ noise
73 duckdb:vortex-compact -1.3% -4.0% +2.8% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -2.0% -4.0% +2.0% +10.0% ➖ noise
74 datafusion:vortex-compact -1.1% +2.6% -3.6% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +1.8% +2.6% -0.8% +10.0% ➖ noise
74 duckdb:duckdb +1.7% +2.6% -0.9% +10.0% ➖ noise
74 duckdb:vortex-compact -0.5% +2.6% -3.1% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +0.3% +2.6% -2.3% +10.0% ➖ noise
75 datafusion:vortex-compact -1.5% -0.8% -0.7% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -1.8% -0.8% -1.0% +10.0% ➖ noise
75 duckdb:duckdb +1.1% -0.8% +2.0% +10.2% ➖ noise
75 duckdb:vortex-compact +2.3% -0.8% +3.1% +12.4% ➖ noise
75 duckdb:vortex-file-compressed -5.3% -0.8% -4.6% +10.0% ➖ noise
76 datafusion:vortex-compact -1.6% +1.9% -3.4% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -6.1% +1.9% -7.8% +16.0% ➖ noise
76 duckdb:duckdb -2.2% +1.9% -4.0% +15.2% ➖ noise
76 duckdb:vortex-compact +1.7% +1.9% -0.2% +12.0% ➖ noise
76 duckdb:vortex-file-compressed -4.0% +1.9% -5.8% +18.6% ➖ noise
77 datafusion:vortex-compact -0.9% -1.8% +0.9% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -0.2% -1.8% +1.6% +10.0% ➖ noise
77 duckdb:duckdb -0.3% -1.8% +1.5% +10.9% ➖ noise
77 duckdb:vortex-compact -1.6% -1.8% +0.2% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +10.9% -1.8% +12.9% +13.3% ➖ noise
78 datafusion:vortex-compact +1.0% -2.3% +3.4% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +1.9% -2.3% +4.3% +10.0% ➖ noise
78 duckdb:duckdb +4.4% -2.3% +6.8% +11.3% ➖ noise
78 duckdb:vortex-compact -0.1% -2.3% +2.2% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -3.9% -2.3% -1.7% +10.0% ➖ noise
79 datafusion:vortex-compact -1.7% +1.4% -3.0% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -1.4% +1.4% -2.7% +10.0% ➖ noise
79 duckdb:duckdb +0.9% +1.4% -0.5% +10.0% ➖ noise
79 duckdb:vortex-compact -1.4% +1.4% -2.8% +10.4% ➖ noise
79 duckdb:vortex-file-compressed -4.1% +1.4% -5.5% +10.7% ➖ noise
80 datafusion:vortex-compact +0.5% +0.9% -0.4% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +0.9% +0.9% -0.0% +10.0% ➖ noise
80 duckdb:duckdb +7.5% +0.9% +6.5% +15.2% ➖ noise
80 duckdb:vortex-compact -1.7% +0.9% -2.6% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -1.1% +0.9% -2.0% +11.9% ➖ noise
81 datafusion:vortex-compact +1.3% +1.2% +0.2% +12.8% ➖ noise
81 datafusion:vortex-file-compressed +2.1% +1.2% +0.9% +13.1% ➖ noise
81 duckdb:duckdb -2.1% +1.2% -3.2% +10.0% ➖ noise
81 duckdb:vortex-compact -0.9% +1.2% -2.1% +10.0% ➖ noise
81 duckdb:vortex-file-compressed +5.4% +1.2% +4.2% +12.7% ➖ noise
82 datafusion:vortex-compact -0.4% +8.3% -8.0% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +0.7% +8.3% -7.0% +10.0% ➖ noise
82 duckdb:duckdb -7.1% +8.3% -14.2% +14.3% ✅ faster
82 duckdb:vortex-compact -1.7% +8.3% -9.2% +13.2% ➖ noise
82 duckdb:vortex-file-compressed +1.1% +8.3% -6.6% +12.7% ➖ noise
83 datafusion:vortex-compact -3.2% -0.1% -3.0% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -3.2% -0.1% -3.0% +10.0% ➖ noise
83 duckdb:duckdb +0.8% -0.1% +0.9% +12.7% ➖ noise
83 duckdb:vortex-compact -2.3% -0.1% -2.2% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +2.6% -0.1% +2.7% +12.0% ➖ noise
84 datafusion:vortex-compact +2.0% +2.4% -0.3% +14.9% ➖ noise
84 datafusion:vortex-file-compressed -6.6% +2.4% -8.7% +21.9% ➖ noise
84 duckdb:duckdb -11.7% +2.4% -13.7% +11.3% ✅ faster
84 duckdb:vortex-compact +4.4% +2.4% +2.0% +11.6% ➖ noise
84 duckdb:vortex-file-compressed -1.0% +2.4% -3.3% +10.0% ➖ noise
85 datafusion:vortex-compact -0.1% -0.9% +0.8% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -3.3% -0.9% -2.4% +10.0% ➖ noise
85 duckdb:duckdb +1.1% -0.9% +2.0% +11.8% ➖ noise
85 duckdb:vortex-compact -5.3% -0.9% -4.4% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -1.6% -0.9% -0.7% +14.8% ➖ noise
86 datafusion:vortex-compact -3.9% +1.5% -5.2% +11.5% ➖ noise
86 datafusion:vortex-file-compressed -3.6% +1.5% -5.0% +13.0% ➖ noise
86 duckdb:duckdb -1.3% +1.5% -2.7% +11.2% ➖ noise
86 duckdb:vortex-compact -10.7% +1.5% -12.0% +17.5% ➖ noise
86 duckdb:vortex-file-compressed -6.6% +1.5% -8.0% +17.2% ➖ noise
87 datafusion:vortex-compact +2.6% -2.5% +5.2% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +1.1% -2.5% +3.7% +10.0% ➖ noise
87 duckdb:duckdb +3.0% -2.5% +5.7% +13.1% ➖ noise
87 duckdb:vortex-compact -6.2% -2.5% -3.8% +12.6% ➖ noise
87 duckdb:vortex-file-compressed -1.3% -2.5% +1.2% +10.0% ➖ noise
88 datafusion:vortex-compact -0.0% +1.7% -1.7% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -0.8% +1.7% -2.5% +10.0% ➖ noise
88 duckdb:duckdb +0.5% +1.7% -1.3% +10.0% ➖ noise
88 duckdb:vortex-compact +1.3% +1.7% -0.5% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +3.9% +1.7% +2.1% +10.0% ➖ noise
89 datafusion:vortex-compact -2.5% +0.9% -3.3% +11.2% ➖ noise
89 datafusion:vortex-file-compressed +0.4% +0.9% -0.5% +10.0% ➖ noise
89 duckdb:duckdb +5.7% +0.9% +4.7% +12.1% ➖ noise
89 duckdb:vortex-compact +4.0% +0.9% +3.0% +11.1% ➖ noise
89 duckdb:vortex-file-compressed +1.8% +0.9% +0.9% +13.4% ➖ noise
90 datafusion:vortex-compact -0.4% -0.9% +0.5% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -0.6% -0.9% +0.3% +10.0% ➖ noise
90 duckdb:duckdb +0.5% -0.9% +1.5% +13.8% ➖ noise
90 duckdb:vortex-compact -1.2% -0.9% -0.3% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -3.3% -0.9% -2.4% +10.0% ➖ noise
91 datafusion:vortex-compact -1.7% +0.0% -1.7% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -8.2% +0.0% -8.2% +10.0% ➖ noise
91 duckdb:duckdb +1.4% +0.0% +1.4% +12.6% ➖ noise
91 duckdb:vortex-compact +1.4% +0.0% +1.4% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -1.9% +0.0% -1.9% +10.0% ➖ noise
92 datafusion:vortex-compact +2.1% -1.8% +4.0% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -4.6% -1.8% -2.8% +10.0% ➖ noise
92 duckdb:duckdb -0.4% -1.8% +1.4% +10.0% ➖ noise
92 duckdb:vortex-compact -2.8% -1.8% -1.0% +15.5% ➖ noise
92 duckdb:vortex-file-compressed -3.0% -1.8% -1.2% +12.2% ➖ noise
93 datafusion:vortex-compact -4.3% +3.8% -7.8% +12.0% ➖ noise
93 datafusion:vortex-file-compressed -1.9% +3.8% -5.4% +12.3% ➖ noise
93 duckdb:duckdb -13.4% +3.8% -16.6% +17.1% ✅ faster
93 duckdb:vortex-compact -0.4% +3.8% -4.0% +14.7% ➖ noise
93 duckdb:vortex-file-compressed +0.2% +3.8% -3.5% +11.1% ➖ noise
94 datafusion:vortex-compact -0.5% -0.3% -0.2% +11.1% ➖ noise
94 datafusion:vortex-file-compressed -2.7% -0.3% -2.4% +10.8% ➖ noise
94 duckdb:duckdb -1.7% -0.3% -1.5% +13.8% ➖ noise
94 duckdb:vortex-compact +3.0% -0.3% +3.3% +14.3% ➖ noise
94 duckdb:vortex-file-compressed +1.3% -0.3% +1.6% +12.7% ➖ noise
95 datafusion:vortex-compact +1.6% +1.2% +0.4% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -3.2% +1.2% -4.4% +11.2% ➖ noise
95 duckdb:duckdb -17.3% +1.2% -18.3% +20.6% ✅ faster
95 duckdb:vortex-compact -6.5% +1.2% -7.6% +19.3% ➖ noise
95 duckdb:vortex-file-compressed -11.5% +1.2% -12.6% +15.9% ➖ noise
96 datafusion:vortex-compact +1.9% +1.1% +0.9% +11.5% ➖ noise
96 datafusion:vortex-file-compressed +6.6% +1.1% +5.5% +14.4% ➖ noise
96 duckdb:duckdb -3.8% +1.1% -4.9% +18.8% ➖ noise
96 duckdb:vortex-compact +1.1% +1.1% +0.0% +10.2% ➖ noise
96 duckdb:vortex-file-compressed +6.3% +1.1% +5.2% +14.8% ➖ noise
97 datafusion:vortex-compact -5.0% +2.6% -7.4% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -3.4% +2.6% -5.9% +10.7% ➖ noise
97 duckdb:duckdb +3.1% +2.6% +0.5% +10.0% ➖ noise
97 duckdb:vortex-compact -1.3% +2.6% -3.8% +13.9% ➖ noise
97 duckdb:vortex-file-compressed -3.6% +2.6% -6.0% +17.3% ➖ noise
98 datafusion:vortex-compact -8.7% +2.8% -11.2% +10.0% ✅ faster
98 datafusion:vortex-file-compressed -2.2% +2.8% -4.9% +10.0% ➖ noise
98 duckdb:duckdb -3.5% +2.8% -6.2% +13.3% ➖ noise
98 duckdb:vortex-compact -0.3% +2.8% -3.0% +13.1% ➖ noise
98 duckdb:vortex-file-compressed -7.3% +2.8% -9.9% +17.7% ➖ noise
99 datafusion:vortex-compact -7.1% +0.3% -7.4% +16.1% ➖ noise
99 datafusion:vortex-file-compressed -2.7% +0.3% -3.0% +18.6% ➖ noise
99 duckdb:duckdb +1.4% +0.3% +1.1% +30.5% ➖ noise
99 duckdb:vortex-compact -7.7% +0.3% -8.0% +17.8% ➖ noise
99 duckdb:vortex-file-compressed -4.6% +0.3% -4.9% +23.6% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: FineWeb NVMe

Summary

  • Overall: 1.045x ➖
  • Vortex: 1.034x ➖
  • Parquet: 1.068x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -3.2%
  • Confidence: low
  • Environment shift: +6.8%

Statistical Summary

  • Systemic shift (parquet controls): +6.8%
  • Control sigma: +1.6%
  • Residual noise: +4.0%
  • Median polish overall: +4.4%
datafusion / vortex-file-compressed (0.981x ➖, 4↑ 2↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6384626 4314088 1.48
fineweb_q01/datafusion:vortex-file-compressed 28553717 26115242 1.09
fineweb_q02/datafusion:vortex-file-compressed 🚨 33028881 29369508 1.12
fineweb_q03/datafusion:vortex-file-compressed 🚀 88417348 112535454 0.79
fineweb_q04/datafusion:vortex-file-compressed 231109719 225939068 1.02
fineweb_q05/datafusion:vortex-file-compressed 🚀 203039248 225848304 0.90
fineweb_q06/datafusion:vortex-file-compressed 🚀 73360981 93576266 0.78
fineweb_q07/datafusion:vortex-file-compressed 🚀 72800839 92337303 0.79
fineweb_q08/datafusion:vortex-file-compressed 27171285 26251100 1.04
datafusion / vortex-compact (1.034x ➖, 0↑ 1↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4738943 5239045 0.90
fineweb_q01/datafusion:vortex-compact 168749753 168403148 1.00
fineweb_q02/datafusion:vortex-compact 167840233 167772216 1.00
fineweb_q03/datafusion:vortex-compact 1460512825 1446869774 1.01
fineweb_q04/datafusion:vortex-compact 1624971610 1568843054 1.04
fineweb_q05/datafusion:vortex-compact 1334569471 1241341216 1.08
fineweb_q06/datafusion:vortex-compact 733658596 698679210 1.05
fineweb_q07/datafusion:vortex-compact 772644408 727180842 1.06
fineweb_q08/datafusion:vortex-compact 🚨 25849564 21844616 1.18
datafusion / parquet (1.077x ➖, 0↑ 2↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 6733566 6013717 1.12
fineweb_q01/datafusion:parquet 287816214 271675860 1.06
fineweb_q02/datafusion:parquet 294231038 277044197 1.06
fineweb_q03/datafusion:parquet 297202750 273178948 1.09
fineweb_q04/datafusion:parquet 309828139 284777482 1.09
fineweb_q05/datafusion:parquet 🚨 312834803 284148000 1.10
fineweb_q06/datafusion:parquet 297857064 285351300 1.04
fineweb_q07/datafusion:parquet 285005563 269839528 1.06
fineweb_q08/datafusion:parquet 288352537 267471298 1.08
duckdb / vortex-file-compressed (1.057x ➖, 0↑ 2↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 3834300 3206809 1.20
fineweb_q01/duckdb:vortex-file-compressed 🚨 32430442 27390972 1.18
fineweb_q02/duckdb:vortex-file-compressed 29227253 28533218 1.02
fineweb_q03/duckdb:vortex-file-compressed 133607137 144940259 0.92
fineweb_q04/duckdb:vortex-file-compressed 224197821 209212486 1.07
fineweb_q05/duckdb:vortex-file-compressed 198789753 187582938 1.06
fineweb_q06/duckdb:vortex-file-compressed 76457690 70849911 1.08
fineweb_q07/duckdb:vortex-file-compressed 72208541 69861092 1.03
fineweb_q08/duckdb:vortex-file-compressed 26605308 27446121 0.97
duckdb / vortex-compact (1.067x ➖, 0↑ 2↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4639256 4043737 1.15
fineweb_q01/duckdb:vortex-compact 109375629 100558912 1.09
fineweb_q02/duckdb:vortex-compact 118774493 115833016 1.03
fineweb_q03/duckdb:vortex-compact 869667416 860087163 1.01
fineweb_q04/duckdb:vortex-compact 928182334 905777362 1.02
fineweb_q05/duckdb:vortex-compact 830118486 810789554 1.02
fineweb_q06/duckdb:vortex-compact 475741725 464543121 1.02
fineweb_q07/duckdb:vortex-compact 509501246 472751869 1.08
fineweb_q08/duckdb:vortex-compact 🚨 26999672 22579316 1.20
duckdb / parquet (1.059x ➖, 0↑ 1↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 38757495 35964587 1.08
fineweb_q01/duckdb:parquet 99906747 91990525 1.09
fineweb_q02/duckdb:parquet 104399453 97015869 1.08
fineweb_q03/duckdb:parquet 317517321 307349907 1.03
fineweb_q04/duckdb:parquet 447352329 435985819 1.03
fineweb_q05/duckdb:parquet 424062005 409093100 1.04
fineweb_q06/duckdb:parquet 207108316 197472508 1.05
fineweb_q07/duckdb:parquet 219665341 209153985 1.05
fineweb_q08/duckdb:parquet 🚨 63492297 57542639 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -9.5% +9.8% -17.7% +59.9% ➖ noise
0 datafusion:vortex-file-compressed +48.0% +9.8% +34.7% +93.6% ➖ noise
0 duckdb:vortex-compact +14.7% +9.8% +4.4% +39.7% ➖ noise
0 duckdb:vortex-file-compressed +19.6% +9.8% +8.8% +53.3% ➖ noise
1 datafusion:vortex-compact +0.2% +7.3% -6.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +9.3% +7.3% +1.9% +21.7% ➖ noise
1 duckdb:vortex-compact +8.8% +7.3% +1.4% +11.9% ➖ noise
1 duckdb:vortex-file-compressed +18.4% +7.3% +10.4% +35.3% ➖ noise
2 datafusion:vortex-compact +0.0% +6.9% -6.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +12.5% +6.9% +5.2% +10.8% ➖ noise
2 duckdb:vortex-compact +2.5% +6.9% -4.1% +10.9% ➖ noise
2 duckdb:vortex-file-compressed +2.4% +6.9% -4.2% +13.9% ➖ noise
3 datafusion:vortex-compact +0.9% +6.0% -4.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -21.4% +6.0% -25.9% +35.0% ➖ noise
3 duckdb:vortex-compact +1.1% +6.0% -4.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -7.8% +6.0% -13.0% +36.2% ➖ noise
4 datafusion:vortex-compact +3.6% +5.7% -2.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.3% +5.7% -3.2% +11.0% ➖ noise
4 duckdb:vortex-compact +2.5% +5.7% -3.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +7.2% +5.7% +1.4% +10.0% ➖ noise
5 datafusion:vortex-compact +7.5% +6.8% +0.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -10.1% +6.8% -15.8% +10.0% ✅ faster
5 duckdb:vortex-compact +2.4% +6.8% -4.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +6.0% +6.8% -0.8% +10.0% ➖ noise
6 datafusion:vortex-compact +5.0% +4.6% +0.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -21.6% +4.6% -25.1% +20.8% ✅ faster
6 duckdb:vortex-compact +2.4% +4.6% -2.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +7.9% +4.6% +3.1% +10.8% ➖ noise
7 datafusion:vortex-compact +6.3% +5.3% +0.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -21.2% +5.3% -25.1% +23.8% ✅ faster
7 duckdb:vortex-compact +7.8% +5.3% +2.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.4% +5.3% -1.9% +10.0% ➖ noise
8 datafusion:vortex-compact +18.3% +9.1% +8.5% +31.3% ➖ noise
8 datafusion:vortex-file-compressed +3.5% +9.1% -5.1% +49.5% ➖ noise
8 duckdb:vortex-compact +19.6% +9.1% +9.6% +20.7% ➖ noise
8 duckdb:vortex-file-compressed -3.1% +9.1% -11.1% +14.5% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: FineWeb S3

Summary

  • Overall: 0.988x ➖
  • Vortex: 0.973x ➖
  • Parquet: 1.018x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -4.4%
  • Confidence: low
  • Environment shift: +1.8%

Statistical Summary

  • Systemic shift (parquet controls): +1.8%
  • Control sigma: +2.7%
  • Residual noise: +3.2%
  • Median polish overall: +2.2%
datafusion / vortex-file-compressed (0.974x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 34451139 30409387 1.13
fineweb_q01/datafusion:vortex-file-compressed 581601531 533024443 1.09
fineweb_q02/datafusion:vortex-file-compressed 530394214 577923005 0.92
fineweb_q03/datafusion:vortex-file-compressed 1336444031 1381043757 0.97
fineweb_q04/datafusion:vortex-file-compressed 1355143310 1408667512 0.96
fineweb_q05/datafusion:vortex-file-compressed 1338516029 1396187927 0.96
fineweb_q06/datafusion:vortex-file-compressed 1462160866 1605771385 0.91
fineweb_q07/datafusion:vortex-file-compressed 1395332921 1437341261 0.97
fineweb_q08/datafusion:vortex-file-compressed 549060307 620099214 0.89
datafusion / vortex-compact (0.949x ➖, 1↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 27438621 49347980 0.56
fineweb_q01/datafusion:vortex-compact 560093895 557202266 1.01
fineweb_q02/datafusion:vortex-compact 625348658 636406342 0.98
fineweb_q03/datafusion:vortex-compact 1892077350 1848677130 1.02
fineweb_q04/datafusion:vortex-compact 2281482066 2232322917 1.02
fineweb_q05/datafusion:vortex-compact 1755823380 1687853048 1.04
fineweb_q06/datafusion:vortex-compact 1459641217 1414193363 1.03
fineweb_q07/datafusion:vortex-compact 1346058836 1325162019 1.02
fineweb_q08/datafusion:vortex-compact 434547154 437609859 0.99
datafusion / parquet (1.018x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1177130903 1111660068 1.06
fineweb_q01/datafusion:parquet 1695427376 1897647484 0.89
fineweb_q02/datafusion:parquet 1791752499 1822071322 0.98
fineweb_q03/datafusion:parquet 1870264606 1784769786 1.05
fineweb_q04/datafusion:parquet 1851630048 1809033242 1.02
fineweb_q05/datafusion:parquet 1776131769 1828002278 0.97
fineweb_q06/datafusion:parquet 1953169744 1781529198 1.10
fineweb_q07/datafusion:parquet 1936207366 1786643275 1.08
fineweb_q08/datafusion:parquet 1805187809 1777386626 1.02
duckdb / vortex-file-compressed (0.957x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 101087001 95575965 1.06
fineweb_q01/duckdb:vortex-file-compressed 561661588 571656262 0.98
fineweb_q02/duckdb:vortex-file-compressed 446619024 508725923 0.88
fineweb_q03/duckdb:vortex-file-compressed 1558482819 1544011973 1.01
fineweb_q04/duckdb:vortex-file-compressed 1549887630 1512904681 1.02
fineweb_q05/duckdb:vortex-file-compressed 1513466285 1545082082 0.98
fineweb_q06/duckdb:vortex-file-compressed 1748893971 1752603680 1.00
fineweb_q07/duckdb:vortex-file-compressed 1574841667 1842175278 0.85
fineweb_q08/duckdb:vortex-file-compressed 668829763 780005579 0.86
duckdb / vortex-compact (1.014x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 82851295 91019234 0.91
fineweb_q01/duckdb:vortex-compact 522074391 580110342 0.90
fineweb_q02/duckdb:vortex-compact 597838154 576035459 1.04
fineweb_q03/duckdb:vortex-compact 1739310924 1629689694 1.07
fineweb_q04/duckdb:vortex-compact 1890857745 1776134880 1.06
fineweb_q05/duckdb:vortex-compact 1651394983 1536398176 1.07
fineweb_q06/duckdb:vortex-compact 1636636006 1521549974 1.08
fineweb_q07/duckdb:vortex-compact 1396796041 1365770003 1.02
fineweb_q08/duckdb:vortex-compact 499106892 503708549 0.99
duckdb / parquet (1.018x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1049796546 1053387650 1.00
fineweb_q01/duckdb:parquet 1737421600 1588900720 1.09
fineweb_q02/duckdb:parquet 1662559408 1653100983 1.01
fineweb_q03/duckdb:parquet 4106463633 4059867217 1.01
fineweb_q04/duckdb:parquet 1817007997 1847014202 0.98
fineweb_q05/duckdb:parquet 2726431307 2659987544 1.02
fineweb_q06/duckdb:parquet 3333813718 3307011257 1.01
fineweb_q07/duckdb:parquet 4073723179 3889637034 1.05
fineweb_q08/duckdb:parquet 1065890299 1073336502 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -44.4% +2.7% -45.9% +187.5% ➖ noise
0 datafusion:vortex-file-compressed +13.3% +2.7% +10.3% +208.3% ➖ noise
0 duckdb:vortex-compact -9.0% +2.7% -11.4% +49.8% ➖ noise
0 duckdb:vortex-file-compressed +5.8% +2.7% +3.0% +34.2% ➖ noise
1 datafusion:vortex-compact +0.5% -1.2% +1.7% +87.9% ➖ noise
1 datafusion:vortex-file-compressed +9.1% -1.2% +10.4% +53.4% ➖ noise
1 duckdb:vortex-compact -10.0% -1.2% -8.9% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -1.7% -1.2% -0.6% +51.0% ➖ noise
2 datafusion:vortex-compact -1.7% -0.6% -1.2% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -8.2% -0.6% -7.7% +38.3% ➖ noise
2 duckdb:vortex-compact +3.8% -0.6% +4.4% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -12.2% -0.6% -11.7% +30.0% ➖ noise
3 datafusion:vortex-compact +2.3% +3.0% -0.6% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -3.2% +3.0% -6.0% +30.0% ➖ noise
3 duckdb:vortex-compact +6.7% +3.0% +3.7% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +0.9% +3.0% -2.0% +30.0% ➖ noise
4 datafusion:vortex-compact +2.2% +0.3% +1.9% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -3.8% +0.3% -4.1% +30.0% ➖ noise
4 duckdb:vortex-compact +6.5% +0.3% +6.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% +0.3% +2.1% +30.0% ➖ noise
5 datafusion:vortex-compact +4.0% -0.2% +4.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -4.1% -0.2% -3.9% +30.0% ➖ noise
5 duckdb:vortex-compact +7.5% -0.2% +7.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -2.0% -0.2% -1.8% +30.0% ➖ noise
6 datafusion:vortex-compact +3.2% +5.1% -1.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -8.9% +5.1% -13.4% +30.0% ➖ noise
6 duckdb:vortex-compact +7.6% +5.1% +2.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -0.2% +5.1% -5.1% +30.0% ➖ noise
7 datafusion:vortex-compact +1.6% +6.5% -4.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -2.9% +6.5% -8.9% +30.0% ➖ noise
7 duckdb:vortex-compact +2.3% +6.5% -4.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -14.5% +6.5% -19.8% +30.0% ➖ noise
8 datafusion:vortex-compact -0.7% +0.4% -1.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -11.5% +0.4% -11.8% +46.8% ➖ noise
8 duckdb:vortex-compact -0.9% +0.4% -1.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -14.3% +0.4% -14.6% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: PolarSignals Profiling

Summary

  • Overall: 0.969x ➖
  • Vortex: 0.969x ➖
datafusion / vortex-file-compressed (0.969x ➖, 0↑ 0↓)
name PR 5126025 (ns) base e523a58 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 113872621 120762752 0.94
polarsignals_q01/datafusion:vortex-file-compressed 342259877 359688663 0.95
polarsignals_q02/datafusion:vortex-file-compressed 20988767 21675435 0.97
polarsignals_q03/datafusion:vortex-file-compressed 347323683 359579808 0.97
polarsignals_q04/datafusion:vortex-file-compressed 12966834 13088602 0.99
polarsignals_q05/datafusion:vortex-file-compressed 16579830 18054856 0.92
polarsignals_q06/datafusion:vortex-file-compressed 21042266 21300286 0.99
polarsignals_q07/datafusion:vortex-file-compressed 12517013 12839995 0.97
polarsignals_q08/datafusion:vortex-file-compressed 437908754 444908145 0.98
polarsignals_q09/datafusion:vortex-file-compressed 11211707 11137452 1.01

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: TPC-H SF=10 on NVME

Summary

  • Overall: 1.001x ➖
  • Vortex: 1.000x ➖
  • Parquet: 0.994x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +0.8%
  • Confidence: low
  • Environment shift: -0.6%

Statistical Summary

  • Systemic shift (parquet controls): -0.6%
  • Control sigma: +2.3%
  • Residual noise: +1.1%
  • Median polish overall: -0.1%
datafusion / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 421333163 435221468 0.97
tpch_q02/datafusion:vortex-file-compressed 157432399 158767796 0.99
tpch_q03/datafusion:vortex-file-compressed 243637736 246079706 0.99
tpch_q04/datafusion:vortex-file-compressed 110153214 105695232 1.04
tpch_q05/datafusion:vortex-file-compressed 453037848 452838777 1.00
tpch_q06/datafusion:vortex-file-compressed 40466174 40170966 1.01
tpch_q07/datafusion:vortex-file-compressed 639912792 638825053 1.00
tpch_q08/datafusion:vortex-file-compressed 457101242 459154798 1.00
tpch_q09/datafusion:vortex-file-compressed 809206179 792488103 1.02
tpch_q10/datafusion:vortex-file-compressed 283866603 285711454 0.99
tpch_q11/datafusion:vortex-file-compressed 116236583 115452147 1.01
tpch_q12/datafusion:vortex-file-compressed 125322562 125982796 0.99
tpch_q13/datafusion:vortex-file-compressed 226420365 223906564 1.01
tpch_q14/datafusion:vortex-file-compressed 71951763 72434678 0.99
tpch_q15/datafusion:vortex-file-compressed 107618902 107243396 1.00
tpch_q16/datafusion:vortex-file-compressed 91283311 93498632 0.98
tpch_q17/datafusion:vortex-file-compressed 734226140 730316256 1.01
tpch_q18/datafusion:vortex-file-compressed 961883760 961898876 1.00
tpch_q19/datafusion:vortex-file-compressed 127014173 127879244 0.99
tpch_q20/datafusion:vortex-file-compressed 200089913 198315031 1.01
tpch_q21/datafusion:vortex-file-compressed 748867688 751988940 1.00
tpch_q22/datafusion:vortex-file-compressed 59634385 60401234 0.99
datafusion / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 480271539 468967354 1.02
tpch_q02/datafusion:vortex-compact 163538633 159873167 1.02
tpch_q03/datafusion:vortex-compact 261438141 261329178 1.00
tpch_q04/datafusion:vortex-compact 127225901 126345205 1.01
tpch_q05/datafusion:vortex-compact 469111349 464461027 1.01
tpch_q06/datafusion:vortex-compact 62373258 63301329 0.99
tpch_q07/datafusion:vortex-compact 669247828 666629391 1.00
tpch_q08/datafusion:vortex-compact 473878108 474576839 1.00
tpch_q09/datafusion:vortex-compact 809201504 806769761 1.00
tpch_q10/datafusion:vortex-compact 318485000 326186051 0.98
tpch_q11/datafusion:vortex-compact 120539133 124790355 0.97
tpch_q12/datafusion:vortex-compact 181841177 183530366 0.99
tpch_q13/datafusion:vortex-compact 273620653 273937700 1.00
tpch_q14/datafusion:vortex-compact 88407238 91116564 0.97
tpch_q15/datafusion:vortex-compact 166631026 167798557 0.99
tpch_q16/datafusion:vortex-compact 100709839 99447450 1.01
tpch_q17/datafusion:vortex-compact 741395282 732153966 1.01
tpch_q18/datafusion:vortex-compact 971715136 967646734 1.00
tpch_q19/datafusion:vortex-compact 241375586 228295918 1.06
tpch_q20/datafusion:vortex-compact 223328001 226260636 0.99
tpch_q21/datafusion:vortex-compact 795225650 793938363 1.00
tpch_q22/datafusion:vortex-compact 69793176 69745157 1.00
datafusion / parquet (0.997x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 464836548 467134874 1.00
tpch_q02/datafusion:parquet 256093646 263431615 0.97
tpch_q03/datafusion:parquet 388546915 392546323 0.99
tpch_q04/datafusion:parquet 147367903 148527827 0.99
tpch_q05/datafusion:parquet 574622815 564288921 1.02
tpch_q06/datafusion:parquet 129338110 134237993 0.96
tpch_q07/datafusion:parquet 795449728 780492163 1.02
tpch_q08/datafusion:parquet 632422291 631486594 1.00
tpch_q09/datafusion:parquet 942880883 955839824 0.99
tpch_q10/datafusion:parquet 595770649 601917940 0.99
tpch_q11/datafusion:parquet 191029753 192114057 0.99
tpch_q12/datafusion:parquet 251432051 246509300 1.02
tpch_q13/datafusion:parquet 334373246 341146677 0.98
tpch_q14/datafusion:parquet 196970410 200436987 0.98
tpch_q15/datafusion:parquet 256484986 253021018 1.01
tpch_q16/datafusion:parquet 173535656 174641326 0.99
tpch_q17/datafusion:parquet 828097568 826028867 1.00
tpch_q18/datafusion:parquet 1017446055 1016959588 1.00
tpch_q19/datafusion:parquet 327585119 312998019 1.05
tpch_q20/datafusion:parquet 366176021 374581772 0.98
tpch_q21/datafusion:parquet 883448277 884405575 1.00
tpch_q22/datafusion:parquet 219105763 219974608 1.00
datafusion / arrow (1.020x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 704827638 719574087 0.98
tpch_q02/datafusion:arrow 202313232 203908469 0.99
tpch_q03/datafusion:arrow 548525679 538776346 1.02
tpch_q04/datafusion:arrow 393394652 385990950 1.02
tpch_q05/datafusion:arrow 1081101355 1035958468 1.04
tpch_q06/datafusion:arrow 321853754 312189782 1.03
tpch_q07/datafusion:arrow 1387687130 1340182962 1.04
tpch_q08/datafusion:arrow 1327786354 1278001926 1.04
tpch_q09/datafusion:arrow 1577775980 1535713073 1.03
tpch_q10/datafusion:arrow 691875110 660544109 1.05
tpch_q11/datafusion:arrow 182053017 176767057 1.03
tpch_q12/datafusion:arrow 735634395 738370088 1.00
tpch_q13/datafusion:arrow 533539338 530870582 1.01
tpch_q14/datafusion:arrow 352629364 349415007 1.01
tpch_q15/datafusion:arrow 745463474 739886598 1.01
tpch_q16/datafusion:arrow 122932450 118167776 1.04
tpch_q17/datafusion:arrow 1563586258 1539829838 1.02
tpch_q18/datafusion:arrow 2143265159 2107176929 1.02
tpch_q19/datafusion:arrow 579420189 569750985 1.02
tpch_q20/datafusion:arrow 563699948 550496273 1.02
tpch_q21/datafusion:arrow 4123933895 4055337654 1.02
tpch_q22/datafusion:arrow 181954424 174686734 1.04
duckdb / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 175089795 175974664 0.99
tpch_q02/duckdb:vortex-file-compressed 53478485 51812285 1.03
tpch_q03/duckdb:vortex-file-compressed 129058427 127260219 1.01
tpch_q04/duckdb:vortex-file-compressed 150634788 149622568 1.01
tpch_q05/duckdb:vortex-file-compressed 130692192 130971271 1.00
tpch_q06/duckdb:vortex-file-compressed 48379462 48993562 0.99
tpch_q07/duckdb:vortex-file-compressed 146106479 146473829 1.00
tpch_q08/duckdb:vortex-file-compressed 176292260 176700356 1.00
tpch_q09/duckdb:vortex-file-compressed 330983954 332757522 0.99
tpch_q10/duckdb:vortex-file-compressed 153108377 152527130 1.00
tpch_q11/duckdb:vortex-file-compressed 36448413 35551451 1.03
tpch_q12/duckdb:vortex-file-compressed 95578328 94052879 1.02
tpch_q13/duckdb:vortex-file-compressed 244984831 245460051 1.00
tpch_q14/duckdb:vortex-file-compressed 69017879 69678691 0.99
tpch_q15/duckdb:vortex-file-compressed 98672224 98214196 1.00
tpch_q16/duckdb:vortex-file-compressed 77866106 78934020 0.99
tpch_q17/duckdb:vortex-file-compressed 100642429 99411004 1.01
tpch_q18/duckdb:vortex-file-compressed 290276756 277176598 1.05
tpch_q19/duckdb:vortex-file-compressed 89320723 90117010 0.99
tpch_q20/duckdb:vortex-file-compressed 163688320 164030576 1.00
tpch_q21/duckdb:vortex-file-compressed 554362521 553865925 1.00
tpch_q22/duckdb:vortex-file-compressed 77595649 77699204 1.00
duckdb / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229105666 229605656 1.00
tpch_q02/duckdb:vortex-compact 58766195 58262783 1.01
tpch_q03/duckdb:vortex-compact 141628410 142621038 0.99
tpch_q04/duckdb:vortex-compact 177488719 175969796 1.01
tpch_q05/duckdb:vortex-compact 145881015 146647961 0.99
tpch_q06/duckdb:vortex-compact 83696468 84798377 0.99
tpch_q07/duckdb:vortex-compact 206989313 210613773 0.98
tpch_q08/duckdb:vortex-compact 188743889 189237355 1.00
tpch_q09/duckdb:vortex-compact 362093688 361345791 1.00
tpch_q10/duckdb:vortex-compact 186359711 184041160 1.01
tpch_q11/duckdb:vortex-compact 42005702 43363500 0.97
tpch_q12/duckdb:vortex-compact 207566610 210269483 0.99
tpch_q13/duckdb:vortex-compact 291041950 289917387 1.00
tpch_q14/duckdb:vortex-compact 100918601 102293024 0.99
tpch_q15/duckdb:vortex-compact 119832220 119086898 1.01
tpch_q16/duckdb:vortex-compact 84405603 84839791 0.99
tpch_q17/duckdb:vortex-compact 116424987 118845205 0.98
tpch_q18/duckdb:vortex-compact 292747009 294975275 0.99
tpch_q19/duckdb:vortex-compact 114676707 114282002 1.00
tpch_q20/duckdb:vortex-compact 207290810 207015355 1.00
tpch_q21/duckdb:vortex-compact 628028348 630320115 1.00
tpch_q22/duckdb:vortex-compact 89029812 89895229 0.99
duckdb / parquet (0.992x ➖, 1↑ 1↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258078667 266612342 0.97
tpch_q02/duckdb:parquet 96993612 103295463 0.94
tpch_q03/duckdb:parquet 211044382 211714166 1.00
tpch_q04/duckdb:parquet 134241704 137678602 0.98
tpch_q05/duckdb:parquet 220897127 216472216 1.02
tpch_q06/duckdb:parquet 69108971 67240119 1.03
tpch_q07/duckdb:parquet 180107111 179492997 1.00
tpch_q08/duckdb:parquet 252039470 256494073 0.98
tpch_q09/duckdb:parquet 461767547 457787242 1.01
tpch_q10/duckdb:parquet 612368027 606442389 1.01
tpch_q11/duckdb:parquet 🚀 39846834 45515855 0.88
tpch_q12/duckdb:parquet 126012802 125888302 1.00
tpch_q13/duckdb:parquet 🚨 465404315 421537898 1.10
tpch_q14/duckdb:parquet 172467968 173153615 1.00
tpch_q15/duckdb:parquet 98062178 96502153 1.02
tpch_q16/duckdb:parquet 155001261 162969777 0.95
tpch_q17/duckdb:parquet 176939500 179853143 0.98
tpch_q18/duckdb:parquet 351908025 342704957 1.03
tpch_q19/duckdb:parquet 276095759 291038416 0.95
tpch_q20/duckdb:parquet 228788552 229849264 1.00
tpch_q21/duckdb:parquet 570508394 565261466 1.01
tpch_q22/duckdb:parquet 289797105 288904117 1.00
duckdb / duckdb (0.996x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116706234 117047811 1.00
tpch_q02/duckdb:duckdb 46519734 44680914 1.04
tpch_q03/duckdb:duckdb 96774081 97171322 1.00
tpch_q04/duckdb:duckdb 129959854 129660837 1.00
tpch_q05/duckdb:duckdb 108223266 109434204 0.99
tpch_q06/duckdb:duckdb 39622843 39767544 1.00
tpch_q07/duckdb:duckdb 86136438 86349580 1.00
tpch_q08/duckdb:duckdb 109399898 109355140 1.00
tpch_q09/duckdb:duckdb 275897129 278382831 0.99
tpch_q10/duckdb:duckdb 202195505 202828375 1.00
tpch_q11/duckdb:duckdb 15127519 15587865 0.97
tpch_q12/duckdb:duckdb 83878748 84016860 1.00
tpch_q13/duckdb:duckdb 257690506 249928194 1.03
tpch_q14/duckdb:duckdb 70289363 72617841 0.97
tpch_q15/duckdb:duckdb 78481608 78559717 1.00
tpch_q16/duckdb:duckdb 71831450 72981402 0.98
tpch_q17/duckdb:duckdb 84214390 84479912 1.00
tpch_q18/duckdb:duckdb 212933391 212091085 1.00
tpch_q19/duckdb:duckdb 116005081 116092341 1.00
tpch_q20/duckdb:duckdb 111887471 112086176 1.00
tpch_q21/duckdb:duckdb 296715488 298579394 0.99
tpch_q22/duckdb:duckdb 66430499 68590135 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.0% -1.9% -0.2% +11.9% ➖ noise
1 datafusion:vortex-compact +2.4% -1.9% +4.3% +13.8% ➖ noise
1 datafusion:vortex-file-compressed -3.2% -1.9% -1.4% +14.5% ➖ noise
1 duckdb:duckdb -0.3% -1.9% +1.6% +11.9% ➖ noise
1 duckdb:vortex-compact -0.2% -1.9% +1.7% +12.0% ➖ noise
1 duckdb:vortex-file-compressed -0.5% -1.9% +1.4% +13.1% ➖ noise
2 datafusion:arrow -0.8% -4.5% +3.8% +10.0% ➖ noise
2 datafusion:vortex-compact +2.3% -4.5% +7.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.8% -4.5% +3.8% +10.0% ➖ noise
2 duckdb:duckdb +4.1% -4.5% +9.0% +17.9% ➖ noise
2 duckdb:vortex-compact +0.9% -4.5% +5.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +3.2% -4.5% +8.0% +10.0% ➖ noise
3 datafusion:arrow +1.8% -0.7% +2.5% +10.0% ➖ noise
3 datafusion:vortex-compact +0.0% -0.7% +0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.0% -0.7% -0.3% +10.0% ➖ noise
3 duckdb:duckdb -0.4% -0.7% +0.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.7% -0.7% -0.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.4% -0.7% +2.1% +10.0% ➖ noise
4 datafusion:arrow +1.9% -1.6% +3.6% +10.0% ➖ noise
4 datafusion:vortex-compact +0.7% -1.6% +2.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +4.2% -1.6% +6.0% +10.0% ➖ noise
4 duckdb:duckdb +0.2% -1.6% +1.9% +10.0% ➖ noise
4 duckdb:vortex-compact +0.9% -1.6% +2.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.7% -1.6% +2.4% +10.0% ➖ noise
5 datafusion:arrow +4.4% +1.9% +2.4% +10.0% ➖ noise
5 datafusion:vortex-compact +1.0% +1.9% -0.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.0% +1.9% -1.9% +10.0% ➖ noise
5 duckdb:duckdb -1.1% +1.9% -3.0% +10.0% ➖ noise
5 duckdb:vortex-compact -0.5% +1.9% -2.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.2% +1.9% -2.1% +10.0% ➖ noise
6 datafusion:arrow +3.1% -0.5% +3.6% +10.0% ➖ noise
6 datafusion:vortex-compact -1.5% -0.5% -1.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.7% -0.5% +1.2% +10.0% ➖ noise
6 duckdb:duckdb -0.4% -0.5% +0.1% +15.9% ➖ noise
6 duckdb:vortex-compact -1.3% -0.5% -0.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.3% -0.5% -0.8% +11.0% ➖ noise
7 datafusion:arrow +3.5% +1.1% +2.4% +10.0% ➖ noise
7 datafusion:vortex-compact +0.4% +1.1% -0.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.2% +1.1% -0.9% +10.0% ➖ noise
7 duckdb:duckdb -0.2% +1.1% -1.4% +11.3% ➖ noise
7 duckdb:vortex-compact -1.7% +1.1% -2.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.3% +1.1% -1.4% +10.0% ➖ noise
8 datafusion:arrow +3.9% -0.8% +4.7% +10.0% ➖ noise
8 datafusion:vortex-compact -0.1% -0.8% +0.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.4% -0.8% +0.4% +10.0% ➖ noise
8 duckdb:duckdb +0.0% -0.8% +0.8% +10.0% ➖ noise
8 duckdb:vortex-compact -0.3% -0.8% +0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.2% -0.8% +0.6% +10.0% ➖ noise
9 datafusion:arrow +2.7% -0.2% +3.0% +10.0% ➖ noise
9 datafusion:vortex-compact +0.3% -0.2% +0.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.1% -0.2% +2.4% +10.0% ➖ noise
9 duckdb:duckdb -0.9% -0.2% -0.6% +10.0% ➖ noise
9 duckdb:vortex-compact +0.2% -0.2% +0.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.5% -0.2% -0.3% +10.0% ➖ noise
10 datafusion:arrow +4.7% -0.0% +4.8% +10.0% ➖ noise
10 datafusion:vortex-compact -2.4% -0.0% -2.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.6% -0.0% -0.6% +10.0% ➖ noise
10 duckdb:duckdb -0.3% -0.0% -0.3% +10.0% ➖ noise
10 duckdb:vortex-compact +1.3% -0.0% +1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.4% -0.0% +0.4% +10.0% ➖ noise
11 datafusion:arrow +3.0% -6.7% +10.4% +11.2% ➖ noise
11 datafusion:vortex-compact -3.4% -6.7% +3.5% +10.1% ➖ noise
11 datafusion:vortex-file-compressed +0.7% -6.7% +7.9% +10.2% ➖ noise
11 duckdb:duckdb -3.0% -6.7% +4.0% +21.0% ➖ noise
11 duckdb:vortex-compact -3.1% -6.7% +3.8% +12.9% ➖ noise
11 duckdb:vortex-file-compressed +2.5% -6.7% +9.9% +12.8% ➖ noise
12 datafusion:arrow -0.4% +1.0% -1.4% +34.9% ➖ noise
12 datafusion:vortex-compact -0.9% +1.0% -1.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.5% +1.0% -1.6% +10.0% ➖ noise
12 duckdb:duckdb -0.2% +1.0% -1.2% +10.0% ➖ noise
12 duckdb:vortex-compact -1.3% +1.0% -2.3% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.6% +1.0% +0.6% +10.0% ➖ noise
13 datafusion:arrow +0.5% +4.0% -3.4% +10.2% ➖ noise
13 datafusion:vortex-compact -0.1% +4.0% -4.0% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.1% +4.0% -2.8% +10.0% ➖ noise
13 duckdb:duckdb +3.1% +4.0% -0.9% +10.0% ➖ noise
13 duckdb:vortex-compact +0.4% +4.0% -3.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.2% +4.0% -4.1% +10.0% ➖ noise
14 datafusion:arrow +0.9% -1.1% +2.0% +10.0% ➖ noise
14 datafusion:vortex-compact -3.0% -1.1% -1.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.7% -1.1% +0.4% +10.0% ➖ noise
14 duckdb:duckdb -3.2% -1.1% -2.2% +11.1% ➖ noise
14 duckdb:vortex-compact -1.3% -1.1% -0.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.9% -1.1% +0.1% +10.0% ➖ noise
15 datafusion:arrow +0.8% +1.5% -0.7% +10.0% ➖ noise
15 datafusion:vortex-compact -0.7% +1.5% -2.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.4% +1.5% -1.1% +10.0% ➖ noise
15 duckdb:duckdb -0.1% +1.5% -1.6% +10.0% ➖ noise
15 duckdb:vortex-compact +0.6% +1.5% -0.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.5% +1.5% -1.0% +10.0% ➖ noise
16 datafusion:arrow +4.0% -2.8% +7.0% +10.0% ➖ noise
16 datafusion:vortex-compact +1.3% -2.8% +4.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.4% -2.8% +0.4% +10.0% ➖ noise
16 duckdb:duckdb -1.6% -2.8% +1.2% +10.0% ➖ noise
16 duckdb:vortex-compact -0.5% -2.8% +2.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.4% -2.8% +1.5% +10.0% ➖ noise
17 datafusion:arrow +1.5% -0.7% +2.2% +10.0% ➖ noise
17 datafusion:vortex-compact +1.3% -0.7% +2.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.5% -0.7% +1.2% +10.0% ➖ noise
17 duckdb:duckdb -0.3% -0.7% +0.4% +10.0% ➖ noise
17 duckdb:vortex-compact -2.0% -0.7% -1.4% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.2% -0.7% +1.9% +10.0% ➖ noise
18 datafusion:arrow +1.7% +1.4% +0.3% +12.1% ➖ noise
18 datafusion:vortex-compact +0.4% +1.4% -0.9% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.0% +1.4% -1.3% +10.0% ➖ noise
18 duckdb:duckdb +0.4% +1.4% -0.9% +10.0% ➖ noise
18 duckdb:vortex-compact -0.8% +1.4% -2.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +4.7% +1.4% +3.3% +10.0% ➖ noise
19 datafusion:arrow +1.7% -0.4% +2.1% +10.0% ➖ noise
19 datafusion:vortex-compact +5.7% -0.4% +6.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.7% -0.4% -0.3% +10.0% ➖ noise
19 duckdb:duckdb -0.1% -0.4% +0.3% +10.0% ➖ noise
19 duckdb:vortex-compact +0.3% -0.4% +0.7% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.9% -0.4% -0.5% +10.0% ➖ noise
20 datafusion:arrow +2.4% -1.4% +3.8% +10.0% ➖ noise
20 datafusion:vortex-compact -1.3% -1.4% +0.1% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.9% -1.4% +2.3% +10.0% ➖ noise
20 duckdb:duckdb -0.2% -1.4% +1.2% +10.0% ➖ noise
20 duckdb:vortex-compact +0.1% -1.4% +1.5% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.2% -1.4% +1.2% +10.0% ➖ noise
21 datafusion:arrow +1.7% +0.4% +1.3% +10.0% ➖ noise
21 datafusion:vortex-compact +0.2% +0.4% -0.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -0.4% +0.4% -0.8% +10.0% ➖ noise
21 duckdb:duckdb -0.6% +0.4% -1.0% +10.0% ➖ noise
21 duckdb:vortex-compact -0.4% +0.4% -0.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.1% +0.4% -0.3% +10.0% ➖ noise
22 datafusion:arrow +4.2% -0.0% +4.2% +10.0% ➖ noise
22 datafusion:vortex-compact +0.1% -0.0% +0.1% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.3% -0.0% -1.2% +10.0% ➖ noise
22 duckdb:duckdb -3.1% -0.0% -3.1% +10.4% ➖ noise
22 duckdb:vortex-compact -1.0% -0.0% -0.9% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.1% -0.0% -0.1% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: TPC-H SF=10 on S3

Summary

  • Overall: 1.039x ➖
  • Vortex: 1.023x ➖
  • Parquet: 1.072x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -4.6%
  • Confidence: environment too noisy
  • Environment shift: +7.2%

Statistical Summary

  • Systemic shift (parquet controls): +7.2%
  • Control sigma: +8.4%
  • Residual noise: +8.1%
  • Median polish overall: +3.2%
datafusion / vortex-file-compressed (1.056x ➖, 0↑ 1↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 723789169 702541865 1.03
tpch_q02/datafusion:vortex-file-compressed 693801219 613918715 1.13
tpch_q03/datafusion:vortex-file-compressed 854542186 759732968 1.12
tpch_q04/datafusion:vortex-file-compressed 598988438 592228422 1.01
tpch_q05/datafusion:vortex-file-compressed 1175056176 1053807039 1.12
tpch_q06/datafusion:vortex-file-compressed 655175361 672770031 0.97
tpch_q07/datafusion:vortex-file-compressed 1117500154 1207492074 0.93
tpch_q08/datafusion:vortex-file-compressed 1204870288 1232655117 0.98
tpch_q09/datafusion:vortex-file-compressed 1426040741 1387525795 1.03
tpch_q10/datafusion:vortex-file-compressed 1018802433 1001721685 1.02
tpch_q11/datafusion:vortex-file-compressed 525870738 487460111 1.08
tpch_q12/datafusion:vortex-file-compressed 909749070 923515731 0.99
tpch_q13/datafusion:vortex-file-compressed 450086035 427570394 1.05
tpch_q14/datafusion:vortex-file-compressed 589615461 597790061 0.99
tpch_q15/datafusion:vortex-file-compressed 1094417175 1058703732 1.03
tpch_q16/datafusion:vortex-file-compressed 🚨 422657725 298906696 1.41
tpch_q17/datafusion:vortex-file-compressed 1206400121 1185558820 1.02
tpch_q18/datafusion:vortex-file-compressed 1322391953 1532710913 0.86
tpch_q19/datafusion:vortex-file-compressed 706223401 645030053 1.09
tpch_q20/datafusion:vortex-file-compressed 1006133684 904051004 1.11
tpch_q21/datafusion:vortex-file-compressed 1788110806 1635196443 1.09
tpch_q22/datafusion:vortex-file-compressed 363237077 282250154 1.29
datafusion / vortex-compact (1.048x ➖, 0↑ 1↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 797778963 747570584 1.07
tpch_q02/datafusion:vortex-compact 671648914 653285077 1.03
tpch_q03/datafusion:vortex-compact 727051580 701665327 1.04
tpch_q04/datafusion:vortex-compact 503768539 524090385 0.96
tpch_q05/datafusion:vortex-compact 1020252247 962344639 1.06
tpch_q06/datafusion:vortex-compact 755717602 623110138 1.21
tpch_q07/datafusion:vortex-compact 1131682316 1098059722 1.03
tpch_q08/datafusion:vortex-compact 1263590234 1174062647 1.08
tpch_q09/datafusion:vortex-compact 1328441342 1280332000 1.04
tpch_q10/datafusion:vortex-compact 🚨 1397367545 896924062 1.56
tpch_q11/datafusion:vortex-compact 460160322 435412666 1.06
tpch_q12/datafusion:vortex-compact 945259200 845091402 1.12
tpch_q13/datafusion:vortex-compact 536514911 424168786 1.26
tpch_q14/datafusion:vortex-compact 789803613 725647681 1.09
tpch_q15/datafusion:vortex-compact 1205917874 1143200249 1.05
tpch_q16/datafusion:vortex-compact 345554962 397598932 0.87
tpch_q17/datafusion:vortex-compact 1226396837 1285237468 0.95
tpch_q18/datafusion:vortex-compact 1203949495 1287277496 0.94
tpch_q19/datafusion:vortex-compact 702556411 792261211 0.89
tpch_q20/datafusion:vortex-compact 966193696 934028316 1.03
tpch_q21/datafusion:vortex-compact 1540276364 1494814029 1.03
tpch_q22/datafusion:vortex-compact 435676797 495271627 0.88
datafusion / parquet (1.120x ➖, 0↑ 5↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 929255157 858700841 1.08
tpch_q02/datafusion:parquet 🚨 984127398 742213701 1.33
tpch_q03/datafusion:parquet 🚨 1498309767 1025101700 1.46
tpch_q04/datafusion:parquet 577545145 483549335 1.19
tpch_q05/datafusion:parquet 🚨 1605869368 1186447535 1.35
tpch_q06/datafusion:parquet 🚨 686080644 522153064 1.31
tpch_q07/datafusion:parquet 🚨 2136288061 1385757224 1.54
tpch_q08/datafusion:parquet 1964608981 1705503075 1.15
tpch_q09/datafusion:parquet 2132495993 1891378959 1.13
tpch_q10/datafusion:parquet 2218397575 2137184438 1.04
tpch_q11/datafusion:parquet 754082302 772924185 0.98
tpch_q12/datafusion:parquet 852573857 881633566 0.97
tpch_q13/datafusion:parquet 726059450 783625133 0.93
tpch_q14/datafusion:parquet 844084079 822906560 1.03
tpch_q15/datafusion:parquet 1152742477 1164038033 0.99
tpch_q16/datafusion:parquet 387579980 427253975 0.91
tpch_q17/datafusion:parquet 1474513449 1429994515 1.03
tpch_q18/datafusion:parquet 1789853815 1671776790 1.07
tpch_q19/datafusion:parquet 1027292883 917579590 1.12
tpch_q20/datafusion:parquet 1259782460 1106885728 1.14
tpch_q21/datafusion:parquet 1790711880 1776820369 1.01
tpch_q22/datafusion:parquet 744152590 652651347 1.14
duckdb / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 592478366 625939910 0.95
tpch_q02/duckdb:vortex-file-compressed 1309265389 1231528885 1.06
tpch_q03/duckdb:vortex-file-compressed 891549456 948122162 0.94
tpch_q04/duckdb:vortex-file-compressed 608262055 615116045 0.99
tpch_q05/duckdb:vortex-file-compressed 1178770346 1198941767 0.98
tpch_q06/duckdb:vortex-file-compressed 814871646 797640022 1.02
tpch_q07/duckdb:vortex-file-compressed 1292880132 1132100269 1.14
tpch_q08/duckdb:vortex-file-compressed 1583505130 1442568358 1.10
tpch_q09/duckdb:vortex-file-compressed 1442649125 1509635003 0.96
tpch_q10/duckdb:vortex-file-compressed 1358083399 1351685515 1.00
tpch_q11/duckdb:vortex-file-compressed 620068296 651376161 0.95
tpch_q12/duckdb:vortex-file-compressed 751894735 662060489 1.14
tpch_q13/duckdb:vortex-file-compressed 852046929 1172469976 0.73
tpch_q14/duckdb:vortex-file-compressed 892993818 846194551 1.06
tpch_q15/duckdb:vortex-file-compressed 520481615 561622048 0.93
tpch_q16/duckdb:vortex-file-compressed 460290373 473528221 0.97
tpch_q17/duckdb:vortex-file-compressed 956237314 1058059302 0.90
tpch_q18/duckdb:vortex-file-compressed 908832017 935833130 0.97
tpch_q19/duckdb:vortex-file-compressed 805865706 800436498 1.01
tpch_q20/duckdb:vortex-file-compressed 1259539113 1140184477 1.10
tpch_q21/duckdb:vortex-file-compressed 1957661383 1873477607 1.04
tpch_q22/duckdb:vortex-file-compressed 662642335 587187034 1.13
duckdb / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 650335852 623272995 1.04
tpch_q02/duckdb:vortex-compact 1095534468 1117369197 0.98
tpch_q03/duckdb:vortex-compact 914955530 803903979 1.14
tpch_q04/duckdb:vortex-compact 536411878 646420916 0.83
tpch_q05/duckdb:vortex-compact 995407956 1069447575 0.93
tpch_q06/duckdb:vortex-compact 739776640 686731891 1.08
tpch_q07/duckdb:vortex-compact 1140212673 898664380 1.27
tpch_q08/duckdb:vortex-compact 1321552722 1413295468 0.94
tpch_q09/duckdb:vortex-compact 1350236659 1430538453 0.94
tpch_q10/duckdb:vortex-compact 1054490250 992021550 1.06
tpch_q11/duckdb:vortex-compact 672518960 718327433 0.94
tpch_q12/duckdb:vortex-compact 760361817 643928834 1.18
tpch_q13/duckdb:vortex-compact 857257514 946350607 0.91
tpch_q14/duckdb:vortex-compact 828311565 880644653 0.94
tpch_q15/duckdb:vortex-compact 570636495 546613924 1.04
tpch_q16/duckdb:vortex-compact 384912794 490184927 0.79
tpch_q17/duckdb:vortex-compact 950757925 857943613 1.11
tpch_q18/duckdb:vortex-compact 794001257 703712839 1.13
tpch_q19/duckdb:vortex-compact 853711153 767887846 1.11
tpch_q20/duckdb:vortex-compact 1104956472 1433590872 0.77
tpch_q21/duckdb:vortex-compact 1656818823 1629225662 1.02
tpch_q22/duckdb:vortex-compact 598668809 729277430 0.82
duckdb / parquet (1.026x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1100045936 874952199 1.26
tpch_q02/duckdb:parquet 1641815219 1568975315 1.05
tpch_q03/duckdb:parquet 1774484075 1690390006 1.05
tpch_q04/duckdb:parquet 999805523 1020056410 0.98
tpch_q05/duckdb:parquet 2094305115 2103650307 1.00
tpch_q06/duckdb:parquet 737740375 656560198 1.12
tpch_q07/duckdb:parquet 1622324915 2020814547 0.80
tpch_q08/duckdb:parquet 2306423764 2430955087 0.95
tpch_q09/duckdb:parquet 2466704396 2106512650 1.17
tpch_q10/duckdb:parquet 3210429012 3265317209 0.98
tpch_q11/duckdb:parquet 972935277 885910203 1.10
tpch_q12/duckdb:parquet 1088912518 878333522 1.24
tpch_q13/duckdb:parquet 1142503629 1123582868 1.02
tpch_q14/duckdb:parquet 1150344629 1204790561 0.95
tpch_q15/duckdb:parquet 885370035 1001962834 0.88
tpch_q16/duckdb:parquet 877483011 785918035 1.12
tpch_q17/duckdb:parquet 1243263823 1203299135 1.03
tpch_q18/duckdb:parquet 1430986148 1645302945 0.87
tpch_q19/duckdb:parquet 1640301262 1522557882 1.08
tpch_q20/duckdb:parquet 1881129262 1692583953 1.11
tpch_q21/duckdb:parquet 1799911753 1957148738 0.92
tpch_q22/duckdb:parquet 1012723556 990363137 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +6.7% +16.6% -8.5% +79.5% ➖ noise
1 datafusion:vortex-file-compressed +3.0% +16.6% -11.7% +75.4% ➖ noise
1 duckdb:vortex-compact +4.3% +16.6% -10.5% +34.0% ➖ noise
1 duckdb:vortex-file-compressed -5.3% +16.6% -18.9% +34.6% ➖ noise
2 datafusion:vortex-compact +2.8% +17.8% -12.7% +63.7% ➖ noise
2 datafusion:vortex-file-compressed +13.0% +17.8% -4.1% +57.2% ➖ noise
2 duckdb:vortex-compact -2.0% +17.8% -16.8% +42.1% ➖ noise
2 duckdb:vortex-file-compressed +6.3% +17.8% -9.7% +36.3% ➖ noise
3 datafusion:vortex-compact +3.6% +23.9% -16.3% +83.7% ➖ noise
3 datafusion:vortex-file-compressed +12.5% +23.9% -9.2% +82.9% ➖ noise
3 duckdb:vortex-compact +13.8% +23.9% -8.1% +52.7% ➖ noise
3 duckdb:vortex-file-compressed -6.0% +23.9% -24.1% +53.1% ➖ noise
4 datafusion:vortex-compact -3.9% +8.2% -11.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.1% +8.2% -6.5% +30.0% ➖ noise
4 duckdb:vortex-compact -17.0% +8.2% -23.3% +30.0% ✅ faster
4 duckdb:vortex-file-compressed -1.1% +8.2% -8.6% +30.0% ➖ noise
5 datafusion:vortex-compact +6.0% +16.1% -8.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +11.5% +16.1% -3.9% +30.0% ➖ noise
5 duckdb:vortex-compact -6.9% +16.1% -19.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -1.7% +16.1% -15.3% +30.0% ➖ noise
6 datafusion:vortex-compact +21.3% +21.5% -0.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -2.6% +21.5% -19.9% +30.0% ➖ noise
6 duckdb:vortex-compact +7.7% +21.5% -11.3% +43.7% ➖ noise
6 duckdb:vortex-file-compressed +2.2% +21.5% -15.9% +30.0% ➖ noise
7 datafusion:vortex-compact +3.1% +11.2% -7.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -7.5% +11.2% -16.8% +30.0% ➖ noise
7 duckdb:vortex-compact +26.9% +11.2% +14.1% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +14.2% +11.2% +2.7% +30.0% ➖ noise
8 datafusion:vortex-compact +7.6% +4.5% +2.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -2.3% +4.5% -6.5% +30.0% ➖ noise
8 duckdb:vortex-compact -6.5% +4.5% -10.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +9.8% +4.5% +5.0% +30.0% ➖ noise
9 datafusion:vortex-compact +3.8% +14.9% -9.7% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +2.8% +14.9% -10.6% +30.0% ➖ noise
9 duckdb:vortex-compact -5.6% +14.9% -17.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -4.4% +14.9% -16.8% +30.0% ➖ noise
10 datafusion:vortex-compact +55.8% +1.0% +54.2% +46.9% 🚨 regression
10 datafusion:vortex-file-compressed +1.7% +1.0% +0.7% +32.2% ➖ noise
10 duckdb:vortex-compact +6.3% +1.0% +5.2% +43.6% ➖ noise
10 duckdb:vortex-file-compressed +0.5% +1.0% -0.5% +35.4% ➖ noise
11 datafusion:vortex-compact +5.7% +3.5% +2.1% +32.8% ➖ noise
11 datafusion:vortex-file-compressed +7.9% +3.5% +4.2% +37.0% ➖ noise
11 duckdb:vortex-compact -6.4% +3.5% -9.6% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -4.8% +3.5% -8.0% +30.0% ➖ noise
12 datafusion:vortex-compact +11.9% +9.5% +2.2% +52.3% ➖ noise
12 datafusion:vortex-file-compressed -1.5% +9.5% -10.0% +36.3% ➖ noise
12 duckdb:vortex-compact +18.1% +9.5% +7.8% +42.4% ➖ noise
12 duckdb:vortex-file-compressed +13.6% +9.5% +3.7% +39.3% ➖ noise
13 datafusion:vortex-compact +26.5% -2.9% +30.3% +54.0% ➖ noise
13 datafusion:vortex-file-compressed +5.3% -2.9% +8.5% +30.0% ➖ noise
13 duckdb:vortex-compact -9.4% -2.9% -6.7% +79.3% ➖ noise
13 duckdb:vortex-file-compressed -27.3% -2.9% -25.1% +65.5% ➖ noise
14 datafusion:vortex-compact +8.8% -1.0% +10.0% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -1.4% -1.0% -0.3% +30.0% ➖ noise
14 duckdb:vortex-compact -5.9% -1.0% -5.0% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +5.5% -1.0% +6.6% +30.0% ➖ noise
15 datafusion:vortex-compact +5.5% -6.5% +12.8% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +3.4% -6.5% +10.5% +30.0% ➖ noise
15 duckdb:vortex-compact +4.4% -6.5% +11.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -7.3% -6.5% -0.9% +30.0% ➖ noise
16 datafusion:vortex-compact -13.1% +0.6% -13.6% +46.5% ➖ noise
16 datafusion:vortex-file-compressed +41.4% +0.6% +40.5% +42.1% ➖ noise
16 duckdb:vortex-compact -21.5% +0.6% -22.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -2.8% +0.6% -3.4% +30.0% ➖ noise
17 datafusion:vortex-compact -4.6% +3.2% -7.6% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +1.8% +3.2% -1.4% +30.0% ➖ noise
17 duckdb:vortex-compact +10.8% +3.2% +7.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -9.6% +3.2% -12.4% +30.0% ➖ noise
18 datafusion:vortex-compact -6.5% -3.5% -3.1% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -13.7% -3.5% -10.6% +30.0% ➖ noise
18 duckdb:vortex-compact +12.8% -3.5% +16.9% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -2.9% -3.5% +0.6% +30.0% ➖ noise
19 datafusion:vortex-compact -11.3% +9.8% -19.3% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +9.5% +9.8% -0.3% +30.0% ➖ noise
19 duckdb:vortex-compact +11.2% +9.8% +1.2% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +0.7% +9.8% -8.3% +30.0% ➖ noise
20 datafusion:vortex-compact +3.4% +12.5% -8.0% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +11.3% +12.5% -1.0% +30.0% ➖ noise
20 duckdb:vortex-compact -22.9% +12.5% -31.5% +30.0% ✅ faster
20 duckdb:vortex-file-compressed +10.5% +12.5% -1.8% +30.0% ➖ noise
21 datafusion:vortex-compact +3.0% -3.7% +7.0% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +9.4% -3.7% +13.6% +30.0% ➖ noise
21 duckdb:vortex-compact +1.7% -3.7% +5.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +4.5% -3.7% +8.5% +30.0% ➖ noise
22 datafusion:vortex-compact -12.0% +8.0% -18.5% +43.8% ➖ noise
22 datafusion:vortex-file-compressed +28.7% +8.0% +19.2% +30.0% ➖ noise
22 duckdb:vortex-compact -17.9% +8.0% -24.0% +30.0% ✅ faster
22 duckdb:vortex-file-compressed +12.9% +8.0% +4.5% +30.0% ➖ noise

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: Clickbench on NVME

Summary

  • Overall: 0.991x ➖
  • Vortex: 1.010x ➖
  • Parquet: 0.979x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +2.1%
  • Confidence: low
  • Environment shift: -2.1%

Statistical Summary

  • Systemic shift (parquet controls): -2.1%
  • Control sigma: +2.0%
  • Residual noise: +2.3%
  • Median polish overall: -1.6%
datafusion / vortex-file-compressed (0.976x ➖, 1↑ 1↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1684441 1680514 1.00
clickbench_q01/datafusion:vortex-file-compressed 14414412 13818806 1.04
clickbench_q02/datafusion:vortex-file-compressed 33340011 33124852 1.01
clickbench_q03/datafusion:vortex-file-compressed 34874629 37228165 0.94
clickbench_q04/datafusion:vortex-file-compressed 322789450 329970727 0.98
clickbench_q05/datafusion:vortex-file-compressed 322665425 329130392 0.98
clickbench_q06/datafusion:vortex-file-compressed 🚀 1673161 1921542 0.87
clickbench_q07/datafusion:vortex-file-compressed 18992570 19120237 0.99
clickbench_q08/datafusion:vortex-file-compressed 393193781 398803357 0.99
clickbench_q09/datafusion:vortex-file-compressed 550505986 593448615 0.93
clickbench_q10/datafusion:vortex-file-compressed 71106401 73657895 0.97
clickbench_q11/datafusion:vortex-file-compressed 81592678 81299217 1.00
clickbench_q12/datafusion:vortex-file-compressed 278654723 279407776 1.00
clickbench_q13/datafusion:vortex-file-compressed 415612781 422141806 0.98
clickbench_q14/datafusion:vortex-file-compressed 254848913 258626389 0.99
clickbench_q15/datafusion:vortex-file-compressed 375713238 381268917 0.99
clickbench_q16/datafusion:vortex-file-compressed 735512529 737857852 1.00
clickbench_q17/datafusion:vortex-file-compressed 717318772 739170516 0.97
clickbench_q18/datafusion:vortex-file-compressed 1505531814 1475179513 1.02
clickbench_q19/datafusion:vortex-file-compressed 24621825 23896679 1.03
clickbench_q20/datafusion:vortex-file-compressed 329197530 346062981 0.95
clickbench_q21/datafusion:vortex-file-compressed 386728920 396425016 0.98
clickbench_q22/datafusion:vortex-file-compressed 537097237 562582086 0.95
clickbench_q23/datafusion:vortex-file-compressed 671504446 704683813 0.95
clickbench_q24/datafusion:vortex-file-compressed 50101178 45851221 1.09
clickbench_q25/datafusion:vortex-file-compressed 69389481 69831790 0.99
clickbench_q26/datafusion:vortex-file-compressed 🚨 52923630 46629710 1.13
clickbench_q27/datafusion:vortex-file-compressed 789349171 815467422 0.97
clickbench_q28/datafusion:vortex-file-compressed 6831505342 6958607620 0.98
clickbench_q29/datafusion:vortex-file-compressed 232356936 249277079 0.93
clickbench_q30/datafusion:vortex-file-compressed 253795114 254893532 1.00
clickbench_q31/datafusion:vortex-file-compressed 292998230 304927765 0.96
clickbench_q32/datafusion:vortex-file-compressed 1398017706 1459432676 0.96
clickbench_q33/datafusion:vortex-file-compressed 1415092701 1489361461 0.95
clickbench_q34/datafusion:vortex-file-compressed 1401912960 1501992859 0.93
clickbench_q35/datafusion:vortex-file-compressed 527522500 547283300 0.96
clickbench_q36/datafusion:vortex-file-compressed 78619064 82391530 0.95
clickbench_q37/datafusion:vortex-file-compressed 37633566 39539165 0.95
clickbench_q38/datafusion:vortex-file-compressed 24352624 24916769 0.98
clickbench_q39/datafusion:vortex-file-compressed 151840827 158860943 0.96
clickbench_q40/datafusion:vortex-file-compressed 20009909 21325066 0.94
clickbench_q41/datafusion:vortex-file-compressed 18671502 19825664 0.94
clickbench_q42/datafusion:vortex-file-compressed 21917186 23249623 0.94
datafusion / parquet (0.965x ➖, 2↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1699048 1985870 0.86
clickbench_q01/datafusion:parquet 22150482 22137879 1.00
clickbench_q02/datafusion:parquet 49894684 48401971 1.03
clickbench_q03/datafusion:parquet 40774097 41056451 0.99
clickbench_q04/datafusion:parquet 337220820 362952558 0.93
clickbench_q05/datafusion:parquet 374325174 392270209 0.95
clickbench_q06/datafusion:parquet 1588437 1646939 0.96
clickbench_q07/datafusion:parquet 25904197 28469464 0.91
clickbench_q08/datafusion:parquet 412024394 438678290 0.94
clickbench_q09/datafusion:parquet 🚀 643141776 722468376 0.89
clickbench_q10/datafusion:parquet 117834189 123400754 0.95
clickbench_q11/datafusion:parquet 145350976 150503373 0.97
clickbench_q12/datafusion:parquet 363625054 388519852 0.94
clickbench_q13/datafusion:parquet 516646160 536482537 0.96
clickbench_q14/datafusion:parquet 366487136 386185009 0.95
clickbench_q15/datafusion:parquet 394878499 415315764 0.95
clickbench_q16/datafusion:parquet 747057976 759753304 0.98
clickbench_q17/datafusion:parquet 725712464 756915957 0.96
clickbench_q18/datafusion:parquet 1467938440 1587167433 0.92
clickbench_q19/datafusion:parquet 33125235 34379220 0.96
clickbench_q20/datafusion:parquet 609505982 632669989 0.96
clickbench_q21/datafusion:parquet 681626937 699895048 0.97
clickbench_q22/datafusion:parquet 984239969 1015827842 0.97
clickbench_q23/datafusion:parquet 3720052274 3883241307 0.96
clickbench_q24/datafusion:parquet 91725169 99474179 0.92
clickbench_q25/datafusion:parquet 150886673 151590971 1.00
clickbench_q26/datafusion:parquet 98037841 96336728 1.02
clickbench_q27/datafusion:parquet 1049578177 1093174456 0.96
clickbench_q28/datafusion:parquet 6390737692 6525598727 0.98
clickbench_q29/datafusion:parquet 236795015 238620926 0.99
clickbench_q30/datafusion:parquet 380651689 381090068 1.00
clickbench_q31/datafusion:parquet 411510610 414465779 0.99
clickbench_q32/datafusion:parquet 1358615720 1321106278 1.03
clickbench_q33/datafusion:parquet 1577375758 1579857103 1.00
clickbench_q34/datafusion:parquet 1558971372 1569165117 0.99
clickbench_q35/datafusion:parquet 548193485 564550202 0.97
clickbench_q36/datafusion:parquet 141249570 148978588 0.95
clickbench_q37/datafusion:parquet 59559132 58749066 1.01
clickbench_q38/datafusion:parquet 91504761 96872033 0.94
clickbench_q39/datafusion:parquet 286611305 293935151 0.98
clickbench_q40/datafusion:parquet 35453963 37537172 0.94
clickbench_q41/datafusion:parquet 30931502 31418740 0.98
clickbench_q42/datafusion:parquet 33672359 34423118 0.98
duckdb / vortex-file-compressed (1.045x ➖, 1↑ 10↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5782591 6382289 0.91
clickbench_q01/duckdb:vortex-file-compressed 14381105 14830036 0.97
clickbench_q02/duckdb:vortex-file-compressed 23440770 23363415 1.00
clickbench_q03/duckdb:vortex-file-compressed 30197989 31119082 0.97
clickbench_q04/duckdb:vortex-file-compressed 170021209 180549796 0.94
clickbench_q05/duckdb:vortex-file-compressed 196197402 205287121 0.96
clickbench_q06/duckdb:vortex-file-compressed 19584071 18971194 1.03
clickbench_q07/duckdb:vortex-file-compressed 17915828 18355137 0.98
clickbench_q08/duckdb:vortex-file-compressed 262380319 268839494 0.98
clickbench_q09/duckdb:vortex-file-compressed 374203137 392221883 0.95
clickbench_q10/duckdb:vortex-file-compressed 74048415 74032091 1.00
clickbench_q11/duckdb:vortex-file-compressed 82937380 82452179 1.01
clickbench_q12/duckdb:vortex-file-compressed 212449739 224604293 0.95
clickbench_q13/duckdb:vortex-file-compressed 427163750 451968037 0.95
clickbench_q14/duckdb:vortex-file-compressed 244820202 245534892 1.00
clickbench_q15/duckdb:vortex-file-compressed 211363700 214202115 0.99
clickbench_q16/duckdb:vortex-file-compressed 🚀 645588970 720215897 0.90
clickbench_q17/duckdb:vortex-file-compressed 545297171 561847870 0.97
clickbench_q18/duckdb:vortex-file-compressed 1277315974 1264761186 1.01
clickbench_q19/duckdb:vortex-file-compressed 21157631 21339635 0.99
clickbench_q20/duckdb:vortex-file-compressed 365474027 369819941 0.99
clickbench_q21/duckdb:vortex-file-compressed 388905037 390562869 1.00
clickbench_q22/duckdb:vortex-file-compressed 🚨 688974870 582816795 1.18
clickbench_q23/duckdb:vortex-file-compressed 🚨 1713603340 883617193 1.94
clickbench_q24/duckdb:vortex-file-compressed 46506968 47211919 0.99
clickbench_q25/duckdb:vortex-file-compressed 69993045 75142585 0.93
clickbench_q26/duckdb:vortex-file-compressed 🚨 49941940 44889124 1.11
clickbench_q27/duckdb:vortex-file-compressed 523542158 520093151 1.01
clickbench_q28/duckdb:vortex-file-compressed 2982228244 2995477570 1.00
clickbench_q29/duckdb:vortex-file-compressed 28259413 28351346 1.00
clickbench_q30/duckdb:vortex-file-compressed 189506699 196434908 0.96
clickbench_q31/duckdb:vortex-file-compressed 269366150 271801997 0.99
clickbench_q32/duckdb:vortex-file-compressed 1281505183 1373098462 0.93
clickbench_q33/duckdb:vortex-file-compressed 🚨 1582552620 1420304411 1.11
clickbench_q34/duckdb:vortex-file-compressed 1688058508 1544264758 1.09
clickbench_q35/duckdb:vortex-file-compressed 366128463 370625961 0.99
clickbench_q36/duckdb:vortex-file-compressed 🚨 34707003 27991412 1.24
clickbench_q37/duckdb:vortex-file-compressed 🚨 26763991 18419649 1.45
clickbench_q38/duckdb:vortex-file-compressed 🚨 27177283 21517684 1.26
clickbench_q39/duckdb:vortex-file-compressed 47852823 43503248 1.10
clickbench_q40/duckdb:vortex-file-compressed 🚨 24384610 20459210 1.19
clickbench_q41/duckdb:vortex-file-compressed 🚨 24452676 19801227 1.23
clickbench_q42/duckdb:vortex-file-compressed 🚨 27594810 21414526 1.29
duckdb / parquet (0.993x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 223516913 224061345 1.00
clickbench_q01/duckdb:parquet 50362591 50805745 0.99
clickbench_q02/duckdb:parquet 67186482 67085541 1.00
clickbench_q03/duckdb:parquet 64561424 64890420 0.99
clickbench_q04/duckdb:parquet 204866175 207508531 0.99
clickbench_q05/duckdb:parquet 282986451 283695184 1.00
clickbench_q06/duckdb:parquet 61219748 60537645 1.01
clickbench_q07/duckdb:parquet 53843855 52375363 1.03
clickbench_q08/duckdb:parquet 267642132 273234160 0.98
clickbench_q09/duckdb:parquet 398842701 401718674 0.99
clickbench_q10/duckdb:parquet 96901993 96475058 1.00
clickbench_q11/duckdb:parquet 108207897 108985943 0.99
clickbench_q12/duckdb:parquet 298420669 302330716 0.99
clickbench_q13/duckdb:parquet 513325976 521964341 0.98
clickbench_q14/duckdb:parquet 329897017 337037976 0.98
clickbench_q15/duckdb:parquet 241998353 242383668 1.00
clickbench_q16/duckdb:parquet 608784183 620030902 0.98
clickbench_q17/duckdb:parquet 513104062 509666788 1.01
clickbench_q18/duckdb:parquet 1052154595 1063394001 0.99
clickbench_q19/duckdb:parquet 49587611 50445788 0.98
clickbench_q20/duckdb:parquet 433500465 435628656 1.00
clickbench_q21/duckdb:parquet 556182624 559432777 0.99
clickbench_q22/duckdb:parquet 922789724 934688539 0.99
clickbench_q23/duckdb:parquet 330026190 319402742 1.03
clickbench_q24/duckdb:parquet 75744483 79142556 0.96
clickbench_q25/duckdb:parquet 140190421 140761625 1.00
clickbench_q26/duckdb:parquet 52339921 52229200 1.00
clickbench_q27/duckdb:parquet 647063857 644423172 1.00
clickbench_q28/duckdb:parquet 4848499156 4848673740 1.00
clickbench_q29/duckdb:parquet 60498193 62022222 0.98
clickbench_q30/duckdb:parquet 307803087 306292236 1.00
clickbench_q31/duckdb:parquet 350189100 350306238 1.00
clickbench_q32/duckdb:parquet 1174980192 1197513049 0.98
clickbench_q33/duckdb:parquet 1215649003 1264420322 0.96
clickbench_q34/duckdb:parquet 1299048841 1304362502 1.00
clickbench_q35/duckdb:parquet 352257571 355031905 0.99
clickbench_q36/duckdb:parquet 64345796 64356076 1.00
clickbench_q37/duckdb:parquet 54456027 55103656 0.99
clickbench_q38/duckdb:parquet 56392918 58663437 0.96
clickbench_q39/duckdb:parquet 97678610 98337967 0.99
clickbench_q40/duckdb:parquet 55331707 55119099 1.00
clickbench_q41/duckdb:parquet 59206939 60201091 0.98
clickbench_q42/duckdb:parquet 52547690 53277587 0.99
duckdb / duckdb (0.979x ➖, 1↑ 1↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17947720 18788928 0.96
clickbench_q01/duckdb:duckdb 33208030 34631592 0.96
clickbench_q02/duckdb:duckdb 46705869 47356916 0.99
clickbench_q03/duckdb:duckdb 47691133 47969358 0.99
clickbench_q04/duckdb:duckdb 209270821 219348188 0.95
clickbench_q05/duckdb:duckdb 314830797 320111120 0.98
clickbench_q06/duckdb:duckdb 34924436 36825630 0.95
clickbench_q07/duckdb:duckdb 35879412 36595142 0.98
clickbench_q08/duckdb:duckdb 301415695 317117853 0.95
clickbench_q09/duckdb:duckdb 473468751 474194644 1.00
clickbench_q10/duckdb:duckdb 98971013 100435223 0.99
clickbench_q11/duckdb:duckdb 109061977 108537256 1.00
clickbench_q12/duckdb:duckdb 301287450 297240895 1.01
clickbench_q13/duckdb:duckdb 534988781 537201819 1.00
clickbench_q14/duckdb:duckdb 329371934 342091253 0.96
clickbench_q15/duckdb:duckdb 264104878 255627633 1.03
clickbench_q16/duckdb:duckdb 662338599 685258069 0.97
clickbench_q17/duckdb:duckdb 592742704 588131719 1.01
clickbench_q18/duckdb:duckdb 1238783693 1277141841 0.97
clickbench_q19/duckdb:duckdb 34915645 36817341 0.95
clickbench_q20/duckdb:duckdb 916739884 964449358 0.95
clickbench_q21/duckdb:duckdb 950096445 1036038826 0.92
clickbench_q22/duckdb:duckdb 1035784082 1054564945 0.98
clickbench_q23/duckdb:duckdb 258634883 255672378 1.01
clickbench_q24/duckdb:duckdb 60652640 62894674 0.96
clickbench_q25/duckdb:duckdb 120450200 126158117 0.95
clickbench_q26/duckdb:duckdb 52397276 52362949 1.00
clickbench_q27/duckdb:duckdb 🚀 907340211 1129458303 0.80
clickbench_q28/duckdb:duckdb 4612454102 4615797535 1.00
clickbench_q29/duckdb:duckdb 49256894 49945912 0.99
clickbench_q30/duckdb:duckdb 289991917 281700858 1.03
clickbench_q31/duckdb:duckdb 🚨 445927405 394511539 1.13
clickbench_q32/duckdb:duckdb 1503801846 1406152709 1.07
clickbench_q33/duckdb:duckdb 1933773069 2060664740 0.94
clickbench_q34/duckdb:duckdb 2086208924 2140283941 0.97
clickbench_q35/duckdb:duckdb 264141896 266674644 0.99
clickbench_q36/duckdb:duckdb 41894282 41810793 1.00
clickbench_q37/duckdb:duckdb 31556546 32648806 0.97
clickbench_q38/duckdb:duckdb 30991508 32530094 0.95
clickbench_q39/duckdb:duckdb 65797905 63855121 1.03
clickbench_q40/duckdb:duckdb 31232646 33120142 0.94
clickbench_q41/duckdb:duckdb 30865263 31638875 0.98
clickbench_q42/duckdb:duckdb 31248954 32776673 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +0.2% -7.6% +8.5% +703.9% ➖ noise
0 duckdb:duckdb -4.5% -7.6% +3.4% +302.8% ➖ noise
0 duckdb:vortex-file-compressed -9.4% -7.6% -1.9% +351.0% ➖ noise
1 datafusion:vortex-file-compressed +4.3% -0.4% +4.7% +27.9% ➖ noise
1 duckdb:duckdb -4.1% -0.4% -3.7% +58.6% ➖ noise
1 duckdb:vortex-file-compressed -3.0% -0.4% -2.6% +14.2% ➖ noise
2 datafusion:vortex-file-compressed +0.6% +1.6% -0.9% +37.5% ➖ noise
2 duckdb:duckdb -1.4% +1.6% -2.9% +22.0% ➖ noise
2 duckdb:vortex-file-compressed +0.3% +1.6% -1.3% +16.9% ➖ noise
3 datafusion:vortex-file-compressed -6.3% -0.6% -5.8% +184.8% ➖ noise
3 duckdb:duckdb -0.6% -0.6% +0.0% +55.9% ➖ noise
3 duckdb:vortex-file-compressed -3.0% -0.6% -2.4% +32.4% ➖ noise
4 datafusion:vortex-file-compressed -2.2% -4.2% +2.1% +10.0% ➖ noise
4 duckdb:duckdb -4.6% -4.2% -0.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.8% -4.2% -1.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.0% -2.4% +0.5% +10.0% ➖ noise
5 duckdb:duckdb -1.6% -2.4% +0.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -4.4% -2.4% -2.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -12.9% -1.2% -11.8% +40.9% ➖ noise
6 duckdb:duckdb -5.2% -1.2% -4.0% +27.7% ➖ noise
6 duckdb:vortex-file-compressed +3.2% -1.2% +4.5% +19.5% ➖ noise
7 datafusion:vortex-file-compressed -0.7% -3.3% +2.7% +10.0% ➖ noise
7 duckdb:duckdb -2.0% -3.3% +1.4% +12.0% ➖ noise
7 duckdb:vortex-file-compressed -2.4% -3.3% +0.9% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.4% -4.1% +2.8% +10.0% ➖ noise
8 duckdb:duckdb -5.0% -4.1% -0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.4% -4.1% +1.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -7.2% -6.0% -1.3% +10.0% ➖ noise
9 duckdb:duckdb -0.2% -6.0% +6.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.6% -6.0% +1.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -3.5% -2.1% -1.4% +10.0% ➖ noise
10 duckdb:duckdb -1.5% -2.1% +0.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.0% -2.1% +2.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.4% -2.1% +2.5% +10.0% ➖ noise
11 duckdb:duckdb +0.5% -2.1% +2.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.6% -2.1% +2.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.3% -3.9% +3.8% +10.0% ➖ noise
12 duckdb:duckdb +1.4% -3.9% +5.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -5.4% -3.9% -1.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.5% -2.7% +1.2% +10.0% ➖ noise
13 duckdb:duckdb -0.4% -2.7% +2.3% +10.5% ➖ noise
13 duckdb:vortex-file-compressed -5.5% -2.7% -2.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.5% -3.6% +2.2% +10.0% ➖ noise
14 duckdb:duckdb -3.7% -3.6% -0.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.3% -3.6% +3.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -1.5% -2.6% +1.1% +10.0% ➖ noise
15 duckdb:duckdb +3.3% -2.6% +6.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -1.3% -2.6% +1.3% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.3% -1.7% +1.4% +10.0% ➖ noise
16 duckdb:duckdb -3.3% -1.7% -1.6% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -10.4% -1.7% -8.8% +12.9% ➖ noise
17 datafusion:vortex-file-compressed -3.0% -1.8% -1.2% +10.0% ➖ noise
17 duckdb:duckdb +0.8% -1.8% +2.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -2.9% -1.8% -1.2% +14.0% ➖ noise
18 datafusion:vortex-file-compressed +2.1% -4.3% +6.7% +10.0% ➖ noise
18 duckdb:duckdb -3.0% -4.3% +1.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.0% -4.3% +5.6% +12.9% ➖ noise
19 datafusion:vortex-file-compressed +3.0% -2.7% +5.9% +10.0% ➖ noise
19 duckdb:duckdb -5.2% -2.7% -2.6% +10.7% ➖ noise
19 duckdb:vortex-file-compressed -0.9% -2.7% +1.9% +31.7% ➖ noise
20 datafusion:vortex-file-compressed -4.9% -2.1% -2.8% +202.0% ➖ noise
20 duckdb:duckdb -4.9% -2.1% -2.9% +30.1% ➖ noise
20 duckdb:vortex-file-compressed -1.2% -2.1% +0.9% +12.2% ➖ noise
21 datafusion:vortex-file-compressed -2.4% -1.6% -0.9% +10.0% ➖ noise
21 duckdb:duckdb -8.3% -1.6% -6.8% +13.1% ➖ noise
21 duckdb:vortex-file-compressed -0.4% -1.6% +1.2% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -4.5% -2.2% -2.4% +10.0% ➖ noise
22 duckdb:duckdb -1.8% -2.2% +0.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +18.2% -2.2% +20.9% +11.8% 🚨 regression
23 datafusion:vortex-file-compressed -4.7% -0.5% -4.2% +58.3% ➖ noise
23 duckdb:duckdb +1.2% -0.5% +1.7% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +93.9% -0.5% +94.9% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +9.3% -6.1% +16.3% +22.0% ➖ noise
24 duckdb:duckdb -3.6% -6.1% +2.7% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -1.5% -6.1% +4.9% +34.6% ➖ noise
25 datafusion:vortex-file-compressed -0.6% -0.4% -0.2% +10.0% ➖ noise
25 duckdb:duckdb -4.5% -0.4% -4.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -6.9% -0.4% -6.4% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +13.5% +1.0% +12.4% +16.4% ➖ noise
26 duckdb:duckdb +0.1% +1.0% -0.9% +11.7% ➖ noise
26 duckdb:vortex-file-compressed +11.3% +1.0% +10.2% +17.0% ➖ noise
27 datafusion:vortex-file-compressed -3.2% -1.8% -1.4% +10.0% ➖ noise
27 duckdb:duckdb -19.7% -1.8% -18.2% +11.3% ✅ faster
27 duckdb:vortex-file-compressed +0.7% -1.8% +2.5% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -1.8% -1.0% -0.8% +10.0% ➖ noise
28 duckdb:duckdb -0.1% -1.0% +1.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.4% -1.0% +0.6% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -6.8% -1.6% -5.3% +11.4% ➖ noise
29 duckdb:duckdb -1.4% -1.6% +0.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -0.3% -1.6% +1.3% +24.0% ➖ noise
30 datafusion:vortex-file-compressed -0.4% +0.2% -0.6% +10.0% ➖ noise
30 duckdb:duckdb +2.9% +0.2% +2.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -3.5% +0.2% -3.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -3.9% -0.4% -3.6% +10.0% ➖ noise
31 duckdb:duckdb +13.0% -0.4% +13.5% +10.0% 🚨 regression
31 duckdb:vortex-file-compressed -0.9% -0.4% -0.5% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -4.2% +0.5% -4.6% +14.7% ➖ noise
32 duckdb:duckdb +6.9% +0.5% +6.5% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -6.7% +0.5% -7.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -5.0% -2.0% -3.0% +17.0% ➖ noise
33 duckdb:duckdb -6.2% -2.0% -4.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +11.4% -2.0% +13.7% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed -6.7% -0.5% -6.2% +10.0% ➖ noise
34 duckdb:duckdb -2.5% -0.5% -2.0% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +9.3% -0.5% +9.9% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -3.6% -1.8% -1.8% +10.0% ➖ noise
35 duckdb:duckdb -0.9% -1.8% +0.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -1.2% -1.8% +0.6% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -4.6% -2.6% -2.0% +12.7% ➖ noise
36 duckdb:duckdb +0.2% -2.6% +2.9% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +24.0% -2.6% +27.3% +10.0% 🚨 regression
37 datafusion:vortex-file-compressed -4.8% +0.1% -4.9% +10.0% ➖ noise
37 duckdb:duckdb -3.3% +0.1% -3.4% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +45.3% +0.1% +45.2% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed -2.3% -4.7% +2.6% +10.0% ➖ noise
38 duckdb:duckdb -4.7% -4.7% -0.0% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +26.3% -4.7% +32.5% +10.0% 🚨 regression
39 datafusion:vortex-file-compressed -4.4% -1.6% -2.9% +10.0% ➖ noise
39 duckdb:duckdb +3.0% -1.6% +4.7% +16.4% ➖ noise
39 duckdb:vortex-file-compressed +10.0% -1.6% +11.8% +10.0% 🚨 regression
40 datafusion:vortex-file-compressed -6.2% -2.6% -3.6% +11.1% ➖ noise
40 duckdb:duckdb -5.7% -2.6% -3.2% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +19.2% -2.6% +22.4% +11.2% 🚨 regression
41 datafusion:vortex-file-compressed -5.8% -1.6% -4.3% +10.0% ➖ noise
41 duckdb:duckdb -2.4% -1.6% -0.9% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +23.5% -1.6% +25.5% +13.2% 🚨 regression
42 datafusion:vortex-file-compressed -5.7% -1.8% -4.0% +11.2% ➖ noise
42 duckdb:duckdb -4.7% -1.8% -2.9% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +28.9% -1.8% +31.2% +14.0% 🚨 regression

@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: Statistical and Population Genetics

Summary

  • Overall: 1.002x ➖
  • Vortex: 1.005x ➖
  • Parquet: 0.996x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +0.9%
  • Confidence: low
  • Environment shift: -0.4%

Statistical Summary

  • Systemic shift (parquet controls): -0.4%
  • Control sigma: +1.1%
  • Residual noise: +0.4%
  • Median polish overall: +0.1%
duckdb / vortex-file-compressed (0.968x ➖, 1↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10859987 11049918 0.98
statpopgen_q01/duckdb:vortex-file-compressed 🚀 18698983 26930255 0.69
statpopgen_q02/duckdb:vortex-file-compressed 1286230238 1283097705 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3061722595 3093859723 0.99
statpopgen_q04/duckdb:vortex-file-compressed 3118153339 3114906050 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1378205756 1398209894 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2066963946 2061354178 1.00
statpopgen_q07/duckdb:vortex-file-compressed 195479129 194739943 1.00
statpopgen_q08/duckdb:vortex-file-compressed 211780997 206971794 1.02
statpopgen_q09/duckdb:vortex-file-compressed 2882360070 2824228770 1.02
statpopgen_q10/duckdb:vortex-file-compressed 4601463924 4597207414 1.00
duckdb / vortex-compact (1.043x ➖, 0↑ 1↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10772689 10655670 1.01
statpopgen_q01/duckdb:vortex-compact 🚨 168495081 114314168 1.47
statpopgen_q02/duckdb:vortex-compact 1827334104 1810784224 1.01
statpopgen_q03/duckdb:vortex-compact 3480725837 3436751804 1.01
statpopgen_q04/duckdb:vortex-compact 3548188031 3507018185 1.01
statpopgen_q05/duckdb:vortex-compact 1836398645 1801977367 1.02
statpopgen_q06/duckdb:vortex-compact 2670842596 2652168643 1.01
statpopgen_q07/duckdb:vortex-compact 961642829 966016219 1.00
statpopgen_q08/duckdb:vortex-compact 995342157 999882949 1.00
statpopgen_q09/duckdb:vortex-compact 3348968812 3330737271 1.01
statpopgen_q10/duckdb:vortex-compact 5392578586 5372739847 1.00
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 22ebbbe (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 306505218 312590429 0.98
statpopgen_q01/duckdb:parquet 394238711 389260711 1.01
statpopgen_q02/duckdb:parquet 970219964 975134280 0.99
statpopgen_q03/duckdb:parquet 1478990511 1504873968 0.98
statpopgen_q04/duckdb:parquet 1491728316 1505596579 0.99
statpopgen_q05/duckdb:parquet 1000462254 1000863893 1.00
statpopgen_q06/duckdb:parquet 1473313236 1477771139 1.00
statpopgen_q07/duckdb:parquet 1863249370 1856927446 1.00
statpopgen_q08/duckdb:parquet 1860727515 1883444929 0.99
statpopgen_q09/duckdb:parquet 1343928840 1356498229 0.99
statpopgen_q10/duckdb:parquet 2668438889 2637896609 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +1.1% -1.9% +3.1% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -1.7% -1.9% +0.2% +10.0% ➖ noise
1 duckdb:vortex-compact +47.4% +1.3% +45.5% +46.3% ➖ noise
1 duckdb:vortex-file-compressed -30.6% +1.3% -31.4% +229.4% ➖ noise
2 duckdb:vortex-compact +0.9% -0.5% +1.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.2% -0.5% +0.8% +10.0% ➖ noise
3 duckdb:vortex-compact +1.3% -1.7% +3.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.0% -1.7% +0.7% +10.0% ➖ noise
4 duckdb:vortex-compact +1.2% -0.9% +2.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.1% -0.9% +1.0% +10.0% ➖ noise
5 duckdb:vortex-compact +1.9% -0.0% +2.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.4% -0.0% -1.4% +10.0% ➖ noise
6 duckdb:vortex-compact +0.7% -0.3% +1.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.3% -0.3% +0.6% +10.0% ➖ noise
7 duckdb:vortex-compact -0.5% +0.3% -0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.4% +0.3% +0.0% +10.0% ➖ noise
8 duckdb:vortex-compact -0.5% -1.2% +0.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.3% -1.2% +3.6% +10.0% ➖ noise
9 duckdb:vortex-compact +0.5% -0.9% +1.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.1% -0.9% +3.0% +10.0% ➖ noise
10 duckdb:vortex-compact +0.4% +1.2% -0.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.1% +1.2% -1.1% +10.0% ➖ noise

@joseph-isaacs joseph-isaacs added action/benchmark Trigger full benchmarks to run on this PR and removed action/benchmark Trigger full benchmarks to run on this PR labels Mar 12, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
@github-actions
Copy link
Contributor

Benchmarks: Random Access

Summary

  • Overall: 1.018x ➖
  • Vortex: 0.953x ➖
  • Parquet: 1.049x ➖
unknown / unknown (1.018x ➖, 7↑ 11↓)
name PR 5126025 (ns) base 1e30897 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2519126 2323595 1.08
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1295082 1386263 0.93
random-access/feature-vectors/correlated/parquet-tokio-local-disk 14427563206 13994175882 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13806571821 13614639448 1.01
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7339108 7857830 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 5858164 6413079 0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚀 1455152 1617448 0.90
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2362631 2529505 0.93
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13774123717 13503736268 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13722155599 13501650407 1.02
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12809504 14035852 0.91
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12692214 14420366 0.88
random-access/lance-tokio-local-disk 840054 770908 1.09
random-access/lance-tokio-local-disk-footer 🚨 1607035 1437971 1.12
random-access/nested-lists/correlated/lance-tokio-local-disk 264616 278440 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 838051 773706 1.08
random-access/nested-lists/correlated/parquet-tokio-local-disk 162544457 167357139 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 163720955 167426352 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk 709044 717798 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 714103 922965 0.77
random-access/nested-lists/uniform/lance-tokio-local-disk 1343615 1239872 1.08
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1934117 1774679 1.09
random-access/nested-lists/uniform/parquet-tokio-local-disk 163908572 168702622 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 163535499 168908652 0.97
random-access/nested-lists/uniform/vortex-tokio-local-disk 2401531 2366474 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2414760 2566095 0.94
random-access/nested-structs/correlated/lance-tokio-local-disk 🚨 488498 438581 1.11
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚨 754099 653125 1.15
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 33301673 26230194 1.27
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 33208240 26350661 1.26
random-access/nested-structs/correlated/vortex-tokio-local-disk 912715 860883 1.06
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 1003787 895149 1.12
random-access/nested-structs/uniform/lance-tokio-local-disk 3226618 2939743 1.10
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3528245 3210709 1.10
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 33619978 25445916 1.32
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 33578680 25662079 1.31
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚨 2095368 1754806 1.19
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚨 2008991 1761486 1.14
random-access/parquet-tokio-local-disk 185688773 192714910 0.96
random-access/parquet-tokio-local-disk-footer 187603806 193512920 0.97
random-access/taxi/correlated/lance-tokio-local-disk 1085880 1004123 1.08
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚨 1978616 1745127 1.13
random-access/taxi/correlated/parquet-tokio-local-disk 282206148 288111251 0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer 277424899 287249450 0.97
random-access/taxi/correlated/vortex-tokio-local-disk 1968161 1878667 1.05
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1973803 2499626 0.79
random-access/taxi/uniform/lance-tokio-local-disk 9444750 8959285 1.05
random-access/taxi/uniform/lance-tokio-local-disk-footer 10226909 9717218 1.05
random-access/taxi/uniform/parquet-tokio-local-disk 293107333 296614846 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 296325560 294787901 1.01
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4782044 5508314 0.87
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4872480 5520891 0.88
random-access/vortex-tokio-local-disk 1370926 1303171 1.05
random-access/vortex-tokio-local-disk-footer 🚀 1367620 1750477 0.78

@github-actions
Copy link
Contributor

Benchmarks: Compression

Summary

  • Overall: 0.998x ➖
  • Vortex: 1.004x ➖
  • Parquet: 0.999x ➖
unknown / unknown (0.998x ➖, 0↑ 0↓)
name PR 5126025 (ns) base 1e30897 (ns) ratio (PR/base)
compress time/Arade 1103584580 1132704486 0.97
compress time/Bimbo 6874011708 7027665474 0.98
compress time/CMSprovider 2955756862 2937486548 1.01
compress time/Euro2016 424058880 425886224 1.00
compress time/Food 381516836 398607677 0.96
compress time/HashTags 903396901 909509257 0.99
compress time/TPC-H l_comment canonical 1301991202 1301084797 1.00
compress time/TPC-H l_comment chunked 1338143201 1345211748 0.99
compress time/taxi 728622519 725331811 1.00
compress time/wide table cols=100 chunks=1 rows=1000 15292077 15704442 0.97
compress time/wide table cols=100 chunks=50 rows=1000 15823351 16085008 0.98
compress time/wide table cols=1000 chunks=1 rows=1000 157252294 157959982 1.00
compress time/wide table cols=1000 chunks=50 rows=1000 158370235 158998186 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1524017909 1568786098 0.97
compress time/wide table cols=10000 chunks=50 rows=1000 1529085171 1561462447 0.98
decompress time/Arade 30927065 29429309 1.05
decompress time/Bimbo 98825888 98497001 1.00
decompress time/CMSprovider 90081609 86497698 1.04
decompress time/Euro2016 22184570 22204990 1.00
decompress time/Food 8983041 8732991 1.03
decompress time/HashTags 82396199 80546526 1.02
decompress time/TPC-H l_comment canonical 42480966 41750749 1.02
decompress time/TPC-H l_comment chunked 43447489 42244516 1.03
decompress time/taxi 18953930 19529951 0.97
decompress time/wide table cols=100 chunks=1 rows=1000 2620072 2640796 0.99
decompress time/wide table cols=100 chunks=50 rows=1000 2664484 2609360 1.02
decompress time/wide table cols=1000 chunks=1 rows=1000 23659379 23578601 1.00
decompress time/wide table cols=1000 chunks=50 rows=1000 23079384 23621359 0.98
decompress time/wide table cols=10000 chunks=1 rows=1000 237025092 237728660 1.00
decompress time/wide table cols=10000 chunks=50 rows=1000 238470249 241571146 0.99
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 2474576942 2518654548 0.98
parquet_rs-zstd compress time/Bimbo 15582906736 16143999089 0.97
parquet_rs-zstd compress time/CMSprovider 7801961615 7881701636 0.99
parquet_rs-zstd compress time/Euro2016 1450476711 1455541069 1.00
parquet_rs-zstd compress time/Food 922050659 949651318 0.97
parquet_rs-zstd compress time/HashTags 2546502969 2587324648 0.98
parquet_rs-zstd compress time/TPC-H l_comment canonical 3162925102 3172769073 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3182590626 3214720506 0.99
parquet_rs-zstd compress time/taxi 1373385590 1398266110 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6459579 6633117 0.97
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6337236 6638561 0.95
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 86397729 83508556 1.03
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 87347825 83277831 1.05
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 885657431 923464170 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 882006350 914799988 0.96
parquet_rs-zstd decompress time/Arade 665631849 672077639 0.99
parquet_rs-zstd decompress time/Bimbo 2262952205 2312240042 0.98
parquet_rs-zstd decompress time/CMSprovider 2116034459 2155082940 0.98
parquet_rs-zstd decompress time/Euro2016 423277918 416458988 1.02
parquet_rs-zstd decompress time/Food 239580787 242941827 0.99
parquet_rs-zstd decompress time/HashTags 680602224 678080085 1.00
parquet_rs-zstd decompress time/TPC-H l_comment canonical 703033101 722254425 0.97
parquet_rs-zstd decompress time/TPC-H l_comment chunked 708492907 722726991 0.98
parquet_rs-zstd decompress time/taxi 285283670 289313327 0.99
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2532902 2573973 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2533577 2555495 0.99
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 29627737 29537710 1.00
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 29451320 29708462 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 329783005 348439216 0.95
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 336448141 339215703 0.99
vortex-file-compressed size/Arade 143320836 143320892 1.00
vortex-file-compressed size/Bimbo 526057964 526057964 1.00
vortex-file-compressed size/CMSprovider 448137780 448338524 1.00
vortex-file-compressed size/Euro2016 164156268 167863828 0.98
vortex-file-compressed size/Food 44159672 44162400 1.00
vortex-file-compressed size/HashTags 195344860 198700644 0.98
vortex-file-compressed size/TPC-H l_comment canonical 179297960 180408824 0.99
vortex-file-compressed size/TPC-H l_comment chunked 179297960 180408824 0.99
vortex-file-compressed size/taxi 51448740 51448740 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.01
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio compress time/Food 0 0 0.99
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio compress time/taxi 0 0 1.02
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.96
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.06
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.03
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.06
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio decompress time/Food 0 0 1.04
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.05
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.05
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 0.98
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 0.98
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 0.99
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 0.99
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs
Copy link
Contributor Author

@AdamGS did you truncate these measurements look like some floats are. in compress

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant