Skip to content

more succinct benchmark summaries#6959

Merged
lwwmanning merged 4 commits intodevelopfrom
wm/short-summary
Mar 13, 2026
Merged

more succinct benchmark summaries#6959
lwwmanning merged 4 commits intodevelopfrom
wm/short-summary

Conversation

@lwwmanning
Copy link
Contributor

Summary

Closes: #000

Testing

Signed-off-by: Will Manning <will@willmanning.io>
@lwwmanning lwwmanning added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 13, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 13, 2026
@lwwmanning lwwmanning enabled auto-merge (squash) March 13, 2026 18:28
@lwwmanning lwwmanning added changelog/chore A trivial change changelog/ci action/benchmark-sql Trigger SQL benchmarks to run on this PR and removed changelog/chore A trivial change labels Mar 13, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 13, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 0c882e6 1 Explore Profiling Data
Previous Runs (3)
Status Commit Job Attempt Link
🟢 Done 8a7b9d1 1 Explore Profiling Data
🟢 Done 8095fdd 1 Explore Profiling Data
🟢 Done db8c8d3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.009x ➖


datafusion / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 116690139 115020787 1.01
polarsignals_q01/datafusion:vortex-file-compressed 352147474 350266542 1.01
polarsignals_q02/datafusion:vortex-file-compressed 21015049 21849357 0.96
polarsignals_q03/datafusion:vortex-file-compressed 347526532 354372013 0.98
polarsignals_q04/datafusion:vortex-file-compressed 12802549 11996383 1.07
polarsignals_q05/datafusion:vortex-file-compressed 16758225 15973788 1.05
polarsignals_q06/datafusion:vortex-file-compressed 19912979 19887319 1.00
polarsignals_q07/datafusion:vortex-file-compressed 12681904 12643909 1.00
polarsignals_q08/datafusion:vortex-file-compressed 438344989 428203218 1.02
polarsignals_q09/datafusion:vortex-file-compressed 10589781 10711031 0.99

@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Vortex (geomean): 1.027x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.7%


datafusion / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 53170040 51725530 1.03
tpch_q02/datafusion:vortex-file-compressed 50510579 50636803 1.00
tpch_q03/datafusion:vortex-file-compressed 27342760 27319634 1.00
tpch_q04/datafusion:vortex-file-compressed 18747269 19022414 0.99
tpch_q05/datafusion:vortex-file-compressed 75397758 78328562 0.96
tpch_q06/datafusion:vortex-file-compressed 10218175 10303718 0.99
tpch_q07/datafusion:vortex-file-compressed 89186599 89254809 1.00
tpch_q08/datafusion:vortex-file-compressed 67490544 64827918 1.04
tpch_q09/datafusion:vortex-file-compressed 87692788 88264355 0.99
tpch_q10/datafusion:vortex-file-compressed 74380621 78934827 0.94
tpch_q11/datafusion:vortex-file-compressed 18983577 17618085 1.08
tpch_q12/datafusion:vortex-file-compressed 34336125 34455774 1.00
tpch_q13/datafusion:vortex-file-compressed 27269331 28582143 0.95
tpch_q14/datafusion:vortex-file-compressed 28963057 27225426 1.06
tpch_q15/datafusion:vortex-file-compressed 24531128 25620447 0.96
tpch_q16/datafusion:vortex-file-compressed 34018613 34402299 0.99
tpch_q17/datafusion:vortex-file-compressed 77433575 76685557 1.01
tpch_q18/datafusion:vortex-file-compressed 101614415 103024796 0.99
tpch_q19/datafusion:vortex-file-compressed 35474121 36591259 0.97
tpch_q20/datafusion:vortex-file-compressed 47630338 49208058 0.97
tpch_q21/datafusion:vortex-file-compressed 92378568 94306768 0.98
tpch_q22/datafusion:vortex-file-compressed 14580075 14629362 1.00
datafusion / vortex-compact (1.037x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 63225825 59159586 1.07
tpch_q02/datafusion:vortex-compact 56340342 55068180 1.02
tpch_q03/datafusion:vortex-compact 33687560 32171473 1.05
tpch_q04/datafusion:vortex-compact 23947143 22871031 1.05
tpch_q05/datafusion:vortex-compact 84703422 83048384 1.02
tpch_q06/datafusion:vortex-compact 14223648 13796537 1.03
tpch_q07/datafusion:vortex-compact 98679006 96027183 1.03
tpch_q08/datafusion:vortex-compact 76111628 74793634 1.02
tpch_q09/datafusion:vortex-compact 99691932 93080742 1.07
tpch_q10/datafusion:vortex-compact 83144888 79888276 1.04
tpch_q11/datafusion:vortex-compact 21572954 20581729 1.05
tpch_q12/datafusion:vortex-compact 45807289 43908398 1.04
tpch_q13/datafusion:vortex-compact 37737591 35858295 1.05
tpch_q14/datafusion:vortex-compact 31487086 32969758 0.96
tpch_q15/datafusion:vortex-compact 35283581 32498427 1.09
tpch_q16/datafusion:vortex-compact 40882591 41111749 0.99
tpch_q17/datafusion:vortex-compact 82360725 80828583 1.02
tpch_q18/datafusion:vortex-compact 121712615 111110347 1.10
tpch_q19/datafusion:vortex-compact 47726920 49545355 0.96
tpch_q20/datafusion:vortex-compact 57795895 54116703 1.07
tpch_q21/datafusion:vortex-compact 111703268 106139041 1.05
tpch_q22/datafusion:vortex-compact 16191602 15450046 1.05
datafusion / parquet (0.999x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 146321534 149419580 0.98
tpch_q02/datafusion:parquet 82169832 80955685 1.01
tpch_q03/datafusion:parquet 88056810 87009895 1.01
tpch_q04/datafusion:parquet 52931228 53717346 0.99
tpch_q05/datafusion:parquet 158613825 163836732 0.97
tpch_q06/datafusion:parquet 36217910 38863930 0.93
tpch_q07/datafusion:parquet 179671005 180304806 1.00
tpch_q08/datafusion:parquet 159008949 166221736 0.96
tpch_q09/datafusion:parquet 209937139 209849831 1.00
tpch_q10/datafusion:parquet 185673816 189950875 0.98
tpch_q11/datafusion:parquet 60151368 58769012 1.02
tpch_q12/datafusion:parquet 119430394 117546076 1.02
tpch_q13/datafusion:parquet 204516923 198742732 1.03
tpch_q14/datafusion:parquet 77294947 80503452 0.96
tpch_q15/datafusion:parquet 70354602 65075834 1.08
tpch_q16/datafusion:parquet 55863354 54334953 1.03
tpch_q17/datafusion:parquet 180870057 180429137 1.00
tpch_q18/datafusion:parquet 229006763 228551906 1.00
tpch_q19/datafusion:parquet 102510197 105488155 0.97
tpch_q20/datafusion:parquet 120242930 118752356 1.01
tpch_q21/datafusion:parquet 171995637 180060902 0.96
tpch_q22/datafusion:parquet 44183487 40814948 1.08
datafusion / arrow (0.993x ➖, 1↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 59763606 71116265 0.84
tpch_q02/datafusion:arrow 23337141 23845015 0.98
tpch_q03/datafusion:arrow 37210566 36445121 1.02
tpch_q04/datafusion:arrow 30634412 30250876 1.01
tpch_q05/datafusion:arrow 90728199 93247956 0.97
tpch_q06/datafusion:arrow 22311364 22179913 1.01
tpch_q07/datafusion:arrow 181780549 172618719 1.05
tpch_q08/datafusion:arrow 50035841 47120528 1.06
tpch_q09/datafusion:arrow 75677939 76039215 1.00
tpch_q10/datafusion:arrow 57665992 56757736 1.02
tpch_q11/datafusion:arrow 12074333 12282426 0.98
tpch_q12/datafusion:arrow 57044435 58054839 0.98
tpch_q13/datafusion:arrow 52726115 51539769 1.02
tpch_q14/datafusion:arrow 25631098 25330460 1.01
tpch_q15/datafusion:arrow 50390947 52192824 0.97
tpch_q16/datafusion:arrow 24312074 25775878 0.94
tpch_q17/datafusion:arrow 82844930 89850108 0.92
tpch_q18/datafusion:arrow 158424153 163351330 0.97
tpch_q19/datafusion:arrow 41760822 39540789 1.06
tpch_q20/datafusion:arrow 42064094 40456937 1.04
tpch_q21/datafusion:arrow 236334636 227681622 1.04
tpch_q22/datafusion:arrow 20437588 21059186 0.97
duckdb / vortex-file-compressed (1.063x ➖, 0↑ 10↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32584110 32009882 1.02
tpch_q02/duckdb:vortex-file-compressed 27780191 28033320 0.99
tpch_q03/duckdb:vortex-file-compressed 30072447 30520681 0.99
tpch_q04/duckdb:vortex-file-compressed 29141222 29218805 1.00
tpch_q05/duckdb:vortex-file-compressed 33179292 34819557 0.95
tpch_q06/duckdb:vortex-file-compressed 10411806 10643312 0.98
tpch_q07/duckdb:vortex-file-compressed 36760362 36847465 1.00
tpch_q08/duckdb:vortex-file-compressed 41456586 40722240 1.02
tpch_q09/duckdb:vortex-file-compressed 78558723 78252105 1.00
tpch_q10/duckdb:vortex-file-compressed 34878164 36854499 0.95
tpch_q11/duckdb:vortex-file-compressed 14784223 15679951 0.94
tpch_q12/duckdb:vortex-file-compressed 🚨 24910695 22000776 1.13
tpch_q13/duckdb:vortex-file-compressed 39453047 37473543 1.05
tpch_q14/duckdb:vortex-file-compressed 🚨 24977144 21387528 1.17
tpch_q15/duckdb:vortex-file-compressed 🚨 17738736 15700712 1.13
tpch_q16/duckdb:vortex-file-compressed 🚨 32862815 29021929 1.13
tpch_q17/duckdb:vortex-file-compressed 🚨 28833212 24324156 1.19
tpch_q18/duckdb:vortex-file-compressed 🚨 55549315 46822320 1.19
tpch_q19/duckdb:vortex-file-compressed 🚨 38230646 32491280 1.18
tpch_q20/duckdb:vortex-file-compressed 🚨 39828650 34313588 1.16
tpch_q21/duckdb:vortex-file-compressed 🚨 118814050 103277242 1.15
tpch_q22/duckdb:vortex-file-compressed 🚨 20683111 17789460 1.16
duckdb / vortex-compact (1.013x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 42549101 39633937 1.07
tpch_q02/duckdb:vortex-compact 37428281 37250399 1.00
tpch_q03/duckdb:vortex-compact 31547319 31935527 0.99
tpch_q04/duckdb:vortex-compact 35150205 33649372 1.04
tpch_q05/duckdb:vortex-compact 39385565 38150116 1.03
tpch_q06/duckdb:vortex-compact 16246074 15282305 1.06
tpch_q07/duckdb:vortex-compact 45196093 43579639 1.04
tpch_q08/duckdb:vortex-compact 46610546 46298723 1.01
tpch_q09/duckdb:vortex-compact 88174201 91887804 0.96
tpch_q10/duckdb:vortex-compact 41907150 40959317 1.02
tpch_q11/duckdb:vortex-compact 19731276 20084490 0.98
tpch_q12/duckdb:vortex-compact 38249847 37723128 1.01
tpch_q13/duckdb:vortex-compact 47422684 46568232 1.02
tpch_q14/duckdb:vortex-compact 31008782 30181654 1.03
tpch_q15/duckdb:vortex-compact 19609654 19581030 1.00
tpch_q16/duckdb:vortex-compact 36442082 37835662 0.96
tpch_q17/duckdb:vortex-compact 30588529 30639338 1.00
tpch_q18/duckdb:vortex-compact 50085639 51201190 0.98
tpch_q19/duckdb:vortex-compact 38542225 38626001 1.00
tpch_q20/duckdb:vortex-compact 45976422 44252653 1.04
tpch_q21/duckdb:vortex-compact 114236874 109130134 1.05
tpch_q22/duckdb:vortex-compact 20529245 20473282 1.00
duckdb / parquet (1.017x ➖, 2↑ 3↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77283906 80250170 0.96
tpch_q02/duckdb:parquet 39676872 38925442 1.02
tpch_q03/duckdb:parquet 70006265 68871236 1.02
tpch_q04/duckdb:parquet 🚀 47971638 55779666 0.86
tpch_q05/duckdb:parquet 69817123 66407682 1.05
tpch_q06/duckdb:parquet 🚨 28174984 20562834 1.37
tpch_q07/duckdb:parquet 70641850 75992232 0.93
tpch_q08/duckdb:parquet 81866830 80208669 1.02
tpch_q09/duckdb:parquet 158375209 154659678 1.02
tpch_q10/duckdb:parquet 🚨 145833390 126743190 1.15
tpch_q11/duckdb:parquet 23729896 22009754 1.08
tpch_q12/duckdb:parquet 47012046 49571713 0.95
tpch_q13/duckdb:parquet 273399486 260852636 1.05
tpch_q14/duckdb:parquet 48927660 48955462 1.00
tpch_q15/duckdb:parquet 23662684 24067817 0.98
tpch_q16/duckdb:parquet 56501523 54523084 1.04
tpch_q17/duckdb:parquet 🚨 54002927 48448402 1.11
tpch_q18/duckdb:parquet 118056901 122778620 0.96
tpch_q19/duckdb:parquet 73108789 68415260 1.07
tpch_q20/duckdb:parquet 🚀 63601605 76031518 0.84
tpch_q21/duckdb:parquet 179642404 177110850 1.01
tpch_q22/duckdb:parquet 52078909 52356683 0.99
duckdb / duckdb (0.997x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16152101 15934759 1.01
tpch_q02/duckdb:duckdb 12354844 11946861 1.03
tpch_q03/duckdb:duckdb 19018849 19168504 0.99
tpch_q04/duckdb:duckdb 18988938 18369837 1.03
tpch_q05/duckdb:duckdb 19616732 20638432 0.95
tpch_q06/duckdb:duckdb 5230399 5263426 0.99
tpch_q07/duckdb:duckdb 22151365 23282096 0.95
tpch_q08/duckdb:duckdb 20552479 20486829 1.00
tpch_q09/duckdb:duckdb 51593251 51908415 0.99
tpch_q10/duckdb:duckdb 41955242 42951730 0.98
tpch_q11/duckdb:duckdb 5778387 5513271 1.05
tpch_q12/duckdb:duckdb 14038939 13759020 1.02
tpch_q13/duckdb:duckdb 37807329 36412885 1.04
tpch_q14/duckdb:duckdb 16923660 17998675 0.94
tpch_q15/duckdb:duckdb 12036641 11629287 1.04
tpch_q16/duckdb:duckdb 21728368 21791761 1.00
tpch_q17/duckdb:duckdb 13146693 14044316 0.94
tpch_q18/duckdb:duckdb 38269558 37666464 1.02
tpch_q19/duckdb:duckdb 26946764 26218491 1.03
tpch_q20/duckdb:duckdb 22621505 23049141 0.98
tpch_q21/duckdb:duckdb 53938735 55420166 0.97
tpch_q22/duckdb:duckdb 23824727 24241310 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -16.0% -2.9% -13.5% +26.2% ➖ noise
1 datafusion:vortex-compact +6.9% -2.9% +10.1% +24.7% ➖ noise
1 datafusion:vortex-file-compressed +2.8% -2.9% +5.8% +24.4% ➖ noise
1 duckdb:duckdb +1.4% -2.9% +4.4% +24.0% ➖ noise
1 duckdb:vortex-compact +7.4% -2.9% +10.5% +23.7% ➖ noise
1 duckdb:vortex-file-compressed +1.8% -2.9% +4.8% +24.3% ➖ noise
2 datafusion:arrow -2.1% +1.7% -3.8% +12.8% ➖ noise
2 datafusion:vortex-compact +2.3% +1.7% +0.6% +12.8% ➖ noise
2 datafusion:vortex-file-compressed -0.2% +1.7% -1.9% +12.8% ➖ noise
2 duckdb:duckdb +3.4% +1.7% +1.7% +12.8% ➖ noise
2 duckdb:vortex-compact +0.5% +1.7% -1.2% +12.8% ➖ noise
2 duckdb:vortex-file-compressed -0.9% +1.7% -2.6% +12.8% ➖ noise
3 datafusion:arrow +2.1% +1.4% +0.7% +12.8% ➖ noise
3 datafusion:vortex-compact +4.7% +1.4% +3.2% +13.2% ➖ noise
3 datafusion:vortex-file-compressed +0.1% +1.4% -1.3% +14.8% ➖ noise
3 duckdb:duckdb -0.8% +1.4% -2.2% +14.8% ➖ noise
3 duckdb:vortex-compact -1.2% +1.4% -2.6% +14.9% ➖ noise
3 duckdb:vortex-file-compressed -1.5% +1.4% -2.9% +15.5% ➖ noise
4 datafusion:arrow +1.3% -7.9% +10.0% +12.8% ➖ noise
4 datafusion:vortex-compact +4.7% -7.9% +13.7% +12.8% 🚨 regression
4 datafusion:vortex-file-compressed -1.4% -7.9% +7.1% +12.8% ➖ noise
4 duckdb:duckdb +3.4% -7.9% +12.3% +12.8% ➖ noise
4 duckdb:vortex-compact +4.5% -7.9% +13.5% +12.8% 🚨 regression
4 duckdb:vortex-file-compressed -0.3% -7.9% +8.3% +14.1% ➖ noise
5 datafusion:arrow -2.7% +0.9% -3.6% +12.8% ➖ noise
5 datafusion:vortex-compact +2.0% +0.9% +1.1% +12.8% ➖ noise
5 datafusion:vortex-file-compressed -3.7% +0.9% -4.6% +12.8% ➖ noise
5 duckdb:duckdb -5.0% +0.9% -5.8% +13.1% ➖ noise
5 duckdb:vortex-compact +3.2% +0.9% +2.3% +12.8% ➖ noise
5 duckdb:vortex-file-compressed -4.7% +0.9% -5.5% +12.8% ➖ noise
6 datafusion:arrow +0.6% +13.0% -11.0% +24.9% ➖ noise
6 datafusion:vortex-compact +3.1% +13.0% -8.8% +25.2% ➖ noise
6 datafusion:vortex-file-compressed -0.8% +13.0% -12.2% +26.8% ➖ noise
6 duckdb:duckdb -0.6% +13.0% -12.1% +29.1% ➖ noise
6 duckdb:vortex-compact +6.3% +13.0% -5.9% +26.4% ➖ noise
6 duckdb:vortex-file-compressed -2.2% +13.0% -13.4% +25.1% ➖ noise
7 datafusion:arrow +5.3% -3.8% +9.4% +12.8% ➖ noise
7 datafusion:vortex-compact +2.8% -3.8% +6.8% +12.8% ➖ noise
7 datafusion:vortex-file-compressed -0.1% -3.8% +3.8% +12.8% ➖ noise
7 duckdb:duckdb -4.9% -3.8% -1.1% +16.5% ➖ noise
7 duckdb:vortex-compact +3.7% -3.8% +7.8% +12.8% ➖ noise
7 duckdb:vortex-file-compressed -0.2% -3.8% +3.7% +12.8% ➖ noise
8 datafusion:arrow +6.2% -1.2% +7.5% +12.8% ➖ noise
8 datafusion:vortex-compact +1.8% -1.2% +3.0% +12.8% ➖ noise
8 datafusion:vortex-file-compressed +4.1% -1.2% +5.4% +12.8% ➖ noise
8 duckdb:duckdb +0.3% -1.2% +1.5% +15.6% ➖ noise
8 duckdb:vortex-compact +0.7% -1.2% +1.9% +12.8% ➖ noise
8 duckdb:vortex-file-compressed +1.8% -1.2% +3.0% +12.8% ➖ noise
9 datafusion:arrow -0.5% +1.2% -1.7% +12.8% ➖ noise
9 datafusion:vortex-compact +7.1% +1.2% +5.8% +12.8% ➖ noise
9 datafusion:vortex-file-compressed -0.6% +1.2% -1.8% +12.8% ➖ noise
9 duckdb:duckdb -0.6% +1.2% -1.8% +14.6% ➖ noise
9 duckdb:vortex-compact -4.0% +1.2% -5.2% +12.8% ➖ noise
9 duckdb:vortex-file-compressed +0.4% +1.2% -0.8% +12.8% ➖ noise
10 datafusion:arrow +1.6% +6.1% -4.2% +12.8% ➖ noise
10 datafusion:vortex-compact +4.1% +6.1% -1.9% +12.8% ➖ noise
10 datafusion:vortex-file-compressed -5.8% +6.1% -11.1% +13.0% ➖ noise
10 duckdb:duckdb -2.3% +6.1% -7.9% +16.7% ➖ noise
10 duckdb:vortex-compact +2.3% +6.1% -3.5% +12.8% ➖ noise
10 duckdb:vortex-file-compressed -5.4% +6.1% -10.8% +12.8% ➖ noise
11 datafusion:arrow -1.7% +5.0% -6.4% +12.9% ➖ noise
11 datafusion:vortex-compact +4.8% +5.0% -0.2% +12.8% ➖ noise
11 datafusion:vortex-file-compressed +7.8% +5.0% +2.6% +13.1% ➖ noise
11 duckdb:duckdb +4.8% +5.0% -0.2% +14.0% ➖ noise
11 duckdb:vortex-compact -1.8% +5.0% -6.5% +12.8% ➖ noise
11 duckdb:vortex-file-compressed -5.7% +5.0% -10.2% +12.8% ➖ noise
12 datafusion:arrow -1.7% -1.8% +0.1% +14.5% ➖ noise
12 datafusion:vortex-compact +4.3% -1.8% +6.3% +14.8% ➖ noise
12 datafusion:vortex-file-compressed -0.3% -1.8% +1.5% +13.4% ➖ noise
12 duckdb:duckdb +2.0% -1.8% +3.9% +15.3% ➖ noise
12 duckdb:vortex-compact +1.4% -1.8% +3.3% +13.9% ➖ noise
12 duckdb:vortex-file-compressed +13.2% -1.8% +15.3% +15.3% 🚨 regression
13 datafusion:arrow +2.3% +3.9% -1.5% +12.8% ➖ noise
13 datafusion:vortex-compact +5.2% +3.9% +1.3% +12.8% ➖ noise
13 datafusion:vortex-file-compressed -4.6% +3.9% -8.1% +12.8% ➖ noise
13 duckdb:duckdb +3.8% +3.9% -0.0% +12.8% ➖ noise
13 duckdb:vortex-compact +1.8% +3.9% -1.9% +12.8% ➖ noise
13 duckdb:vortex-file-compressed +5.3% +3.9% +1.4% +12.8% ➖ noise
14 datafusion:arrow +1.2% -2.0% +3.3% +12.8% ➖ noise
14 datafusion:vortex-compact -4.5% -2.0% -2.5% +15.6% ➖ noise
14 datafusion:vortex-file-compressed +6.4% -2.0% +8.6% +13.6% ➖ noise
14 duckdb:duckdb -6.0% -2.0% -4.0% +20.7% ➖ noise
14 duckdb:vortex-compact +2.7% -2.0% +4.9% +13.1% ➖ noise
14 duckdb:vortex-file-compressed +16.8% -2.0% +19.2% +12.9% 🚨 regression
15 datafusion:arrow -3.5% +3.1% -6.4% +16.3% ➖ noise
15 datafusion:vortex-compact +8.6% +3.1% +5.3% +16.5% ➖ noise
15 datafusion:vortex-file-compressed -4.3% +3.1% -7.1% +18.4% ➖ noise
15 duckdb:duckdb +3.5% +3.1% +0.4% +17.1% ➖ noise
15 duckdb:vortex-compact +0.1% +3.1% -2.9% +15.9% ➖ noise
15 duckdb:vortex-file-compressed +13.0% +3.1% +9.6% +15.7% ➖ noise
16 datafusion:arrow -5.7% +3.2% -8.6% +12.8% ➖ noise
16 datafusion:vortex-compact -0.6% +3.2% -3.7% +12.8% ➖ noise
16 datafusion:vortex-file-compressed -1.1% +3.2% -4.2% +12.8% ➖ noise
16 duckdb:duckdb -0.3% +3.2% -3.4% +17.1% ➖ noise
16 duckdb:vortex-compact -3.7% +3.2% -6.7% +12.8% ➖ noise
16 duckdb:vortex-file-compressed +13.2% +3.2% +9.7% +12.8% ➖ noise
17 datafusion:arrow -7.8% +5.7% -12.8% +13.0% ✅ faster
17 datafusion:vortex-compact +1.9% +5.7% -3.6% +12.8% ➖ noise
17 datafusion:vortex-file-compressed +1.0% +5.7% -4.5% +13.0% ➖ noise
17 duckdb:duckdb -6.4% +5.7% -11.4% +14.8% ➖ noise
17 duckdb:vortex-compact -0.2% +5.7% -5.6% +14.4% ➖ noise
17 duckdb:vortex-file-compressed +18.5% +5.7% +12.1% +15.5% ➖ noise
18 datafusion:arrow -3.0% -1.8% -1.2% +12.8% ➖ noise
18 datafusion:vortex-compact +9.5% -1.8% +11.6% +12.8% ➖ noise
18 datafusion:vortex-file-compressed -1.4% -1.8% +0.5% +12.8% ➖ noise
18 duckdb:duckdb +1.6% -1.8% +3.5% +12.8% ➖ noise
18 duckdb:vortex-compact -2.2% -1.8% -0.3% +12.8% ➖ noise
18 duckdb:vortex-file-compressed +18.6% -1.8% +20.9% +13.1% 🚨 regression
19 datafusion:arrow +5.6% +1.9% +3.6% +15.9% ➖ noise
19 datafusion:vortex-compact -3.7% +1.9% -5.5% +19.6% ➖ noise
19 datafusion:vortex-file-compressed -3.1% +1.9% -4.9% +20.7% ➖ noise
19 duckdb:duckdb +2.8% +1.9% +0.9% +19.2% ➖ noise
19 duckdb:vortex-compact -0.2% +1.9% -2.1% +15.2% ➖ noise
19 duckdb:vortex-file-compressed +17.7% +1.9% +15.5% +18.8% ➖ noise
20 datafusion:arrow +4.0% -8.0% +13.0% +12.8% 🚨 regression
20 datafusion:vortex-compact +6.8% -8.0% +16.0% +12.8% 🚨 regression
20 datafusion:vortex-file-compressed -3.2% -8.0% +5.2% +12.8% ➖ noise
20 duckdb:duckdb -1.9% -8.0% +6.6% +12.8% ➖ noise
20 duckdb:vortex-compact +3.9% -8.0% +12.9% +15.5% ➖ noise
20 duckdb:vortex-file-compressed +16.1% -8.0% +26.1% +15.5% 🚨 regression
21 datafusion:arrow +3.8% -1.6% +5.5% +12.8% ➖ noise
21 datafusion:vortex-compact +5.2% -1.6% +6.9% +12.8% ➖ noise
21 datafusion:vortex-file-compressed -2.0% -1.6% -0.5% +12.8% ➖ noise
21 duckdb:duckdb -2.7% -1.6% -1.1% +12.8% ➖ noise
21 duckdb:vortex-compact +4.7% -1.6% +6.3% +12.8% ➖ noise
21 duckdb:vortex-file-compressed +15.0% -1.6% +16.9% +12.8% 🚨 regression
22 datafusion:arrow -3.0% +3.8% -6.5% +23.4% ➖ noise
22 datafusion:vortex-compact +4.8% +3.8% +1.0% +12.8% ➖ noise
22 datafusion:vortex-file-compressed -0.3% +3.8% -4.0% +12.8% ➖ noise
22 duckdb:duckdb -1.7% +3.8% -5.3% +12.8% ➖ noise
22 duckdb:vortex-compact +0.3% +3.8% -3.4% +12.8% ➖ noise
22 duckdb:vortex-file-compressed +16.3% +3.8% +12.0% +12.8% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 0.994x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.3%


datafusion / vortex-file-compressed (1.014x ➖, 2↑ 1↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4559841 5235071 0.87
fineweb_q01/datafusion:vortex-file-compressed 26947913 26467242 1.02
fineweb_q02/datafusion:vortex-file-compressed 28376359 27692767 1.02
fineweb_q03/datafusion:vortex-file-compressed 🚀 77017616 86468587 0.89
fineweb_q04/datafusion:vortex-file-compressed 244718489 226432404 1.08
fineweb_q05/datafusion:vortex-file-compressed 200701748 199575697 1.01
fineweb_q06/datafusion:vortex-file-compressed 69881945 67278767 1.04
fineweb_q07/datafusion:vortex-file-compressed 69985240 66912331 1.05
fineweb_q08/datafusion:vortex-file-compressed 🚨 29299754 24733609 1.18
datafusion / vortex-compact (0.988x ➖, 1↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4451690 4124470 1.08
fineweb_q01/datafusion:vortex-compact 162811511 161383438 1.01
fineweb_q02/datafusion:vortex-compact 161750001 162767861 0.99
fineweb_q03/datafusion:vortex-compact 1436617416 1437238490 1.00
fineweb_q04/datafusion:vortex-compact 1552494006 1570850402 0.99
fineweb_q05/datafusion:vortex-compact 1225357474 1231855473 0.99
fineweb_q06/datafusion:vortex-compact 696589594 695590372 1.00
fineweb_q07/datafusion:vortex-compact 729904405 721951437 1.01
fineweb_q08/datafusion:vortex-compact 🚀 20356569 24331200 0.84
datafusion / parquet (0.987x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 5828473 6419543 0.91
fineweb_q01/datafusion:parquet 268798905 273340356 0.98
fineweb_q02/datafusion:parquet 271984240 274328220 0.99
fineweb_q03/datafusion:parquet 278793749 271431319 1.03
fineweb_q04/datafusion:parquet 287488583 284561641 1.01
fineweb_q05/datafusion:parquet 282597082 277413605 1.02
fineweb_q06/datafusion:parquet 274284666 285033164 0.96
fineweb_q07/datafusion:parquet 268700376 271079098 0.99
fineweb_q08/datafusion:parquet 265074835 266749448 0.99
duckdb / vortex-file-compressed (0.984x ➖, 1↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3271537 3169900 1.03
fineweb_q01/duckdb:vortex-file-compressed 🚀 26428933 29853819 0.89
fineweb_q02/duckdb:vortex-file-compressed 27651531 26200956 1.06
fineweb_q03/duckdb:vortex-file-compressed 146928180 139056065 1.06
fineweb_q04/duckdb:vortex-file-compressed 208553647 206434401 1.01
fineweb_q05/duckdb:vortex-file-compressed 182221107 187562751 0.97
fineweb_q06/duckdb:vortex-file-compressed 70594979 72965424 0.97
fineweb_q07/duckdb:vortex-file-compressed 67280578 71181543 0.95
fineweb_q08/duckdb:vortex-file-compressed 26200768 27742938 0.94
duckdb / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3848546 3778694 1.02
fineweb_q01/duckdb:vortex-compact 95458544 105676754 0.90
fineweb_q02/duckdb:vortex-compact 110266902 110564273 1.00
fineweb_q03/duckdb:vortex-compact 861752393 859181485 1.00
fineweb_q04/duckdb:vortex-compact 903625857 901274181 1.00
fineweb_q05/duckdb:vortex-compact 814225304 812830552 1.00
fineweb_q06/duckdb:vortex-compact 463758609 466281359 0.99
fineweb_q07/duckdb:vortex-compact 471148878 472557011 1.00
fineweb_q08/duckdb:vortex-compact 22299320 22267148 1.00
duckdb / parquet (1.007x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36017110 35960784 1.00
fineweb_q01/duckdb:parquet 94372925 90525034 1.04
fineweb_q02/duckdb:parquet 95102751 94008527 1.01
fineweb_q03/duckdb:parquet 308133919 306576043 1.01
fineweb_q04/duckdb:parquet 437118465 436321340 1.00
fineweb_q05/duckdb:parquet 409159957 407583448 1.00
fineweb_q06/duckdb:parquet 198554893 197170808 1.01
fineweb_q07/duckdb:parquet 209537991 209020183 1.00
fineweb_q08/duckdb:parquet 56810124 57296910 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +7.9% -4.6% +13.2% +50.1% ➖ noise
0 datafusion:vortex-file-compressed -12.9% -4.6% -8.7% +79.4% ➖ noise
0 duckdb:vortex-compact +1.8% -4.6% +6.8% +39.4% ➖ noise
0 duckdb:vortex-file-compressed +3.2% -4.6% +8.2% +52.3% ➖ noise
1 datafusion:vortex-compact +0.9% +1.3% -0.4% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +1.8% +1.3% +0.6% +13.0% ➖ noise
1 duckdb:vortex-compact -9.7% +1.3% -10.8% +23.7% ➖ noise
1 duckdb:vortex-file-compressed -11.5% +1.3% -12.6% +38.0% ➖ noise
2 datafusion:vortex-compact -0.6% +0.1% -0.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +2.5% +0.1% +2.3% +13.6% ➖ noise
2 duckdb:vortex-compact -0.3% +0.1% -0.4% +20.2% ➖ noise
2 duckdb:vortex-file-compressed +5.5% +0.1% +5.4% +11.7% ➖ noise
3 datafusion:vortex-compact -0.0% +1.6% -1.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -10.9% +1.6% -12.3% +30.1% ➖ noise
3 duckdb:vortex-compact +0.3% +1.6% -1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.7% +1.6% +4.0% +29.8% ➖ noise
4 datafusion:vortex-compact -1.2% +0.6% -1.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +8.1% +0.6% +7.4% +11.7% ➖ noise
4 duckdb:vortex-compact +0.3% +0.6% -0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.0% +0.6% +0.4% +10.0% ➖ noise
5 datafusion:vortex-compact -0.5% +1.1% -1.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.6% +1.1% -0.6% +10.0% ➖ noise
5 duckdb:vortex-compact +0.2% +1.1% -0.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.8% +1.1% -3.9% +10.0% ➖ noise
6 datafusion:vortex-compact +0.1% -1.6% +1.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.9% -1.6% +5.5% +15.3% ➖ noise
6 duckdb:vortex-compact -0.5% -1.6% +1.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.2% -1.6% -1.7% +13.9% ➖ noise
7 datafusion:vortex-compact +1.1% -0.3% +1.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.6% -0.3% +4.9% +14.6% ➖ noise
7 duckdb:vortex-compact -0.3% -0.3% +0.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.5% -0.3% -5.2% +10.0% ➖ noise
8 datafusion:vortex-compact -16.3% -0.7% -15.7% +26.1% ➖ noise
8 datafusion:vortex-file-compressed +18.5% -0.7% +19.3% +35.4% ➖ noise
8 duckdb:vortex-compact +0.1% -0.7% +0.9% +18.5% ➖ noise
8 duckdb:vortex-file-compressed -5.6% -0.7% -4.9% +19.2% ➖ noise

@lwwmanning lwwmanning disabled auto-merge March 13, 2026 18:44
@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Vortex (geomean): 1.022x ➖
Parquet (geomean): 1.014x ➖
Shifts: Parquet (control) +1.4% · Median polish +2.1%


datafusion / vortex-file-compressed (1.024x ➖, 0↑ 1↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 30454438 29326481 1.04
tpcds_q02/datafusion:vortex-file-compressed 80727806 75437311 1.07
tpcds_q03/datafusion:vortex-file-compressed 28622587 26860868 1.07
tpcds_q04/datafusion:vortex-file-compressed 🚨 427603091 388305670 1.10
tpcds_q05/datafusion:vortex-file-compressed 79195521 73858864 1.07
tpcds_q06/datafusion:vortex-file-compressed 77170383 76846023 1.00
tpcds_q07/datafusion:vortex-file-compressed 77662539 74300433 1.05
tpcds_q08/datafusion:vortex-file-compressed 40371303 38543851 1.05
tpcds_q09/datafusion:vortex-file-compressed 48946411 46498129 1.05
tpcds_q10/datafusion:vortex-file-compressed 50314569 49531110 1.02
tpcds_q11/datafusion:vortex-file-compressed 243809735 234456335 1.04
tpcds_q12/datafusion:vortex-file-compressed 37410522 35181694 1.06
tpcds_q13/datafusion:vortex-file-compressed 79472969 78476461 1.01
tpcds_q14/datafusion:vortex-file-compressed 226285754 207101180 1.09
tpcds_q15/datafusion:vortex-file-compressed 52317760 48288659 1.08
tpcds_q16/datafusion:vortex-file-compressed 29888781 29363371 1.02
tpcds_q17/datafusion:vortex-file-compressed 112140960 113240219 0.99
tpcds_q18/datafusion:vortex-file-compressed 105874545 100629116 1.05
tpcds_q19/datafusion:vortex-file-compressed 48771323 47411206 1.03
tpcds_q20/datafusion:vortex-file-compressed 41156946 41059106 1.00
tpcds_q21/datafusion:vortex-file-compressed 180622844 169327841 1.07
tpcds_q22/datafusion:vortex-file-compressed 74190705 72676450 1.02
tpcds_q23/datafusion:vortex-file-compressed 194507529 187346672 1.04
tpcds_q24/datafusion:vortex-file-compressed 189210937 180291870 1.05
tpcds_q25/datafusion:vortex-file-compressed 112713270 110916454 1.02
tpcds_q26/datafusion:vortex-file-compressed 60813014 58555156 1.04
tpcds_q27/datafusion:vortex-file-compressed 173587467 164195741 1.06
tpcds_q28/datafusion:vortex-file-compressed 48866087 50738108 0.96
tpcds_q29/datafusion:vortex-file-compressed 114581740 110534641 1.04
tpcds_q30/datafusion:vortex-file-compressed 29889735 30045067 0.99
tpcds_q31/datafusion:vortex-file-compressed 181316766 180039399 1.01
tpcds_q32/datafusion:vortex-file-compressed 24542755 23621734 1.04
tpcds_q33/datafusion:vortex-file-compressed 36735658 37038777 0.99
tpcds_q34/datafusion:vortex-file-compressed 37593164 38206593 0.98
tpcds_q35/datafusion:vortex-file-compressed 62607052 61204484 1.02
tpcds_q36/datafusion:vortex-file-compressed 107701180 106283010 1.01
tpcds_q37/datafusion:vortex-file-compressed 38476003 36600789 1.05
tpcds_q38/datafusion:vortex-file-compressed 88152962 86210032 1.02
tpcds_q39/datafusion:vortex-file-compressed 190526120 196740302 0.97
tpcds_q40/datafusion:vortex-file-compressed 54774196 54979740 1.00
tpcds_q41/datafusion:vortex-file-compressed 15379863 14749786 1.04
tpcds_q42/datafusion:vortex-file-compressed 32295667 30601275 1.06
tpcds_q43/datafusion:vortex-file-compressed 49080694 46488597 1.06
tpcds_q44/datafusion:vortex-file-compressed 43005356 43002139 1.00
tpcds_q45/datafusion:vortex-file-compressed 49171383 49990764 0.98
tpcds_q46/datafusion:vortex-file-compressed 65759418 65357482 1.01
tpcds_q47/datafusion:vortex-file-compressed 281386034 272737322 1.03
tpcds_q48/datafusion:vortex-file-compressed 67299261 68493285 0.98
tpcds_q49/datafusion:vortex-file-compressed 69835181 70529822 0.99
tpcds_q50/datafusion:vortex-file-compressed 75859058 76671292 0.99
tpcds_q51/datafusion:vortex-file-compressed 95356457 91468504 1.04
tpcds_q52/datafusion:vortex-file-compressed 31340538 30136010 1.04
tpcds_q53/datafusion:vortex-file-compressed 31052925 29270058 1.06
tpcds_q54/datafusion:vortex-file-compressed 49989043 48246217 1.04
tpcds_q55/datafusion:vortex-file-compressed 32202947 30457890 1.06
tpcds_q56/datafusion:vortex-file-compressed 48476933 44191146 1.10
tpcds_q57/datafusion:vortex-file-compressed 182058509 179598709 1.01
tpcds_q58/datafusion:vortex-file-compressed 113878612 109198060 1.04
tpcds_q59/datafusion:vortex-file-compressed 94722305 96182443 0.98
tpcds_q60/datafusion:vortex-file-compressed 48481410 47289281 1.03
tpcds_q61/datafusion:vortex-file-compressed 57995295 59745150 0.97
tpcds_q62/datafusion:vortex-file-compressed 44671837 44076312 1.01
tpcds_q63/datafusion:vortex-file-compressed 29661293 29619974 1.00
tpcds_q64/datafusion:vortex-file-compressed 747953744 701895026 1.07
tpcds_q65/datafusion:vortex-file-compressed 53212744 54313376 0.98
tpcds_q66/datafusion:vortex-file-compressed 114681899 105554434 1.09
tpcds_q67/datafusion:vortex-file-compressed 146574284 142682551 1.03
tpcds_q68/datafusion:vortex-file-compressed 65086896 65135956 1.00
tpcds_q69/datafusion:vortex-file-compressed 45812907 47111943 0.97
tpcds_q70/datafusion:vortex-file-compressed 136381913 127880173 1.07
tpcds_q71/datafusion:vortex-file-compressed 30704010 29925082 1.03
tpcds_q72/datafusion:vortex-file-compressed 3543649122 3396865900 1.04
tpcds_q73/datafusion:vortex-file-compressed 38034425 36792278 1.03
tpcds_q74/datafusion:vortex-file-compressed 168796522 169943086 0.99
tpcds_q75/datafusion:vortex-file-compressed 134414033 136649177 0.98
tpcds_q76/datafusion:vortex-file-compressed 64159460 62391017 1.03
tpcds_q77/datafusion:vortex-file-compressed 55582337 53317176 1.04
tpcds_q78/datafusion:vortex-file-compressed 182929145 178727329 1.02
tpcds_q79/datafusion:vortex-file-compressed 42667258 42764920 1.00
tpcds_q80/datafusion:vortex-file-compressed 122272600 116336377 1.05
tpcds_q81/datafusion:vortex-file-compressed 37341932 36110899 1.03
tpcds_q82/datafusion:vortex-file-compressed 41813892 40246619 1.04
tpcds_q83/datafusion:vortex-file-compressed 66521919 67961032 0.98
tpcds_q84/datafusion:vortex-file-compressed 15157073 15070114 1.01
tpcds_q85/datafusion:vortex-file-compressed 136174864 134936984 1.01
tpcds_q86/datafusion:vortex-file-compressed 31247047 32053220 0.97
tpcds_q87/datafusion:vortex-file-compressed 90044051 89716178 1.00
tpcds_q88/datafusion:vortex-file-compressed 80831085 78559411 1.03
tpcds_q89/datafusion:vortex-file-compressed 57772192 57495317 1.00
tpcds_q90/datafusion:vortex-file-compressed 16872059 16848032 1.00
tpcds_q91/datafusion:vortex-file-compressed 27654205 27111460 1.02
tpcds_q92/datafusion:vortex-file-compressed 20867655 19819734 1.05
tpcds_q93/datafusion:vortex-file-compressed 37695482 37408812 1.01
tpcds_q94/datafusion:vortex-file-compressed 27963451 26875205 1.04
tpcds_q95/datafusion:vortex-file-compressed 85583076 89066143 0.96
tpcds_q96/datafusion:vortex-file-compressed 15751719 14811268 1.06
tpcds_q97/datafusion:vortex-file-compressed 32578406 33078908 0.98
tpcds_q98/datafusion:vortex-file-compressed 49938535 50786205 0.98
tpcds_q99/datafusion:vortex-file-compressed 62062173 60495649 1.03
datafusion / vortex-compact (1.012x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35230885 35515212 0.99
tpcds_q02/datafusion:vortex-compact 84197006 82650780 1.02
tpcds_q03/datafusion:vortex-compact 33381908 32778058 1.02
tpcds_q04/datafusion:vortex-compact 462724562 438579693 1.06
tpcds_q05/datafusion:vortex-compact 89173679 83253611 1.07
tpcds_q06/datafusion:vortex-compact 86124073 84841178 1.02
tpcds_q07/datafusion:vortex-compact 96130685 92408581 1.04
tpcds_q08/datafusion:vortex-compact 51307135 48242697 1.06
tpcds_q09/datafusion:vortex-compact 100483832 101940334 0.99
tpcds_q10/datafusion:vortex-compact 68646761 67752789 1.01
tpcds_q11/datafusion:vortex-compact 264141572 263441801 1.00
tpcds_q12/datafusion:vortex-compact 41084193 39417957 1.04
tpcds_q13/datafusion:vortex-compact 145926544 142175643 1.03
tpcds_q14/datafusion:vortex-compact 276940370 271239767 1.02
tpcds_q15/datafusion:vortex-compact 54321011 53991519 1.01
tpcds_q16/datafusion:vortex-compact 41539094 40434153 1.03
tpcds_q17/datafusion:vortex-compact 132952672 128455102 1.04
tpcds_q18/datafusion:vortex-compact 121299614 121637798 1.00
tpcds_q19/datafusion:vortex-compact 60986268 64086556 0.95
tpcds_q20/datafusion:vortex-compact 44845545 47944446 0.94
tpcds_q21/datafusion:vortex-compact 181669826 183696952 0.99
tpcds_q22/datafusion:vortex-compact 77540390 78541857 0.99
tpcds_q23/datafusion:vortex-compact 234481346 230760552 1.02
tpcds_q24/datafusion:vortex-compact 215772647 215582664 1.00
tpcds_q25/datafusion:vortex-compact 129872823 130763226 0.99
tpcds_q26/datafusion:vortex-compact 75121366 74051340 1.01
tpcds_q27/datafusion:vortex-compact 220112855 215450098 1.02
tpcds_q28/datafusion:vortex-compact 104701100 103611459 1.01
tpcds_q29/datafusion:vortex-compact 135127345 128358920 1.05
tpcds_q30/datafusion:vortex-compact 37642997 36564497 1.03
tpcds_q31/datafusion:vortex-compact 215666415 220212209 0.98
tpcds_q32/datafusion:vortex-compact 30556406 30458908 1.00
tpcds_q33/datafusion:vortex-compact 53587284 51809246 1.03
tpcds_q34/datafusion:vortex-compact 58885846 58662225 1.00
tpcds_q35/datafusion:vortex-compact 78219141 77469131 1.01
tpcds_q36/datafusion:vortex-compact 132575575 131387399 1.01
tpcds_q37/datafusion:vortex-compact 51084688 52787830 0.97
tpcds_q38/datafusion:vortex-compact 106294150 101182419 1.05
tpcds_q39/datafusion:vortex-compact 196127960 201012484 0.98
tpcds_q40/datafusion:vortex-compact 65867243 63430529 1.04
tpcds_q41/datafusion:vortex-compact 16834799 16818823 1.00
tpcds_q42/datafusion:vortex-compact 38411777 36980673 1.04
tpcds_q43/datafusion:vortex-compact 55577497 55741504 1.00
tpcds_q44/datafusion:vortex-compact 72321866 70924108 1.02
tpcds_q45/datafusion:vortex-compact 52673278 53503686 0.98
tpcds_q46/datafusion:vortex-compact 94824090 93365203 1.02
tpcds_q47/datafusion:vortex-compact 304968670 307687854 0.99
tpcds_q48/datafusion:vortex-compact 114007409 112017570 1.02
tpcds_q49/datafusion:vortex-compact 100514606 99774160 1.01
tpcds_q50/datafusion:vortex-compact 93886715 93927566 1.00
tpcds_q51/datafusion:vortex-compact 101928577 102130784 1.00
tpcds_q52/datafusion:vortex-compact 37472004 35407553 1.06
tpcds_q53/datafusion:vortex-compact 40598269 39400169 1.03
tpcds_q54/datafusion:vortex-compact 63873610 64909140 0.98
tpcds_q55/datafusion:vortex-compact 38105385 37337715 1.02
tpcds_q56/datafusion:vortex-compact 60684590 59917221 1.01
tpcds_q57/datafusion:vortex-compact 199766805 197381464 1.01
tpcds_q58/datafusion:vortex-compact 120886642 122347268 0.99
tpcds_q59/datafusion:vortex-compact 110661233 110041855 1.01
tpcds_q60/datafusion:vortex-compact 60864734 62805838 0.97
tpcds_q61/datafusion:vortex-compact 83154120 81644888 1.02
tpcds_q62/datafusion:vortex-compact 47331129 47628750 0.99
tpcds_q63/datafusion:vortex-compact 39069106 38351350 1.02
tpcds_q64/datafusion:vortex-compact 833103083 796469273 1.05
tpcds_q65/datafusion:vortex-compact 75394318 71423800 1.06
tpcds_q66/datafusion:vortex-compact 110108889 118963551 0.93
tpcds_q67/datafusion:vortex-compact 156111547 152686209 1.02
tpcds_q68/datafusion:vortex-compact 96384936 92901431 1.04
tpcds_q69/datafusion:vortex-compact 63563473 61934272 1.03
tpcds_q70/datafusion:vortex-compact 142387340 141465517 1.01
tpcds_q71/datafusion:vortex-compact 45697450 45853425 1.00
tpcds_q72/datafusion:vortex-compact 3578732549 3460632828 1.03
tpcds_q73/datafusion:vortex-compact 60035949 59268549 1.01
tpcds_q74/datafusion:vortex-compact 190461269 191733787 0.99
tpcds_q75/datafusion:vortex-compact 184377481 180679517 1.02
tpcds_q76/datafusion:vortex-compact 81614741 79727568 1.02
tpcds_q77/datafusion:vortex-compact 68375899 70611189 0.97
tpcds_q78/datafusion:vortex-compact 206791574 205685820 1.01
tpcds_q79/datafusion:vortex-compact 69422071 68866100 1.01
tpcds_q80/datafusion:vortex-compact 143042524 137786349 1.04
tpcds_q81/datafusion:vortex-compact 43838697 42350565 1.04
tpcds_q82/datafusion:vortex-compact 52922012 51087159 1.04
tpcds_q83/datafusion:vortex-compact 68618274 66145144 1.04
tpcds_q84/datafusion:vortex-compact 18498431 18653540 0.99
tpcds_q85/datafusion:vortex-compact 163677631 160775890 1.02
tpcds_q86/datafusion:vortex-compact 33158177 33384036 0.99
tpcds_q87/datafusion:vortex-compact 106032607 105021994 1.01
tpcds_q88/datafusion:vortex-compact 133329613 133241145 1.00
tpcds_q89/datafusion:vortex-compact 65213145 66322796 0.98
tpcds_q90/datafusion:vortex-compact 23113825 22280985 1.04
tpcds_q91/datafusion:vortex-compact 43251817 41796175 1.03
tpcds_q92/datafusion:vortex-compact 23320527 22276400 1.05
tpcds_q93/datafusion:vortex-compact 55606176 52963417 1.05
tpcds_q94/datafusion:vortex-compact 33396234 32466553 1.03
tpcds_q95/datafusion:vortex-compact 99314113 99103040 1.00
tpcds_q96/datafusion:vortex-compact 24437379 25286578 0.97
tpcds_q97/datafusion:vortex-compact 45737868 44482055 1.03
tpcds_q98/datafusion:vortex-compact 57030588 56869728 1.00
tpcds_q99/datafusion:vortex-compact 66618606 67301891 0.99
datafusion / parquet (1.015x ➖, 1↑ 2↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 40653048 37235882 1.09
tpcds_q02/datafusion:parquet 🚨 54472393 48907674 1.11
tpcds_q03/datafusion:parquet 16936710 17178326 0.99
tpcds_q04/datafusion:parquet 376863104 386096708 0.98
tpcds_q05/datafusion:parquet 93089162 88427075 1.05
tpcds_q06/datafusion:parquet 95619655 93315983 1.02
tpcds_q07/datafusion:parquet 142621122 131349977 1.09
tpcds_q08/datafusion:parquet 41398131 39664732 1.04
tpcds_q09/datafusion:parquet 55710219 54130401 1.03
tpcds_q10/datafusion:parquet 105768139 99484659 1.06
tpcds_q11/datafusion:parquet 235509051 222632191 1.06
tpcds_q12/datafusion:parquet 🚨 32584659 29603995 1.10
tpcds_q13/datafusion:parquet 143676656 145858759 0.99
tpcds_q14/datafusion:parquet 216341233 213236281 1.01
tpcds_q15/datafusion:parquet 56737956 54963974 1.03
tpcds_q16/datafusion:parquet 35035085 34030145 1.03
tpcds_q17/datafusion:parquet 175321286 172215566 1.02
tpcds_q18/datafusion:parquet 180610249 178626510 1.01
tpcds_q19/datafusion:parquet 37131535 35516555 1.05
tpcds_q20/datafusion:parquet 25770971 24459895 1.05
tpcds_q21/datafusion:parquet 28808788 27729752 1.04
tpcds_q22/datafusion:parquet 🚀 148882337 171020733 0.87
tpcds_q23/datafusion:parquet 187284088 187150032 1.00
tpcds_q24/datafusion:parquet 211393999 208368739 1.01
tpcds_q25/datafusion:parquet 179692431 178613856 1.01
tpcds_q26/datafusion:parquet 120704750 113949034 1.06
tpcds_q27/datafusion:parquet 261702988 261377473 1.00
tpcds_q28/datafusion:parquet 54079586 51947450 1.04
tpcds_q29/datafusion:parquet 183316241 181661436 1.01
tpcds_q30/datafusion:parquet 46256063 44230113 1.05
tpcds_q31/datafusion:parquet 107972975 106317800 1.02
tpcds_q32/datafusion:parquet 29552251 29988174 0.99
tpcds_q33/datafusion:parquet 37550176 37505824 1.00
tpcds_q34/datafusion:parquet 36768996 36680813 1.00
tpcds_q35/datafusion:parquet 100264890 97544831 1.03
tpcds_q36/datafusion:parquet 84080462 81970969 1.03
tpcds_q37/datafusion:parquet 26721047 25744331 1.04
tpcds_q38/datafusion:parquet 63558557 65314123 0.97
tpcds_q39/datafusion:parquet 101791308 101887618 1.00
tpcds_q40/datafusion:parquet 37092068 37284524 0.99
tpcds_q41/datafusion:parquet 13272017 12722953 1.04
tpcds_q42/datafusion:parquet 17098489 15731944 1.09
tpcds_q43/datafusion:parquet 27959413 27460068 1.02
tpcds_q44/datafusion:parquet 41931651 41078531 1.02
tpcds_q45/datafusion:parquet 68078771 69284433 0.98
tpcds_q46/datafusion:parquet 51707895 49401561 1.05
tpcds_q47/datafusion:parquet 184781802 188462248 0.98
tpcds_q48/datafusion:parquet 131286929 134581712 0.98
tpcds_q49/datafusion:parquet 73239395 72082185 1.02
tpcds_q50/datafusion:parquet 109799841 109850125 1.00
tpcds_q51/datafusion:parquet 95258492 100443486 0.95
tpcds_q52/datafusion:parquet 16060250 16096550 1.00
tpcds_q53/datafusion:parquet 31612480 30178871 1.05
tpcds_q54/datafusion:parquet 49220061 47834795 1.03
tpcds_q55/datafusion:parquet 17512976 16127106 1.09
tpcds_q56/datafusion:parquet 36362400 38819807 0.94
tpcds_q57/datafusion:parquet 136142113 132367210 1.03
tpcds_q58/datafusion:parquet 74964834 74023045 1.01
tpcds_q59/datafusion:parquet 72909535 71234641 1.02
tpcds_q60/datafusion:parquet 37573051 37909616 0.99
tpcds_q61/datafusion:parquet 67817653 67965573 1.00
tpcds_q62/datafusion:parquet 46579553 46222405 1.01
tpcds_q63/datafusion:parquet 31896457 32562316 0.98
tpcds_q64/datafusion:parquet 1012747303 1000334583 1.01
tpcds_q65/datafusion:parquet 50485178 50420207 1.00
tpcds_q66/datafusion:parquet 85428427 88032347 0.97
tpcds_q67/datafusion:parquet 178205712 183967979 0.97
tpcds_q68/datafusion:parquet 51563607 53760528 0.96
tpcds_q69/datafusion:parquet 97444228 92876765 1.05
tpcds_q70/datafusion:parquet 112442714 110079869 1.02
tpcds_q71/datafusion:parquet 29950211 30641869 0.98
tpcds_q72/datafusion:parquet 874152216 871111480 1.00
tpcds_q73/datafusion:parquet 37118888 39126609 0.95
tpcds_q74/datafusion:parquet 131997081 135075813 0.98
tpcds_q75/datafusion:parquet 136578837 135163046 1.01
tpcds_q76/datafusion:parquet 89841640 92735418 0.97
tpcds_q77/datafusion:parquet 58960500 61176128 0.96
tpcds_q78/datafusion:parquet 190185674 177195041 1.07
tpcds_q79/datafusion:parquet 40679864 41882096 0.97
tpcds_q80/datafusion:parquet 116963148 118714527 0.99
tpcds_q81/datafusion:parquet 44164361 42639310 1.04
tpcds_q82/datafusion:parquet 30090207 30071416 1.00
tpcds_q83/datafusion:parquet 57435388 56658250 1.01
tpcds_q84/datafusion:parquet 50809210 48997617 1.04
tpcds_q85/datafusion:parquet 255270570 246238354 1.04
tpcds_q86/datafusion:parquet 21487629 21625971 0.99
tpcds_q87/datafusion:parquet 69594713 67207247 1.04
tpcds_q88/datafusion:parquet 82868018 79728617 1.04
tpcds_q89/datafusion:parquet 38294808 37764089 1.01
tpcds_q90/datafusion:parquet 20700470 19755163 1.05
tpcds_q91/datafusion:parquet 79620399 78636479 1.01
tpcds_q92/datafusion:parquet 25747635 27168525 0.95
tpcds_q93/datafusion:parquet 40838362 40298798 1.01
tpcds_q94/datafusion:parquet 29819035 30123845 0.99
tpcds_q95/datafusion:parquet 133454125 131822783 1.01
tpcds_q96/datafusion:parquet 16654773 15188583 1.10
tpcds_q97/datafusion:parquet 37424073 38206039 0.98
tpcds_q98/datafusion:parquet 38691481 37554435 1.03
tpcds_q99/datafusion:parquet 49113064 44844867 1.10
duckdb / vortex-file-compressed (1.039x ➖, 1↑ 8↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 27792714 25318153 1.10
tpcds_q02/duckdb:vortex-file-compressed 90358081 82288838 1.10
tpcds_q03/duckdb:vortex-file-compressed 24514508 22873518 1.07
tpcds_q04/duckdb:vortex-file-compressed 108291378 106289410 1.02
tpcds_q05/duckdb:vortex-file-compressed 106399539 99743500 1.07
tpcds_q06/duckdb:vortex-file-compressed 37486898 35972110 1.04
tpcds_q07/duckdb:vortex-file-compressed 24474763 23417625 1.05
tpcds_q08/duckdb:vortex-file-compressed 25405995 24190285 1.05
tpcds_q09/duckdb:vortex-file-compressed 42747811 40335503 1.06
tpcds_q10/duckdb:vortex-file-compressed 38342362 36629405 1.05
tpcds_q11/duckdb:vortex-file-compressed 61851344 61371264 1.01
tpcds_q12/duckdb:vortex-file-compressed 15526840 14645371 1.06
tpcds_q13/duckdb:vortex-file-compressed 34220214 33507257 1.02
tpcds_q14/duckdb:vortex-file-compressed 207392289 197877812 1.05
tpcds_q15/duckdb:vortex-file-compressed 42988076 40614621 1.06
tpcds_q16/duckdb:vortex-file-compressed 32250375 30501824 1.06
tpcds_q17/duckdb:vortex-file-compressed 40842641 39527086 1.03
tpcds_q18/duckdb:vortex-file-compressed 48746713 47706697 1.02
tpcds_q19/duckdb:vortex-file-compressed 34732043 32009188 1.09
tpcds_q20/duckdb:vortex-file-compressed 16948853 15773741 1.07
tpcds_q21/duckdb:vortex-file-compressed 21430373 22232932 0.96
tpcds_q22/duckdb:vortex-file-compressed 111506702 104965548 1.06
tpcds_q23/duckdb:vortex-file-compressed 134135758 130496348 1.03
tpcds_q24/duckdb:vortex-file-compressed 56551695 56897499 0.99
tpcds_q25/duckdb:vortex-file-compressed 39588351 36753527 1.08
tpcds_q26/duckdb:vortex-file-compressed 42864465 40992882 1.05
tpcds_q27/duckdb:vortex-file-compressed 89552028 88447804 1.01
tpcds_q28/duckdb:vortex-file-compressed 38153659 37201054 1.03
tpcds_q29/duckdb:vortex-file-compressed 38073488 37379935 1.02
tpcds_q30/duckdb:vortex-file-compressed 29309908 28479891 1.03
tpcds_q31/duckdb:vortex-file-compressed 25332233 27193609 0.93
tpcds_q32/duckdb:vortex-file-compressed 17042993 17183895 0.99
tpcds_q33/duckdb:vortex-file-compressed 67638800 63912563 1.06
tpcds_q34/duckdb:vortex-file-compressed 🚨 21046884 18592441 1.13
tpcds_q35/duckdb:vortex-file-compressed 🚨 68652946 60996200 1.13
tpcds_q36/duckdb:vortex-file-compressed 🚨 30163648 26815956 1.12
tpcds_q37/duckdb:vortex-file-compressed 24406935 22223259 1.10
tpcds_q38/duckdb:vortex-file-compressed 38369009 35871807 1.07
tpcds_q39/duckdb:vortex-file-compressed 🚀 46206290 55788153 0.83
tpcds_q40/duckdb:vortex-file-compressed 26094298 24114235 1.08
tpcds_q41/duckdb:vortex-file-compressed 13831707 13090184 1.06
tpcds_q42/duckdb:vortex-file-compressed 12163095 12156305 1.00
tpcds_q43/duckdb:vortex-file-compressed 21364974 19896479 1.07
tpcds_q44/duckdb:vortex-file-compressed 🚨 25264549 22937052 1.10
tpcds_q45/duckdb:vortex-file-compressed 28736742 28060205 1.02
tpcds_q46/duckdb:vortex-file-compressed 49951711 46995899 1.06
tpcds_q47/duckdb:vortex-file-compressed 49359144 50022244 0.99
tpcds_q48/duckdb:vortex-file-compressed 30673689 29611634 1.04
tpcds_q49/duckdb:vortex-file-compressed 31751106 31019867 1.02
tpcds_q50/duckdb:vortex-file-compressed 35221655 35492757 0.99
tpcds_q51/duckdb:vortex-file-compressed 101376322 100348788 1.01
tpcds_q52/duckdb:vortex-file-compressed 🚨 13331020 12046186 1.11
tpcds_q53/duckdb:vortex-file-compressed 17890362 16865318 1.06
tpcds_q54/duckdb:vortex-file-compressed 50559946 48259912 1.05
tpcds_q55/duckdb:vortex-file-compressed 12247189 12299844 1.00
tpcds_q56/duckdb:vortex-file-compressed 70485557 67250512 1.05
tpcds_q57/duckdb:vortex-file-compressed 46779455 43543237 1.07
tpcds_q58/duckdb:vortex-file-compressed 35244055 32923552 1.07
tpcds_q59/duckdb:vortex-file-compressed 56951121 56466515 1.01
tpcds_q60/duckdb:vortex-file-compressed 72479656 69835953 1.04
tpcds_q61/duckdb:vortex-file-compressed 37553480 38848214 0.97
tpcds_q62/duckdb:vortex-file-compressed 18416696 18458140 1.00
tpcds_q63/duckdb:vortex-file-compressed 18949524 17459623 1.09
tpcds_q64/duckdb:vortex-file-compressed 81121862 79822593 1.02
tpcds_q65/duckdb:vortex-file-compressed 23595696 23700904 1.00
tpcds_q66/duckdb:vortex-file-compressed 62878632 59947564 1.05
tpcds_q67/duckdb:vortex-file-compressed 145362096 144090783 1.01
tpcds_q68/duckdb:vortex-file-compressed 40569733 40445920 1.00
tpcds_q69/duckdb:vortex-file-compressed 39285632 37996320 1.03
tpcds_q70/duckdb:vortex-file-compressed 24968507 24673258 1.01
tpcds_q71/duckdb:vortex-file-compressed 21238051 20685458 1.03
tpcds_q72/duckdb:vortex-file-compressed 178972274 175330400 1.02
tpcds_q73/duckdb:vortex-file-compressed 20162346 19768502 1.02
tpcds_q74/duckdb:vortex-file-compressed 53722245 49131149 1.09
tpcds_q75/duckdb:vortex-file-compressed 57650633 60294383 0.96
tpcds_q76/duckdb:vortex-file-compressed 🚨 67070216 58226913 1.15
tpcds_q77/duckdb:vortex-file-compressed 67704961 68263090 0.99
tpcds_q78/duckdb:vortex-file-compressed 78063166 80958481 0.96
tpcds_q79/duckdb:vortex-file-compressed 36436553 34052477 1.07
tpcds_q80/duckdb:vortex-file-compressed 96914365 94864048 1.02
tpcds_q81/duckdb:vortex-file-compressed 35015048 32991682 1.06
tpcds_q82/duckdb:vortex-file-compressed 24169863 22734989 1.06
tpcds_q83/duckdb:vortex-file-compressed 30144666 27940748 1.08
tpcds_q84/duckdb:vortex-file-compressed 17851223 17095502 1.04
tpcds_q85/duckdb:vortex-file-compressed 48206415 44699591 1.08
tpcds_q86/duckdb:vortex-file-compressed 🚨 19840323 17596060 1.13
tpcds_q87/duckdb:vortex-file-compressed 41319343 40863765 1.01
tpcds_q88/duckdb:vortex-file-compressed 41216856 40460258 1.02
tpcds_q89/duckdb:vortex-file-compressed 18868451 18543059 1.02
tpcds_q90/duckdb:vortex-file-compressed 15261486 15318924 1.00
tpcds_q91/duckdb:vortex-file-compressed 29052449 26768829 1.09
tpcds_q92/duckdb:vortex-file-compressed 15152038 14511089 1.04
tpcds_q93/duckdb:vortex-file-compressed 31328050 30500305 1.03
tpcds_q94/duckdb:vortex-file-compressed 23906332 21822300 1.10
tpcds_q95/duckdb:vortex-file-compressed 154122644 154192315 1.00
tpcds_q96/duckdb:vortex-file-compressed 18021307 17531824 1.03
tpcds_q97/duckdb:vortex-file-compressed 38577951 39769255 0.97
tpcds_q98/duckdb:vortex-file-compressed 19328396 17775916 1.09
tpcds_q99/duckdb:vortex-file-compressed 🚨 35518969 32235094 1.10
duckdb / vortex-compact (1.012x ➖, 2↑ 3↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 35647431 33123731 1.08
tpcds_q02/duckdb:vortex-compact 126770431 123695331 1.02
tpcds_q03/duckdb:vortex-compact 49778338 49688955 1.00
tpcds_q04/duckdb:vortex-compact 128929816 123066730 1.05
tpcds_q05/duckdb:vortex-compact 175432401 171481264 1.02
tpcds_q06/duckdb:vortex-compact 41990615 40299796 1.04
tpcds_q07/duckdb:vortex-compact 39287415 38238761 1.03
tpcds_q08/duckdb:vortex-compact 30366862 28412528 1.07
tpcds_q09/duckdb:vortex-compact 114174667 111225634 1.03
tpcds_q10/duckdb:vortex-compact 50602224 47825075 1.06
tpcds_q11/duckdb:vortex-compact 77419043 76713073 1.01
tpcds_q12/duckdb:vortex-compact 20476310 20754431 0.99
tpcds_q13/duckdb:vortex-compact 54019485 54648895 0.99
tpcds_q14/duckdb:vortex-compact 293123543 291357138 1.01
tpcds_q15/duckdb:vortex-compact 45011768 43915623 1.02
tpcds_q16/duckdb:vortex-compact 37730238 38113624 0.99
tpcds_q17/duckdb:vortex-compact 53434052 52813403 1.01
tpcds_q18/duckdb:vortex-compact 69222569 67522286 1.03
tpcds_q19/duckdb:vortex-compact 42025731 40382572 1.04
tpcds_q20/duckdb:vortex-compact 21549383 20863660 1.03
tpcds_q21/duckdb:vortex-compact 27868323 27759760 1.00
tpcds_q22/duckdb:vortex-compact 115486457 112044343 1.03
tpcds_q23/duckdb:vortex-compact 🚀 157270166 175006075 0.90
tpcds_q24/duckdb:vortex-compact 79950533 78407247 1.02
tpcds_q25/duckdb:vortex-compact 53033092 52336448 1.01
tpcds_q26/duckdb:vortex-compact 52161926 50458162 1.03
tpcds_q27/duckdb:vortex-compact 143536568 143315323 1.00
tpcds_q28/duckdb:vortex-compact 108645461 108910856 1.00
tpcds_q29/duckdb:vortex-compact 54087080 52685305 1.03
tpcds_q30/duckdb:vortex-compact 36119844 34862582 1.04
tpcds_q31/duckdb:vortex-compact 31384180 31548159 0.99
tpcds_q32/duckdb:vortex-compact 24539239 24820719 0.99
tpcds_q33/duckdb:vortex-compact 148311363 151254586 0.98
tpcds_q34/duckdb:vortex-compact 30656025 30947100 0.99
tpcds_q35/duckdb:vortex-compact 72889156 74700024 0.98
tpcds_q36/duckdb:vortex-compact 35055039 35797421 0.98
tpcds_q37/duckdb:vortex-compact 31789550 32610328 0.97
tpcds_q38/duckdb:vortex-compact 43602254 42720998 1.02
tpcds_q39/duckdb:vortex-compact 53772935 56449188 0.95
tpcds_q40/duckdb:vortex-compact 33238576 31934272 1.04
tpcds_q41/duckdb:vortex-compact 17543713 17484053 1.00
tpcds_q42/duckdb:vortex-compact 🚨 16341552 14449029 1.13
tpcds_q43/duckdb:vortex-compact 25253450 24934520 1.01
tpcds_q44/duckdb:vortex-compact 36806983 36568414 1.01
tpcds_q45/duckdb:vortex-compact 34394100 35273807 0.98
tpcds_q46/duckdb:vortex-compact 63332533 61853419 1.02
tpcds_q47/duckdb:vortex-compact 58340309 56623419 1.03
tpcds_q48/duckdb:vortex-compact 46151745 45488501 1.01
tpcds_q49/duckdb:vortex-compact 49436338 51076695 0.97
tpcds_q50/duckdb:vortex-compact 56497776 55224579 1.02
tpcds_q51/duckdb:vortex-compact 105077417 110577527 0.95
tpcds_q52/duckdb:vortex-compact 16225729 15324462 1.06
tpcds_q53/duckdb:vortex-compact 22818493 22198927 1.03
tpcds_q54/duckdb:vortex-compact 91091662 85541746 1.06
tpcds_q55/duckdb:vortex-compact 15772893 14925400 1.06
tpcds_q56/duckdb:vortex-compact 145634718 140263481 1.04
tpcds_q57/duckdb:vortex-compact 49194353 48373122 1.02
tpcds_q58/duckdb:vortex-compact 42049036 42168384 1.00
tpcds_q59/duckdb:vortex-compact 69431718 67880510 1.02
tpcds_q60/duckdb:vortex-compact 148707074 148585831 1.00
tpcds_q61/duckdb:vortex-compact 53373456 55330174 0.96
tpcds_q62/duckdb:vortex-compact 🚨 26404411 22779261 1.16
tpcds_q63/duckdb:vortex-compact 22988357 23661280 0.97
tpcds_q64/duckdb:vortex-compact 106916661 106404693 1.00
tpcds_q65/duckdb:vortex-compact 29696394 28325319 1.05
tpcds_q66/duckdb:vortex-compact 100522925 97911218 1.03
tpcds_q67/duckdb:vortex-compact 153000085 151989235 1.01
tpcds_q68/duckdb:vortex-compact 58275236 58826026 0.99
tpcds_q69/duckdb:vortex-compact 52118256 50656070 1.03
tpcds_q70/duckdb:vortex-compact 🚨 33551495 29875875 1.12
tpcds_q71/duckdb:vortex-compact 26957027 28216078 0.96
tpcds_q72/duckdb:vortex-compact 195079827 198995585 0.98
tpcds_q73/duckdb:vortex-compact 29592206 28946397 1.02
tpcds_q74/duckdb:vortex-compact 59966551 60697343 0.99
tpcds_q75/duckdb:vortex-compact 71379301 74018008 0.96
tpcds_q76/duckdb:vortex-compact 135670522 136756702 0.99
tpcds_q77/duckdb:vortex-compact 140271265 140590657 1.00
tpcds_q78/duckdb:vortex-compact 87955330 90423852 0.97
tpcds_q79/duckdb:vortex-compact 62507528 61574974 1.02
tpcds_q80/duckdb:vortex-compact 166716336 167183564 1.00
tpcds_q81/duckdb:vortex-compact 41782597 41957075 1.00
tpcds_q82/duckdb:vortex-compact 33364972 31647035 1.05
tpcds_q83/duckdb:vortex-compact 47457682 47259874 1.00
tpcds_q84/duckdb:vortex-compact 22561383 21599487 1.04
tpcds_q85/duckdb:vortex-compact 63133821 62287952 1.01
tpcds_q86/duckdb:vortex-compact 21331779 20177418 1.06
tpcds_q87/duckdb:vortex-compact 42199021 43435449 0.97
tpcds_q88/duckdb:vortex-compact 43846540 44663999 0.98
tpcds_q89/duckdb:vortex-compact 24239240 23682215 1.02
tpcds_q90/duckdb:vortex-compact 16185610 16294629 0.99
tpcds_q91/duckdb:vortex-compact 47034017 46303577 1.02
tpcds_q92/duckdb:vortex-compact 20598308 22002891 0.94
tpcds_q93/duckdb:vortex-compact 39975091 39447730 1.01
tpcds_q94/duckdb:vortex-compact 28589342 29254588 0.98
tpcds_q95/duckdb:vortex-compact 153799697 154504168 1.00
tpcds_q96/duckdb:vortex-compact 🚀 19123825 21742514 0.88
tpcds_q97/duckdb:vortex-compact 46505382 42657620 1.09
tpcds_q98/duckdb:vortex-compact 24131412 22370188 1.08
tpcds_q99/duckdb:vortex-compact 38246993 36987925 1.03
duckdb / parquet (1.014x ➖, 0↑ 2↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 46673631 47235121 0.99
tpcds_q02/duckdb:parquet 58923224 61502310 0.96
tpcds_q03/duckdb:parquet 12271868 11940502 1.03
tpcds_q04/duckdb:parquet 128058011 127768798 1.00
tpcds_q05/duckdb:parquet 76256713 70250516 1.09
tpcds_q06/duckdb:parquet 29016303 30092812 0.96
tpcds_q07/duckdb:parquet 23603177 23462564 1.01
tpcds_q08/duckdb:parquet 29017296 27805261 1.04
tpcds_q09/duckdb:parquet 40022811 39992079 1.00
tpcds_q10/duckdb:parquet 35054281 36862268 0.95
tpcds_q11/duckdb:parquet 92173172 89059477 1.03
tpcds_q12/duckdb:parquet 15102211 15019318 1.01
tpcds_q13/duckdb:parquet 35237868 34500774 1.02
tpcds_q14/duckdb:parquet 168770017 167674517 1.01
tpcds_q15/duckdb:parquet 31001926 30485644 1.02
tpcds_q16/duckdb:parquet 21151542 21324376 0.99
tpcds_q17/duckdb:parquet 39237101 37392638 1.05
tpcds_q18/duckdb:parquet 48975248 47562158 1.03
tpcds_q19/duckdb:parquet 29964045 29509925 1.02
tpcds_q20/duckdb:parquet 16391280 15961794 1.03
tpcds_q21/duckdb:parquet 12010673 11605522 1.03
tpcds_q22/duckdb:parquet 71765906 69363741 1.03
tpcds_q23/duckdb:parquet 116934023 116486854 1.00
tpcds_q24/duckdb:parquet 45699451 45834168 1.00
tpcds_q25/duckdb:parquet 33721280 32311536 1.04
tpcds_q26/duckdb:parquet 37143569 36766342 1.01
tpcds_q27/duckdb:parquet 90893382 90230158 1.01
tpcds_q28/duckdb:parquet 37328470 37399863 1.00
tpcds_q29/duckdb:parquet 35789636 36294499 0.99
tpcds_q30/duckdb:parquet 40448970 40143192 1.01
tpcds_q31/duckdb:parquet 23650023 23078172 1.02
tpcds_q32/duckdb:parquet 11688341 11076246 1.06
tpcds_q33/duckdb:parquet 71585929 71594178 1.00
tpcds_q34/duckdb:parquet 21187839 21001795 1.01
tpcds_q35/duckdb:parquet 60980094 62008630 0.98
tpcds_q36/duckdb:parquet 21311877 20863395 1.02
tpcds_q37/duckdb:parquet 13939894 13494628 1.03
tpcds_q38/duckdb:parquet 36759906 36791592 1.00
tpcds_q39/duckdb:parquet 33181087 33113797 1.00
tpcds_q40/duckdb:parquet 18259277 18613343 0.98
tpcds_q41/duckdb:parquet 7704893 7514617 1.03
tpcds_q42/duckdb:parquet 10275785 10677979 0.96
tpcds_q43/duckdb:parquet 16188341 15871048 1.02
tpcds_q44/duckdb:parquet 22010209 22632108 0.97
tpcds_q45/duckdb:parquet 27763384 26861107 1.03
tpcds_q46/duckdb:parquet 46465965 45606737 1.02
tpcds_q47/duckdb:parquet 47476429 47129242 1.01
tpcds_q48/duckdb:parquet 30890942 31344872 0.99
tpcds_q49/duckdb:parquet 🚨 26653544 23879829 1.12
tpcds_q50/duckdb:parquet 25301237 25184843 1.00
tpcds_q51/duckdb:parquet 🚨 120051899 96911381 1.24
tpcds_q52/duckdb:parquet 11399010 11240093 1.01
tpcds_q53/duckdb:parquet 16852353 16334201 1.03
tpcds_q54/duckdb:parquet 42860868 42754061 1.00
tpcds_q55/duckdb:parquet 11134798 11067145 1.01
tpcds_q56/duckdb:parquet 68975677 70855817 0.97
tpcds_q57/duckdb:parquet 36003305 35306672 1.02
tpcds_q58/duckdb:parquet 21498187 21850731 0.98
tpcds_q59/duckdb:parquet 37420807 36504784 1.03
tpcds_q60/duckdb:parquet 74799232 72905382 1.03
tpcds_q61/duckdb:parquet 31406538 28795676 1.09
tpcds_q62/duckdb:parquet 12043185 12841163 0.94
tpcds_q63/duckdb:parquet 15587985 15520024 1.00
tpcds_q64/duckdb:parquet 74285213 75616655 0.98
tpcds_q65/duckdb:parquet 20815642 20971335 0.99
tpcds_q66/duckdb:parquet 61509891 56458375 1.09
tpcds_q67/duckdb:parquet 135337549 135324531 1.00
tpcds_q68/duckdb:parquet 38414805 38040359 1.01
tpcds_q69/duckdb:parquet 39247333 38251323 1.03
tpcds_q70/duckdb:parquet 20077975 19726429 1.02
tpcds_q71/duckdb:parquet 17706106 18750915 0.94
tpcds_q72/duckdb:parquet 164292017 163167561 1.01
tpcds_q73/duckdb:parquet 18571527 18216103 1.02
tpcds_q74/duckdb:parquet 49421269 50958219 0.97
tpcds_q75/duckdb:parquet 55028476 53633927 1.03
tpcds_q76/duckdb:parquet 67794444 70129250 0.97
tpcds_q77/duckdb:parquet 60881468 63031037 0.97
tpcds_q78/duckdb:parquet 76730022 76071056 1.01
tpcds_q79/duckdb:parquet 27937935 27778389 1.01
tpcds_q80/duckdb:parquet 84296954 85036336 0.99
tpcds_q81/duckdb:parquet 46536927 46731348 1.00
tpcds_q82/duckdb:parquet 15712665 15651198 1.00
tpcds_q83/duckdb:parquet 17027575 16483881 1.03
tpcds_q84/duckdb:parquet 21388915 20406522 1.05
tpcds_q85/duckdb:parquet 40786870 38306966 1.06
tpcds_q86/duckdb:parquet 12749211 12174900 1.05
tpcds_q87/duckdb:parquet 37130920 36776828 1.01
tpcds_q88/duckdb:parquet 29631322 28893970 1.03
tpcds_q89/duckdb:parquet 18022740 17337541 1.04
tpcds_q90/duckdb:parquet 7621246 7695993 0.99
tpcds_q91/duckdb:parquet 22948082 24248540 0.95
tpcds_q92/duckdb:parquet 12094608 11760708 1.03
tpcds_q93/duckdb:parquet 30689358 29539616 1.04
tpcds_q94/duckdb:parquet 16765521 16729045 1.00
tpcds_q95/duckdb:parquet 136306224 129745823 1.05
tpcds_q96/duckdb:parquet 9707266 9166759 1.06
tpcds_q97/duckdb:parquet 36731970 35219600 1.04
tpcds_q98/duckdb:parquet 18218558 18246797 1.00
tpcds_q99/duckdb:parquet 20345984 20026088 1.02
duckdb / duckdb (1.030x ➖, 0↑ 5↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20647203 20242816 1.02
tpcds_q02/duckdb:duckdb 19625679 18408276 1.07
tpcds_q03/duckdb:duckdb 8521874 8525509 1.00
tpcds_q04/duckdb:duckdb 161574574 162861411 0.99
tpcds_q05/duckdb:duckdb 19376163 18559204 1.04
tpcds_q06/duckdb:duckdb 23141633 22629390 1.02
tpcds_q07/duckdb:duckdb 40379128 38719833 1.04
tpcds_q08/duckdb:duckdb 121457795 119822617 1.01
tpcds_q09/duckdb:duckdb 19727638 19560551 1.01
tpcds_q10/duckdb:duckdb 23361559 22799040 1.02
tpcds_q11/duckdb:duckdb 143183682 139242451 1.03
tpcds_q12/duckdb:duckdb 11465764 11221255 1.02
tpcds_q13/duckdb:duckdb 23864015 23658721 1.01
tpcds_q14/duckdb:duckdb 91715902 92816524 0.99
tpcds_q15/duckdb:duckdb 25317128 23916762 1.06
tpcds_q16/duckdb:duckdb 🚨 18728862 16534186 1.13
tpcds_q17/duckdb:duckdb 21809487 21884487 1.00
tpcds_q18/duckdb:duckdb 44894432 43774598 1.03
tpcds_q19/duckdb:duckdb 16781402 16084856 1.04
tpcds_q20/duckdb:duckdb 11887662 12295930 0.97
tpcds_q21/duckdb:duckdb 6790372 6297571 1.08
tpcds_q22/duckdb:duckdb 62034541 60286224 1.03
tpcds_q23/duckdb:duckdb 82949086 79726100 1.04
tpcds_q24/duckdb:duckdb 🚨 24626533 21982637 1.12
tpcds_q25/duckdb:duckdb 17495994 16776537 1.04
tpcds_q26/duckdb:duckdb 27974312 25768709 1.09
tpcds_q27/duckdb:duckdb 41259270 40074214 1.03
tpcds_q28/duckdb:duckdb 21784724 20959343 1.04
tpcds_q29/duckdb:duckdb 20242878 20091054 1.01
tpcds_q30/duckdb:duckdb 30485206 27739469 1.10
tpcds_q31/duckdb:duckdb 21020959 19762472 1.06
tpcds_q32/duckdb:duckdb 🚨 7575407 6878395 1.10
tpcds_q33/duckdb:duckdb 13347975 12544956 1.06
tpcds_q34/duckdb:duckdb 15193308 14981945 1.01
tpcds_q35/duckdb:duckdb 33525297 32664356 1.03
tpcds_q36/duckdb:duckdb 73008528 69801753 1.05
tpcds_q37/duckdb:duckdb 7884581 7895239 1.00
tpcds_q38/duckdb:duckdb 31045085 30153178 1.03
tpcds_q39/duckdb:duckdb 🚨 31489251 26097204 1.21
tpcds_q40/duckdb:duckdb 13601813 12981733 1.05
tpcds_q41/duckdb:duckdb 8500485 8176231 1.04
tpcds_q42/duckdb:duckdb 6612408 6466953 1.02
tpcds_q43/duckdb:duckdb 11190995 10945996 1.02
tpcds_q44/duckdb:duckdb 13604115 13519837 1.01
tpcds_q45/duckdb:duckdb 16701767 17100449 0.98
tpcds_q46/duckdb:duckdb 37298795 35373476 1.05
tpcds_q47/duckdb:duckdb 40388560 41220774 0.98
tpcds_q48/duckdb:duckdb 23054012 22014287 1.05
tpcds_q49/duckdb:duckdb 16314809 16194694 1.01
tpcds_q50/duckdb:duckdb 14677383 13567766 1.08
tpcds_q51/duckdb:duckdb 92917116 92061697 1.01
tpcds_q52/duckdb:duckdb 7614334 7109076 1.07
tpcds_q53/duckdb:duckdb 11813085 11414035 1.03
tpcds_q54/duckdb:duckdb 16734913 17084693 0.98
tpcds_q55/duckdb:duckdb 6937137 6754418 1.03
tpcds_q56/duckdb:duckdb 🚨 14304587 12991056 1.10
tpcds_q57/duckdb:duckdb 31582726 31854074 0.99
tpcds_q58/duckdb:duckdb 12237242 12177334 1.00
tpcds_q59/duckdb:duckdb 34741460 34136863 1.02
tpcds_q60/duckdb:duckdb 14797101 14316036 1.03
tpcds_q61/duckdb:duckdb 14662190 14377140 1.02
tpcds_q62/duckdb:duckdb 9341161 9035008 1.03
tpcds_q63/duckdb:duckdb 11255556 11000744 1.02
tpcds_q64/duckdb:duckdb 55839552 51203728 1.09
tpcds_q65/duckdb:duckdb 33211959 34513828 0.96
tpcds_q66/duckdb:duckdb 24070146 25989338 0.93
tpcds_q67/duckdb:duckdb 128763485 130200279 0.99
tpcds_q68/duckdb:duckdb 25216652 24794783 1.02
tpcds_q69/duckdb:duckdb 25212960 24314731 1.04
tpcds_q70/duckdb:duckdb 15357654 14119311 1.09
tpcds_q71/duckdb:duckdb 12878848 12040700 1.07
tpcds_q72/duckdb:duckdb 42509342 41903157 1.01
tpcds_q73/duckdb:duckdb 10623263 10496840 1.01
tpcds_q74/duckdb:duckdb 99573652 99129110 1.00
tpcds_q75/duckdb:duckdb 42107002 43340510 0.97
tpcds_q76/duckdb:duckdb 12051968 12641968 0.95
tpcds_q77/duckdb:duckdb 11937996 12414673 0.96
tpcds_q78/duckdb:duckdb 63894354 62760620 1.02
tpcds_q79/duckdb:duckdb 17744879 18318038 0.97
tpcds_q80/duckdb:duckdb 28400814 28598676 0.99
tpcds_q81/duckdb:duckdb 38418181 36971435 1.04
tpcds_q82/duckdb:duckdb 8743497 8627462 1.01
tpcds_q83/duckdb:duckdb 9407124 8943742 1.05
tpcds_q84/duckdb:duckdb 14315548 13119156 1.09
tpcds_q85/duckdb:duckdb 24640763 23469752 1.05
tpcds_q86/duckdb:duckdb 11023814 10051795 1.10
tpcds_q87/duckdb:duckdb 32272915 32443911 0.99
tpcds_q88/duckdb:duckdb 24326466 23885335 1.02
tpcds_q89/duckdb:duckdb 13183135 13246696 1.00
tpcds_q90/duckdb:duckdb 5946321 5593076 1.06
tpcds_q91/duckdb:duckdb 12913050 12161433 1.06
tpcds_q92/duckdb:duckdb 8609179 8545259 1.01
tpcds_q93/duckdb:duckdb 20488709 21125964 0.97
tpcds_q94/duckdb:duckdb 12559898 12270462 1.02
tpcds_q95/duckdb:duckdb 134350147 128017082 1.05
tpcds_q96/duckdb:duckdb 4822000 4570573 1.06
tpcds_q97/duckdb:duckdb 32113557 29999750 1.07
tpcds_q98/duckdb:duckdb 13830694 13293052 1.04
tpcds_q99/duckdb:duckdb 16244932 15900852 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -0.8% +3.9% -4.5% +10.9% ➖ noise
1 datafusion:vortex-file-compressed +3.8% +3.9% -0.0% +24.0% ➖ noise
1 duckdb:duckdb +2.0% +3.9% -1.8% +10.0% ➖ noise
1 duckdb:vortex-compact +7.6% +3.9% +3.6% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +9.8% +3.9% +5.7% +10.0% ➖ noise
2 datafusion:vortex-compact +1.9% +3.3% -1.4% +10.3% ➖ noise
2 datafusion:vortex-file-compressed +7.0% +3.3% +3.6% +11.6% ➖ noise
2 duckdb:duckdb +6.6% +3.3% +3.2% +11.1% ➖ noise
2 duckdb:vortex-compact +2.5% +3.3% -0.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +9.8% +3.3% +6.3% +11.7% ➖ noise
3 datafusion:vortex-compact +1.8% +0.7% +1.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +6.6% +0.7% +5.9% +10.0% ➖ noise
3 duckdb:duckdb -0.0% +0.7% -0.7% +14.5% ➖ noise
3 duckdb:vortex-compact +0.2% +0.7% -0.5% +12.3% ➖ noise
3 duckdb:vortex-file-compressed +7.2% +0.7% +6.5% +11.3% ➖ noise
4 datafusion:vortex-compact +5.5% -1.1% +6.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +10.1% -1.1% +11.3% +10.0% 🚨 regression
4 duckdb:duckdb -0.8% -1.1% +0.3% +10.0% ➖ noise
4 duckdb:vortex-compact +4.8% -1.1% +5.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.9% -1.1% +3.0% +11.3% ➖ noise
5 datafusion:vortex-compact +7.1% +6.9% +0.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +7.2% +6.9% +0.3% +10.0% ➖ noise
5 duckdb:duckdb +4.4% +6.9% -2.3% +14.0% ➖ noise
5 duckdb:vortex-compact +2.3% +6.9% -4.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +6.7% +6.9% -0.2% +10.6% ➖ noise
6 datafusion:vortex-compact +1.5% -0.6% +2.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.4% -0.6% +1.0% +10.0% ➖ noise
6 duckdb:duckdb +2.3% -0.6% +2.9% +12.4% ➖ noise
6 duckdb:vortex-compact +4.2% -0.6% +4.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.2% -0.6% +4.8% +10.0% ➖ noise
7 datafusion:vortex-compact +4.0% +4.5% -0.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.5% +4.5% +0.0% +10.0% ➖ noise
7 duckdb:duckdb +4.3% +4.5% -0.2% +19.8% ➖ noise
7 duckdb:vortex-compact +2.7% +4.5% -1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.5% +4.5% +0.0% +10.5% ➖ noise
8 datafusion:vortex-compact +6.4% +4.4% +1.9% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +4.7% +4.4% +0.4% +10.0% ➖ noise
8 duckdb:duckdb +1.4% +4.4% -2.9% +10.0% ➖ noise
8 duckdb:vortex-compact +6.9% +4.4% +2.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +5.0% +4.4% +0.6% +10.0% ➖ noise
9 datafusion:vortex-compact -1.4% +1.5% -2.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +5.3% +1.5% +3.7% +10.0% ➖ noise
9 duckdb:duckdb +0.9% +1.5% -0.6% +10.0% ➖ noise
9 duckdb:vortex-compact +2.7% +1.5% +1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +6.0% +1.5% +4.4% +10.0% ➖ noise
10 datafusion:vortex-compact +1.3% +0.5% +0.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.6% +0.5% +1.0% +12.2% ➖ noise
10 duckdb:duckdb +2.5% +0.5% +1.9% +10.0% ➖ noise
10 duckdb:vortex-compact +5.8% +0.5% +5.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.7% +0.5% +4.1% +10.0% ➖ noise
11 datafusion:vortex-compact +0.3% +4.6% -4.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.0% +4.6% -0.6% +10.0% ➖ noise
11 duckdb:duckdb +2.8% +4.6% -1.7% +10.0% ➖ noise
11 duckdb:vortex-compact +0.9% +4.6% -3.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.8% +4.6% -3.7% +10.0% ➖ noise
12 datafusion:vortex-compact +4.2% +5.2% -0.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +6.3% +5.2% +1.1% +11.5% ➖ noise
12 duckdb:duckdb +2.2% +5.2% -2.9% +12.3% ➖ noise
12 duckdb:vortex-compact -1.3% +5.2% -6.2% +13.3% ➖ noise
12 duckdb:vortex-file-compressed +6.0% +5.2% +0.8% +12.2% ➖ noise
13 datafusion:vortex-compact +2.6% +0.3% +2.3% +10.9% ➖ noise
13 datafusion:vortex-file-compressed +1.3% +0.3% +1.0% +10.0% ➖ noise
13 duckdb:duckdb +0.9% +0.3% +0.6% +10.2% ➖ noise
13 duckdb:vortex-compact -1.2% +0.3% -1.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.1% +0.3% +1.8% +10.0% ➖ noise
14 datafusion:vortex-compact +2.1% +1.1% +1.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +9.3% +1.1% +8.1% +10.0% ➖ noise
14 duckdb:duckdb -1.2% +1.1% -2.2% +10.0% ➖ noise
14 duckdb:vortex-compact +0.6% +1.1% -0.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +4.8% +1.1% +3.7% +14.5% ➖ noise
15 datafusion:vortex-compact +0.6% +2.5% -1.8% +11.3% ➖ noise
15 datafusion:vortex-file-compressed +8.3% +2.5% +5.7% +11.3% ➖ noise
15 duckdb:duckdb +5.9% +2.5% +3.3% +11.0% ➖ noise
15 duckdb:vortex-compact +2.5% +2.5% +0.0% +14.9% ➖ noise
15 duckdb:vortex-file-compressed +5.8% +2.5% +3.3% +10.0% ➖ noise
16 datafusion:vortex-compact +2.7% +1.1% +1.7% +12.7% ➖ noise
16 datafusion:vortex-file-compressed +1.8% +1.1% +0.7% +11.0% ➖ noise
16 duckdb:duckdb +13.3% +1.1% +12.1% +15.7% ➖ noise
16 duckdb:vortex-compact -1.0% +1.1% -2.0% +14.8% ➖ noise
16 duckdb:vortex-file-compressed +5.7% +1.1% +4.6% +13.8% ➖ noise
17 datafusion:vortex-compact +3.5% +3.4% +0.1% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.0% +3.4% -4.2% +10.0% ➖ noise
17 duckdb:duckdb -0.3% +3.4% -3.6% +10.0% ➖ noise
17 duckdb:vortex-compact +1.2% +3.4% -2.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +3.3% +3.4% -0.0% +10.0% ➖ noise
18 datafusion:vortex-compact -0.3% +2.0% -2.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +5.2% +2.0% +3.1% +10.0% ➖ noise
18 duckdb:duckdb +2.6% +2.0% +0.5% +10.0% ➖ noise
18 duckdb:vortex-compact +2.5% +2.0% +0.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.2% +2.0% +0.1% +10.0% ➖ noise
19 datafusion:vortex-compact -4.8% +3.0% -7.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +2.9% +3.0% -0.2% +10.0% ➖ noise
19 duckdb:duckdb +4.3% +3.0% +1.3% +10.9% ➖ noise
19 duckdb:vortex-compact +4.1% +3.0% +1.0% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +8.5% +3.0% +5.3% +10.3% ➖ noise
20 datafusion:vortex-compact -6.5% +4.0% -10.1% +10.0% ✅ faster
20 datafusion:vortex-file-compressed +0.2% +4.0% -3.6% +10.0% ➖ noise
20 duckdb:duckdb -3.3% +4.0% -7.1% +10.0% ➖ noise
20 duckdb:vortex-compact +3.3% +4.0% -0.7% +15.2% ➖ noise
20 duckdb:vortex-file-compressed +7.4% +4.0% +3.3% +17.8% ➖ noise
21 datafusion:vortex-compact -1.1% +3.7% -4.6% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +6.7% +3.7% +2.9% +12.8% ➖ noise
21 duckdb:duckdb +7.8% +3.7% +4.0% +17.3% ➖ noise
21 duckdb:vortex-compact +0.4% +3.7% -3.2% +11.5% ➖ noise
21 duckdb:vortex-file-compressed -3.6% +3.7% -7.0% +16.9% ➖ noise
22 datafusion:vortex-compact -1.3% -5.1% +4.0% +10.7% ➖ noise
22 datafusion:vortex-file-compressed +2.1% -5.1% +7.6% +13.0% ➖ noise
22 duckdb:duckdb +2.9% -5.1% +8.4% +10.3% ➖ noise
22 duckdb:vortex-compact +3.1% -5.1% +8.6% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +6.2% -5.1% +11.9% +10.3% 🚨 regression
23 datafusion:vortex-compact +1.6% +0.2% +1.4% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +3.8% +0.2% +3.6% +10.0% ➖ noise
23 duckdb:duckdb +4.0% +0.2% +3.8% +16.5% ➖ noise
23 duckdb:vortex-compact -10.1% +0.2% -10.3% +14.6% ➖ noise
23 duckdb:vortex-file-compressed +2.8% +0.2% +2.6% +10.6% ➖ noise
24 datafusion:vortex-compact +0.1% +0.6% -0.5% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +4.9% +0.6% +4.3% +10.0% ➖ noise
24 duckdb:duckdb +12.0% +0.6% +11.4% +11.1% 🚨 regression
24 duckdb:vortex-compact +2.0% +0.6% +1.4% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -0.6% +0.6% -1.2% +10.0% ➖ noise
25 datafusion:vortex-compact -0.7% +2.5% -3.1% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +1.6% +2.5% -0.8% +10.0% ➖ noise
25 duckdb:duckdb +4.3% +2.5% +1.8% +11.2% ➖ noise
25 duckdb:vortex-compact +1.3% +2.5% -1.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +7.7% +2.5% +5.1% +10.0% ➖ noise
26 datafusion:vortex-compact +1.4% +3.4% -1.9% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +3.9% +3.4% +0.4% +10.0% ➖ noise
26 duckdb:duckdb +8.6% +3.4% +4.9% +12.7% ➖ noise
26 duckdb:vortex-compact +3.4% +3.4% -0.1% +10.5% ➖ noise
26 duckdb:vortex-file-compressed +4.6% +3.4% +1.1% +11.1% ➖ noise
27 datafusion:vortex-compact +2.2% +0.4% +1.7% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +5.7% +0.4% +5.3% +10.0% ➖ noise
27 duckdb:duckdb +3.0% +0.4% +2.5% +14.5% ➖ noise
27 duckdb:vortex-compact +0.2% +0.4% -0.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +1.2% +0.4% +0.8% +10.0% ➖ noise
28 datafusion:vortex-compact +1.1% +1.9% -0.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -3.7% +1.9% -5.5% +10.0% ➖ noise
28 duckdb:duckdb +3.9% +1.9% +2.0% +10.0% ➖ noise
28 duckdb:vortex-compact -0.2% +1.9% -2.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +2.6% +1.9% +0.6% +10.0% ➖ noise
29 datafusion:vortex-compact +5.3% -0.2% +5.5% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +3.7% -0.2% +3.9% +10.0% ➖ noise
29 duckdb:duckdb +0.8% -0.2% +1.0% +10.3% ➖ noise
29 duckdb:vortex-compact +2.7% -0.2% +2.9% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.9% -0.2% +2.1% +10.0% ➖ noise
30 datafusion:vortex-compact +2.9% +2.7% +0.3% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -0.5% +2.7% -3.1% +10.0% ➖ noise
30 duckdb:duckdb +9.9% +2.7% +7.1% +10.0% ➖ noise
30 duckdb:vortex-compact +3.6% +2.7% +0.9% +12.9% ➖ noise
30 duckdb:vortex-file-compressed +2.9% +2.7% +0.3% +12.2% ➖ noise
31 datafusion:vortex-compact -2.1% +2.0% -4.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.7% +2.0% -1.3% +10.0% ➖ noise
31 duckdb:duckdb +6.4% +2.0% +4.3% +11.9% ➖ noise
31 duckdb:vortex-compact -0.5% +2.0% -2.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -6.8% +2.0% -8.7% +10.0% ➖ noise
32 datafusion:vortex-compact +0.3% +2.0% -1.6% +11.5% ➖ noise
32 datafusion:vortex-file-compressed +3.9% +2.0% +1.9% +10.0% ➖ noise
32 duckdb:duckdb +10.1% +2.0% +8.0% +12.8% ➖ noise
32 duckdb:vortex-compact -1.1% +2.0% -3.1% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -0.8% +2.0% -2.7% +10.3% ➖ noise
33 datafusion:vortex-compact +3.4% +0.1% +3.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -0.8% +0.1% -0.9% +10.0% ➖ noise
33 duckdb:duckdb +6.4% +0.1% +6.3% +10.0% ➖ noise
33 duckdb:vortex-compact -1.9% +0.1% -2.0% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +5.8% +0.1% +5.8% +11.1% ➖ noise
34 datafusion:vortex-compact +0.4% +0.6% -0.2% +10.5% ➖ noise
34 datafusion:vortex-file-compressed -1.6% +0.6% -2.2% +10.0% ➖ noise
34 duckdb:duckdb +1.4% +0.6% +0.8% +17.8% ➖ noise
34 duckdb:vortex-compact -0.9% +0.6% -1.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +13.2% +0.6% +12.6% +11.0% 🚨 regression
35 datafusion:vortex-compact +1.0% +0.5% +0.4% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.3% +0.5% +1.7% +10.0% ➖ noise
35 duckdb:duckdb +2.6% +0.5% +2.1% +13.3% ➖ noise
35 duckdb:vortex-compact -2.4% +0.5% -2.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +12.6% +0.5% +11.9% +10.6% 🚨 regression
36 datafusion:vortex-compact +0.9% +2.4% -1.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.3% +2.4% -1.0% +10.8% ➖ noise
36 duckdb:duckdb +4.6% +2.4% +2.2% +10.0% ➖ noise
36 duckdb:vortex-compact -2.1% +2.4% -4.3% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +12.5% +2.4% +9.9% +11.2% ➖ noise
37 datafusion:vortex-compact -3.2% +3.5% -6.5% +13.0% ➖ noise
37 datafusion:vortex-file-compressed +5.1% +3.5% +1.5% +15.1% ➖ noise
37 duckdb:duckdb -0.1% +3.5% -3.6% +14.0% ➖ noise
37 duckdb:vortex-compact -2.5% +3.5% -5.9% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +9.8% +3.5% +6.1% +15.3% ➖ noise
38 datafusion:vortex-compact +5.1% -1.4% +6.5% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +2.3% -1.4% +3.7% +10.6% ➖ noise
38 duckdb:duckdb +3.0% -1.4% +4.4% +14.5% ➖ noise
38 duckdb:vortex-compact +2.1% -1.4% +3.5% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +7.0% -1.4% +8.5% +13.4% ➖ noise
39 datafusion:vortex-compact -2.4% +0.1% -2.5% +11.3% ➖ noise
39 datafusion:vortex-file-compressed -3.2% +0.1% -3.2% +10.2% ➖ noise
39 duckdb:duckdb +20.7% +0.1% +20.6% +17.2% 🚨 regression
39 duckdb:vortex-compact -4.7% +0.1% -4.8% +18.5% ➖ noise
39 duckdb:vortex-file-compressed -17.2% +0.1% -17.2% +20.9% ➖ noise
40 datafusion:vortex-compact +3.8% -1.2% +5.1% +13.4% ➖ noise
40 datafusion:vortex-file-compressed -0.4% -1.2% +0.8% +15.4% ➖ noise
40 duckdb:duckdb +4.8% -1.2% +6.1% +15.8% ➖ noise
40 duckdb:vortex-compact +4.1% -1.2% +5.4% +15.7% ➖ noise
40 duckdb:vortex-file-compressed +8.2% -1.2% +9.5% +13.4% ➖ noise
41 datafusion:vortex-compact +0.1% +3.4% -3.2% +14.5% ➖ noise
41 datafusion:vortex-file-compressed +4.3% +3.4% +0.8% +14.6% ➖ noise
41 duckdb:duckdb +4.0% +3.4% +0.5% +10.1% ➖ noise
41 duckdb:vortex-compact +0.3% +3.4% -3.0% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +5.7% +3.4% +2.2% +10.0% ➖ noise
42 datafusion:vortex-compact +3.9% +2.3% +1.6% +13.3% ➖ noise
42 datafusion:vortex-file-compressed +5.5% +2.3% +3.2% +11.2% ➖ noise
42 duckdb:duckdb +2.2% +2.3% -0.0% +16.2% ➖ noise
42 duckdb:vortex-compact +13.1% +2.3% +10.6% +19.6% ➖ noise
42 duckdb:vortex-file-compressed +0.1% +2.3% -2.2% +18.4% ➖ noise
43 datafusion:vortex-compact -0.3% +1.9% -2.2% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +5.6% +1.9% +3.6% +10.0% ➖ noise
43 duckdb:duckdb +2.2% +1.9% +0.3% +10.0% ➖ noise
43 duckdb:vortex-compact +1.3% +1.9% -0.6% +10.0% ➖ noise
43 duckdb:vortex-file-compressed +7.4% +1.9% +5.4% +10.0% ➖ noise
44 datafusion:vortex-compact +2.0% -0.4% +2.3% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +0.0% -0.4% +0.4% +10.0% ➖ noise
44 duckdb:duckdb +0.6% -0.4% +1.0% +12.7% ➖ noise
44 duckdb:vortex-compact +0.7% -0.4% +1.0% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +10.1% -0.4% +10.6% +12.5% ➖ noise
45 datafusion:vortex-compact -1.6% +0.8% -2.3% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -1.6% +0.8% -2.4% +10.0% ➖ noise
45 duckdb:duckdb -2.3% +0.8% -3.1% +11.5% ➖ noise
45 duckdb:vortex-compact -2.5% +0.8% -3.2% +13.5% ➖ noise
45 duckdb:vortex-file-compressed +2.4% +0.8% +1.6% +10.0% ➖ noise
46 datafusion:vortex-compact +1.6% +3.3% -1.7% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +0.6% +3.3% -2.6% +10.0% ➖ noise
46 duckdb:duckdb +5.4% +3.3% +2.1% +10.0% ➖ noise
46 duckdb:vortex-compact +2.4% +3.3% -0.8% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +6.3% +3.3% +2.9% +10.0% ➖ noise
47 datafusion:vortex-compact -0.9% -0.6% -0.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +3.2% -0.6% +3.8% +10.0% ➖ noise
47 duckdb:duckdb -2.0% -0.6% -1.4% +10.0% ➖ noise
47 duckdb:vortex-compact +3.0% -0.6% +3.7% +13.0% ➖ noise
47 duckdb:vortex-file-compressed -1.3% -0.6% -0.7% +11.4% ➖ noise
48 datafusion:vortex-compact +1.8% -1.9% +3.8% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -1.7% -1.9% +0.2% +10.0% ➖ noise
48 duckdb:duckdb +4.7% -1.9% +6.8% +10.0% ➖ noise
48 duckdb:vortex-compact +1.5% -1.9% +3.5% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +3.6% -1.9% +5.6% +10.5% ➖ noise
49 datafusion:vortex-compact +0.7% +6.5% -5.4% +14.1% ➖ noise
49 datafusion:vortex-file-compressed -1.0% +6.5% -7.0% +15.3% ➖ noise
49 duckdb:duckdb +0.7% +6.5% -5.4% +16.6% ➖ noise
49 duckdb:vortex-compact -3.2% +6.5% -9.1% +16.9% ➖ noise
49 duckdb:vortex-file-compressed +2.4% +6.5% -3.9% +18.9% ➖ noise
50 datafusion:vortex-compact -0.0% +0.2% -0.3% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -1.1% +0.2% -1.3% +10.0% ➖ noise
50 duckdb:duckdb +8.2% +0.2% +8.0% +38.6% ➖ noise
50 duckdb:vortex-compact +2.3% +0.2% +2.1% +10.9% ➖ noise
50 duckdb:vortex-file-compressed -0.8% +0.2% -1.0% +10.0% ➖ noise
51 datafusion:vortex-compact -0.2% +8.4% -7.9% +12.5% ➖ noise
51 datafusion:vortex-file-compressed +4.3% +8.4% -3.8% +12.6% ➖ noise
51 duckdb:duckdb +0.9% +8.4% -6.9% +11.2% ➖ noise
51 duckdb:vortex-compact -5.0% +8.4% -12.3% +20.9% ➖ noise
51 duckdb:vortex-file-compressed +1.0% +8.4% -6.8% +20.9% ➖ noise
52 datafusion:vortex-compact +5.8% +0.6% +5.2% +15.4% ➖ noise
52 datafusion:vortex-file-compressed +4.0% +0.6% +3.4% +16.4% ➖ noise
52 duckdb:duckdb +7.1% +0.6% +6.5% +14.4% ➖ noise
52 duckdb:vortex-compact +5.9% +0.6% +5.3% +16.5% ➖ noise
52 duckdb:vortex-file-compressed +10.7% +0.6% +10.0% +17.8% ➖ noise
53 datafusion:vortex-compact +3.0% +4.0% -0.9% +13.5% ➖ noise
53 datafusion:vortex-file-compressed +6.1% +4.0% +2.1% +10.0% ➖ noise
53 duckdb:duckdb +3.5% +4.0% -0.4% +11.1% ➖ noise
53 duckdb:vortex-compact +2.8% +4.0% -1.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +6.1% +4.0% +2.0% +12.2% ➖ noise
54 datafusion:vortex-compact -1.6% +1.6% -3.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +3.6% +1.6% +2.0% +10.0% ➖ noise
54 duckdb:duckdb -2.0% +1.6% -3.6% +10.0% ➖ noise
54 duckdb:vortex-compact +6.5% +1.6% +4.8% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +4.8% +1.6% +3.2% +10.8% ➖ noise
55 datafusion:vortex-compact +2.1% +4.5% -2.4% +14.1% ➖ noise
55 datafusion:vortex-file-compressed +5.7% +4.5% +1.2% +11.7% ➖ noise
55 duckdb:duckdb +2.7% +4.5% -1.7% +16.9% ➖ noise
55 duckdb:vortex-compact +5.7% +4.5% +1.1% +15.2% ➖ noise
55 duckdb:vortex-file-compressed -0.4% +4.5% -4.7% +14.1% ➖ noise
56 datafusion:vortex-compact +1.3% -4.5% +6.1% +12.5% ➖ noise
56 datafusion:vortex-file-compressed +9.7% -4.5% +14.9% +10.2% 🚨 regression
56 duckdb:duckdb +10.1% -4.5% +15.3% +12.1% 🚨 regression
56 duckdb:vortex-compact +3.8% -4.5% +8.7% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +4.8% -4.5% +9.8% +14.8% ➖ noise
57 datafusion:vortex-compact +1.2% +2.4% -1.2% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +1.4% +2.4% -1.0% +10.0% ➖ noise
57 duckdb:duckdb -0.9% +2.4% -3.2% +10.0% ➖ noise
57 duckdb:vortex-compact +1.7% +2.4% -0.7% +10.6% ➖ noise
57 duckdb:vortex-file-compressed +7.4% +2.4% +4.9% +13.6% ➖ noise
58 datafusion:vortex-compact -1.2% -0.2% -1.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +4.3% -0.2% +4.5% +10.0% ➖ noise
58 duckdb:duckdb +0.5% -0.2% +0.7% +14.0% ➖ noise
58 duckdb:vortex-compact -0.3% -0.2% -0.1% +11.4% ➖ noise
58 duckdb:vortex-file-compressed +7.0% -0.2% +7.2% +14.7% ➖ noise
59 datafusion:vortex-compact +0.6% +2.4% -1.8% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -1.5% +2.4% -3.9% +10.0% ➖ noise
59 duckdb:duckdb +1.8% +2.4% -0.6% +10.0% ➖ noise
59 duckdb:vortex-compact +2.3% +2.4% -0.1% +10.0% ➖ noise
59 duckdb:vortex-file-compressed +0.9% +2.4% -1.5% +10.0% ➖ noise
60 datafusion:vortex-compact -3.1% +0.8% -3.9% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +2.5% +0.8% +1.7% +11.0% ➖ noise
60 duckdb:duckdb +3.4% +0.8% +2.5% +11.4% ➖ noise
60 duckdb:vortex-compact +0.1% +0.8% -0.8% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +3.8% +0.8% +2.9% +12.0% ➖ noise
61 datafusion:vortex-compact +1.8% +4.3% -2.4% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -2.9% +4.3% -6.9% +10.0% ➖ noise
61 duckdb:duckdb +2.0% +4.3% -2.2% +10.5% ➖ noise
61 duckdb:vortex-compact -3.5% +4.3% -7.5% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -3.3% +4.3% -7.3% +13.5% ➖ noise
62 datafusion:vortex-compact -0.6% -2.8% +2.2% +10.0% ➖ noise
62 datafusion:vortex-file-compressed +1.4% -2.8% +4.3% +10.6% ➖ noise
62 duckdb:duckdb +3.4% -2.8% +6.3% +12.0% ➖ noise
62 duckdb:vortex-compact +15.9% -2.8% +19.2% +22.2% ➖ noise
62 duckdb:vortex-file-compressed -0.2% -2.8% +2.6% +22.2% ➖ noise
63 datafusion:vortex-compact +1.9% -0.8% +2.7% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +0.1% -0.8% +1.0% +10.0% ➖ noise
63 duckdb:duckdb +2.3% -0.8% +3.2% +10.4% ➖ noise
63 duckdb:vortex-compact -2.8% -0.8% -2.0% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +8.5% -0.8% +9.4% +11.5% ➖ noise
64 datafusion:vortex-compact +4.6% -0.3% +4.9% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +6.6% -0.3% +6.9% +10.0% ➖ noise
64 duckdb:duckdb +9.1% -0.3% +9.4% +10.0% ➖ noise
64 duckdb:vortex-compact +0.5% -0.3% +0.8% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +1.6% -0.3% +1.9% +10.0% ➖ noise
65 datafusion:vortex-compact +5.6% -0.3% +5.9% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -2.0% -0.3% -1.7% +13.6% ➖ noise
65 duckdb:duckdb -3.8% -0.3% -3.5% +12.2% ➖ noise
65 duckdb:vortex-compact +4.8% -0.3% +5.2% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -0.4% -0.3% -0.1% +10.0% ➖ noise
66 datafusion:vortex-compact -7.4% +2.8% -10.0% +14.9% ➖ noise
66 datafusion:vortex-file-compressed +8.6% +2.8% +5.7% +13.9% ➖ noise
66 duckdb:duckdb -7.4% +2.8% -9.9% +19.2% ➖ noise
66 duckdb:vortex-compact +2.7% +2.8% -0.2% +12.6% ➖ noise
66 duckdb:vortex-file-compressed +4.9% +2.8% +2.0% +13.2% ➖ noise
67 datafusion:vortex-compact +2.2% -1.6% +3.9% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +2.7% -1.6% +4.4% +10.0% ➖ noise
67 duckdb:duckdb -1.1% -1.6% +0.5% +10.0% ➖ noise
67 duckdb:vortex-compact +0.7% -1.6% +2.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +0.9% -1.6% +2.5% +10.0% ➖ noise
68 datafusion:vortex-compact +3.7% -1.6% +5.4% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -0.1% -1.6% +1.5% +10.0% ➖ noise
68 duckdb:duckdb +1.7% -1.6% +3.3% +10.0% ➖ noise
68 duckdb:vortex-compact -0.9% -1.6% +0.7% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +0.3% -1.6% +1.9% +10.0% ➖ noise
69 datafusion:vortex-compact +2.6% +3.8% -1.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -2.8% +3.8% -6.3% +10.0% ➖ noise
69 duckdb:duckdb +3.7% +3.8% -0.1% +13.7% ➖ noise
69 duckdb:vortex-compact +2.9% +3.8% -0.8% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +3.4% +3.8% -0.3% +10.0% ➖ noise
70 datafusion:vortex-compact +0.7% +2.0% -1.3% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +6.6% +2.0% +4.6% +10.5% ➖ noise
70 duckdb:duckdb +8.8% +2.0% +6.7% +12.8% ➖ noise
70 duckdb:vortex-compact +12.3% +2.0% +10.1% +12.9% ➖ noise
70 duckdb:vortex-file-compressed +1.2% +2.0% -0.8% +10.0% ➖ noise
71 datafusion:vortex-compact -0.3% -3.9% +3.7% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +2.6% -3.9% +6.8% +12.4% ➖ noise
71 duckdb:duckdb +7.0% -3.9% +11.3% +13.0% ➖ noise
71 duckdb:vortex-compact -4.5% -3.9% -0.6% +10.9% ➖ noise
71 duckdb:vortex-file-compressed +2.7% -3.9% +6.9% +13.7% ➖ noise
72 datafusion:vortex-compact +3.4% +0.5% +2.9% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +4.3% +0.5% +3.8% +10.0% ➖ noise
72 duckdb:duckdb +1.4% +0.5% +0.9% +10.0% ➖ noise
72 duckdb:vortex-compact -2.0% +0.5% -2.5% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +2.1% +0.5% +1.6% +10.0% ➖ noise
73 datafusion:vortex-compact +1.3% -1.7% +3.0% +21.6% ➖ noise
73 datafusion:vortex-file-compressed +3.4% -1.7% +5.1% +24.4% ➖ noise
73 duckdb:duckdb +1.2% -1.7% +2.9% +13.2% ➖ noise
73 duckdb:vortex-compact +2.2% -1.7% +4.0% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +2.0% -1.7% +3.7% +10.0% ➖ noise
74 datafusion:vortex-compact -0.7% -2.6% +2.0% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -0.7% -2.6% +2.0% +10.0% ➖ noise
74 duckdb:duckdb +0.4% -2.6% +3.2% +10.0% ➖ noise
74 duckdb:vortex-compact -1.2% -2.6% +1.5% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +9.3% -2.6% +12.3% +10.0% 🚨 regression
75 datafusion:vortex-compact +2.0% +1.8% +0.2% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -1.6% +1.8% -3.4% +10.0% ➖ noise
75 duckdb:duckdb -2.8% +1.8% -4.6% +10.0% ➖ noise
75 duckdb:vortex-compact -3.6% +1.8% -5.3% +12.2% ➖ noise
75 duckdb:vortex-file-compressed -4.4% +1.8% -6.1% +10.0% ➖ noise
76 datafusion:vortex-compact +2.4% -3.2% +5.8% +10.3% ➖ noise
76 datafusion:vortex-file-compressed +2.8% -3.2% +6.3% +15.4% ➖ noise
76 duckdb:duckdb -4.7% -3.2% -1.5% +14.6% ➖ noise
76 duckdb:vortex-compact -0.8% -3.2% +2.5% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +15.2% -3.2% +19.0% +16.5% 🚨 regression
77 datafusion:vortex-compact -3.2% -3.5% +0.4% +10.7% ➖ noise
77 datafusion:vortex-file-compressed +4.2% -3.5% +8.0% +10.0% ➖ noise
77 duckdb:duckdb -3.8% -3.5% -0.3% +13.7% ➖ noise
77 duckdb:vortex-compact -0.2% -3.5% +3.4% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -0.8% -3.5% +2.8% +19.1% ➖ noise
78 datafusion:vortex-compact +0.5% +4.0% -3.4% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +2.4% +4.0% -1.6% +10.0% ➖ noise
78 duckdb:duckdb +1.8% +4.0% -2.2% +11.2% ➖ noise
78 duckdb:vortex-compact -2.7% +4.0% -6.5% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -3.6% +4.0% -7.3% +12.5% ➖ noise
79 datafusion:vortex-compact +0.8% -1.2% +2.0% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -0.2% -1.2% +0.9% +10.0% ➖ noise
79 duckdb:duckdb -3.1% -1.2% -2.0% +11.7% ➖ noise
79 duckdb:vortex-compact +1.5% -1.2% +2.7% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +7.0% -1.2% +8.3% +11.4% ➖ noise
80 datafusion:vortex-compact +3.8% -1.2% +5.0% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +5.1% -1.2% +6.3% +10.0% ➖ noise
80 duckdb:duckdb -0.7% -1.2% +0.5% +16.6% ➖ noise
80 duckdb:vortex-compact -0.3% -1.2% +0.9% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +2.2% -1.2% +3.4% +10.0% ➖ noise
81 datafusion:vortex-compact +3.5% +1.6% +1.9% +12.2% ➖ noise
81 datafusion:vortex-file-compressed +3.4% +1.6% +1.8% +14.6% ➖ noise
81 duckdb:duckdb +3.9% +1.6% +2.3% +10.3% ➖ noise
81 duckdb:vortex-compact -0.4% +1.6% -1.9% +14.5% ➖ noise
81 duckdb:vortex-file-compressed +6.1% +1.6% +4.5% +11.2% ➖ noise
82 datafusion:vortex-compact +3.6% +0.2% +3.4% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +3.9% +0.2% +3.7% +11.2% ➖ noise
82 duckdb:duckdb +1.3% +0.2% +1.1% +18.2% ➖ noise
82 duckdb:vortex-compact +5.4% +0.2% +5.2% +13.7% ➖ noise
82 duckdb:vortex-file-compressed +6.3% +0.2% +6.1% +16.4% ➖ noise
83 datafusion:vortex-compact +3.7% +2.3% +1.4% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -2.1% +2.3% -4.3% +10.0% ➖ noise
83 duckdb:duckdb +5.2% +2.3% +2.8% +11.3% ➖ noise
83 duckdb:vortex-compact +0.4% +2.3% -1.9% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +7.9% +2.3% +5.4% +10.0% ➖ noise
84 datafusion:vortex-compact -0.8% +4.3% -4.9% +13.3% ➖ noise
84 datafusion:vortex-file-compressed +0.6% +4.3% -3.5% +11.9% ➖ noise
84 duckdb:duckdb +9.1% +4.3% +4.7% +10.0% ➖ noise
84 duckdb:vortex-compact +4.5% +4.3% +0.2% +10.5% ➖ noise
84 duckdb:vortex-file-compressed +4.4% +4.3% +0.2% +10.0% ➖ noise
85 datafusion:vortex-compact +1.8% +5.1% -3.1% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +0.9% +5.1% -3.9% +10.0% ➖ noise
85 duckdb:duckdb +5.0% +5.1% -0.1% +13.2% ➖ noise
85 duckdb:vortex-compact +1.4% +5.1% -3.5% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +7.8% +5.1% +2.6% +10.0% ➖ noise
86 datafusion:vortex-compact -0.7% +2.0% -2.6% +10.5% ➖ noise
86 datafusion:vortex-file-compressed -2.5% +2.0% -4.4% +11.9% ➖ noise
86 duckdb:duckdb +9.7% +2.0% +7.5% +15.7% ➖ noise
86 duckdb:vortex-compact +5.7% +2.0% +3.6% +16.7% ➖ noise
86 duckdb:vortex-file-compressed +12.8% +2.0% +10.5% +16.5% ➖ noise
87 datafusion:vortex-compact +1.0% +2.2% -1.3% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +0.4% +2.2% -1.8% +10.0% ➖ noise
87 duckdb:duckdb -0.5% +2.2% -2.7% +11.1% ➖ noise
87 duckdb:vortex-compact -2.8% +2.2% -5.0% +14.3% ➖ noise
87 duckdb:vortex-file-compressed +1.1% +2.2% -1.1% +13.7% ➖ noise
88 datafusion:vortex-compact +0.1% +3.2% -3.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +2.9% +3.2% -0.3% +10.0% ➖ noise
88 duckdb:duckdb +1.8% +3.2% -1.4% +10.0% ➖ noise
88 duckdb:vortex-compact -1.8% +3.2% -4.9% +10.2% ➖ noise
88 duckdb:vortex-file-compressed +1.9% +3.2% -1.3% +10.9% ➖ noise
89 datafusion:vortex-compact -1.7% +2.7% -4.2% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +0.5% +2.7% -2.1% +11.4% ➖ noise
89 duckdb:duckdb -0.5% +2.7% -3.1% +14.0% ➖ noise
89 duckdb:vortex-compact +2.4% +2.7% -0.3% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +1.8% +2.7% -0.9% +12.1% ➖ noise
90 datafusion:vortex-compact +3.7% +1.9% +1.8% +12.3% ➖ noise
90 datafusion:vortex-file-compressed +0.1% +1.9% -1.7% +13.0% ➖ noise
90 duckdb:duckdb +6.3% +1.9% +4.4% +17.6% ➖ noise
90 duckdb:vortex-compact -0.7% +1.9% -2.5% +14.0% ➖ noise
90 duckdb:vortex-file-compressed -0.4% +1.9% -2.2% +13.6% ➖ noise
91 datafusion:vortex-compact +3.5% -2.1% +5.7% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +2.0% -2.1% +4.2% +11.2% ➖ noise
91 duckdb:duckdb +6.2% -2.1% +8.5% +14.2% ➖ noise
91 duckdb:vortex-compact +1.6% -2.1% +3.8% +10.8% ➖ noise
91 duckdb:vortex-file-compressed +8.5% -2.1% +10.9% +12.2% ➖ noise
92 datafusion:vortex-compact +4.7% -1.3% +6.0% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +5.3% -1.3% +6.7% +10.8% ➖ noise
92 duckdb:duckdb +0.7% -1.3% +2.1% +15.3% ➖ noise
92 duckdb:vortex-compact -6.4% -1.3% -5.2% +14.6% ➖ noise
92 duckdb:vortex-file-compressed +4.4% -1.3% +5.8% +13.6% ➖ noise
93 datafusion:vortex-compact +5.0% +2.6% +2.3% +11.8% ➖ noise
93 datafusion:vortex-file-compressed +0.8% +2.6% -1.8% +11.9% ➖ noise
93 duckdb:duckdb -3.0% +2.6% -5.5% +18.5% ➖ noise
93 duckdb:vortex-compact +1.3% +2.6% -1.2% +10.0% ➖ noise
93 duckdb:vortex-file-compressed +2.7% +2.6% +0.1% +16.1% ➖ noise
94 datafusion:vortex-compact +2.9% -0.4% +3.3% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +4.0% -0.4% +4.5% +10.0% ➖ noise
94 duckdb:duckdb +2.4% -0.4% +2.8% +10.0% ➖ noise
94 duckdb:vortex-compact -2.3% -0.4% -1.9% +10.1% ➖ noise
94 duckdb:vortex-file-compressed +9.6% -0.4% +10.0% +13.8% ➖ noise
95 datafusion:vortex-compact +0.2% +3.1% -2.8% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -3.9% +3.1% -6.8% +10.0% ➖ noise
95 duckdb:duckdb +4.9% +3.1% +1.8% +10.0% ➖ noise
95 duckdb:vortex-compact -0.5% +3.1% -3.5% +17.3% ➖ noise
95 duckdb:vortex-file-compressed -0.0% +3.1% -3.1% +15.9% ➖ noise
96 datafusion:vortex-compact -3.4% +7.8% -10.3% +12.4% ➖ noise
96 datafusion:vortex-file-compressed +6.3% +7.8% -1.3% +14.8% ➖ noise
96 duckdb:duckdb +5.5% +7.8% -2.1% +17.6% ➖ noise
96 duckdb:vortex-compact -12.0% +7.8% -18.4% +17.5% ✅ faster
96 duckdb:vortex-file-compressed +2.8% +7.8% -4.6% +11.1% ➖ noise
97 datafusion:vortex-compact +2.8% +1.1% +1.7% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -1.5% +1.1% -2.6% +10.0% ➖ noise
97 duckdb:duckdb +7.0% +1.1% +5.9% +10.7% ➖ noise
97 duckdb:vortex-compact +9.0% +1.1% +7.9% +12.1% ➖ noise
97 duckdb:vortex-file-compressed -3.0% +1.1% -4.0% +13.1% ➖ noise
98 datafusion:vortex-compact +0.3% +1.4% -1.1% +11.5% ➖ noise
98 datafusion:vortex-file-compressed -1.7% +1.4% -3.0% +10.0% ➖ noise
98 duckdb:duckdb +4.0% +1.4% +2.6% +12.8% ➖ noise
98 duckdb:vortex-compact +7.9% +1.4% +6.4% +12.6% ➖ noise
98 duckdb:vortex-file-compressed +8.7% +1.4% +7.2% +11.9% ➖ noise
99 datafusion:vortex-compact -1.0% +5.5% -6.2% +18.0% ➖ noise
99 datafusion:vortex-file-compressed +2.6% +5.5% -2.7% +16.2% ➖ noise
99 duckdb:duckdb +2.2% +5.5% -3.1% +12.9% ➖ noise
99 duckdb:vortex-compact +3.4% +5.5% -2.0% +33.3% ➖ noise
99 duckdb:vortex-file-compressed +10.2% +5.5% +4.5% +28.4% ➖ noise

Signed-off-by: Will Manning <will@willmanning.io>
@lwwmanning lwwmanning added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 13, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 13, 2026
@lwwmanning lwwmanning enabled auto-merge (squash) March 13, 2026 18:52
@lwwmanning lwwmanning disabled auto-merge March 13, 2026 18:54
@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.5%
Vortex (geomean): 0.954x ➖
Parquet (geomean): 0.966x ➖
Shifts: Parquet (control) -3.4% · Median polish -3.7%


datafusion / vortex-file-compressed (0.935x ➖, 4↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 418982989 438053432 0.96
tpch_q02/datafusion:vortex-file-compressed 155854483 163452246 0.95
tpch_q03/datafusion:vortex-file-compressed 🚀 251746955 280872258 0.90
tpch_q04/datafusion:vortex-file-compressed 106587949 112530775 0.95
tpch_q05/datafusion:vortex-file-compressed 🚀 459413540 512624037 0.90
tpch_q06/datafusion:vortex-file-compressed 40649950 43989007 0.92
tpch_q07/datafusion:vortex-file-compressed 645272066 670942803 0.96
tpch_q08/datafusion:vortex-file-compressed 466625395 492562096 0.95
tpch_q09/datafusion:vortex-file-compressed 802758578 843409535 0.95
tpch_q10/datafusion:vortex-file-compressed 284737617 302802643 0.94
tpch_q11/datafusion:vortex-file-compressed 117752282 121852803 0.97
tpch_q12/datafusion:vortex-file-compressed 123916475 127948558 0.97
tpch_q13/datafusion:vortex-file-compressed 227898981 234276888 0.97
tpch_q14/datafusion:vortex-file-compressed 🚀 71479837 83838785 0.85
tpch_q15/datafusion:vortex-file-compressed 107867448 113757371 0.95
tpch_q16/datafusion:vortex-file-compressed 93177687 97389739 0.96
tpch_q17/datafusion:vortex-file-compressed 🚀 740288075 828943054 0.89
tpch_q18/datafusion:vortex-file-compressed 974957978 1082666864 0.90
tpch_q19/datafusion:vortex-file-compressed 125899253 132913735 0.95
tpch_q20/datafusion:vortex-file-compressed 200127957 209974028 0.95
tpch_q21/datafusion:vortex-file-compressed 763084463 835020431 0.91
tpch_q22/datafusion:vortex-file-compressed 61471724 66410495 0.93
datafusion / vortex-compact (0.961x ➖, 3↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 484083780 470079112 1.03
tpch_q02/datafusion:vortex-compact 164219469 160154659 1.03
tpch_q03/datafusion:vortex-compact 264044967 262368942 1.01
tpch_q04/datafusion:vortex-compact 127825169 129038467 0.99
tpch_q05/datafusion:vortex-compact 470833974 498720005 0.94
tpch_q06/datafusion:vortex-compact 64163986 64529273 0.99
tpch_q07/datafusion:vortex-compact 674543155 724411662 0.93
tpch_q08/datafusion:vortex-compact 478499726 511090666 0.94
tpch_q09/datafusion:vortex-compact 814740945 858832117 0.95
tpch_q10/datafusion:vortex-compact 🚀 334304747 375836582 0.89
tpch_q11/datafusion:vortex-compact 121114205 124102196 0.98
tpch_q12/datafusion:vortex-compact 186842766 190236583 0.98
tpch_q13/datafusion:vortex-compact 276702248 303307967 0.91
tpch_q14/datafusion:vortex-compact 90410627 95649712 0.95
tpch_q15/datafusion:vortex-compact 167333024 169571126 0.99
tpch_q16/datafusion:vortex-compact 100128643 99567081 1.01
tpch_q17/datafusion:vortex-compact 🚀 748350453 846482139 0.88
tpch_q18/datafusion:vortex-compact 980994376 1086779063 0.90
tpch_q19/datafusion:vortex-compact 229158838 235409379 0.97
tpch_q20/datafusion:vortex-compact 🚀 230331892 257177659 0.90
tpch_q21/datafusion:vortex-compact 806515151 802805233 1.00
tpch_q22/datafusion:vortex-compact 72213780 72002762 1.00
datafusion / parquet (0.961x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 467576712 508486007 0.92
tpch_q02/datafusion:parquet 257384924 263837424 0.98
tpch_q03/datafusion:parquet 394996437 402917317 0.98
tpch_q04/datafusion:parquet 149975322 160523546 0.93
tpch_q05/datafusion:parquet 582935438 605487779 0.96
tpch_q06/datafusion:parquet 123825291 124112822 1.00
tpch_q07/datafusion:parquet 794674003 867315621 0.92
tpch_q08/datafusion:parquet 644021460 661107654 0.97
tpch_q09/datafusion:parquet 963771183 1051499401 0.92
tpch_q10/datafusion:parquet 595422721 628810505 0.95
tpch_q11/datafusion:parquet 189207574 195504015 0.97
tpch_q12/datafusion:parquet 242714895 245371444 0.99
tpch_q13/datafusion:parquet 346305697 364518834 0.95
tpch_q14/datafusion:parquet 202498957 200248830 1.01
tpch_q15/datafusion:parquet 263727078 274321859 0.96
tpch_q16/datafusion:parquet 178687480 178613140 1.00
tpch_q17/datafusion:parquet 844642869 832559394 1.01
tpch_q18/datafusion:parquet 1033135473 1139654935 0.91
tpch_q19/datafusion:parquet 321385431 341478988 0.94
tpch_q20/datafusion:parquet 383046881 373744421 1.02
tpch_q21/datafusion:parquet 888517972 959362932 0.93
tpch_q22/datafusion:parquet 223199741 236457391 0.94
datafusion / arrow (0.923x ➖, 6↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 720579896 784337785 0.92
tpch_q02/datafusion:arrow 202134826 217588733 0.93
tpch_q03/datafusion:arrow 🚀 558135020 626635498 0.89
tpch_q04/datafusion:arrow 398137030 442336718 0.90
tpch_q05/datafusion:arrow 🚀 1059185871 1196877709 0.88
tpch_q06/datafusion:arrow 326477659 346397597 0.94
tpch_q07/datafusion:arrow 1399616482 1521357139 0.92
tpch_q08/datafusion:arrow 1320533692 1333207863 0.99
tpch_q09/datafusion:arrow 1570442781 1710746100 0.92
tpch_q10/datafusion:arrow 🚀 693986622 777356356 0.89
tpch_q11/datafusion:arrow 178867994 196667406 0.91
tpch_q12/datafusion:arrow 🚀 736507611 832064977 0.89
tpch_q13/datafusion:arrow 538924393 573032075 0.94
tpch_q14/datafusion:arrow 364656691 366380088 1.00
tpch_q15/datafusion:arrow 790157181 746981791 1.06
tpch_q16/datafusion:arrow 120573576 125122235 0.96
tpch_q17/datafusion:arrow 1586957343 1685012757 0.94
tpch_q18/datafusion:arrow 2131845447 2361367025 0.90
tpch_q19/datafusion:arrow 591157504 656199933 0.90
tpch_q20/datafusion:arrow 🚀 570297447 646359701 0.88
tpch_q21/datafusion:arrow 4150944425 4525523129 0.92
tpch_q22/datafusion:arrow 🚀 177512780 211683774 0.84
duckdb / vortex-file-compressed (0.958x ➖, 3↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 177259973 180287471 0.98
tpch_q02/duckdb:vortex-file-compressed 55267661 52630444 1.05
tpch_q03/duckdb:vortex-file-compressed 132647498 134883146 0.98
tpch_q04/duckdb:vortex-file-compressed 🚀 151047304 179408206 0.84
tpch_q05/duckdb:vortex-file-compressed 131048197 132230705 0.99
tpch_q06/duckdb:vortex-file-compressed 49940563 51213542 0.98
tpch_q07/duckdb:vortex-file-compressed 153308814 153293357 1.00
tpch_q08/duckdb:vortex-file-compressed 179146936 191190859 0.94
tpch_q09/duckdb:vortex-file-compressed 335584579 351634595 0.95
tpch_q10/duckdb:vortex-file-compressed 🚀 157638001 175851276 0.90
tpch_q11/duckdb:vortex-file-compressed 38377206 37589964 1.02
tpch_q12/duckdb:vortex-file-compressed 95608012 97090379 0.98
tpch_q13/duckdb:vortex-file-compressed 245099072 258216730 0.95
tpch_q14/duckdb:vortex-file-compressed 🚀 69026859 81997681 0.84
tpch_q15/duckdb:vortex-file-compressed 96774576 99476855 0.97
tpch_q16/duckdb:vortex-file-compressed 79064288 80251185 0.99
tpch_q17/duckdb:vortex-file-compressed 103784156 104908212 0.99
tpch_q18/duckdb:vortex-file-compressed 273195961 285267904 0.96
tpch_q19/duckdb:vortex-file-compressed 91706682 97198803 0.94
tpch_q20/duckdb:vortex-file-compressed 165255269 173088115 0.95
tpch_q21/duckdb:vortex-file-compressed 567491887 576918060 0.98
tpch_q22/duckdb:vortex-file-compressed 77822069 86408932 0.90
duckdb / vortex-compact (0.963x ➖, 3↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 231609519 235832899 0.98
tpch_q02/duckdb:vortex-compact 58772086 59685818 0.98
tpch_q03/duckdb:vortex-compact 144380274 152707804 0.95
tpch_q04/duckdb:vortex-compact 179398389 192988177 0.93
tpch_q05/duckdb:vortex-compact 148105062 155326742 0.95
tpch_q06/duckdb:vortex-compact 87479936 93658950 0.93
tpch_q07/duckdb:vortex-compact 209807758 211710889 0.99
tpch_q08/duckdb:vortex-compact 🚀 190563554 217142134 0.88
tpch_q09/duckdb:vortex-compact 368336044 373734204 0.99
tpch_q10/duckdb:vortex-compact 187084435 185344291 1.01
tpch_q11/duckdb:vortex-compact 42008161 42543672 0.99
tpch_q12/duckdb:vortex-compact 211636232 209220272 1.01
tpch_q13/duckdb:vortex-compact 292049199 293811881 0.99
tpch_q14/duckdb:vortex-compact 104541820 112541767 0.93
tpch_q15/duckdb:vortex-compact 120946176 120907828 1.00
tpch_q16/duckdb:vortex-compact 86809042 86279262 1.01
tpch_q17/duckdb:vortex-compact 115701391 116234330 1.00
tpch_q18/duckdb:vortex-compact 294047216 291387768 1.01
tpch_q19/duckdb:vortex-compact 🚀 114428518 130212351 0.88
tpch_q20/duckdb:vortex-compact 208274732 209657922 0.99
tpch_q21/duckdb:vortex-compact 633638574 688074253 0.92
tpch_q22/duckdb:vortex-compact 🚀 90557808 101302125 0.89
duckdb / parquet (0.970x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257111402 259327836 0.99
tpch_q02/duckdb:parquet 96843453 106772020 0.91
tpch_q03/duckdb:parquet 211813456 214496895 0.99
tpch_q04/duckdb:parquet 135094551 143979205 0.94
tpch_q05/duckdb:parquet 221221578 222714674 0.99
tpch_q06/duckdb:parquet 67682996 69536681 0.97
tpch_q07/duckdb:parquet 182874125 191207203 0.96
tpch_q08/duckdb:parquet 252557569 263665654 0.96
tpch_q09/duckdb:parquet 457241083 473067114 0.97
tpch_q10/duckdb:parquet 611297870 630752671 0.97
tpch_q11/duckdb:parquet 42671628 45541721 0.94
tpch_q12/duckdb:parquet 125783377 128151382 0.98
tpch_q13/duckdb:parquet 450961502 415294990 1.09
tpch_q14/duckdb:parquet 175947506 183361987 0.96
tpch_q15/duckdb:parquet 97983755 99478686 0.98
tpch_q16/duckdb:parquet 155455995 168016149 0.93
tpch_q17/duckdb:parquet 179605776 184014553 0.98
tpch_q18/duckdb:parquet 350044200 362369589 0.97
tpch_q19/duckdb:parquet 282929416 296037713 0.96
tpch_q20/duckdb:parquet 236158250 225725576 1.05
tpch_q21/duckdb:parquet 573308073 619084466 0.93
tpch_q22/duckdb:parquet 292752833 301375251 0.97
duckdb / duckdb (0.971x ➖, 2↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117391908 117795663 1.00
tpch_q02/duckdb:duckdb 48210660 50298584 0.96
tpch_q03/duckdb:duckdb 97194280 101957762 0.95
tpch_q04/duckdb:duckdb 133200233 139310608 0.96
tpch_q05/duckdb:duckdb 110416224 115528310 0.96
tpch_q06/duckdb:duckdb 40049082 38278292 1.05
tpch_q07/duckdb:duckdb 85773969 90742459 0.95
tpch_q08/duckdb:duckdb 112022343 112277622 1.00
tpch_q09/duckdb:duckdb 279712106 282950290 0.99
tpch_q10/duckdb:duckdb 205892784 209761229 0.98
tpch_q11/duckdb:duckdb 15242845 15569185 0.98
tpch_q12/duckdb:duckdb 84778805 85707331 0.99
tpch_q13/duckdb:duckdb 256668363 262724546 0.98
tpch_q14/duckdb:duckdb 71913691 71460662 1.01
tpch_q15/duckdb:duckdb 78945301 81418257 0.97
tpch_q16/duckdb:duckdb 🚀 73321055 82251395 0.89
tpch_q17/duckdb:duckdb 85033752 84960507 1.00
tpch_q18/duckdb:duckdb 213225683 221061349 0.96
tpch_q19/duckdb:duckdb 116667821 117735712 0.99
tpch_q20/duckdb:duckdb 112258248 114430606 0.98
tpch_q21/duckdb:duckdb 303946903 314373115 0.97
tpch_q22/duckdb:duckdb 🚀 65455473 74066737 0.88
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -8.1% -4.5% -3.8% +13.3% ➖ noise
1 datafusion:vortex-compact +3.0% -4.5% +7.9% +12.9% ➖ noise
1 datafusion:vortex-file-compressed -4.4% -4.5% +0.2% +21.2% ➖ noise
1 duckdb:duckdb -0.3% -4.5% +4.4% +11.4% ➖ noise
1 duckdb:vortex-compact -1.8% -4.5% +2.9% +11.8% ➖ noise
1 duckdb:vortex-file-compressed -1.7% -4.5% +3.0% +15.9% ➖ noise
2 datafusion:arrow -7.1% -5.9% -1.2% +10.0% ➖ noise
2 datafusion:vortex-compact +2.5% -5.9% +9.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -4.6% -5.9% +1.4% +10.0% ➖ noise
2 duckdb:duckdb -4.2% -5.9% +1.9% +11.7% ➖ noise
2 duckdb:vortex-compact -1.5% -5.9% +4.7% +10.2% ➖ noise
2 duckdb:vortex-file-compressed +5.0% -5.9% +11.6% +12.5% ➖ noise
3 datafusion:arrow -10.9% -1.6% -9.5% +10.0% ✅ faster
3 datafusion:vortex-compact +0.6% -1.6% +2.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -10.4% -1.6% -8.9% +11.8% ➖ noise
3 duckdb:duckdb -4.7% -1.6% -3.1% +10.0% ➖ noise
3 duckdb:vortex-compact -5.5% -1.6% -3.9% +11.6% ➖ noise
3 duckdb:vortex-file-compressed -1.7% -1.6% -0.0% +10.0% ➖ noise
4 datafusion:arrow -10.0% -6.4% -3.9% +10.0% ➖ noise
4 datafusion:vortex-compact -0.9% -6.4% +5.8% +11.2% ➖ noise
4 datafusion:vortex-file-compressed -5.3% -6.4% +1.2% +10.0% ➖ noise
4 duckdb:duckdb -4.4% -6.4% +2.1% +10.0% ➖ noise
4 duckdb:vortex-compact -7.0% -6.4% -0.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -15.8% -6.4% -10.1% +13.3% ➖ noise
5 datafusion:arrow -11.5% -2.2% -9.5% +10.0% ✅ faster
5 datafusion:vortex-compact -5.6% -2.2% -3.5% +12.0% ➖ noise
5 datafusion:vortex-file-compressed -10.4% -2.2% -8.4% +10.0% ➖ noise
5 duckdb:duckdb -4.4% -2.2% -2.3% +10.0% ➖ noise
5 duckdb:vortex-compact -4.6% -2.2% -2.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.9% -2.2% +1.3% +10.0% ➖ noise
6 datafusion:arrow -5.8% -1.5% -4.4% +13.2% ➖ noise
6 datafusion:vortex-compact -0.6% -1.5% +0.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -7.6% -1.5% -6.2% +10.0% ➖ noise
6 duckdb:duckdb +4.6% -1.5% +6.2% +15.2% ➖ noise
6 duckdb:vortex-compact -6.6% -1.5% -5.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.5% -1.5% -1.0% +10.0% ➖ noise
7 datafusion:arrow -8.0% -6.4% -1.7% +10.0% ➖ noise
7 datafusion:vortex-compact -6.9% -6.4% -0.5% +10.3% ➖ noise
7 datafusion:vortex-file-compressed -3.8% -6.4% +2.7% +10.0% ➖ noise
7 duckdb:duckdb -5.5% -6.4% +1.0% +10.0% ➖ noise
7 duckdb:vortex-compact -0.9% -6.4% +5.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.0% -6.4% +6.8% +17.2% ➖ noise
8 datafusion:arrow -1.0% -3.4% +2.5% +12.6% ➖ noise
8 datafusion:vortex-compact -6.4% -3.4% -3.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -5.3% -3.4% -1.9% +10.0% ➖ noise
8 duckdb:duckdb -0.2% -3.4% +3.3% +10.0% ➖ noise
8 duckdb:vortex-compact -12.2% -3.4% -9.1% +13.5% ➖ noise
8 duckdb:vortex-file-compressed -6.3% -3.4% -3.0% +11.0% ➖ noise
9 datafusion:arrow -8.2% -5.9% -2.5% +10.0% ➖ noise
9 datafusion:vortex-compact -5.1% -5.9% +0.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -4.8% -5.9% +1.1% +10.0% ➖ noise
9 duckdb:duckdb -1.1% -5.9% +5.0% +10.4% ➖ noise
9 duckdb:vortex-compact -1.4% -5.9% +4.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.6% -5.9% +1.4% +10.0% ➖ noise
10 datafusion:arrow -10.7% -4.2% -6.8% +10.0% ➖ noise
10 datafusion:vortex-compact -11.1% -4.2% -7.1% +10.7% ➖ noise
10 datafusion:vortex-file-compressed -6.0% -4.2% -1.8% +12.0% ➖ noise
10 duckdb:duckdb -1.8% -4.2% +2.5% +11.2% ➖ noise
10 duckdb:vortex-compact +0.9% -4.2% +5.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -10.4% -4.2% -6.4% +14.5% ➖ noise
11 datafusion:arrow -9.1% -4.8% -4.5% +14.6% ➖ noise
11 datafusion:vortex-compact -2.4% -4.8% +2.5% +13.0% ➖ noise
11 datafusion:vortex-file-compressed -3.4% -4.8% +1.5% +12.0% ➖ noise
11 duckdb:duckdb -2.1% -4.8% +2.8% +20.1% ➖ noise
11 duckdb:vortex-compact -1.3% -4.8% +3.7% +16.3% ➖ noise
11 duckdb:vortex-file-compressed +2.1% -4.8% +7.2% +18.6% ➖ noise
12 datafusion:arrow -11.5% -1.5% -10.2% +37.5% ➖ noise
12 datafusion:vortex-compact -1.8% -1.5% -0.3% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -3.2% -1.5% -1.7% +10.0% ➖ noise
12 duckdb:duckdb -1.1% -1.5% +0.4% +10.0% ➖ noise
12 duckdb:vortex-compact +1.2% -1.5% +2.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.5% -1.5% -0.1% +12.9% ➖ noise
13 datafusion:arrow -6.0% +1.6% -7.4% +13.9% ➖ noise
13 datafusion:vortex-compact -8.8% +1.6% -10.2% +11.1% ✅ faster
13 datafusion:vortex-file-compressed -2.7% +1.6% -4.2% +12.0% ➖ noise
13 duckdb:duckdb -2.3% +1.6% -3.8% +11.1% ➖ noise
13 duckdb:vortex-compact -0.6% +1.6% -2.1% +13.6% ➖ noise
13 duckdb:vortex-file-compressed -5.1% +1.6% -6.5% +10.0% ➖ noise
14 datafusion:arrow -0.5% -1.5% +1.0% +10.0% ➖ noise
14 datafusion:vortex-compact -5.5% -1.5% -4.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -14.7% -1.5% -13.4% +10.0% ✅ faster
14 duckdb:duckdb +0.6% -1.5% +2.2% +10.0% ➖ noise
14 duckdb:vortex-compact -7.1% -1.5% -5.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -15.8% -1.5% -14.5% +12.5% ✅ faster
15 datafusion:arrow +5.8% -2.7% +8.7% +10.0% ➖ noise
15 datafusion:vortex-compact -1.3% -2.7% +1.4% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -5.2% -2.7% -2.6% +10.0% ➖ noise
15 duckdb:duckdb -3.0% -2.7% -0.4% +10.0% ➖ noise
15 duckdb:vortex-compact +0.0% -2.7% +2.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -2.7% -2.7% -0.0% +10.0% ➖ noise
16 datafusion:arrow -3.6% -3.8% +0.2% +11.7% ➖ noise
16 datafusion:vortex-compact +0.6% -3.8% +4.5% +11.0% ➖ noise
16 datafusion:vortex-file-compressed -4.3% -3.8% -0.6% +12.6% ➖ noise
16 duckdb:duckdb -10.9% -3.8% -7.3% +11.9% ➖ noise
16 duckdb:vortex-compact +0.6% -3.8% +4.6% +10.6% ➖ noise
16 duckdb:vortex-file-compressed -1.5% -3.8% +2.4% +11.5% ➖ noise
17 datafusion:arrow -5.8% -0.5% -5.4% +10.0% ➖ noise
17 datafusion:vortex-compact -11.6% -0.5% -11.2% +13.3% ➖ noise
17 datafusion:vortex-file-compressed -10.7% -0.5% -10.3% +12.6% ➖ noise
17 duckdb:duckdb +0.1% -0.5% +0.6% +10.0% ➖ noise
17 duckdb:vortex-compact -0.5% -0.5% +0.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -1.1% -0.5% -0.6% +10.0% ➖ noise
18 datafusion:arrow -9.7% -6.4% -3.5% +15.4% ➖ noise
18 datafusion:vortex-compact -9.7% -6.4% -3.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -9.9% -6.4% -3.8% +10.0% ➖ noise
18 duckdb:duckdb -3.5% -6.4% +3.1% +10.0% ➖ noise
18 duckdb:vortex-compact +0.9% -6.4% +7.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.2% -6.4% +2.3% +10.8% ➖ noise
19 datafusion:arrow -9.9% -5.2% -5.0% +12.0% ➖ noise
19 datafusion:vortex-compact -2.7% -5.2% +2.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.3% -5.2% -0.1% +13.4% ➖ noise
19 duckdb:duckdb -0.9% -5.2% +4.5% +10.0% ➖ noise
19 duckdb:vortex-compact -12.1% -5.2% -7.3% +11.5% ➖ noise
19 duckdb:vortex-file-compressed -5.7% -5.2% -0.5% +11.9% ➖ noise
20 datafusion:arrow -11.8% +3.5% -14.8% +11.1% ✅ faster
20 datafusion:vortex-compact -10.4% +3.5% -13.5% +10.0% ✅ faster
20 datafusion:vortex-file-compressed -4.7% +3.5% -8.0% +10.0% ➖ noise
20 duckdb:duckdb -1.9% +3.5% -5.3% +10.0% ➖ noise
20 duckdb:vortex-compact -0.7% +3.5% -4.1% +12.8% ➖ noise
20 duckdb:vortex-file-compressed -4.5% +3.5% -7.8% +10.0% ➖ noise
21 datafusion:arrow -8.3% -7.4% -1.0% +10.0% ➖ noise
21 datafusion:vortex-compact +0.5% -7.4% +8.5% +10.3% ➖ noise
21 datafusion:vortex-file-compressed -8.6% -7.4% -1.3% +10.0% ➖ noise
21 duckdb:duckdb -3.3% -7.4% +4.4% +10.0% ➖ noise
21 duckdb:vortex-compact -7.9% -7.4% -0.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -1.6% -7.4% +6.2% +10.0% ➖ noise
22 datafusion:arrow -16.1% -4.2% -12.4% +11.8% ✅ faster
22 datafusion:vortex-compact +0.3% -4.2% +4.7% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -7.4% -4.2% -3.3% +10.6% ➖ noise
22 duckdb:duckdb -11.6% -4.2% -7.7% +10.0% ➖ noise
22 duckdb:vortex-compact -10.6% -4.2% -6.6% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -9.9% -4.2% -5.9% +14.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.1%
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.999x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.0%


duckdb / vortex-file-compressed (0.965x ➖, 1↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10740429 10834571 0.99
statpopgen_q01/duckdb:vortex-file-compressed 🚀 18653461 26907040 0.69
statpopgen_q02/duckdb:vortex-file-compressed 1292677701 1294042899 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3149950220 3154086245 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3077985890 3175448053 0.97
statpopgen_q05/duckdb:vortex-file-compressed 1358383470 1357259773 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2041777280 2037883654 1.00
statpopgen_q07/duckdb:vortex-file-compressed 200783787 195057513 1.03
statpopgen_q08/duckdb:vortex-file-compressed 211417545 208110521 1.02
statpopgen_q09/duckdb:vortex-file-compressed 2836651034 2906689621 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4565175118 4597547637 0.99
duckdb / vortex-compact (0.971x ➖, 1↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10813308 10817917 1.00
statpopgen_q01/duckdb:vortex-compact 🚀 114831380 166076297 0.69
statpopgen_q02/duckdb:vortex-compact 1796390619 1789490518 1.00
statpopgen_q03/duckdb:vortex-compact 3510346763 3457695393 1.02
statpopgen_q04/duckdb:vortex-compact 3484676127 3431462538 1.02
statpopgen_q05/duckdb:vortex-compact 1827421740 1809401681 1.01
statpopgen_q06/duckdb:vortex-compact 2658313812 2661003749 1.00
statpopgen_q07/duckdb:vortex-compact 963985264 961147466 1.00
statpopgen_q08/duckdb:vortex-compact 1010141543 1005351304 1.00
statpopgen_q09/duckdb:vortex-compact 3277299771 3299395106 0.99
statpopgen_q10/duckdb:vortex-compact 5369276302 5343826443 1.00
duckdb / parquet (0.999x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 314554689 313222834 1.00
statpopgen_q01/duckdb:parquet 395617599 391906749 1.01
statpopgen_q02/duckdb:parquet 974885153 997201434 0.98
statpopgen_q03/duckdb:parquet 1504745851 1490962595 1.01
statpopgen_q04/duckdb:parquet 1483945311 1519848287 0.98
statpopgen_q05/duckdb:parquet 998903141 998995001 1.00
statpopgen_q06/duckdb:parquet 1477437191 1449084303 1.02
statpopgen_q07/duckdb:parquet 1873279367 1877668923 1.00
statpopgen_q08/duckdb:parquet 1885340228 1864925931 1.01
statpopgen_q09/duckdb:parquet 1382301616 1385494000 1.00
statpopgen_q10/duckdb:parquet 2680163103 2719915812 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -0.0% +0.4% -0.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -0.9% +0.4% -1.3% +10.0% ➖ noise
1 duckdb:vortex-compact -30.9% +0.9% -31.5% +48.9% ➖ noise
1 duckdb:vortex-file-compressed -30.7% +0.9% -31.3% +204.2% ➖ noise
2 duckdb:vortex-compact +0.4% -2.2% +2.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.1% -2.2% +2.2% +10.0% ➖ noise
3 duckdb:vortex-compact +1.5% +0.9% +0.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.1% +0.9% -1.0% +10.0% ➖ noise
4 duckdb:vortex-compact +1.6% -2.4% +4.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -3.1% -2.4% -0.7% +10.0% ➖ noise
5 duckdb:vortex-compact +1.0% -0.0% +1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.1% -0.0% +0.1% +10.0% ➖ noise
6 duckdb:vortex-compact -0.1% +2.0% -2.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.2% +2.0% -1.7% +10.0% ➖ noise
7 duckdb:vortex-compact +0.3% -0.2% +0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.9% -0.2% +3.2% +10.0% ➖ noise
8 duckdb:vortex-compact +0.5% +1.1% -0.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.6% +1.1% +0.5% +10.0% ➖ noise
9 duckdb:vortex-compact -0.7% -0.2% -0.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.4% -0.2% -2.2% +10.0% ➖ noise
10 duckdb:vortex-compact +0.5% -1.5% +2.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.7% -1.5% +0.8% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.6%
Vortex (geomean): 1.025x ➖
Parquet (geomean): 1.040x ➖
Shifts: Parquet (control) +4.0% · Median polish +2.9%


datafusion / vortex-file-compressed (1.028x ➖, 1↑ 2↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1650989 1680875 0.98
clickbench_q01/datafusion:vortex-file-compressed 13930198 15098841 0.92
clickbench_q02/datafusion:vortex-file-compressed 35103480 32705751 1.07
clickbench_q03/datafusion:vortex-file-compressed 38146197 36293284 1.05
clickbench_q04/datafusion:vortex-file-compressed 318517028 320727699 0.99
clickbench_q05/datafusion:vortex-file-compressed 318556259 314436961 1.01
clickbench_q06/datafusion:vortex-file-compressed 1641039 1671489 0.98
clickbench_q07/datafusion:vortex-file-compressed 18187975 18141217 1.00
clickbench_q08/datafusion:vortex-file-compressed 393574660 389296304 1.01
clickbench_q09/datafusion:vortex-file-compressed 596983168 592387324 1.01
clickbench_q10/datafusion:vortex-file-compressed 74132694 71661091 1.03
clickbench_q11/datafusion:vortex-file-compressed 82258208 81626449 1.01
clickbench_q12/datafusion:vortex-file-compressed 280019864 274390804 1.02
clickbench_q13/datafusion:vortex-file-compressed 425289131 417201772 1.02
clickbench_q14/datafusion:vortex-file-compressed 258091066 251786819 1.03
clickbench_q15/datafusion:vortex-file-compressed 397346177 377698360 1.05
clickbench_q16/datafusion:vortex-file-compressed 759392898 717093881 1.06
clickbench_q17/datafusion:vortex-file-compressed 740156378 708710300 1.04
clickbench_q18/datafusion:vortex-file-compressed 1498184143 1446532339 1.04
clickbench_q19/datafusion:vortex-file-compressed 24294981 23830265 1.02
clickbench_q20/datafusion:vortex-file-compressed 339673695 340432650 1.00
clickbench_q21/datafusion:vortex-file-compressed 396485481 395790834 1.00
clickbench_q22/datafusion:vortex-file-compressed 570018715 556602045 1.02
clickbench_q23/datafusion:vortex-file-compressed 625302498 605386815 1.03
clickbench_q24/datafusion:vortex-file-compressed 🚀 46508531 52416050 0.89
clickbench_q25/datafusion:vortex-file-compressed 69803420 73838136 0.95
clickbench_q26/datafusion:vortex-file-compressed 51087653 51494465 0.99
clickbench_q27/datafusion:vortex-file-compressed 841252531 771778186 1.09
clickbench_q28/datafusion:vortex-file-compressed 6946625499 6843810486 1.02
clickbench_q29/datafusion:vortex-file-compressed 234921506 241534883 0.97
clickbench_q30/datafusion:vortex-file-compressed 258826048 251291880 1.03
clickbench_q31/datafusion:vortex-file-compressed 301906410 294539562 1.03
clickbench_q32/datafusion:vortex-file-compressed 1415384516 1317002923 1.07
clickbench_q33/datafusion:vortex-file-compressed 1498813410 1418186521 1.06
clickbench_q34/datafusion:vortex-file-compressed 1538392899 1425191183 1.08
clickbench_q35/datafusion:vortex-file-compressed 566760179 547988644 1.03
clickbench_q36/datafusion:vortex-file-compressed 🚨 94893097 83026173 1.14
clickbench_q37/datafusion:vortex-file-compressed 41842931 39190471 1.07
clickbench_q38/datafusion:vortex-file-compressed 25651637 23747784 1.08
clickbench_q39/datafusion:vortex-file-compressed 🚨 172568545 155512391 1.11
clickbench_q40/datafusion:vortex-file-compressed 22705926 21135828 1.07
clickbench_q41/datafusion:vortex-file-compressed 20737331 19430386 1.07
clickbench_q42/datafusion:vortex-file-compressed 24193742 22129779 1.09
datafusion / parquet (1.056x ➖, 0↑ 5↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 1942978 1749488 1.11
clickbench_q01/datafusion:parquet 21381641 20811464 1.03
clickbench_q02/datafusion:parquet 50250358 47733633 1.05
clickbench_q03/datafusion:parquet 42505007 41365079 1.03
clickbench_q04/datafusion:parquet 🚨 377561775 338400246 1.12
clickbench_q05/datafusion:parquet 399543937 367404077 1.09
clickbench_q06/datafusion:parquet 1578718 1541584 1.02
clickbench_q07/datafusion:parquet 27710003 25322808 1.09
clickbench_q08/datafusion:parquet 439326648 412109842 1.07
clickbench_q09/datafusion:parquet 🚨 725611704 648417195 1.12
clickbench_q10/datafusion:parquet 123826161 120825391 1.02
clickbench_q11/datafusion:parquet 151656538 143367253 1.06
clickbench_q12/datafusion:parquet 385304463 368706479 1.05
clickbench_q13/datafusion:parquet 535787024 511638892 1.05
clickbench_q14/datafusion:parquet 374988038 361022396 1.04
clickbench_q15/datafusion:parquet 405616503 384951291 1.05
clickbench_q16/datafusion:parquet 813216710 748870705 1.09
clickbench_q17/datafusion:parquet 753271821 714976256 1.05
clickbench_q18/datafusion:parquet 1585836286 1483860652 1.07
clickbench_q19/datafusion:parquet 34616897 33446381 1.03
clickbench_q20/datafusion:parquet 626866169 610843605 1.03
clickbench_q21/datafusion:parquet 689181190 673937188 1.02
clickbench_q22/datafusion:parquet 1031201916 986234739 1.05
clickbench_q23/datafusion:parquet 4022222032 3737687311 1.08
clickbench_q24/datafusion:parquet 94693203 97592980 0.97
clickbench_q25/datafusion:parquet 159251068 150258529 1.06
clickbench_q26/datafusion:parquet 96631201 95884707 1.01
clickbench_q27/datafusion:parquet 1116600022 1063245391 1.05
clickbench_q28/datafusion:parquet 6732577296 6619697144 1.02
clickbench_q29/datafusion:parquet 247950856 236655102 1.05
clickbench_q30/datafusion:parquet 409982930 377035080 1.09
clickbench_q31/datafusion:parquet 436295657 412650296 1.06
clickbench_q32/datafusion:parquet 1336640047 1259100174 1.06
clickbench_q33/datafusion:parquet 1603174284 1520784393 1.05
clickbench_q34/datafusion:parquet 1640398259 1534689499 1.07
clickbench_q35/datafusion:parquet 581375074 549961751 1.06
clickbench_q36/datafusion:parquet 🚨 163877179 139084887 1.18
clickbench_q37/datafusion:parquet 62381179 58714453 1.06
clickbench_q38/datafusion:parquet 94377348 92248761 1.02
clickbench_q39/datafusion:parquet 🚨 298642345 267861301 1.11
clickbench_q40/datafusion:parquet 37108482 35255853 1.05
clickbench_q41/datafusion:parquet 31752966 30101287 1.05
clickbench_q42/datafusion:parquet 32669646 32536418 1.00
duckdb / vortex-file-compressed (1.022x ➖, 3↑ 5↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6539031 6501847 1.01
clickbench_q01/duckdb:vortex-file-compressed 14931414 13619764 1.10
clickbench_q02/duckdb:vortex-file-compressed 25049622 23860320 1.05
clickbench_q03/duckdb:vortex-file-compressed 31874994 30962295 1.03
clickbench_q04/duckdb:vortex-file-compressed 173936316 173136345 1.00
clickbench_q05/duckdb:vortex-file-compressed 210918682 198649941 1.06
clickbench_q06/duckdb:vortex-file-compressed 20712637 19560449 1.06
clickbench_q07/duckdb:vortex-file-compressed 16695361 15178816 1.10
clickbench_q08/duckdb:vortex-file-compressed 269151166 269017331 1.00
clickbench_q09/duckdb:vortex-file-compressed 386476244 381142001 1.01
clickbench_q10/duckdb:vortex-file-compressed 77459796 74434180 1.04
clickbench_q11/duckdb:vortex-file-compressed 86315808 81663263 1.06
clickbench_q12/duckdb:vortex-file-compressed 221597022 217186606 1.02
clickbench_q13/duckdb:vortex-file-compressed 447051239 443406481 1.01
clickbench_q14/duckdb:vortex-file-compressed 242575954 238837662 1.02
clickbench_q15/duckdb:vortex-file-compressed 212950002 211931544 1.00
clickbench_q16/duckdb:vortex-file-compressed 733088693 713788249 1.03
clickbench_q17/duckdb:vortex-file-compressed 558126001 531790795 1.05
clickbench_q18/duckdb:vortex-file-compressed 1153336659 1207475426 0.96
clickbench_q19/duckdb:vortex-file-compressed 21613385 21578625 1.00
clickbench_q20/duckdb:vortex-file-compressed 363057854 373751831 0.97
clickbench_q21/duckdb:vortex-file-compressed 406319900 396386393 1.03
clickbench_q22/duckdb:vortex-file-compressed 606659399 617437594 0.98
clickbench_q23/duckdb:vortex-file-compressed 1044413736 959892066 1.09
clickbench_q24/duckdb:vortex-file-compressed 🚀 45451814 61339046 0.74
clickbench_q25/duckdb:vortex-file-compressed 🚀 67746464 80820948 0.84
clickbench_q26/duckdb:vortex-file-compressed 🚀 42966539 48302421 0.89
clickbench_q27/duckdb:vortex-file-compressed 521387526 523358937 1.00
clickbench_q28/duckdb:vortex-file-compressed 3006341172 2977879830 1.01
clickbench_q29/duckdb:vortex-file-compressed 27767515 27499235 1.01
clickbench_q30/duckdb:vortex-file-compressed 193741333 190560208 1.02
clickbench_q31/duckdb:vortex-file-compressed 283125524 270644633 1.05
clickbench_q32/duckdb:vortex-file-compressed 1291749070 1329545770 0.97
clickbench_q33/duckdb:vortex-file-compressed 1439635313 1487267478 0.97
clickbench_q34/duckdb:vortex-file-compressed 1550416086 1565199889 0.99
clickbench_q35/duckdb:vortex-file-compressed 377074835 374145357 1.01
clickbench_q36/duckdb:vortex-file-compressed 🚨 35087333 30119652 1.16
clickbench_q37/duckdb:vortex-file-compressed 🚨 27059380 22589461 1.20
clickbench_q38/duckdb:vortex-file-compressed 🚨 27066405 24195492 1.12
clickbench_q39/duckdb:vortex-file-compressed 48522170 46006479 1.05
clickbench_q40/duckdb:vortex-file-compressed 🚨 27086281 22553656 1.20
clickbench_q41/duckdb:vortex-file-compressed 🚨 26113687 22329021 1.17
clickbench_q42/duckdb:vortex-file-compressed 26654690 25656579 1.04
duckdb / parquet (1.023x ➖, 0↑ 1↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 257771977 221181643 1.17
clickbench_q01/duckdb:parquet 52280178 49969791 1.05
clickbench_q02/duckdb:parquet 70358011 66022287 1.07
clickbench_q03/duckdb:parquet 65227626 64763219 1.01
clickbench_q04/duckdb:parquet 212533646 202173713 1.05
clickbench_q05/duckdb:parquet 288827350 279860362 1.03
clickbench_q06/duckdb:parquet 64042902 60880541 1.05
clickbench_q07/duckdb:parquet 54351066 54316767 1.00
clickbench_q08/duckdb:parquet 275277922 272143383 1.01
clickbench_q09/duckdb:parquet 403225022 397664124 1.01
clickbench_q10/duckdb:parquet 98139561 97799371 1.00
clickbench_q11/duckdb:parquet 109637061 109416552 1.00
clickbench_q12/duckdb:parquet 301036588 299295012 1.01
clickbench_q13/duckdb:parquet 531059681 523410213 1.01
clickbench_q14/duckdb:parquet 344654547 331339105 1.04
clickbench_q15/duckdb:parquet 249327011 242332700 1.03
clickbench_q16/duckdb:parquet 627954254 607164286 1.03
clickbench_q17/duckdb:parquet 521548055 509794975 1.02
clickbench_q18/duckdb:parquet 1083652406 1058179705 1.02
clickbench_q19/duckdb:parquet 51072575 49871062 1.02
clickbench_q20/duckdb:parquet 439926294 440447045 1.00
clickbench_q21/duckdb:parquet 564719253 570140093 0.99
clickbench_q22/duckdb:parquet 951373784 930951289 1.02
clickbench_q23/duckdb:parquet 315976251 327994895 0.96
clickbench_q24/duckdb:parquet 79821706 82057811 0.97
clickbench_q25/duckdb:parquet 141878150 140778135 1.01
clickbench_q26/duckdb:parquet 52832471 55576979 0.95
clickbench_q27/duckdb:parquet 649638796 658116560 0.99
clickbench_q28/duckdb:parquet 4913212037 4926839399 1.00
clickbench_q29/duckdb:parquet 63370570 61530851 1.03
clickbench_q30/duckdb:parquet 312125832 304140769 1.03
clickbench_q31/duckdb:parquet 363705255 348681836 1.04
clickbench_q32/duckdb:parquet 1201465980 1121175713 1.07
clickbench_q33/duckdb:parquet 1299738406 1252957374 1.04
clickbench_q34/duckdb:parquet 1380040917 1332813175 1.04
clickbench_q35/duckdb:parquet 355212512 353088451 1.01
clickbench_q36/duckdb:parquet 65595594 64634781 1.01
clickbench_q37/duckdb:parquet 55099041 54626233 1.01
clickbench_q38/duckdb:parquet 60626292 57482370 1.05
clickbench_q39/duckdb:parquet 100505347 98977331 1.02
clickbench_q40/duckdb:parquet 58324773 56174355 1.04
clickbench_q41/duckdb:parquet 60957129 59058473 1.03
clickbench_q42/duckdb:parquet 53963649 50146404 1.08
duckdb / duckdb (0.987x ➖, 2↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 19771831 18382679 1.08
clickbench_q01/duckdb:duckdb 34520805 34023235 1.01
clickbench_q02/duckdb:duckdb 47518046 46255055 1.03
clickbench_q03/duckdb:duckdb 48911337 47604394 1.03
clickbench_q04/duckdb:duckdb 223683248 228222400 0.98
clickbench_q05/duckdb:duckdb 336124725 335061699 1.00
clickbench_q06/duckdb:duckdb 37240827 35568922 1.05
clickbench_q07/duckdb:duckdb 36687031 36950851 0.99
clickbench_q08/duckdb:duckdb 315471418 306955520 1.03
clickbench_q09/duckdb:duckdb 493187458 506378037 0.97
clickbench_q10/duckdb:duckdb 98229262 99271261 0.99
clickbench_q11/duckdb:duckdb 109840878 109152046 1.01
clickbench_q12/duckdb:duckdb 316721112 312575693 1.01
clickbench_q13/duckdb:duckdb 566386148 572510231 0.99
clickbench_q14/duckdb:duckdb 368252461 378671526 0.97
clickbench_q15/duckdb:duckdb 261385245 266277083 0.98
clickbench_q16/duckdb:duckdb 🚀 702990531 911926083 0.77
clickbench_q17/duckdb:duckdb 🚀 600838292 785345596 0.77
clickbench_q18/duckdb:duckdb 1278437852 1276463047 1.00
clickbench_q19/duckdb:duckdb 36708918 35458533 1.04
clickbench_q20/duckdb:duckdb 930987827 1024506517 0.91
clickbench_q21/duckdb:duckdb 1038427933 1029937930 1.01
clickbench_q22/duckdb:duckdb 1089396631 1088383112 1.00
clickbench_q23/duckdb:duckdb 265545284 257825673 1.03
clickbench_q24/duckdb:duckdb 63524277 61629032 1.03
clickbench_q25/duckdb:duckdb 124089786 134339023 0.92
clickbench_q26/duckdb:duckdb 56333973 59281004 0.95
clickbench_q27/duckdb:duckdb 1099540366 1173402493 0.94
clickbench_q28/duckdb:duckdb 4625923234 4662263331 0.99
clickbench_q29/duckdb:duckdb 51115301 47920273 1.07
clickbench_q30/duckdb:duckdb 296884098 299638020 0.99
clickbench_q31/duckdb:duckdb 434475103 442781384 0.98
clickbench_q32/duckdb:duckdb 1520346500 1526412440 1.00
clickbench_q33/duckdb:duckdb 1988626066 1959687062 1.01
clickbench_q34/duckdb:duckdb 1997871719 2160086389 0.92
clickbench_q35/duckdb:duckdb 263293356 270305202 0.97
clickbench_q36/duckdb:duckdb 43228578 42818499 1.01
clickbench_q37/duckdb:duckdb 33108690 31642075 1.05
clickbench_q38/duckdb:duckdb 32072724 31314924 1.02
clickbench_q39/duckdb:duckdb 65384096 66150027 0.99
clickbench_q40/duckdb:duckdb 33067496 32251500 1.03
clickbench_q41/duckdb:duckdb 31490901 31389286 1.00
clickbench_q42/duckdb:duckdb 33059727 32708730 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -1.8% +13.8% -13.7% +731.7% ➖ noise
0 duckdb:duckdb +7.6% +13.8% -5.5% +300.3% ➖ noise
0 duckdb:vortex-file-compressed +0.6% +13.8% -11.6% +337.0% ➖ noise
1 datafusion:vortex-file-compressed -7.7% +3.7% -11.0% +37.4% ➖ noise
1 duckdb:duckdb +1.5% +3.7% -2.1% +58.1% ➖ noise
1 duckdb:vortex-file-compressed +9.6% +3.7% +5.7% +22.1% ➖ noise
2 datafusion:vortex-file-compressed +7.3% +5.9% +1.3% +36.9% ➖ noise
2 duckdb:duckdb +2.7% +5.9% -3.0% +22.3% ➖ noise
2 duckdb:vortex-file-compressed +5.0% +5.9% -0.9% +16.3% ➖ noise
3 datafusion:vortex-file-compressed +5.1% +1.7% +3.3% +184.6% ➖ noise
3 duckdb:duckdb +2.7% +1.7% +1.0% +53.2% ➖ noise
3 duckdb:vortex-file-compressed +2.9% +1.7% +1.2% +29.5% ➖ noise
4 datafusion:vortex-file-compressed -0.7% +8.3% -8.3% +10.0% ➖ noise
4 duckdb:duckdb -2.0% +8.3% -9.5% +10.0% ✅ faster
4 duckdb:vortex-file-compressed +0.5% +8.3% -7.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.3% +5.9% -4.4% +10.0% ➖ noise
5 duckdb:duckdb +0.3% +5.9% -5.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +6.2% +5.9% +0.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.8% +3.8% -5.4% +45.9% ➖ noise
6 duckdb:duckdb +4.7% +3.8% +0.9% +29.3% ➖ noise
6 duckdb:vortex-file-compressed +5.9% +3.8% +2.0% +19.4% ➖ noise
7 datafusion:vortex-file-compressed +0.3% +4.6% -4.2% +11.1% ➖ noise
7 duckdb:duckdb -0.7% +4.6% -5.1% +10.8% ➖ noise
7 duckdb:vortex-file-compressed +10.0% +4.6% +5.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.1% +3.8% -2.6% +10.0% ➖ noise
8 duckdb:duckdb +2.8% +3.8% -1.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.0% +3.8% -3.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.8% +6.5% -5.4% +10.0% ➖ noise
9 duckdb:duckdb -2.6% +6.5% -8.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.4% +6.5% -4.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.4% +1.4% +2.0% +10.6% ➖ noise
10 duckdb:duckdb -1.0% +1.4% -2.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.1% +1.4% +2.6% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.8% +3.0% -2.1% +10.0% ➖ noise
11 duckdb:duckdb +0.6% +3.0% -2.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +5.7% +3.0% +2.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +2.1% +2.5% -0.5% +10.0% ➖ noise
12 duckdb:duckdb +1.3% +2.5% -1.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.0% +2.5% -0.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.9% +3.1% -1.1% +10.0% ➖ noise
13 duckdb:duckdb -1.1% +3.1% -4.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.8% +3.1% -2.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.5% +3.9% -1.4% +10.0% ➖ noise
14 duckdb:duckdb -2.8% +3.9% -6.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.6% +3.9% -2.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +5.2% +4.1% +1.0% +10.0% ➖ noise
15 duckdb:duckdb -1.8% +4.1% -5.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.5% +4.1% -3.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +5.9% +6.0% -0.1% +10.0% ➖ noise
16 duckdb:duckdb -22.9% +6.0% -27.3% +10.0% ✅ faster
16 duckdb:vortex-file-compressed +2.7% +6.0% -3.1% +12.9% ➖ noise
17 datafusion:vortex-file-compressed +4.4% +3.8% +0.6% +10.0% ➖ noise
17 duckdb:duckdb -23.5% +3.8% -26.3% +10.0% ✅ faster
17 duckdb:vortex-file-compressed +5.0% +3.8% +1.1% +12.8% ➖ noise
18 datafusion:vortex-file-compressed +3.6% +4.6% -1.0% +10.0% ➖ noise
18 duckdb:duckdb +0.2% +4.6% -4.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -4.5% +4.6% -8.7% +10.5% ➖ noise
19 datafusion:vortex-file-compressed +2.0% +3.0% -1.0% +10.0% ➖ noise
19 duckdb:duckdb +3.5% +3.0% +0.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.2% +3.0% -2.7% +29.0% ➖ noise
20 datafusion:vortex-file-compressed -0.2% +1.2% -1.4% +201.9% ➖ noise
20 duckdb:duckdb -9.1% +1.2% -10.2% +26.1% ➖ noise
20 duckdb:vortex-file-compressed -2.9% +1.2% -4.1% +11.6% ➖ noise
21 datafusion:vortex-file-compressed +0.2% +0.6% -0.5% +10.0% ➖ noise
21 duckdb:duckdb +0.8% +0.6% +0.2% +10.4% ➖ noise
21 duckdb:vortex-file-compressed +2.5% +0.6% +1.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +2.4% +3.4% -0.9% +10.0% ➖ noise
22 duckdb:duckdb +0.1% +3.4% -3.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -1.7% +3.4% -4.9% +12.8% ➖ noise
23 datafusion:vortex-file-compressed +3.3% +1.8% +1.4% +60.1% ➖ noise
23 duckdb:duckdb +3.0% +1.8% +1.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +8.8% +1.8% +6.9% +11.5% ➖ noise
24 datafusion:vortex-file-compressed -11.3% -2.8% -8.7% +44.0% ➖ noise
24 duckdb:duckdb +3.1% -2.8% +6.1% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -25.9% -2.8% -23.7% +36.1% ➖ noise
25 datafusion:vortex-file-compressed -5.5% +3.4% -8.5% +11.9% ➖ noise
25 duckdb:duckdb -7.6% +3.4% -10.6% +10.0% ✅ faster
25 duckdb:vortex-file-compressed -16.2% +3.4% -18.9% +14.1% ✅ faster
26 datafusion:vortex-file-compressed -0.8% -2.1% +1.4% +10.5% ➖ noise
26 duckdb:duckdb -5.0% -2.1% -2.9% +11.3% ➖ noise
26 duckdb:vortex-file-compressed -11.0% -2.1% -9.1% +39.7% ➖ noise
27 datafusion:vortex-file-compressed +9.0% +1.8% +7.1% +10.0% ➖ noise
27 duckdb:duckdb -6.3% +1.8% -8.0% +14.6% ➖ noise
27 duckdb:vortex-file-compressed -0.4% +1.8% -2.2% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.5% +0.7% +0.8% +10.0% ➖ noise
28 duckdb:duckdb -0.8% +0.7% -1.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.0% +0.7% +0.2% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -2.7% +3.9% -6.4% +10.0% ➖ noise
29 duckdb:duckdb +6.7% +3.9% +2.7% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.0% +3.9% -2.8% +12.5% ➖ noise
30 datafusion:vortex-file-compressed +3.0% +5.6% -2.5% +10.0% ➖ noise
30 duckdb:duckdb -0.9% +5.6% -6.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +1.7% +5.6% -3.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +2.5% +5.0% -2.4% +10.0% ➖ noise
31 duckdb:duckdb -1.9% +5.0% -6.6% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +4.6% +5.0% -0.4% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +7.5% +6.7% +0.8% +16.9% ➖ noise
32 duckdb:duckdb -0.4% +6.7% -6.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -2.8% +6.7% -8.9% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +5.7% +4.6% +1.1% +17.1% ➖ noise
33 duckdb:duckdb +1.5% +4.6% -3.0% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -3.2% +4.6% -7.4% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +7.9% +5.2% +2.6% +10.0% ➖ noise
34 duckdb:duckdb -7.5% +5.2% -12.1% +10.0% ✅ faster
34 duckdb:vortex-file-compressed -0.9% +5.2% -5.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +3.4% +3.1% +0.3% +10.0% ➖ noise
35 duckdb:duckdb -2.6% +3.1% -5.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.8% +3.1% -2.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +14.3% +9.4% +4.5% +11.8% ➖ noise
36 duckdb:duckdb +1.0% +9.4% -7.7% +12.7% ➖ noise
36 duckdb:vortex-file-compressed +16.5% +9.4% +6.5% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +6.8% +3.5% +3.1% +10.0% ➖ noise
37 duckdb:duckdb +4.6% +3.5% +1.1% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +19.8% +3.5% +15.7% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed +8.0% +3.9% +4.0% +10.0% ➖ noise
38 duckdb:duckdb +2.4% +3.9% -1.4% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +11.9% +3.9% +7.7% +10.5% ➖ noise
39 datafusion:vortex-file-compressed +11.0% +6.4% +4.3% +10.0% ➖ noise
39 duckdb:duckdb -1.2% +6.4% -7.1% +20.6% ➖ noise
39 duckdb:vortex-file-compressed +5.5% +6.4% -0.9% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +7.4% +4.5% +2.8% +11.4% ➖ noise
40 duckdb:duckdb +2.5% +4.5% -1.9% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +20.1% +4.5% +14.9% +16.7% ➖ noise
41 datafusion:vortex-file-compressed +6.7% +4.3% +2.3% +14.4% ➖ noise
41 duckdb:duckdb +0.3% +4.3% -3.9% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +16.9% +4.3% +12.1% +10.0% 🚨 regression
42 datafusion:vortex-file-compressed +9.3% +3.9% +5.2% +10.0% ➖ noise
42 duckdb:duckdb +1.1% +3.9% -2.8% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +3.9% +3.9% -0.1% +15.6% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.7%
Vortex (geomean): 0.937x ➖
Parquet (geomean): 0.895x ➖
Shifts: Parquet (control) -10.5% · Median polish -6.5%


datafusion / vortex-file-compressed (0.859x ➖, 3↑ 1↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 234957983 212694676 1.10
tpch_q02/datafusion:vortex-file-compressed 465215859 599797501 0.78
tpch_q03/datafusion:vortex-file-compressed 358496045 497569179 0.72
tpch_q04/datafusion:vortex-file-compressed 🚀 229718957 344827599 0.67
tpch_q05/datafusion:vortex-file-compressed 483349485 542232739 0.89
tpch_q06/datafusion:vortex-file-compressed 🚀 242651709 431250138 0.56
tpch_q07/datafusion:vortex-file-compressed 412360463 423181846 0.97
tpch_q08/datafusion:vortex-file-compressed 601637029 662439049 0.91
tpch_q09/datafusion:vortex-file-compressed 519304308 555328517 0.94
tpch_q10/datafusion:vortex-file-compressed 487593625 546961113 0.89
tpch_q11/datafusion:vortex-file-compressed 272884185 342530763 0.80
tpch_q12/datafusion:vortex-file-compressed 394633801 558669066 0.71
tpch_q13/datafusion:vortex-file-compressed 219891460 172300262 1.28
tpch_q14/datafusion:vortex-file-compressed 192850714 208809767 0.92
tpch_q15/datafusion:vortex-file-compressed 311329962 340626532 0.91
tpch_q16/datafusion:vortex-file-compressed 184837262 209276426 0.88
tpch_q17/datafusion:vortex-file-compressed 🚨 441361890 315743480 1.40
tpch_q18/datafusion:vortex-file-compressed 317164032 312273846 1.02
tpch_q19/datafusion:vortex-file-compressed 297739304 397271280 0.75
tpch_q20/datafusion:vortex-file-compressed 350550236 438989151 0.80
tpch_q21/datafusion:vortex-file-compressed 467783523 640564582 0.73
tpch_q22/datafusion:vortex-file-compressed 🚀 144708936 208268227 0.69
datafusion / vortex-compact (0.936x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 228625979 244989179 0.93
tpch_q02/datafusion:vortex-compact 440444321 490202166 0.90
tpch_q03/datafusion:vortex-compact 326491106 433937712 0.75
tpch_q04/datafusion:vortex-compact 230509035 233248110 0.99
tpch_q05/datafusion:vortex-compact 381219502 447804029 0.85
tpch_q06/datafusion:vortex-compact 262477820 323056539 0.81
tpch_q07/datafusion:vortex-compact 406499485 386266962 1.05
tpch_q08/datafusion:vortex-compact 469435741 603530359 0.78
tpch_q09/datafusion:vortex-compact 482146494 487167742 0.99
tpch_q10/datafusion:vortex-compact 512499711 457298052 1.12
tpch_q11/datafusion:vortex-compact 297528903 265345995 1.12
tpch_q12/datafusion:vortex-compact 452448625 470501535 0.96
tpch_q13/datafusion:vortex-compact 195396596 200783135 0.97
tpch_q14/datafusion:vortex-compact 284187681 303954111 0.93
tpch_q15/datafusion:vortex-compact 443911608 459750295 0.97
tpch_q16/datafusion:vortex-compact 164399418 179233179 0.92
tpch_q17/datafusion:vortex-compact 348836596 339460666 1.03
tpch_q18/datafusion:vortex-compact 351783392 366076761 0.96
tpch_q19/datafusion:vortex-compact 517250767 434079505 1.19
tpch_q20/datafusion:vortex-compact 500912517 607726037 0.82
tpch_q21/datafusion:vortex-compact 514877711 638726525 0.81
tpch_q22/datafusion:vortex-compact 119569426 135270753 0.88
datafusion / parquet (0.814x ➖, 4↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 273486473 236232621 1.16
tpch_q02/datafusion:parquet 520343884 653970335 0.80
tpch_q03/datafusion:parquet 🚀 323731617 523563651 0.62
tpch_q04/datafusion:parquet 172290459 219949929 0.78
tpch_q05/datafusion:parquet 550312445 715926969 0.77
tpch_q06/datafusion:parquet 158104189 130488565 1.21
tpch_q07/datafusion:parquet 580768631 781693058 0.74
tpch_q08/datafusion:parquet 667122245 807987058 0.83
tpch_q09/datafusion:parquet 555735046 585562931 0.95
tpch_q10/datafusion:parquet 🚀 587119504 870460859 0.67
tpch_q11/datafusion:parquet 🚀 358207560 636682760 0.56
tpch_q12/datafusion:parquet 311258709 398264683 0.78
tpch_q13/datafusion:parquet 433996858 542263248 0.80
tpch_q14/datafusion:parquet 220822133 294892570 0.75
tpch_q15/datafusion:parquet 🚀 303684109 469613405 0.65
tpch_q16/datafusion:parquet 194090647 169805420 1.14
tpch_q17/datafusion:parquet 415742218 494640181 0.84
tpch_q18/datafusion:parquet 500368563 566664615 0.88
tpch_q19/datafusion:parquet 357295038 466325026 0.77
tpch_q20/datafusion:parquet 410262477 524984625 0.78
tpch_q21/datafusion:parquet 618569283 734989001 0.84
tpch_q22/datafusion:parquet 153625186 168633064 0.91
duckdb / vortex-file-compressed (0.952x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 250172888 251307736 1.00
tpch_q02/duckdb:vortex-file-compressed 871481460 912598863 0.95
tpch_q03/duckdb:vortex-file-compressed 504014189 627455250 0.80
tpch_q04/duckdb:vortex-file-compressed 325441991 374775795 0.87
tpch_q05/duckdb:vortex-file-compressed 821946003 960024210 0.86
tpch_q06/duckdb:vortex-file-compressed 367076178 385962021 0.95
tpch_q07/duckdb:vortex-file-compressed 658096439 712977140 0.92
tpch_q08/duckdb:vortex-file-compressed 894596097 872432432 1.03
tpch_q09/duckdb:vortex-file-compressed 849306625 816436696 1.04
tpch_q10/duckdb:vortex-file-compressed 679805209 756918427 0.90
tpch_q11/duckdb:vortex-file-compressed 488859443 501512456 0.97
tpch_q12/duckdb:vortex-file-compressed 478591669 462584968 1.03
tpch_q13/duckdb:vortex-file-compressed 463157672 458811174 1.01
tpch_q14/duckdb:vortex-file-compressed 409940802 454243491 0.90
tpch_q15/duckdb:vortex-file-compressed 254623896 238198182 1.07
tpch_q16/duckdb:vortex-file-compressed 337262626 331979637 1.02
tpch_q17/duckdb:vortex-file-compressed 574408514 586175840 0.98
tpch_q18/duckdb:vortex-file-compressed 552160996 528142237 1.05
tpch_q19/duckdb:vortex-file-compressed 421440157 448932894 0.94
tpch_q20/duckdb:vortex-file-compressed 717690428 876401160 0.82
tpch_q21/duckdb:vortex-file-compressed 1041186283 1108609514 0.94
tpch_q22/duckdb:vortex-file-compressed 346272418 357130697 0.97
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 293643067 292981922 1.00
tpch_q02/duckdb:vortex-compact 843988872 868980281 0.97
tpch_q03/duckdb:vortex-compact 511622972 507770830 1.01
tpch_q04/duckdb:vortex-compact 367731489 341029937 1.08
tpch_q05/duckdb:vortex-compact 884846899 730374179 1.21
tpch_q06/duckdb:vortex-compact 358059200 369827450 0.97
tpch_q07/duckdb:vortex-compact 609271622 652580141 0.93
tpch_q08/duckdb:vortex-compact 856206580 758820785 1.13
tpch_q09/duckdb:vortex-compact 824104263 855037464 0.96
tpch_q10/duckdb:vortex-compact 642945392 792801921 0.81
tpch_q11/duckdb:vortex-compact 544460338 557239772 0.98
tpch_q12/duckdb:vortex-compact 415264384 442117232 0.94
tpch_q13/duckdb:vortex-compact 444867133 408900902 1.09
tpch_q14/duckdb:vortex-compact 536951310 417222935 1.29
tpch_q15/duckdb:vortex-compact 312718765 354057752 0.88
tpch_q16/duckdb:vortex-compact 385475548 349103649 1.10
tpch_q17/duckdb:vortex-compact 642922117 652942982 0.98
tpch_q18/duckdb:vortex-compact 505065922 562018875 0.90
tpch_q19/duckdb:vortex-compact 445570508 547515651 0.81
tpch_q20/duckdb:vortex-compact 783828417 799699949 0.98
tpch_q21/duckdb:vortex-compact 1084365459 1015864049 1.07
tpch_q22/duckdb:vortex-compact 366517244 304849802 1.20
duckdb / parquet (0.983x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 497414576 475491530 1.05
tpch_q02/duckdb:parquet 1222673859 1284879111 0.95
tpch_q03/duckdb:parquet 932589227 1125971554 0.83
tpch_q04/duckdb:parquet 567525797 602656794 0.94
tpch_q05/duckdb:parquet 1375619726 1486265405 0.93
tpch_q06/duckdb:parquet 416923246 399752672 1.04
tpch_q07/duckdb:parquet 1176391998 1019350588 1.15
tpch_q08/duckdb:parquet 1629045169 1434868104 1.14
tpch_q09/duckdb:parquet 1280224697 1336169447 0.96
tpch_q10/duckdb:parquet 1281878579 1329840968 0.96
tpch_q11/duckdb:parquet 824616802 800527393 1.03
tpch_q12/duckdb:parquet 574475896 632411460 0.91
tpch_q13/duckdb:parquet 884197330 830273880 1.06
tpch_q14/duckdb:parquet 635997670 591368017 1.08
tpch_q15/duckdb:parquet 524511275 514817347 1.02
tpch_q16/duckdb:parquet 524457738 517217308 1.01
tpch_q17/duckdb:parquet 742629396 775186740 0.96
tpch_q18/duckdb:parquet 844216805 939006131 0.90
tpch_q19/duckdb:parquet 779073550 835283410 0.93
tpch_q20/duckdb:parquet 1006911131 1207385684 0.83
tpch_q21/duckdb:parquet 1128354694 1085347610 1.04
tpch_q22/duckdb:parquet 511295182 518681119 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -6.7% +10.0% -15.2% +121.7% ➖ noise
1 datafusion:vortex-file-compressed +10.5% +10.0% +0.4% +125.6% ➖ noise
1 duckdb:vortex-compact +0.2% +10.0% -8.9% +42.8% ➖ noise
1 duckdb:vortex-file-compressed -0.5% +10.0% -9.5% +45.8% ➖ noise
2 datafusion:vortex-compact -10.2% -13.0% +3.3% +45.0% ➖ noise
2 datafusion:vortex-file-compressed -22.4% -13.0% -10.9% +41.1% ➖ noise
2 duckdb:vortex-compact -2.9% -13.0% +11.6% +33.7% ➖ noise
2 duckdb:vortex-file-compressed -4.5% -13.0% +9.7% +33.7% ➖ noise
3 datafusion:vortex-compact -24.8% -28.4% +5.1% +59.8% ➖ noise
3 datafusion:vortex-file-compressed -28.0% -28.4% +0.7% +88.8% ➖ noise
3 duckdb:vortex-compact +0.8% -28.4% +40.8% +33.7% 🚨 regression
3 duckdb:vortex-file-compressed -19.7% -28.4% +12.2% +34.4% ➖ noise
4 datafusion:vortex-compact -1.2% -14.1% +15.1% +39.7% ➖ noise
4 datafusion:vortex-file-compressed -33.4% -14.1% -22.4% +33.7% ➖ noise
4 duckdb:vortex-compact +7.8% -14.1% +25.5% +33.7% ➖ noise
4 duckdb:vortex-file-compressed -13.2% -14.1% +1.1% +33.7% ➖ noise
5 datafusion:vortex-compact -14.9% -15.7% +0.9% +33.7% ➖ noise
5 datafusion:vortex-file-compressed -10.9% -15.7% +5.7% +33.7% ➖ noise
5 duckdb:vortex-compact +21.1% -15.7% +43.6% +33.7% 🚨 regression
5 duckdb:vortex-file-compressed -14.4% -15.7% +1.5% +33.7% ➖ noise
6 datafusion:vortex-compact -18.8% +12.4% -27.7% +33.7% ✅ faster
6 datafusion:vortex-file-compressed -43.7% +12.4% -49.9% +56.9% ✅ faster
6 duckdb:vortex-compact -3.2% +12.4% -13.9% +33.7% ➖ noise
6 duckdb:vortex-file-compressed -4.9% +12.4% -15.4% +33.7% ➖ noise
7 datafusion:vortex-compact +5.2% -7.4% +13.7% +33.7% ➖ noise
7 datafusion:vortex-file-compressed -2.6% -7.4% +5.2% +33.7% ➖ noise
7 duckdb:vortex-compact -6.6% -7.4% +0.8% +33.7% ➖ noise
7 duckdb:vortex-file-compressed -7.7% -7.4% -0.3% +35.7% ➖ noise
8 datafusion:vortex-compact -22.2% -3.2% -19.7% +33.7% ➖ noise
8 datafusion:vortex-file-compressed -9.2% -3.2% -6.2% +33.7% ➖ noise
8 duckdb:vortex-compact +12.8% -3.2% +16.5% +33.7% ➖ noise
8 duckdb:vortex-file-compressed +2.5% -3.2% +5.9% +33.7% ➖ noise
9 datafusion:vortex-compact -1.0% -4.6% +3.8% +35.0% ➖ noise
9 datafusion:vortex-file-compressed -6.5% -4.6% -1.9% +40.4% ➖ noise
9 duckdb:vortex-compact -3.6% -4.6% +1.1% +34.4% ➖ noise
9 duckdb:vortex-file-compressed +4.0% -4.6% +9.1% +33.7% ➖ noise
10 datafusion:vortex-compact +12.1% -19.4% +39.0% +33.7% 🚨 regression
10 datafusion:vortex-file-compressed -10.9% -19.4% +10.6% +35.2% ➖ noise
10 duckdb:vortex-compact -18.9% -19.4% +0.6% +33.7% ➖ noise
10 duckdb:vortex-file-compressed -10.2% -19.4% +11.4% +40.7% ➖ noise
11 datafusion:vortex-compact +12.1% -23.9% +47.3% +39.3% 🚨 regression
11 datafusion:vortex-file-compressed -20.3% -23.9% +4.6% +64.2% ➖ noise
11 duckdb:vortex-compact -2.3% -23.9% +28.3% +36.5% ➖ noise
11 duckdb:vortex-file-compressed -2.5% -23.9% +28.0% +33.7% ➖ noise
12 datafusion:vortex-compact -3.8% -15.7% +14.1% +33.7% ➖ noise
12 datafusion:vortex-file-compressed -29.4% -15.7% -16.2% +48.2% ➖ noise
12 duckdb:vortex-compact -6.1% -15.7% +11.5% +45.1% ➖ noise
12 duckdb:vortex-file-compressed +3.5% -15.7% +22.8% +43.5% ➖ noise
13 datafusion:vortex-compact -2.7% -7.7% +5.4% +74.4% ➖ noise
13 datafusion:vortex-file-compressed +27.6% -7.7% +38.2% +73.6% ➖ noise
13 duckdb:vortex-compact +8.8% -7.7% +17.8% +36.3% ➖ noise
13 duckdb:vortex-file-compressed +0.9% -7.7% +9.3% +59.0% ➖ noise
14 datafusion:vortex-compact -6.5% -10.3% +4.2% +33.7% ➖ noise
14 datafusion:vortex-file-compressed -7.6% -10.3% +2.9% +33.7% ➖ noise
14 duckdb:vortex-compact +28.7% -10.3% +43.4% +33.7% 🚨 regression
14 duckdb:vortex-file-compressed -9.8% -10.3% +0.6% +33.7% ➖ noise
15 datafusion:vortex-compact -3.4% -18.8% +19.0% +33.7% ➖ noise
15 datafusion:vortex-file-compressed -8.6% -18.8% +12.6% +48.2% ➖ noise
15 duckdb:vortex-compact -11.7% -18.8% +8.8% +33.7% ➖ noise
15 duckdb:vortex-file-compressed +6.9% -18.8% +31.7% +33.7% ➖ noise
16 datafusion:vortex-compact -8.3% +7.7% -14.8% +33.7% ➖ noise
16 datafusion:vortex-file-compressed -11.7% +7.7% -18.0% +41.8% ➖ noise
16 duckdb:vortex-compact +10.4% +7.7% +2.6% +44.4% ➖ noise
16 duckdb:vortex-file-compressed +1.6% +7.7% -5.6% +39.7% ➖ noise
17 datafusion:vortex-compact +2.8% -10.3% +14.5% +33.7% ➖ noise
17 datafusion:vortex-file-compressed +39.8% -10.3% +55.8% +46.8% 🚨 regression
17 duckdb:vortex-compact -1.5% -10.3% +9.7% +33.7% ➖ noise
17 duckdb:vortex-file-compressed -2.0% -10.3% +9.2% +33.7% ➖ noise
18 datafusion:vortex-compact -3.9% -10.9% +7.9% +33.7% ➖ noise
18 datafusion:vortex-file-compressed +1.6% -10.9% +14.0% +33.7% ➖ noise
18 duckdb:vortex-compact -10.1% -10.9% +0.9% +36.0% ➖ noise
18 duckdb:vortex-file-compressed +4.5% -10.9% +17.3% +33.7% ➖ noise
19 datafusion:vortex-compact +19.2% -15.5% +41.0% +48.8% ➖ noise
19 datafusion:vortex-file-compressed -25.1% -15.5% -11.3% +42.5% ➖ noise
19 duckdb:vortex-compact -18.6% -15.5% -3.7% +33.7% ➖ noise
19 duckdb:vortex-file-compressed -6.1% -15.5% +11.0% +33.7% ➖ noise
20 datafusion:vortex-compact -17.6% -19.3% +2.1% +33.7% ➖ noise
20 datafusion:vortex-file-compressed -20.1% -19.3% -1.1% +33.7% ➖ noise
20 duckdb:vortex-compact -2.0% -19.3% +21.4% +33.7% ➖ noise
20 duckdb:vortex-file-compressed -18.1% -19.3% +1.4% +33.7% ➖ noise
21 datafusion:vortex-compact -19.4% -6.5% -13.8% +33.7% ➖ noise
21 datafusion:vortex-file-compressed -27.0% -6.5% -21.9% +33.7% ➖ noise
21 duckdb:vortex-compact +6.7% -6.5% +14.1% +33.7% ➖ noise
21 duckdb:vortex-file-compressed -6.1% -6.5% +0.4% +33.7% ➖ noise
22 datafusion:vortex-compact -11.6% -5.2% -6.7% +33.7% ➖ noise
22 datafusion:vortex-file-compressed -30.5% -5.2% -26.7% +33.7% ✅ faster
22 duckdb:vortex-compact +20.2% -5.2% +26.9% +33.7% ➖ noise
22 duckdb:vortex-file-compressed -3.0% -5.2% +2.3% +33.7% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.0%
Vortex (geomean): 1.005x ➖
Parquet (geomean): 0.957x ➖
Shifts: Parquet (control) -4.3% · Median polish -0.0%


datafusion / vortex-file-compressed (0.995x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 30417222 33025473 0.92
fineweb_q01/datafusion:vortex-file-compressed 478638858 474699224 1.01
fineweb_q02/datafusion:vortex-file-compressed 469260688 468131410 1.00
fineweb_q03/datafusion:vortex-file-compressed 1372900713 1425490356 0.96
fineweb_q04/datafusion:vortex-file-compressed 1385105163 1427619822 0.97
fineweb_q05/datafusion:vortex-file-compressed 1374863634 1412133473 0.97
fineweb_q06/datafusion:vortex-file-compressed 1592274619 1480551045 1.08
fineweb_q07/datafusion:vortex-file-compressed 1407461731 1467022297 0.96
fineweb_q08/datafusion:vortex-file-compressed 594114790 542919442 1.09
datafusion / vortex-compact (0.921x ➖, 1↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 35616690 60418737 0.59
fineweb_q01/datafusion:vortex-compact 512431839 558676039 0.92
fineweb_q02/datafusion:vortex-compact 636690311 701263878 0.91
fineweb_q03/datafusion:vortex-compact 1828470252 1866150948 0.98
fineweb_q04/datafusion:vortex-compact 2221896840 2236141513 0.99
fineweb_q05/datafusion:vortex-compact 1695423725 1691996219 1.00
fineweb_q06/datafusion:vortex-compact 1437445602 1430567398 1.00
fineweb_q07/datafusion:vortex-compact 1302406971 1355699604 0.96
fineweb_q08/datafusion:vortex-compact 402932413 392274691 1.03
datafusion / parquet (0.979x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1148985074 1221124382 0.94
fineweb_q01/datafusion:parquet 1849263306 1840791380 1.00
fineweb_q02/datafusion:parquet 1880572142 1782632449 1.05
fineweb_q03/datafusion:parquet 1727477740 1719073912 1.00
fineweb_q04/datafusion:parquet 1910841300 1928480767 0.99
fineweb_q05/datafusion:parquet 1857710443 1847361871 1.01
fineweb_q06/datafusion:parquet 1696890503 1907322701 0.89
fineweb_q07/datafusion:parquet 1734433439 1877241951 0.92
fineweb_q08/datafusion:parquet 1786777986 1774294120 1.01
duckdb / vortex-file-compressed (1.026x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 129684097 100752614 1.29
fineweb_q01/duckdb:vortex-file-compressed 712125743 662333151 1.08
fineweb_q02/duckdb:vortex-file-compressed 452811872 515755220 0.88
fineweb_q03/duckdb:vortex-file-compressed 1563345498 1546259058 1.01
fineweb_q04/duckdb:vortex-file-compressed 1600872125 1561588752 1.03
fineweb_q05/duckdb:vortex-file-compressed 1536814432 1504149077 1.02
fineweb_q06/duckdb:vortex-file-compressed 1703351561 1668099397 1.02
fineweb_q07/duckdb:vortex-file-compressed 1531142194 1605926627 0.95
fineweb_q08/duckdb:vortex-file-compressed 647082502 644929446 1.00
duckdb / vortex-compact (1.086x ➖, 0↑ 1↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 108189064 65943962 1.64
fineweb_q01/duckdb:vortex-compact 621707843 540113935 1.15
fineweb_q02/duckdb:vortex-compact 622993526 586025634 1.06
fineweb_q03/duckdb:vortex-compact 1658842746 1577270607 1.05
fineweb_q04/duckdb:vortex-compact 1753481027 1635844354 1.07
fineweb_q05/duckdb:vortex-compact 1506545402 1496555376 1.01
fineweb_q06/duckdb:vortex-compact 1453741520 1487000986 0.98
fineweb_q07/duckdb:vortex-compact 1333612344 1332026378 1.00
fineweb_q08/duckdb:vortex-compact 477781363 507521677 0.94
duckdb / parquet (0.936x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1034527407 1285249968 0.80
fineweb_q01/duckdb:parquet 1651633944 1800374040 0.92
fineweb_q02/duckdb:parquet 1566263860 1551583934 1.01
fineweb_q03/duckdb:parquet 4005033309 4105720370 0.98
fineweb_q04/duckdb:parquet 1848494425 1936367765 0.95
fineweb_q05/duckdb:parquet 2592349614 2605133838 1.00
fineweb_q06/duckdb:parquet 3289390512 3484164199 0.94
fineweb_q07/duckdb:parquet 4033868597 4499192468 0.90
fineweb_q08/duckdb:parquet 1053145198 1118608904 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -41.1% -13.0% -32.3% +98.7% ➖ noise
0 datafusion:vortex-file-compressed -7.9% -13.0% +5.8% +144.6% ➖ noise
0 duckdb:vortex-compact +64.1% -13.0% +88.5% +31.3% 🚨 regression
0 duckdb:vortex-file-compressed +28.7% -13.0% +47.9% +36.4% 🚨 regression
1 datafusion:vortex-compact -8.3% -4.0% -4.5% +60.6% ➖ noise
1 datafusion:vortex-file-compressed +0.8% -4.0% +5.0% +105.5% ➖ noise
1 duckdb:vortex-compact +15.1% -4.0% +19.9% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +7.5% -4.0% +12.0% +30.0% ➖ noise
2 datafusion:vortex-compact -9.2% +3.2% -12.0% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +0.2% +3.2% -2.9% +38.1% ➖ noise
2 duckdb:vortex-compact +6.3% +3.2% +3.0% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -12.2% +3.2% -14.9% +30.0% ➖ noise
3 datafusion:vortex-compact -2.0% -1.0% -1.0% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -3.7% -1.0% -2.7% +30.0% ➖ noise
3 duckdb:vortex-compact +5.2% -1.0% +6.2% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +1.1% -1.0% +2.1% +30.0% ➖ noise
4 datafusion:vortex-compact -0.6% -2.7% +2.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -3.0% -2.7% -0.2% +30.0% ➖ noise
4 duckdb:vortex-compact +7.2% -2.7% +10.2% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.5% -2.7% +5.4% +30.0% ➖ noise
5 datafusion:vortex-compact +0.2% +0.0% +0.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -2.6% +0.0% -2.7% +30.0% ➖ noise
5 duckdb:vortex-compact +0.7% +0.0% +0.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +2.2% +0.0% +2.1% +30.0% ➖ noise
6 datafusion:vortex-compact +0.5% -8.4% +9.6% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +7.5% -8.4% +17.3% +30.0% ➖ noise
6 duckdb:vortex-compact -2.2% -8.4% +6.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +2.1% -8.4% +11.4% +30.0% ➖ noise
7 datafusion:vortex-compact -3.9% -9.0% +5.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -4.1% -9.0% +5.4% +30.0% ➖ noise
7 duckdb:vortex-compact +0.1% -9.0% +10.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -4.7% -9.0% +4.8% +30.0% ➖ noise
8 datafusion:vortex-compact +2.7% -2.6% +5.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +9.4% -2.6% +12.4% +30.0% ➖ noise
8 duckdb:vortex-compact -5.9% -2.6% -3.3% +68.0% ➖ noise
8 duckdb:vortex-file-compressed +0.3% -2.6% +3.0% +30.0% ➖ noise

Signed-off-by: Will Manning <will@willmanning.io>
@lwwmanning lwwmanning added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 13, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 13, 2026
@lwwmanning lwwmanning enabled auto-merge (squash) March 13, 2026 19:19
@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.5%
Vortex (geomean): 0.977x ➖
Parquet (geomean): 0.973x ➖
Shifts: Parquet (control) -2.7% · Median polish -0.9%


datafusion / vortex-file-compressed (0.961x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 730409560 737703887 0.99
tpch_q02/datafusion:vortex-file-compressed 747422918 798755892 0.94
tpch_q03/datafusion:vortex-file-compressed 813121819 870067934 0.93
tpch_q04/datafusion:vortex-file-compressed 603747564 671626542 0.90
tpch_q05/datafusion:vortex-file-compressed 1110879789 1164363524 0.95
tpch_q06/datafusion:vortex-file-compressed 633450637 639153839 0.99
tpch_q07/datafusion:vortex-file-compressed 1211465410 1194365073 1.01
tpch_q08/datafusion:vortex-file-compressed 1259100134 1221879323 1.03
tpch_q09/datafusion:vortex-file-compressed 1442343154 1388635522 1.04
tpch_q10/datafusion:vortex-file-compressed 1047219541 1053817362 0.99
tpch_q11/datafusion:vortex-file-compressed 481687285 601692514 0.80
tpch_q12/datafusion:vortex-file-compressed 938369857 965945971 0.97
tpch_q13/datafusion:vortex-file-compressed 459834628 571996007 0.80
tpch_q14/datafusion:vortex-file-compressed 615331976 619032219 0.99
tpch_q15/datafusion:vortex-file-compressed 1147157487 1252322431 0.92
tpch_q16/datafusion:vortex-file-compressed 426209492 406927498 1.05
tpch_q17/datafusion:vortex-file-compressed 1231193003 1194194571 1.03
tpch_q18/datafusion:vortex-file-compressed 1399199992 1329595772 1.05
tpch_q19/datafusion:vortex-file-compressed 681570255 708304785 0.96
tpch_q20/datafusion:vortex-file-compressed 952246700 978621148 0.97
tpch_q21/datafusion:vortex-file-compressed 1667214975 1864181777 0.89
tpch_q22/datafusion:vortex-file-compressed 331792990 338614026 0.98
datafusion / vortex-compact (0.944x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 730403460 750304597 0.97
tpch_q02/datafusion:vortex-compact 675457012 874912121 0.77
tpch_q03/datafusion:vortex-compact 813902250 909898884 0.89
tpch_q04/datafusion:vortex-compact 584588999 761663398 0.77
tpch_q05/datafusion:vortex-compact 971924491 1011573078 0.96
tpch_q06/datafusion:vortex-compact 628486676 677535081 0.93
tpch_q07/datafusion:vortex-compact 1181079883 1174251858 1.01
tpch_q08/datafusion:vortex-compact 1257678939 1231535840 1.02
tpch_q09/datafusion:vortex-compact 1386491095 1487561045 0.93
tpch_q10/datafusion:vortex-compact 925339888 1133855445 0.82
tpch_q11/datafusion:vortex-compact 462083449 486099677 0.95
tpch_q12/datafusion:vortex-compact 951136450 905533663 1.05
tpch_q13/datafusion:vortex-compact 508811644 465048138 1.09
tpch_q14/datafusion:vortex-compact 693885619 820686230 0.85
tpch_q15/datafusion:vortex-compact 1189798393 1337382182 0.89
tpch_q16/datafusion:vortex-compact 348964406 394947251 0.88
tpch_q17/datafusion:vortex-compact 1252927347 1289695445 0.97
tpch_q18/datafusion:vortex-compact 1286616290 1250397519 1.03
tpch_q19/datafusion:vortex-compact 769412401 751585567 1.02
tpch_q20/datafusion:vortex-compact 932701034 1023226183 0.91
tpch_q21/datafusion:vortex-compact 1585232980 1573592080 1.01
tpch_q22/datafusion:vortex-compact 433780057 381262861 1.14
datafusion / parquet (0.946x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 902735198 972521496 0.93
tpch_q02/datafusion:parquet 1056945170 1231787075 0.86
tpch_q03/datafusion:parquet 991688823 1357931726 0.73
tpch_q04/datafusion:parquet 518595072 543284659 0.95
tpch_q05/datafusion:parquet 1390062136 1287358343 1.08
tpch_q06/datafusion:parquet 531679968 533537264 1.00
tpch_q07/datafusion:parquet 1588652340 1623686690 0.98
tpch_q08/datafusion:parquet 1588592104 1588377794 1.00
tpch_q09/datafusion:parquet 1854540224 2110369237 0.88
tpch_q10/datafusion:parquet 2097332747 2204383005 0.95
tpch_q11/datafusion:parquet 730415034 687667926 1.06
tpch_q12/datafusion:parquet 667008059 752300219 0.89
tpch_q13/datafusion:parquet 702607793 740224110 0.95
tpch_q14/datafusion:parquet 791987723 817117103 0.97
tpch_q15/datafusion:parquet 1156734730 1248949614 0.93
tpch_q16/datafusion:parquet 389634781 459382458 0.85
tpch_q17/datafusion:parquet 1428450817 1419766296 1.01
tpch_q18/datafusion:parquet 1745257134 1764826015 0.99
tpch_q19/datafusion:parquet 1004087032 1085123928 0.93
tpch_q20/datafusion:parquet 1127839543 1157155995 0.97
tpch_q21/datafusion:parquet 1785956237 1920926743 0.93
tpch_q22/datafusion:parquet 921136318 875591926 1.05
duckdb / vortex-file-compressed (0.988x ➖, 0↑ 1↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 671796619 611642517 1.10
tpch_q02/duckdb:vortex-file-compressed 1085244139 1211605545 0.90
tpch_q03/duckdb:vortex-file-compressed 970686231 930597760 1.04
tpch_q04/duckdb:vortex-file-compressed 696250606 670882222 1.04
tpch_q05/duckdb:vortex-file-compressed 1217339773 1145149290 1.06
tpch_q06/duckdb:vortex-file-compressed 844167063 787123592 1.07
tpch_q07/duckdb:vortex-file-compressed 1229640170 1108797600 1.11
tpch_q08/duckdb:vortex-file-compressed 1528468070 1610297883 0.95
tpch_q09/duckdb:vortex-file-compressed 1568115368 1597253345 0.98
tpch_q10/duckdb:vortex-file-compressed 1260701414 1311008776 0.96
tpch_q11/duckdb:vortex-file-compressed 🚨 644273056 493430522 1.31
tpch_q12/duckdb:vortex-file-compressed 838605604 817970413 1.03
tpch_q13/duckdb:vortex-file-compressed 1037933295 1231174933 0.84
tpch_q14/duckdb:vortex-file-compressed 930598573 929282206 1.00
tpch_q15/duckdb:vortex-file-compressed 603771899 606963900 0.99
tpch_q16/duckdb:vortex-file-compressed 428346197 522153462 0.82
tpch_q17/duckdb:vortex-file-compressed 1024784406 1072121842 0.96
tpch_q18/duckdb:vortex-file-compressed 1004151019 1002864636 1.00
tpch_q19/duckdb:vortex-file-compressed 799837508 850790048 0.94
tpch_q20/duckdb:vortex-file-compressed 1316489112 1298046440 1.01
tpch_q21/duckdb:vortex-file-compressed 2126330053 2301654330 0.92
tpch_q22/duckdb:vortex-file-compressed 576605666 702753169 0.82
duckdb / vortex-compact (1.018x ➖, 0↑ 1↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 691808649 789789871 0.88
tpch_q02/duckdb:vortex-compact 1056323871 1089582193 0.97
tpch_q03/duckdb:vortex-compact 829169673 900195172 0.92
tpch_q04/duckdb:vortex-compact 540380335 504571361 1.07
tpch_q05/duckdb:vortex-compact 1042599203 1171907297 0.89
tpch_q06/duckdb:vortex-compact 757546538 820948606 0.92
tpch_q07/duckdb:vortex-compact 1074426492 1096863235 0.98
tpch_q08/duckdb:vortex-compact 1368621937 1433131375 0.95
tpch_q09/duckdb:vortex-compact 1452457016 1578132887 0.92
tpch_q10/duckdb:vortex-compact 🚨 1287362659 979980772 1.31
tpch_q11/duckdb:vortex-compact 633663824 779080466 0.81
tpch_q12/duckdb:vortex-compact 668098158 617197254 1.08
tpch_q13/duckdb:vortex-compact 867939157 838180116 1.04
tpch_q14/duckdb:vortex-compact 859282132 832498889 1.03
tpch_q15/duckdb:vortex-compact 608430427 542241334 1.12
tpch_q16/duckdb:vortex-compact 425505278 331892589 1.28
tpch_q17/duckdb:vortex-compact 955673777 871594837 1.10
tpch_q18/duckdb:vortex-compact 811393161 687140983 1.18
tpch_q19/duckdb:vortex-compact 801795494 697077883 1.15
tpch_q20/duckdb:vortex-compact 1261225679 1230963780 1.02
tpch_q21/duckdb:vortex-compact 1737498703 1641970447 1.06
tpch_q22/duckdb:vortex-compact 592665854 682775440 0.87
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR 0c882e6 (ns) base da4c196 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1198312229 1181153110 1.01
tpch_q02/duckdb:parquet 1499452837 1745336405 0.86
tpch_q03/duckdb:parquet 1743424405 1661461461 1.05
tpch_q04/duckdb:parquet 1009715956 1197250782 0.84
tpch_q05/duckdb:parquet 2441862443 2246661240 1.09
tpch_q06/duckdb:parquet 770493360 750001990 1.03
tpch_q07/duckdb:parquet 1948012504 1736478969 1.12
tpch_q08/duckdb:parquet 2482211144 2584132957 0.96
tpch_q09/duckdb:parquet 2410077575 2406895905 1.00
tpch_q10/duckdb:parquet 3282615279 3355364604 0.98
tpch_q11/duckdb:parquet 937900579 939329630 1.00
tpch_q12/duckdb:parquet 1116247421 985998606 1.13
tpch_q13/duckdb:parquet 1339598706 1274401642 1.05
tpch_q14/duckdb:parquet 1348501661 1625540603 0.83
tpch_q15/duckdb:parquet 1009700114 838534476 1.20
tpch_q16/duckdb:parquet 848096759 865014539 0.98
tpch_q17/duckdb:parquet 1335206707 1396008078 0.96
tpch_q18/duckdb:parquet 1437235829 1580234948 0.91
tpch_q19/duckdb:parquet 1529584372 1739666718 0.88
tpch_q20/duckdb:parquet 1848186766 1771593577 1.04
tpch_q21/duckdb:parquet 2272742842 1945077315 1.17
tpch_q22/duckdb:parquet 1159689984 1130852219 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.7% -3.0% +0.3% +60.2% ➖ noise
1 datafusion:vortex-file-compressed -1.0% -3.0% +2.0% +62.0% ➖ noise
1 duckdb:vortex-compact -12.4% -3.0% -9.7% +41.4% ➖ noise
1 duckdb:vortex-file-compressed +9.8% -3.0% +13.2% +35.0% ➖ noise
2 datafusion:vortex-compact -22.8% -14.1% -10.1% +36.3% ➖ noise
2 datafusion:vortex-file-compressed -6.4% -14.1% +9.0% +33.7% ➖ noise
2 duckdb:vortex-compact -3.1% -14.1% +12.9% +50.7% ➖ noise
2 duckdb:vortex-file-compressed -10.4% -14.1% +4.3% +37.0% ➖ noise
3 datafusion:vortex-compact -10.6% -12.5% +2.2% +80.2% ➖ noise
3 datafusion:vortex-file-compressed -6.5% -12.5% +6.8% +68.5% ➖ noise
3 duckdb:vortex-compact -7.9% -12.5% +5.2% +54.0% ➖ noise
3 duckdb:vortex-file-compressed +4.3% -12.5% +19.2% +52.2% ➖ noise
4 datafusion:vortex-compact -23.2% -10.3% -14.5% +35.8% ➖ noise
4 datafusion:vortex-file-compressed -10.1% -10.3% +0.2% +30.0% ➖ noise
4 duckdb:vortex-compact +7.1% -10.3% +19.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +3.8% -10.3% +15.7% +30.0% ➖ noise
5 datafusion:vortex-compact -3.9% +8.3% -11.3% +44.6% ➖ noise
5 datafusion:vortex-file-compressed -4.6% +8.3% -11.9% +30.2% ➖ noise
5 duckdb:vortex-compact -11.0% +8.3% -17.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +6.3% +8.3% -1.9% +30.0% ➖ noise
6 datafusion:vortex-compact -7.2% +1.2% -8.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -0.9% +1.2% -2.0% +30.0% ➖ noise
6 duckdb:vortex-compact -7.7% +1.2% -8.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +7.2% +1.2% +6.0% +30.0% ➖ noise
7 datafusion:vortex-compact +0.6% +4.8% -4.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +1.4% +4.8% -3.2% +30.0% ➖ noise
7 duckdb:vortex-compact -2.0% +4.8% -6.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +10.9% +4.8% +5.9% +30.0% ➖ noise
8 datafusion:vortex-compact +2.1% -2.0% +4.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +3.0% -2.0% +5.1% +30.0% ➖ noise
8 duckdb:vortex-compact -4.5% -2.0% -2.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -5.1% -2.0% -3.2% +30.0% ➖ noise
9 datafusion:vortex-compact -6.8% -6.2% -0.6% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +3.9% -6.2% +10.7% +30.0% ➖ noise
9 duckdb:vortex-compact -8.0% -6.2% -1.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -1.8% -6.2% +4.7% +30.0% ➖ noise
10 datafusion:vortex-compact -18.4% -3.5% -15.4% +34.3% ➖ noise
10 datafusion:vortex-file-compressed -0.6% -3.5% +3.0% +30.0% ➖ noise
10 duckdb:vortex-compact +31.4% -3.5% +36.2% +31.4% 🚨 regression
10 duckdb:vortex-file-compressed -3.8% -3.5% -0.3% +35.3% ➖ noise
11 datafusion:vortex-compact -4.9% +3.0% -7.7% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -19.9% +3.0% -22.3% +30.0% ➖ noise
11 duckdb:vortex-compact -18.7% +3.0% -21.0% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +30.6% +3.0% +26.8% +30.0% ➖ noise
12 datafusion:vortex-compact +5.0% +0.2% +4.8% +30.3% ➖ noise
12 datafusion:vortex-file-compressed -2.9% +0.2% -3.0% +30.0% ➖ noise
12 duckdb:vortex-compact +8.2% +0.2% +8.0% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +2.5% +0.2% +2.3% +34.6% ➖ noise
13 datafusion:vortex-compact +9.4% -0.1% +9.5% +43.9% ➖ noise
13 datafusion:vortex-file-compressed -19.6% -0.1% -19.5% +41.3% ➖ noise
13 duckdb:vortex-compact +3.6% -0.1% +3.7% +65.7% ➖ noise
13 duckdb:vortex-file-compressed -15.7% -0.1% -15.6% +57.7% ➖ noise
14 datafusion:vortex-compact -15.5% -10.3% -5.7% +47.1% ➖ noise
14 datafusion:vortex-file-compressed -0.6% -10.3% +10.9% +42.2% ➖ noise
14 duckdb:vortex-compact +3.2% -10.3% +15.1% +39.7% ➖ noise
14 duckdb:vortex-file-compressed +0.1% -10.3% +11.7% +41.5% ➖ noise
15 datafusion:vortex-compact -11.0% +5.6% -15.8% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -8.4% +5.6% -13.3% +30.0% ➖ noise
15 duckdb:vortex-compact +12.2% +5.6% +6.3% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -0.5% +5.6% -5.8% +30.0% ➖ noise
16 datafusion:vortex-compact -11.6% -8.8% -3.1% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +4.7% -8.8% +14.9% +34.3% ➖ noise
16 duckdb:vortex-compact +28.2% -8.8% +40.6% +30.0% 🚨 regression
16 duckdb:vortex-file-compressed -18.0% -8.8% -10.0% +30.0% ➖ noise
17 datafusion:vortex-compact -2.9% -1.9% -1.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +3.1% -1.9% +5.1% +30.0% ➖ noise
17 duckdb:vortex-compact +9.6% -1.9% +11.8% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -4.4% -1.9% -2.6% +30.0% ➖ noise
18 datafusion:vortex-compact +2.9% -5.2% +8.5% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +5.2% -5.2% +11.0% +30.0% ➖ noise
18 duckdb:vortex-compact +18.1% -5.2% +24.5% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +0.1% -5.2% +5.6% +30.0% ➖ noise
19 datafusion:vortex-compact +2.4% -9.8% +13.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -3.8% -9.8% +6.7% +30.0% ➖ noise
19 duckdb:vortex-compact +15.0% -9.8% +27.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -6.0% -9.8% +4.2% +30.0% ➖ noise
20 datafusion:vortex-compact -8.8% +0.8% -9.6% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -2.7% +0.8% -3.5% +30.0% ➖ noise
20 duckdb:vortex-compact +2.5% +0.8% +1.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +1.4% +0.8% +0.6% +30.0% ➖ noise
21 datafusion:vortex-compact +0.7% +4.2% -3.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -10.6% +4.2% -14.2% +30.0% ➖ noise
21 duckdb:vortex-compact +5.8% +4.2% +1.5% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -7.6% +4.2% -11.4% +30.0% ➖ noise
22 datafusion:vortex-compact +13.8% +3.9% +9.5% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -2.0% +3.9% -5.7% +39.1% ➖ noise
22 duckdb:vortex-compact -13.2% +3.9% -16.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -18.0% +3.9% -21.0% +30.0% ➖ noise

Signed-off-by: Will Manning <will@willmanning.io>
@lwwmanning lwwmanning added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 13, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 13, 2026
@lwwmanning lwwmanning merged commit 91bc940 into develop Mar 13, 2026
108 of 111 checks passed
@lwwmanning lwwmanning deleted the wm/short-summary branch March 13, 2026 20:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants