Skip to content

Upgrade fsst-rs to 0.5.9#7177

Merged
AdamGS merged 1 commit intodevelopfrom
adamg/update-fsst-0-5-9
Mar 26, 2026
Merged

Upgrade fsst-rs to 0.5.9#7177
AdamGS merged 1 commit intodevelopfrom
adamg/update-fsst-0-5-9

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Mar 26, 2026

just a very petty upgrade because I want to run benchmarks.

@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Mar 26, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 26, 2026
@AdamGS AdamGS added the changelog/chore A trivial change label Mar 26, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Mar 26, 2026

Merging this PR will not alter performance

✅ 1106 untouched benchmarks
⏩ 1522 skipped benchmarks1


Comparing adamg/update-fsst-0-5-9 (dca3fac) with develop (c8eae59)

Open in CodSpeed

Footnotes

  1. 1522 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 1bcc137 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 1bcc137 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.006x ➖


datafusion / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 114055383 114487000 1.00
polarsignals_q01/datafusion:vortex-file-compressed 340862422 341931777 1.00
polarsignals_q02/datafusion:vortex-file-compressed 22139049 21537152 1.03
polarsignals_q03/datafusion:vortex-file-compressed 346298853 341310473 1.01
polarsignals_q04/datafusion:vortex-file-compressed 11775422 11985626 0.98
polarsignals_q05/datafusion:vortex-file-compressed 15997611 15663928 1.02
polarsignals_q06/datafusion:vortex-file-compressed 20947591 19412767 1.08
polarsignals_q07/datafusion:vortex-file-compressed 12303475 11938404 1.03
polarsignals_q08/datafusion:vortex-file-compressed 440378795 433312424 1.02
polarsignals_q09/datafusion:vortex-file-compressed 10797413 11887254 0.91

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Vortex (geomean): 1.030x ➖
Parquet (geomean): 1.020x ➖
Shifts: Parquet (control) +2.0% · Median polish +1.3%


datafusion / vortex-file-compressed (1.072x ➖, 0↑ 7↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 76069670 63193500 1.20
tpch_q02/datafusion:vortex-file-compressed 🚨 70657820 61419706 1.15
tpch_q03/datafusion:vortex-file-compressed 🚨 43601286 35444325 1.23
tpch_q04/datafusion:vortex-file-compressed 🚨 27488797 23268936 1.18
tpch_q05/datafusion:vortex-file-compressed 🚨 107500378 96779518 1.11
tpch_q06/datafusion:vortex-file-compressed 13714221 12931846 1.06
tpch_q07/datafusion:vortex-file-compressed 120904793 110502214 1.09
tpch_q08/datafusion:vortex-file-compressed 88709492 83711796 1.06
tpch_q09/datafusion:vortex-file-compressed 113604096 108633181 1.05
tpch_q10/datafusion:vortex-file-compressed 94765030 92979731 1.02
tpch_q11/datafusion:vortex-file-compressed 22449597 24029213 0.93
tpch_q12/datafusion:vortex-file-compressed 42181324 40792520 1.03
tpch_q13/datafusion:vortex-file-compressed 33747772 31957380 1.06
tpch_q14/datafusion:vortex-file-compressed 34938855 32022320 1.09
tpch_q15/datafusion:vortex-file-compressed 🚨 35691481 31586118 1.13
tpch_q16/datafusion:vortex-file-compressed 42602107 40824452 1.04
tpch_q17/datafusion:vortex-file-compressed 🚨 112840659 95176499 1.19
tpch_q18/datafusion:vortex-file-compressed 155776633 143568088 1.09
tpch_q19/datafusion:vortex-file-compressed 44543634 42201434 1.06
tpch_q20/datafusion:vortex-file-compressed 68739933 69772599 0.99
tpch_q21/datafusion:vortex-file-compressed 140442303 143783043 0.98
tpch_q22/datafusion:vortex-file-compressed 20655591 22463747 0.92
datafusion / vortex-compact (0.999x ➖, 4↑ 3↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 78785424 83308413 0.95
tpch_q02/datafusion:vortex-compact 🚀 62877702 71970550 0.87
tpch_q03/datafusion:vortex-compact 🚀 44447772 50428895 0.88
tpch_q04/datafusion:vortex-compact 30092225 31293175 0.96
tpch_q05/datafusion:vortex-compact 🚀 103036278 116823851 0.88
tpch_q06/datafusion:vortex-compact 18479256 18990385 0.97
tpch_q07/datafusion:vortex-compact 🚀 124659895 138619335 0.90
tpch_q08/datafusion:vortex-compact 95970406 101606204 0.94
tpch_q09/datafusion:vortex-compact 130687798 130031002 1.01
tpch_q10/datafusion:vortex-compact 107444483 99689429 1.08
tpch_q11/datafusion:vortex-compact 🚨 30207386 26982321 1.12
tpch_q12/datafusion:vortex-compact 60641189 57176285 1.06
tpch_q13/datafusion:vortex-compact 🚨 48506458 42179912 1.15
tpch_q14/datafusion:vortex-compact 40717653 39171643 1.04
tpch_q15/datafusion:vortex-compact 47318633 43754813 1.08
tpch_q16/datafusion:vortex-compact 52799900 49702730 1.06
tpch_q17/datafusion:vortex-compact 100406249 110178658 0.91
tpch_q18/datafusion:vortex-compact 147487586 147520130 1.00
tpch_q19/datafusion:vortex-compact 🚨 55435148 50143247 1.11
tpch_q20/datafusion:vortex-compact 65478780 67630301 0.97
tpch_q21/datafusion:vortex-compact 147841521 136691920 1.08
tpch_q22/datafusion:vortex-compact 20800536 20153937 1.03
datafusion / parquet (1.021x ➖, 1↑ 3↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 130923167 154657332 0.85
tpch_q02/datafusion:parquet 98414417 97417151 1.01
tpch_q03/datafusion:parquet 90128234 99045039 0.91
tpch_q04/datafusion:parquet 60000831 59397193 1.01
tpch_q05/datafusion:parquet 182192639 179481685 1.02
tpch_q06/datafusion:parquet 51803377 52039982 1.00
tpch_q07/datafusion:parquet 205134345 207074369 0.99
tpch_q08/datafusion:parquet 174703541 182828198 0.96
tpch_q09/datafusion:parquet 249352124 242372842 1.03
tpch_q10/datafusion:parquet 230887854 209907469 1.10
tpch_q11/datafusion:parquet 69474873 68191178 1.02
tpch_q12/datafusion:parquet 137034392 133291419 1.03
tpch_q13/datafusion:parquet 239503580 242468770 0.99
tpch_q14/datafusion:parquet 89319599 89220054 1.00
tpch_q15/datafusion:parquet 80212343 75189533 1.07
tpch_q16/datafusion:parquet 69934214 66775953 1.05
tpch_q17/datafusion:parquet 🚨 243600174 219559821 1.11
tpch_q18/datafusion:parquet 278320760 280633413 0.99
tpch_q19/datafusion:parquet 123571638 116746960 1.06
tpch_q20/datafusion:parquet 144520834 136154213 1.06
tpch_q21/datafusion:parquet 🚨 234679328 207669182 1.13
tpch_q22/datafusion:parquet 🚨 53490805 46135968 1.16
datafusion / arrow (0.927x ➖, 7↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 93987842 87604045 1.07
tpch_q02/datafusion:arrow 25915697 27848296 0.93
tpch_q03/datafusion:arrow 51098966 53257249 0.96
tpch_q04/datafusion:arrow 38290324 42353492 0.90
tpch_q05/datafusion:arrow 113467473 119072423 0.95
tpch_q06/datafusion:arrow 29229403 31069387 0.94
tpch_q07/datafusion:arrow 267012572 243120876 1.10
tpch_q08/datafusion:arrow 68515260 62433690 1.10
tpch_q09/datafusion:arrow 🚀 108235076 121053183 0.89
tpch_q10/datafusion:arrow 🚀 86219454 114136958 0.76
tpch_q11/datafusion:arrow 15870057 15037555 1.06
tpch_q12/datafusion:arrow 78409766 83555003 0.94
tpch_q13/datafusion:arrow 🚀 57907977 67823461 0.85
tpch_q14/datafusion:arrow 🚀 36152507 43411868 0.83
tpch_q15/datafusion:arrow 🚀 77588394 103193319 0.75
tpch_q16/datafusion:arrow 🚀 28021654 32038397 0.87
tpch_q17/datafusion:arrow 🚀 112794020 130696931 0.86
tpch_q18/datafusion:arrow 204086556 223524886 0.91
tpch_q19/datafusion:arrow 58317443 64526193 0.90
tpch_q20/datafusion:arrow 57266265 57468609 1.00
tpch_q21/datafusion:arrow 375701012 376841777 1.00
tpch_q22/datafusion:arrow 24939003 27460975 0.91
duckdb / vortex-file-compressed (1.093x ➖, 0↑ 7↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 39066814 35984446 1.09
tpch_q02/duckdb:vortex-file-compressed 🚨 37885435 32873574 1.15
tpch_q03/duckdb:vortex-file-compressed 38292572 35907281 1.07
tpch_q04/duckdb:vortex-file-compressed 🚨 40971166 36857521 1.11
tpch_q05/duckdb:vortex-file-compressed 45559567 43341992 1.05
tpch_q06/duckdb:vortex-file-compressed 14370835 13316913 1.08
tpch_q07/duckdb:vortex-file-compressed 48385715 46010975 1.05
tpch_q08/duckdb:vortex-file-compressed 56787765 51709538 1.10
tpch_q09/duckdb:vortex-file-compressed 110313680 100315491 1.10
tpch_q10/duckdb:vortex-file-compressed 45217659 47562819 0.95
tpch_q11/duckdb:vortex-file-compressed 20109335 18401732 1.09
tpch_q12/duckdb:vortex-file-compressed 30413859 29108531 1.04
tpch_q13/duckdb:vortex-file-compressed 🚨 50501450 45344523 1.11
tpch_q14/duckdb:vortex-file-compressed 🚨 33511809 28039669 1.20
tpch_q15/duckdb:vortex-file-compressed 🚨 21185159 18670976 1.13
tpch_q16/duckdb:vortex-file-compressed 🚨 39006835 35063900 1.11
tpch_q17/duckdb:vortex-file-compressed 🚨 35809013 30181619 1.19
tpch_q18/duckdb:vortex-file-compressed 61053090 56134072 1.09
tpch_q19/duckdb:vortex-file-compressed 47237246 43437815 1.09
tpch_q20/duckdb:vortex-file-compressed 48623975 44388713 1.10
tpch_q21/duckdb:vortex-file-compressed 157645917 144119210 1.09
tpch_q22/duckdb:vortex-file-compressed 26207170 24068579 1.09
duckdb / vortex-compact (0.962x ➖, 3↑ 3↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 43838276 44181415 0.99
tpch_q02/duckdb:vortex-compact 🚨 48401263 43122773 1.12
tpch_q03/duckdb:vortex-compact 🚨 44272727 40212198 1.10
tpch_q04/duckdb:vortex-compact 🚨 46483308 40961393 1.13
tpch_q05/duckdb:vortex-compact 44834513 47374452 0.95
tpch_q06/duckdb:vortex-compact 17456291 18249733 0.96
tpch_q07/duckdb:vortex-compact 51592599 54034139 0.95
tpch_q08/duckdb:vortex-compact 🚀 51418042 63602653 0.81
tpch_q09/duckdb:vortex-compact 🚀 106996985 121132614 0.88
tpch_q10/duckdb:vortex-compact 47552605 52532808 0.91
tpch_q11/duckdb:vortex-compact 25972809 25678639 1.01
tpch_q12/duckdb:vortex-compact 44466801 46478595 0.96
tpch_q13/duckdb:vortex-compact 57673695 63244173 0.91
tpch_q14/duckdb:vortex-compact 35049035 37726104 0.93
tpch_q15/duckdb:vortex-compact 🚀 22212123 27516593 0.81
tpch_q16/duckdb:vortex-compact 40174243 44351685 0.91
tpch_q17/duckdb:vortex-compact 37255479 39001453 0.96
tpch_q18/duckdb:vortex-compact 59585443 58659632 1.02
tpch_q19/duckdb:vortex-compact 48483528 49893396 0.97
tpch_q20/duckdb:vortex-compact 55430538 54467547 1.02
tpch_q21/duckdb:vortex-compact 137105016 143090061 0.96
tpch_q22/duckdb:vortex-compact 24257269 24535313 0.99
duckdb / parquet (1.018x ➖, 0↑ 2↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 110381749 108358303 1.02
tpch_q02/duckdb:parquet 43557581 43693044 1.00
tpch_q03/duckdb:parquet 76513877 77379155 0.99
tpch_q04/duckdb:parquet 52427230 52640524 1.00
tpch_q05/duckdb:parquet 73543578 74821266 0.98
tpch_q06/duckdb:parquet 22446220 22580755 0.99
tpch_q07/duckdb:parquet 77458603 77012845 1.01
tpch_q08/duckdb:parquet 89348164 91805615 0.97
tpch_q09/duckdb:parquet 162189530 175027249 0.93
tpch_q10/duckdb:parquet 149700254 154084050 0.97
tpch_q11/duckdb:parquet 26290195 24611064 1.07
tpch_q12/duckdb:parquet 49670642 48778607 1.02
tpch_q13/duckdb:parquet 329443202 321502404 1.02
tpch_q14/duckdb:parquet 58269569 60873673 0.96
tpch_q15/duckdb:parquet 28014096 27162053 1.03
tpch_q16/duckdb:parquet 67749671 65855049 1.03
tpch_q17/duckdb:parquet 🚨 65318237 57856577 1.13
tpch_q18/duckdb:parquet 🚨 147854876 127368408 1.16
tpch_q19/duckdb:parquet 84904836 79028570 1.07
tpch_q20/duckdb:parquet 68359782 69575072 0.98
tpch_q21/duckdb:parquet 221471260 214214397 1.03
tpch_q22/duckdb:parquet 60618905 56984263 1.06
duckdb / duckdb (0.988x ➖, 1↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16800739 17453860 0.96
tpch_q02/duckdb:duckdb 14710386 15110446 0.97
tpch_q03/duckdb:duckdb 23941199 23917980 1.00
tpch_q04/duckdb:duckdb 22288177 22121131 1.01
tpch_q05/duckdb:duckdb 🚀 21448795 23848486 0.90
tpch_q06/duckdb:duckdb 5880881 6066065 0.97
tpch_q07/duckdb:duckdb 24828513 27034111 0.92
tpch_q08/duckdb:duckdb 23668367 25078119 0.94
tpch_q09/duckdb:duckdb 66684189 68021636 0.98
tpch_q10/duckdb:duckdb 52633579 51025074 1.03
tpch_q11/duckdb:duckdb 7309091 6843885 1.07
tpch_q12/duckdb:duckdb 15530280 15455841 1.00
tpch_q13/duckdb:duckdb 40730124 42684140 0.95
tpch_q14/duckdb:duckdb 20053758 19364998 1.04
tpch_q15/duckdb:duckdb 13121246 14166603 0.93
tpch_q16/duckdb:duckdb 26365564 25297369 1.04
tpch_q17/duckdb:duckdb 15226722 15339741 0.99
tpch_q18/duckdb:duckdb 42392909 40843414 1.04
tpch_q19/duckdb:duckdb 32857670 32904243 1.00
tpch_q20/duckdb:duckdb 24671470 24783451 1.00
tpch_q21/duckdb:duckdb 68905035 67072927 1.03
tpch_q22/duckdb:duckdb 26806842 27333342 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +7.3% -7.1% +15.5% +25.9% ➖ noise
1 datafusion:vortex-compact -5.4% -7.1% +1.8% +23.9% ➖ noise
1 datafusion:vortex-file-compressed +20.4% -7.1% +29.6% +26.9% 🚨 regression
1 duckdb:duckdb -3.7% -7.1% +3.7% +23.6% ➖ noise
1 duckdb:vortex-compact -0.8% -7.1% +6.8% +23.1% ➖ noise
1 duckdb:vortex-file-compressed +8.6% -7.1% +16.9% +22.6% ➖ noise
2 datafusion:arrow -6.9% +0.4% -7.3% +13.2% ➖ noise
2 datafusion:vortex-compact -12.6% +0.4% -12.9% +13.2% ✅ faster
2 datafusion:vortex-file-compressed +15.0% +0.4% +14.6% +13.2% 🚨 regression
2 duckdb:duckdb -2.6% +0.4% -3.0% +14.2% ➖ noise
2 duckdb:vortex-compact +12.2% +0.4% +11.8% +13.2% ➖ noise
2 duckdb:vortex-file-compressed +15.2% +0.4% +14.8% +13.2% 🚨 regression
3 datafusion:arrow -4.1% -5.1% +1.1% +20.0% ➖ noise
3 datafusion:vortex-compact -11.9% -5.1% -7.1% +16.1% ➖ noise
3 datafusion:vortex-file-compressed +23.0% -5.1% +29.7% +13.2% 🚨 regression
3 duckdb:duckdb +0.1% -5.1% +5.5% +18.7% ➖ noise
3 duckdb:vortex-compact +10.1% -5.1% +16.1% +14.6% 🚨 regression
3 duckdb:vortex-file-compressed +6.6% -5.1% +12.4% +17.3% ➖ noise
4 datafusion:arrow -9.6% +0.3% -9.9% +14.9% ➖ noise
4 datafusion:vortex-compact -3.8% +0.3% -4.1% +14.0% ➖ noise
4 datafusion:vortex-file-compressed +18.1% +0.3% +17.8% +13.2% 🚨 regression
4 duckdb:duckdb +0.8% +0.3% +0.5% +15.5% ➖ noise
4 duckdb:vortex-compact +13.5% +0.3% +13.1% +13.2% ➖ noise
4 duckdb:vortex-file-compressed +11.2% +0.3% +10.8% +13.3% ➖ noise
5 datafusion:arrow -4.7% -0.1% -4.6% +13.2% ➖ noise
5 datafusion:vortex-compact -11.8% -0.1% -11.7% +13.2% ✅ faster
5 datafusion:vortex-file-compressed +11.1% -0.1% +11.2% +13.2% ➖ noise
5 duckdb:duckdb -10.1% -0.1% -10.0% +16.9% ➖ noise
5 duckdb:vortex-compact -5.4% -0.1% -5.3% +15.2% ➖ noise
5 duckdb:vortex-file-compressed +5.1% -0.1% +5.2% +13.2% ➖ noise
6 datafusion:arrow -5.9% -0.5% -5.4% +25.9% ➖ noise
6 datafusion:vortex-compact -2.7% -0.5% -2.2% +25.2% ➖ noise
6 datafusion:vortex-file-compressed +6.0% -0.5% +6.6% +25.2% ➖ noise
6 duckdb:duckdb -3.1% -0.5% -2.5% +26.2% ➖ noise
6 duckdb:vortex-compact -4.3% -0.5% -3.8% +23.3% ➖ noise
6 duckdb:vortex-file-compressed +7.9% -0.5% +8.5% +23.6% ➖ noise
7 datafusion:arrow +9.8% -0.2% +10.0% +13.2% ➖ noise
7 datafusion:vortex-compact -10.1% -0.2% -9.9% +13.2% ➖ noise
7 datafusion:vortex-file-compressed +9.4% -0.2% +9.6% +13.2% ➖ noise
7 duckdb:duckdb -8.2% -0.2% -8.0% +15.1% ➖ noise
7 duckdb:vortex-compact -4.5% -0.2% -4.3% +13.2% ➖ noise
7 duckdb:vortex-file-compressed +5.2% -0.2% +5.4% +13.2% ➖ noise
8 datafusion:arrow +9.7% -3.6% +13.8% +13.2% 🚨 regression
8 datafusion:vortex-compact -5.5% -3.6% -2.1% +13.2% ➖ noise
8 datafusion:vortex-file-compressed +6.0% -3.6% +9.9% +13.2% ➖ noise
8 duckdb:duckdb -5.6% -3.6% -2.1% +13.2% ➖ noise
8 duckdb:vortex-compact -19.2% -3.6% -16.2% +15.3% ✅ faster
8 duckdb:vortex-file-compressed +9.8% -3.6% +13.9% +18.1% ➖ noise
9 datafusion:arrow -10.6% -2.4% -8.4% +23.7% ➖ noise
9 datafusion:vortex-compact +0.5% -2.4% +2.9% +13.2% ➖ noise
9 datafusion:vortex-file-compressed +4.6% -2.4% +7.1% +13.2% ➖ noise
9 duckdb:duckdb -2.0% -2.4% +0.4% +13.2% ➖ noise
9 duckdb:vortex-compact -11.7% -2.4% -9.5% +14.6% ➖ noise
9 duckdb:vortex-file-compressed +10.0% -2.4% +12.6% +13.2% ➖ noise
10 datafusion:arrow -24.5% +3.4% -26.9% +13.2% ✅ faster
10 datafusion:vortex-compact +7.8% +3.4% +4.3% +13.2% ➖ noise
10 datafusion:vortex-file-compressed +1.9% +3.4% -1.4% +13.2% ➖ noise
10 duckdb:duckdb +3.2% +3.4% -0.2% +17.6% ➖ noise
10 duckdb:vortex-compact -9.5% +3.4% -12.4% +13.2% ✅ faster
10 duckdb:vortex-file-compressed -4.9% +3.4% -8.0% +13.2% ➖ noise
11 datafusion:arrow +5.5% +4.3% +1.2% +18.6% ➖ noise
11 datafusion:vortex-compact +12.0% +4.3% +7.3% +15.0% ➖ noise
11 datafusion:vortex-file-compressed -6.6% +4.3% -10.4% +16.0% ➖ noise
11 duckdb:duckdb +6.8% +4.3% +2.4% +17.5% ➖ noise
11 duckdb:vortex-compact +1.1% +4.3% -3.0% +14.9% ➖ noise
11 duckdb:vortex-file-compressed +9.3% +4.3% +4.8% +13.2% ➖ noise
12 datafusion:arrow -6.2% +2.3% -8.3% +14.6% ➖ noise
12 datafusion:vortex-compact +6.1% +2.3% +3.7% +14.6% ➖ noise
12 datafusion:vortex-file-compressed +3.4% +2.3% +1.1% +14.9% ➖ noise
12 duckdb:duckdb +0.5% +2.3% -1.8% +14.1% ➖ noise
12 duckdb:vortex-compact -4.3% +2.3% -6.5% +13.2% ➖ noise
12 duckdb:vortex-file-compressed +4.5% +2.3% +2.1% +13.2% ➖ noise
13 datafusion:arrow -14.6% +0.6% -15.1% +13.2% ✅ faster
13 datafusion:vortex-compact +15.0% +0.6% +14.3% +13.2% 🚨 regression
13 datafusion:vortex-file-compressed +5.6% +0.6% +5.0% +13.2% ➖ noise
13 duckdb:duckdb -4.6% +0.6% -5.2% +13.2% ➖ noise
13 duckdb:vortex-compact -8.8% +0.6% -9.4% +13.2% ➖ noise
13 duckdb:vortex-file-compressed +11.4% +0.6% +10.7% +13.2% ➖ noise
14 datafusion:arrow -16.7% -2.1% -14.9% +15.2% ✅ faster
14 datafusion:vortex-compact +3.9% -2.1% +6.2% +13.2% ➖ noise
14 datafusion:vortex-file-compressed +9.1% -2.1% +11.5% +13.2% ➖ noise
14 duckdb:duckdb +3.6% -2.1% +5.8% +18.0% ➖ noise
14 duckdb:vortex-compact -7.1% -2.1% -5.1% +13.2% ➖ noise
14 duckdb:vortex-file-compressed +19.5% -2.1% +22.1% +15.8% 🚨 regression
15 datafusion:arrow -24.8% +4.9% -28.3% +24.7% ✅ faster
15 datafusion:vortex-compact +8.1% +4.9% +3.1% +19.9% ➖ noise
15 datafusion:vortex-file-compressed +13.0% +4.9% +7.7% +21.8% ➖ noise
15 duckdb:duckdb -7.4% +4.9% -11.7% +21.3% ➖ noise
15 duckdb:vortex-compact -19.3% +4.9% -23.0% +20.0% ✅ faster
15 duckdb:vortex-file-compressed +13.5% +4.9% +8.2% +21.7% ➖ noise
16 datafusion:arrow -12.5% +3.8% -15.7% +13.2% ✅ faster
16 datafusion:vortex-compact +6.2% +3.8% +2.3% +13.2% ➖ noise
16 datafusion:vortex-file-compressed +4.4% +3.8% +0.5% +13.2% ➖ noise
16 duckdb:duckdb +4.2% +3.8% +0.4% +15.2% ➖ noise
16 duckdb:vortex-compact -9.4% +3.8% -12.7% +13.2% ✅ faster
16 duckdb:vortex-file-compressed +11.2% +3.8% +7.2% +13.2% ➖ noise
17 datafusion:arrow -13.7% +11.9% -22.9% +17.2% ✅ faster
17 datafusion:vortex-compact -8.9% +11.9% -18.6% +20.2% ✅ faster
17 datafusion:vortex-file-compressed +18.6% +11.9% +5.9% +14.8% ➖ noise
17 duckdb:duckdb -0.7% +11.9% -11.3% +14.4% ➖ noise
17 duckdb:vortex-compact -4.5% +11.9% -14.6% +14.5% ✅ faster
17 duckdb:vortex-file-compressed +18.6% +11.9% +6.0% +20.6% ➖ noise
18 datafusion:arrow -8.7% +7.3% -14.9% +13.2% ✅ faster
18 datafusion:vortex-compact -0.0% +7.3% -6.8% +15.1% ➖ noise
18 datafusion:vortex-file-compressed +8.5% +7.3% +1.1% +13.2% ➖ noise
18 duckdb:duckdb +3.8% +7.3% -3.3% +13.2% ➖ noise
18 duckdb:vortex-compact +1.6% +7.3% -5.3% +13.2% ➖ noise
18 duckdb:vortex-file-compressed +8.8% +7.3% +1.4% +15.7% ➖ noise
19 datafusion:arrow -9.6% +6.6% -15.2% +16.1% ✅ faster
19 datafusion:vortex-compact +10.6% +6.6% +3.7% +20.4% ➖ noise
19 datafusion:vortex-file-compressed +5.6% +6.6% -1.0% +16.0% ➖ noise
19 duckdb:duckdb -0.1% +6.6% -6.4% +21.8% ➖ noise
19 duckdb:vortex-compact -2.8% +6.6% -8.9% +14.9% ➖ noise
19 duckdb:vortex-file-compressed +8.7% +6.6% +2.0% +15.6% ➖ noise
20 datafusion:arrow -0.4% +2.1% -2.4% +13.8% ➖ noise
20 datafusion:vortex-compact -3.2% +2.1% -5.2% +13.2% ➖ noise
20 datafusion:vortex-file-compressed -1.5% +2.1% -3.5% +13.2% ➖ noise
20 duckdb:duckdb -0.5% +2.1% -2.5% +14.3% ➖ noise
20 duckdb:vortex-compact +1.8% +2.1% -0.3% +15.3% ➖ noise
20 duckdb:vortex-file-compressed +9.5% +2.1% +7.3% +20.6% ➖ noise
21 datafusion:arrow -0.3% +8.1% -7.8% +13.2% ➖ noise
21 datafusion:vortex-compact +8.2% +8.1% +0.1% +13.2% ➖ noise
21 datafusion:vortex-file-compressed -2.3% +8.1% -9.6% +13.2% ➖ noise
21 duckdb:duckdb +2.7% +8.1% -5.0% +13.2% ➖ noise
21 duckdb:vortex-compact -4.2% +8.1% -11.4% +13.2% ➖ noise
21 duckdb:vortex-file-compressed +9.4% +8.1% +1.2% +13.2% ➖ noise
22 datafusion:arrow -9.2% +11.1% -18.2% +13.2% ✅ faster
22 datafusion:vortex-compact +3.2% +11.1% -7.1% +13.2% ➖ noise
22 datafusion:vortex-file-compressed -8.0% +11.1% -17.2% +15.6% ✅ faster
22 duckdb:duckdb -1.9% +11.1% -11.7% +13.2% ✅ faster
22 duckdb:vortex-compact -1.1% +11.1% -11.0% +13.2% ➖ noise
22 duckdb:vortex-file-compressed +8.9% +11.1% -2.0% +13.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Vortex (geomean): 0.999x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.2%


datafusion / vortex-file-compressed (1.027x ➖, 1↑ 2↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 3897003 4672683 0.83
fineweb_q01/datafusion:vortex-file-compressed 🚨 27910346 24050884 1.16
fineweb_q02/datafusion:vortex-file-compressed 29164306 26803080 1.09
fineweb_q03/datafusion:vortex-file-compressed 73659897 81338849 0.91
fineweb_q04/datafusion:vortex-file-compressed 254557645 247318333 1.03
fineweb_q05/datafusion:vortex-file-compressed 238129905 233525657 1.02
fineweb_q06/datafusion:vortex-file-compressed 65005571 69185072 0.94
fineweb_q07/datafusion:vortex-file-compressed 70111488 66939106 1.05
fineweb_q08/datafusion:vortex-file-compressed 🚨 28625383 22205123 1.29
datafusion / vortex-compact (0.995x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4590675 4698719 0.98
fineweb_q01/datafusion:vortex-compact 162040242 160160067 1.01
fineweb_q02/datafusion:vortex-compact 162385206 162785203 1.00
fineweb_q03/datafusion:vortex-compact 1441175154 1439550253 1.00
fineweb_q04/datafusion:vortex-compact 1566793581 1570570247 1.00
fineweb_q05/datafusion:vortex-compact 1234197986 1226575268 1.01
fineweb_q06/datafusion:vortex-compact 689330803 691954851 1.00
fineweb_q07/datafusion:vortex-compact 727940362 746163369 0.98
fineweb_q08/datafusion:vortex-compact 22660718 22840209 0.99
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 5893844 5856953 1.01
fineweb_q01/datafusion:parquet 266900838 272961124 0.98
fineweb_q02/datafusion:parquet 268310379 271318767 0.99
fineweb_q03/datafusion:parquet 281793240 270606686 1.04
fineweb_q04/datafusion:parquet 281774979 283609147 0.99
fineweb_q05/datafusion:parquet 283027815 281172176 1.01
fineweb_q06/datafusion:parquet 273363139 287759416 0.95
fineweb_q07/datafusion:parquet 270722585 269952392 1.00
fineweb_q08/datafusion:parquet 261618853 264811437 0.99
duckdb / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3326195 3360144 0.99
fineweb_q01/duckdb:vortex-file-compressed 26860509 28069733 0.96
fineweb_q02/duckdb:vortex-file-compressed 26874730 26604211 1.01
fineweb_q03/duckdb:vortex-file-compressed 156010782 168483444 0.93
fineweb_q04/duckdb:vortex-file-compressed 228970856 231190837 0.99
fineweb_q05/duckdb:vortex-file-compressed 219666729 219650723 1.00
fineweb_q06/duckdb:vortex-file-compressed 72425049 67011826 1.08
fineweb_q07/duckdb:vortex-file-compressed 64884162 63515568 1.02
fineweb_q08/duckdb:vortex-file-compressed 24843192 24932422 1.00
duckdb / vortex-compact (0.978x ➖, 1↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3838243 4142017 0.93
fineweb_q01/duckdb:vortex-compact 🚀 102414056 113883435 0.90
fineweb_q02/duckdb:vortex-compact 115697065 115744927 1.00
fineweb_q03/duckdb:vortex-compact 859980654 864548245 0.99
fineweb_q04/duckdb:vortex-compact 907563218 908481791 1.00
fineweb_q05/duckdb:vortex-compact 809361691 814122720 0.99
fineweb_q06/duckdb:vortex-compact 468041788 460334329 1.02
fineweb_q07/duckdb:vortex-compact 478723094 471376175 1.02
fineweb_q08/duckdb:vortex-compact 22217863 23077935 0.96
duckdb / parquet (0.987x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 34967058 38000025 0.92
fineweb_q01/duckdb:parquet 91349524 92234629 0.99
fineweb_q02/duckdb:parquet 94759199 95776602 0.99
fineweb_q03/duckdb:parquet 307950064 306125426 1.01
fineweb_q04/duckdb:parquet 436979479 437002093 1.00
fineweb_q05/duckdb:parquet 408568691 409109768 1.00
fineweb_q06/duckdb:parquet 197450367 198108240 1.00
fineweb_q07/duckdb:parquet 207908843 209354499 0.99
fineweb_q08/duckdb:parquet 57175194 57557694 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -2.3% -3.8% +1.5% +51.5% ➖ noise
0 datafusion:vortex-file-compressed -16.6% -3.8% -13.3% +76.3% ➖ noise
0 duckdb:vortex-compact -7.3% -3.8% -3.7% +43.1% ➖ noise
0 duckdb:vortex-file-compressed -1.0% -3.8% +2.9% +55.3% ➖ noise
1 datafusion:vortex-compact +1.2% -1.6% +2.8% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +16.0% -1.6% +17.9% +16.1% 🚨 regression
1 duckdb:vortex-compact -10.1% -1.6% -8.6% +16.4% ➖ noise
1 duckdb:vortex-file-compressed -4.3% -1.6% -2.8% +37.2% ➖ noise
2 datafusion:vortex-compact -0.2% -1.1% +0.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +8.8% -1.1% +10.0% +14.0% ➖ noise
2 duckdb:vortex-compact -0.0% -1.1% +1.1% +16.7% ➖ noise
2 duckdb:vortex-file-compressed +1.0% -1.1% +2.1% +10.0% ➖ noise
3 datafusion:vortex-compact +0.1% +2.3% -2.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -9.4% +2.3% -11.5% +23.1% ➖ noise
3 duckdb:vortex-compact -0.5% +2.3% -2.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -7.4% +2.3% -9.5% +22.7% ➖ noise
4 datafusion:vortex-compact -0.2% -0.3% +0.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.9% -0.3% +3.3% +10.2% ➖ noise
4 duckdb:vortex-compact -0.1% -0.3% +0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.0% -0.3% -0.6% +10.0% ➖ noise
5 datafusion:vortex-compact +0.6% +0.3% +0.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.0% +0.3% +1.7% +11.1% ➖ noise
5 duckdb:vortex-compact -0.6% +0.3% -0.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.0% +0.3% -0.3% +10.0% ➖ noise
6 datafusion:vortex-compact -0.4% -2.7% +2.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -6.0% -2.7% -3.4% +29.5% ➖ noise
6 duckdb:vortex-compact +1.7% -2.7% +4.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +8.1% -2.7% +11.1% +13.5% ➖ noise
7 datafusion:vortex-compact -2.4% -0.2% -2.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.7% -0.2% +5.0% +10.9% ➖ noise
7 duckdb:vortex-compact +1.6% -0.2% +1.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.2% -0.2% +2.4% +10.0% ➖ noise
8 datafusion:vortex-compact -0.8% -0.9% +0.2% +19.9% ➖ noise
8 datafusion:vortex-file-compressed +28.9% -0.9% +30.1% +33.1% ➖ noise
8 duckdb:vortex-compact -3.7% -0.9% -2.8% +16.5% ➖ noise
8 duckdb:vortex-file-compressed -0.4% -0.9% +0.6% +16.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.6%
Vortex (geomean): 0.854x ✅
Parquet (geomean): 0.875x ✅
Shifts: Parquet (control) -12.5% · Median polish -12.9%


datafusion / vortex-file-compressed (0.842x ✅, 86↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 29199835 38200517 0.76
tpcds_q02/datafusion:vortex-file-compressed 🚀 77200457 96311777 0.80
tpcds_q03/datafusion:vortex-file-compressed 🚀 28668300 32698405 0.88
tpcds_q04/datafusion:vortex-file-compressed 🚀 396100285 475498912 0.83
tpcds_q05/datafusion:vortex-file-compressed 74981709 80765016 0.93
tpcds_q06/datafusion:vortex-file-compressed 🚀 78371298 89607247 0.87
tpcds_q07/datafusion:vortex-file-compressed 🚀 79182755 92612241 0.85
tpcds_q08/datafusion:vortex-file-compressed 🚀 39773196 46191383 0.86
tpcds_q09/datafusion:vortex-file-compressed 🚀 48777960 56581943 0.86
tpcds_q10/datafusion:vortex-file-compressed 🚀 50441665 58589298 0.86
tpcds_q11/datafusion:vortex-file-compressed 🚀 236669250 273059867 0.87
tpcds_q12/datafusion:vortex-file-compressed 🚀 34846696 41169490 0.85
tpcds_q13/datafusion:vortex-file-compressed 82761275 91379053 0.91
tpcds_q14/datafusion:vortex-file-compressed 🚀 217439371 251950118 0.86
tpcds_q15/datafusion:vortex-file-compressed 🚀 50176702 58778193 0.85
tpcds_q16/datafusion:vortex-file-compressed 🚀 29844218 33215300 0.90
tpcds_q17/datafusion:vortex-file-compressed 🚀 110838830 126434710 0.88
tpcds_q18/datafusion:vortex-file-compressed 🚀 102926939 114388587 0.90
tpcds_q19/datafusion:vortex-file-compressed 47308642 52137500 0.91
tpcds_q20/datafusion:vortex-file-compressed 42143675 46663280 0.90
tpcds_q21/datafusion:vortex-file-compressed 184788972 202049130 0.91
tpcds_q22/datafusion:vortex-file-compressed 🚀 72320298 81756770 0.88
tpcds_q23/datafusion:vortex-file-compressed 🚀 189001305 220656781 0.86
tpcds_q24/datafusion:vortex-file-compressed 🚀 183031748 217792844 0.84
tpcds_q25/datafusion:vortex-file-compressed 🚀 110769102 137906644 0.80
tpcds_q26/datafusion:vortex-file-compressed 🚀 62856996 74779897 0.84
tpcds_q27/datafusion:vortex-file-compressed 🚀 167725241 204545656 0.82
tpcds_q28/datafusion:vortex-file-compressed 🚀 51173643 58101582 0.88
tpcds_q29/datafusion:vortex-file-compressed 🚀 114638080 128145988 0.89
tpcds_q30/datafusion:vortex-file-compressed 🚀 29136128 34892887 0.84
tpcds_q31/datafusion:vortex-file-compressed 🚀 181128530 202481795 0.89
tpcds_q32/datafusion:vortex-file-compressed 🚀 23915425 27182622 0.88
tpcds_q33/datafusion:vortex-file-compressed 🚀 38395619 43783135 0.88
tpcds_q34/datafusion:vortex-file-compressed 🚀 38731028 45894578 0.84
tpcds_q35/datafusion:vortex-file-compressed 🚀 60212274 73791745 0.82
tpcds_q36/datafusion:vortex-file-compressed 🚀 105676197 126768282 0.83
tpcds_q37/datafusion:vortex-file-compressed 🚀 36961610 46324833 0.80
tpcds_q38/datafusion:vortex-file-compressed 🚀 87944861 97722416 0.90
tpcds_q39/datafusion:vortex-file-compressed 🚀 210323416 250710383 0.84
tpcds_q40/datafusion:vortex-file-compressed 🚀 55272623 69841565 0.79
tpcds_q41/datafusion:vortex-file-compressed 🚀 16063798 19674570 0.82
tpcds_q42/datafusion:vortex-file-compressed 🚀 29924842 37523561 0.80
tpcds_q43/datafusion:vortex-file-compressed 🚀 47854350 58285467 0.82
tpcds_q44/datafusion:vortex-file-compressed 🚀 44816006 52898754 0.85
tpcds_q45/datafusion:vortex-file-compressed 🚀 49056136 57753806 0.85
tpcds_q46/datafusion:vortex-file-compressed 🚀 66891894 76759313 0.87
tpcds_q47/datafusion:vortex-file-compressed 🚀 283251604 350673781 0.81
tpcds_q48/datafusion:vortex-file-compressed 🚀 70988589 87804029 0.81
tpcds_q49/datafusion:vortex-file-compressed 🚀 71743141 88869512 0.81
tpcds_q50/datafusion:vortex-file-compressed 🚀 75464296 99867881 0.76
tpcds_q51/datafusion:vortex-file-compressed 🚀 98521259 131811697 0.75
tpcds_q52/datafusion:vortex-file-compressed 🚀 30644783 41740185 0.73
tpcds_q53/datafusion:vortex-file-compressed 🚀 30116183 43934687 0.69
tpcds_q54/datafusion:vortex-file-compressed 🚀 49467042 65116223 0.76
tpcds_q55/datafusion:vortex-file-compressed 🚀 31302445 40367998 0.78
tpcds_q56/datafusion:vortex-file-compressed 🚀 47308085 62107003 0.76
tpcds_q57/datafusion:vortex-file-compressed 🚀 190525542 252486015 0.75
tpcds_q58/datafusion:vortex-file-compressed 🚀 112181752 128559695 0.87
tpcds_q59/datafusion:vortex-file-compressed 🚀 96408570 107862503 0.89
tpcds_q60/datafusion:vortex-file-compressed 47260057 51822476 0.91
tpcds_q61/datafusion:vortex-file-compressed 🚀 59122579 66326806 0.89
tpcds_q62/datafusion:vortex-file-compressed 46284684 50883197 0.91
tpcds_q63/datafusion:vortex-file-compressed 🚀 30229154 34068388 0.89
tpcds_q64/datafusion:vortex-file-compressed 🚀 719716511 823802780 0.87
tpcds_q65/datafusion:vortex-file-compressed 🚀 52280237 63179997 0.83
tpcds_q66/datafusion:vortex-file-compressed 108144833 119484642 0.91
tpcds_q67/datafusion:vortex-file-compressed 145587016 159925494 0.91
tpcds_q68/datafusion:vortex-file-compressed 🚀 67472454 77058022 0.88
tpcds_q69/datafusion:vortex-file-compressed 🚀 45726930 54102348 0.85
tpcds_q70/datafusion:vortex-file-compressed 🚀 131041917 160585253 0.82
tpcds_q71/datafusion:vortex-file-compressed 🚀 31371459 41979096 0.75
tpcds_q72/datafusion:vortex-file-compressed 🚀 3586988602 5222968365 0.69
tpcds_q73/datafusion:vortex-file-compressed 🚀 41004484 54466241 0.75
tpcds_q74/datafusion:vortex-file-compressed 🚀 168284435 213118712 0.79
tpcds_q75/datafusion:vortex-file-compressed 🚀 135169120 172499585 0.78
tpcds_q76/datafusion:vortex-file-compressed 🚀 63466184 73107377 0.87
tpcds_q77/datafusion:vortex-file-compressed 🚀 54874932 72827095 0.75
tpcds_q78/datafusion:vortex-file-compressed 🚀 183058830 229520096 0.80
tpcds_q79/datafusion:vortex-file-compressed 🚀 42775979 51454338 0.83
tpcds_q80/datafusion:vortex-file-compressed 🚀 121224248 142049746 0.85
tpcds_q81/datafusion:vortex-file-compressed 🚀 37517523 48033733 0.78
tpcds_q82/datafusion:vortex-file-compressed 🚀 41197056 48080415 0.86
tpcds_q83/datafusion:vortex-file-compressed 🚀 65815713 74062337 0.89
tpcds_q84/datafusion:vortex-file-compressed 🚀 16137359 18979766 0.85
tpcds_q85/datafusion:vortex-file-compressed 🚀 138238991 156550453 0.88
tpcds_q86/datafusion:vortex-file-compressed 🚀 31261059 34865064 0.90
tpcds_q87/datafusion:vortex-file-compressed 91179856 98307860 0.93
tpcds_q88/datafusion:vortex-file-compressed 82378794 91171313 0.90
tpcds_q89/datafusion:vortex-file-compressed 🚀 58052620 66616991 0.87
tpcds_q90/datafusion:vortex-file-compressed 🚀 16823611 19497187 0.86
tpcds_q91/datafusion:vortex-file-compressed 🚀 27807788 32676493 0.85
tpcds_q92/datafusion:vortex-file-compressed 🚀 19652390 22378785 0.88
tpcds_q93/datafusion:vortex-file-compressed 🚀 38569744 45372723 0.85
tpcds_q94/datafusion:vortex-file-compressed 🚀 26808530 31010231 0.86
tpcds_q95/datafusion:vortex-file-compressed 89138331 98888885 0.90
tpcds_q96/datafusion:vortex-file-compressed 🚀 16293938 19847620 0.82
tpcds_q97/datafusion:vortex-file-compressed 🚀 32401744 39481495 0.82
tpcds_q98/datafusion:vortex-file-compressed 🚀 47743895 56474427 0.85
tpcds_q99/datafusion:vortex-file-compressed 63392785 69906225 0.91
datafusion / vortex-compact (0.852x ✅, 87↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚀 34961561 40474249 0.86
tpcds_q02/datafusion:vortex-compact 🚀 82371050 93032602 0.89
tpcds_q03/datafusion:vortex-compact 🚀 33423027 37785563 0.88
tpcds_q04/datafusion:vortex-compact 448908041 498532879 0.90
tpcds_q05/datafusion:vortex-compact 🚀 85943818 97088097 0.89
tpcds_q06/datafusion:vortex-compact 🚀 83720498 99607764 0.84
tpcds_q07/datafusion:vortex-compact 🚀 94198905 116262444 0.81
tpcds_q08/datafusion:vortex-compact 🚀 49834166 57327792 0.87
tpcds_q09/datafusion:vortex-compact 🚀 99943634 114799585 0.87
tpcds_q10/datafusion:vortex-compact 🚀 67795776 79805642 0.85
tpcds_q11/datafusion:vortex-compact 🚀 255356911 305525037 0.84
tpcds_q12/datafusion:vortex-compact 🚀 38764581 43220501 0.90
tpcds_q13/datafusion:vortex-compact 149056126 156317758 0.95
tpcds_q14/datafusion:vortex-compact 🚀 272446438 325343297 0.84
tpcds_q15/datafusion:vortex-compact 🚀 53413631 76375672 0.70
tpcds_q16/datafusion:vortex-compact 🚀 40590696 55459651 0.73
tpcds_q17/datafusion:vortex-compact 🚀 128392270 169941072 0.76
tpcds_q18/datafusion:vortex-compact 🚀 114576523 148131560 0.77
tpcds_q19/datafusion:vortex-compact 🚀 61910041 75820933 0.82
tpcds_q20/datafusion:vortex-compact 🚀 45883932 57262305 0.80
tpcds_q21/datafusion:vortex-compact 🚀 186629057 214553251 0.87
tpcds_q22/datafusion:vortex-compact 79463344 87356983 0.91
tpcds_q23/datafusion:vortex-compact 🚀 228239697 266557006 0.86
tpcds_q24/datafusion:vortex-compact 🚀 208583123 237061780 0.88
tpcds_q25/datafusion:vortex-compact 🚀 126171840 145113837 0.87
tpcds_q26/datafusion:vortex-compact 🚀 71224771 85139793 0.84
tpcds_q27/datafusion:vortex-compact 🚀 212432058 244560581 0.87
tpcds_q28/datafusion:vortex-compact 105021144 111816576 0.94
tpcds_q29/datafusion:vortex-compact 134329779 144581412 0.93
tpcds_q30/datafusion:vortex-compact 🚀 36398850 42795269 0.85
tpcds_q31/datafusion:vortex-compact 🚀 213418201 244671392 0.87
tpcds_q32/datafusion:vortex-compact 🚀 29772357 34003422 0.88
tpcds_q33/datafusion:vortex-compact 🚀 50675678 57577889 0.88
tpcds_q34/datafusion:vortex-compact 🚀 56179172 65569428 0.86
tpcds_q35/datafusion:vortex-compact 🚀 74215963 91017752 0.82
tpcds_q36/datafusion:vortex-compact 🚀 132798219 169709085 0.78
tpcds_q37/datafusion:vortex-compact 🚀 50804656 70457591 0.72
tpcds_q38/datafusion:vortex-compact 🚀 101663063 116772752 0.87
tpcds_q39/datafusion:vortex-compact 🚀 190745248 248726908 0.77
tpcds_q40/datafusion:vortex-compact 🚀 62985944 75210864 0.84
tpcds_q41/datafusion:vortex-compact 🚀 16564288 18642573 0.89
tpcds_q42/datafusion:vortex-compact 39014000 40663667 0.96
tpcds_q43/datafusion:vortex-compact 🚀 57225548 63928223 0.90
tpcds_q44/datafusion:vortex-compact 🚀 77656747 86427574 0.90
tpcds_q45/datafusion:vortex-compact 🚀 54728590 61775624 0.89
tpcds_q46/datafusion:vortex-compact 🚀 85233548 98624534 0.86
tpcds_q47/datafusion:vortex-compact 🚀 308401443 364465278 0.85
tpcds_q48/datafusion:vortex-compact 119165099 124491433 0.96
tpcds_q49/datafusion:vortex-compact 99187738 109152273 0.91
tpcds_q50/datafusion:vortex-compact 🚀 92423689 106231150 0.87
tpcds_q51/datafusion:vortex-compact 🚀 104196029 124158573 0.84
tpcds_q52/datafusion:vortex-compact 🚀 35558392 41278692 0.86
tpcds_q53/datafusion:vortex-compact 🚀 40881558 47027536 0.87
tpcds_q54/datafusion:vortex-compact 🚀 62751783 70598767 0.89
tpcds_q55/datafusion:vortex-compact 36913919 39516053 0.93
tpcds_q56/datafusion:vortex-compact 🚀 57908063 65810306 0.88
tpcds_q57/datafusion:vortex-compact 🚀 205305674 230659456 0.89
tpcds_q58/datafusion:vortex-compact 🚀 120564308 138591118 0.87
tpcds_q59/datafusion:vortex-compact 🚀 111421289 134695771 0.83
tpcds_q60/datafusion:vortex-compact 🚀 60537874 69387689 0.87
tpcds_q61/datafusion:vortex-compact 🚀 78801302 94148436 0.84
tpcds_q62/datafusion:vortex-compact 🚀 46271082 56846893 0.81
tpcds_q63/datafusion:vortex-compact 🚀 40644834 46468471 0.87
tpcds_q64/datafusion:vortex-compact 🚀 795524583 961112831 0.83
tpcds_q65/datafusion:vortex-compact 🚀 74676562 88078101 0.85
tpcds_q66/datafusion:vortex-compact 🚀 116924343 134656852 0.87
tpcds_q67/datafusion:vortex-compact 🚀 155455889 181653367 0.86
tpcds_q68/datafusion:vortex-compact 🚀 88544448 103029267 0.86
tpcds_q69/datafusion:vortex-compact 🚀 64090862 72668209 0.88
tpcds_q70/datafusion:vortex-compact 🚀 142206256 167544394 0.85
tpcds_q71/datafusion:vortex-compact 🚀 44910788 52608243 0.85
tpcds_q72/datafusion:vortex-compact 🚀 3543920867 4750953029 0.75
tpcds_q73/datafusion:vortex-compact 🚀 57015079 74583368 0.76
tpcds_q74/datafusion:vortex-compact 🚀 185387366 240291216 0.77
tpcds_q75/datafusion:vortex-compact 🚀 184437832 224558441 0.82
tpcds_q76/datafusion:vortex-compact 80080215 87261543 0.92
tpcds_q77/datafusion:vortex-compact 70161280 77208477 0.91
tpcds_q78/datafusion:vortex-compact 🚀 208341569 241881930 0.86
tpcds_q79/datafusion:vortex-compact 🚀 64587394 73318840 0.88
tpcds_q80/datafusion:vortex-compact 🚀 140173703 163122753 0.86
tpcds_q81/datafusion:vortex-compact 🚀 41962552 50243711 0.84
tpcds_q82/datafusion:vortex-compact 🚀 55398638 64270369 0.86
tpcds_q83/datafusion:vortex-compact 🚀 64873740 78447326 0.83
tpcds_q84/datafusion:vortex-compact 🚀 19443379 21940364 0.89
tpcds_q85/datafusion:vortex-compact 🚀 161168470 183666262 0.88
tpcds_q86/datafusion:vortex-compact 🚀 31847882 37293718 0.85
tpcds_q87/datafusion:vortex-compact 103421793 114340057 0.90
tpcds_q88/datafusion:vortex-compact 🚀 143673764 160179123 0.90
tpcds_q89/datafusion:vortex-compact 🚀 67083243 78209731 0.86
tpcds_q90/datafusion:vortex-compact 🚀 22179628 2528538 0.88
tpcds_q91/datafusion:vortex-compact 🚀 42668153 50147481 0.85
tpcds_q92/datafusion:vortex-compact 🚀 22899593 26418435 0.87
tpcds_q93/datafusion:vortex-compact 🚀 54629601 67853812 0.81
tpcds_q94/datafusion:vortex-compact 🚀 33290074 37565930 0.89
tpcds_q95/datafusion:vortex-compact 🚀 100628033 115519389 0.87
tpcds_q96/datafusion:vortex-compact 🚀 26296793 32360751 0.81
tpcds_q97/datafusion:vortex-compact 🚀 43019999 57415958 0.75
tpcds_q98/datafusion:vortex-compact 🚀 58331458 72894970 0.80
tpcds_q99/datafusion:vortex-compact 🚀 65925470 86475728 0.76
datafusion / parquet (0.859x ✅, 76↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 37739056 44054806 0.86
tpcds_q02/datafusion:parquet 54915258 59892033 0.92
tpcds_q03/datafusion:parquet 🚀 17241675 20272531 0.85
tpcds_q04/datafusion:parquet 🚀 366467975 473745265 0.77
tpcds_q05/datafusion:parquet 🚀 93316668 104675659 0.89
tpcds_q06/datafusion:parquet 97582420 98997373 0.99
tpcds_q07/datafusion:parquet 🚀 136186113 155724459 0.87
tpcds_q08/datafusion:parquet 🚀 38464685 43632979 0.88
tpcds_q09/datafusion:parquet 🚀 55432476 62838830 0.88
tpcds_q10/datafusion:parquet 🚀 105176533 119508486 0.88
tpcds_q11/datafusion:parquet 🚀 230730425 274846440 0.84
tpcds_q12/datafusion:parquet 🚀 31088637 34906058 0.89
tpcds_q13/datafusion:parquet 145632242 157269423 0.93
tpcds_q14/datafusion:parquet 🚀 214854539 253199950 0.85
tpcds_q15/datafusion:parquet 58386309 63869467 0.91
tpcds_q16/datafusion:parquet 🚀 33756978 39725122 0.85
tpcds_q17/datafusion:parquet 172925935 188283416 0.92
tpcds_q18/datafusion:parquet 🚀 184127720 207129237 0.89
tpcds_q19/datafusion:parquet 36998920 39044422 0.95
tpcds_q20/datafusion:parquet 🚀 24434315 29203128 0.84
tpcds_q21/datafusion:parquet 🚀 28004516 32233243 0.87
tpcds_q22/datafusion:parquet 🚀 149779625 190643811 0.79
tpcds_q23/datafusion:parquet 🚀 190339831 225605663 0.84
tpcds_q24/datafusion:parquet 🚀 212456664 240755489 0.88
tpcds_q25/datafusion:parquet 180336754 191530478 0.94
tpcds_q26/datafusion:parquet 🚀 116563114 131446953 0.89
tpcds_q27/datafusion:parquet 🚀 272088852 313260836 0.87
tpcds_q28/datafusion:parquet 🚀 54025953 60621685 0.89
tpcds_q29/datafusion:parquet 181824945 198976740 0.91
tpcds_q30/datafusion:parquet 🚀 46042628 51161110 0.90
tpcds_q31/datafusion:parquet 108405102 120282863 0.90
tpcds_q32/datafusion:parquet 31380515 32603886 0.96
tpcds_q33/datafusion:parquet 🚀 38213704 44115302 0.87
tpcds_q34/datafusion:parquet 🚀 36070819 40738255 0.89
tpcds_q35/datafusion:parquet 🚀 101675039 114009990 0.89
tpcds_q36/datafusion:parquet 🚀 85294356 94800968 0.90
tpcds_q37/datafusion:parquet 🚀 25063331 28485975 0.88
tpcds_q38/datafusion:parquet 67965292 74119727 0.92
tpcds_q39/datafusion:parquet 🚀 100744015 145912857 0.69
tpcds_q40/datafusion:parquet 🚀 36643090 45512831 0.81
tpcds_q41/datafusion:parquet 🚀 13689972 15435068 0.89
tpcds_q42/datafusion:parquet 🚀 16378268 18764225 0.87
tpcds_q43/datafusion:parquet 🚀 25941345 32114722 0.81
tpcds_q44/datafusion:parquet 🚀 42348324 50087466 0.85
tpcds_q45/datafusion:parquet 69963986 74531764 0.94
tpcds_q46/datafusion:parquet 🚀 51865682 60313286 0.86
tpcds_q47/datafusion:parquet 🚀 197103364 229171564 0.86
tpcds_q48/datafusion:parquet 🚀 136034928 160575231 0.85
tpcds_q49/datafusion:parquet 🚀 76726302 97308011 0.79
tpcds_q50/datafusion:parquet 🚀 110692138 130417774 0.85
tpcds_q51/datafusion:parquet 🚀 104034605 132137431 0.79
tpcds_q52/datafusion:parquet 🚀 16451937 22812971 0.72
tpcds_q53/datafusion:parquet 🚀 32498260 40868741 0.80
tpcds_q54/datafusion:parquet 🚀 49941510 60687739 0.82
tpcds_q55/datafusion:parquet 🚀 17041476 21817715 0.78
tpcds_q56/datafusion:parquet 🚀 36766032 48446768 0.76
tpcds_q57/datafusion:parquet 🚀 136735615 196321606 0.70
tpcds_q58/datafusion:parquet 🚀 77025745 98111301 0.79
tpcds_q59/datafusion:parquet 🚀 71412976 87443135 0.82
tpcds_q60/datafusion:parquet 🚀 38041775 44735265 0.85
tpcds_q61/datafusion:parquet 🚀 67311571 80517955 0.84
tpcds_q62/datafusion:parquet 🚀 44204453 54767317 0.81
tpcds_q63/datafusion:parquet 🚀 32224094 36117495 0.89
tpcds_q64/datafusion:parquet 🚀 1016592640 1145927171 0.89
tpcds_q65/datafusion:parquet 🚀 49821170 62259599 0.80
tpcds_q66/datafusion:parquet 🚀 88885173 98862761 0.90
tpcds_q67/datafusion:parquet 🚀 181888307 217477496 0.84
tpcds_q68/datafusion:parquet 🚀 52537678 62860085 0.84
tpcds_q69/datafusion:parquet 🚀 98436345 128435475 0.77
tpcds_q70/datafusion:parquet 🚀 109898453 135856059 0.81
tpcds_q71/datafusion:parquet 30082811 33227508 0.91
tpcds_q72/datafusion:parquet 🚀 888411129 1069376697 0.83
tpcds_q73/datafusion:parquet 39393029 40706487 0.97
tpcds_q74/datafusion:parquet 🚀 134565260 156317647 0.86
tpcds_q75/datafusion:parquet 🚀 135194362 156712684 0.86
tpcds_q76/datafusion:parquet 🚀 88499275 100971299 0.88
tpcds_q77/datafusion:parquet 60131825 66670055 0.90
tpcds_q78/datafusion:parquet 🚀 188737686 222091305 0.85
tpcds_q79/datafusion:parquet 🚀 39145198 48061674 0.81
tpcds_q80/datafusion:parquet 🚀 115108559 136642948 0.84
tpcds_q81/datafusion:parquet 43699414 48415594 0.90
tpcds_q82/datafusion:parquet 30335632 32736258 0.93
tpcds_q83/datafusion:parquet 🚀 55480294 63805122 0.87
tpcds_q84/datafusion:parquet 50803506 55987483 0.91
tpcds_q85/datafusion:parquet 251103046 274889309 0.91
tpcds_q86/datafusion:parquet 🚀 21462530 24987990 0.86
tpcds_q87/datafusion:parquet 🚀 66916226 75941026 0.88
tpcds_q88/datafusion:parquet 80516234 88805980 0.91
tpcds_q89/datafusion:parquet 39756082 42527776 0.93
tpcds_q90/datafusion:parquet 🚀 19571366 21932230 0.89
tpcds_q91/datafusion:parquet 81707258 87515922 0.93
tpcds_q92/datafusion:parquet 🚀 26577128 30377113 0.87
tpcds_q93/datafusion:parquet 🚀 39780519 46396593 0.86
tpcds_q94/datafusion:parquet 🚀 29708728 39622318 0.75
tpcds_q95/datafusion:parquet 138400652 152497281 0.91
tpcds_q96/datafusion:parquet 🚀 15338969 18244093 0.84
tpcds_q97/datafusion:parquet 🚀 39620386 48199175 0.82
tpcds_q98/datafusion:parquet 🚀 38390521 46206404 0.83
tpcds_q99/datafusion:parquet 🚀 47326816 57050048 0.83
duckdb / vortex-file-compressed (0.846x ✅, 84↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀 26138453 30332322 0.86
tpcds_q02/duckdb:vortex-file-compressed 🚀 81773577 96603045 0.85
tpcds_q03/duckdb:vortex-file-compressed 22890091 25035396 0.91
tpcds_q04/duckdb:vortex-file-compressed 110512393 122126351 0.90
tpcds_q05/duckdb:vortex-file-compressed 🚀 94741769 119554859 0.79
tpcds_q06/duckdb:vortex-file-compressed 🚀 38286576 43542513 0.88
tpcds_q07/duckdb:vortex-file-compressed 🚀 25190842 28123178 0.90
tpcds_q08/duckdb:vortex-file-compressed 🚀 23945302 29371298 0.82
tpcds_q09/duckdb:vortex-file-compressed 🚀 40505649 49319348 0.82
tpcds_q10/duckdb:vortex-file-compressed 🚀 36909808 46010674 0.80
tpcds_q11/duckdb:vortex-file-compressed 🚀 64461128 77310356 0.83
tpcds_q12/duckdb:vortex-file-compressed 🚀 15351098 18203995 0.84
tpcds_q13/duckdb:vortex-file-compressed 🚀 34808104 43274185 0.80
tpcds_q14/duckdb:vortex-file-compressed 206350895 217949443 0.95
tpcds_q15/duckdb:vortex-file-compressed 🚀 43379664 49688650 0.87
tpcds_q16/duckdb:vortex-file-compressed 🚀 29908415 37133976 0.81
tpcds_q17/duckdb:vortex-file-compressed 🚀 41938744 48899396 0.86
tpcds_q18/duckdb:vortex-file-compressed 🚀 46094953 57838950 0.80
tpcds_q19/duckdb:vortex-file-compressed 🚀 35296926 44428155 0.79
tpcds_q20/duckdb:vortex-file-compressed 🚀 17513544 23324693 0.75
tpcds_q21/duckdb:vortex-file-compressed 🚀 20376458 24050355 0.85
tpcds_q22/duckdb:vortex-file-compressed 🚀 114842228 132128395 0.87
tpcds_q23/duckdb:vortex-file-compressed 🚀 131122260 166119267 0.79
tpcds_q24/duckdb:vortex-file-compressed 🚀 59312434 71785343 0.83
tpcds_q25/duckdb:vortex-file-compressed 🚀 38870607 47082753 0.83
tpcds_q26/duckdb:vortex-file-compressed 🚀 41123988 58027137 0.71
tpcds_q27/duckdb:vortex-file-compressed 🚀 93256681 126405304 0.74
tpcds_q28/duckdb:vortex-file-compressed 🚀 38017636 51255426 0.74
tpcds_q29/duckdb:vortex-file-compressed 🚀 39817740 54846069 0.73
tpcds_q30/duckdb:vortex-file-compressed 🚀 30265863 44175874 0.69
tpcds_q31/duckdb:vortex-file-compressed 🚀 26958309 36684160 0.73
tpcds_q32/duckdb:vortex-file-compressed 🚀 17606704 24991360 0.70
tpcds_q33/duckdb:vortex-file-compressed 🚀 69236907 99241467 0.70
tpcds_q34/duckdb:vortex-file-compressed 🚀 21256809 26109004 0.81
tpcds_q35/duckdb:vortex-file-compressed 🚀 67778064 84268182 0.80
tpcds_q36/duckdb:vortex-file-compressed 🚀 28776088 33448511 0.86
tpcds_q37/duckdb:vortex-file-compressed 🚀 23346127 27377728 0.85
tpcds_q38/duckdb:vortex-file-compressed 🚀 38351637 42877486 0.89
tpcds_q39/duckdb:vortex-file-compressed 🚀 47553071 53037230 0.90
tpcds_q40/duckdb:vortex-file-compressed 25056476 27799830 0.90
tpcds_q41/duckdb:vortex-file-compressed 🚀 14052998 17206273 0.82
tpcds_q42/duckdb:vortex-file-compressed 🚀 12083493 14501367 0.83
tpcds_q43/duckdb:vortex-file-compressed 20755446 22989024 0.90
tpcds_q44/duckdb:vortex-file-compressed 24387684 26862796 0.91
tpcds_q45/duckdb:vortex-file-compressed 🚀 28195129 35612104 0.79
tpcds_q46/duckdb:vortex-file-compressed 🚀 50233262 60115939 0.84
tpcds_q47/duckdb:vortex-file-compressed 🚀 51253676 57801209 0.89
tpcds_q48/duckdb:vortex-file-compressed 🚀 32030411 37720762 0.85
tpcds_q49/duckdb:vortex-file-compressed 🚀 30102539 34581802 0.87
tpcds_q50/duckdb:vortex-file-compressed 🚀 38380218 43386008 0.88
tpcds_q51/duckdb:vortex-file-compressed 🚀 103168089 115975387 0.89
tpcds_q52/duckdb:vortex-file-compressed 🚀 12722629 14452277 0.88
tpcds_q53/duckdb:vortex-file-compressed 🚀 17971316 20710891 0.87
tpcds_q54/duckdb:vortex-file-compressed 🚀 50101087 57468794 0.87
tpcds_q55/duckdb:vortex-file-compressed 12543648 13260152 0.95
tpcds_q56/duckdb:vortex-file-compressed 🚀 69262219 78132029 0.89
tpcds_q57/duckdb:vortex-file-compressed 🚀 45178843 50695591 0.89
tpcds_q58/duckdb:vortex-file-compressed 33502591 37153962 0.90
tpcds_q59/duckdb:vortex-file-compressed 58749375 62173897 0.94
tpcds_q60/duckdb:vortex-file-compressed 🚀 73472489 87298181 0.84
tpcds_q61/duckdb:vortex-file-compressed 🚀 38441730 48040194 0.80
tpcds_q62/duckdb:vortex-file-compressed 22117803 22675049 0.98
tpcds_q63/duckdb:vortex-file-compressed 🚀 18002664 22097146 0.81
tpcds_q64/duckdb:vortex-file-compressed 🚀 81837621 99324019 0.82
tpcds_q65/duckdb:vortex-file-compressed 🚀 24621146 30399630 0.81
tpcds_q66/duckdb:vortex-file-compressed 🚀 58444526 70999646 0.82
tpcds_q67/duckdb:vortex-file-compressed 🚀 149243562 188634779 0.79
tpcds_q68/duckdb:vortex-file-compressed 🚀 43219793 49231660 0.88
tpcds_q69/duckdb:vortex-file-compressed 🚀 39627970 45029176 0.88
tpcds_q70/duckdb:vortex-file-compressed 25844097 27445645 0.94
tpcds_q71/duckdb:vortex-file-compressed 🚀 21202491 24964162 0.85
tpcds_q72/duckdb:vortex-file-compressed 177949069 192832205 0.92
tpcds_q73/duckdb:vortex-file-compressed 🚀 20791498 23720138 0.88
tpcds_q74/duckdb:vortex-file-compressed 🚀 52701835 59913379 0.88
tpcds_q75/duckdb:vortex-file-compressed 🚀 61481104 69001910 0.89
tpcds_q76/duckdb:vortex-file-compressed 🚀 67464123 80377803 0.84
tpcds_q77/duckdb:vortex-file-compressed 🚀 68136764 81095087 0.84
tpcds_q78/duckdb:vortex-file-compressed 🚀 79274468 93099194 0.85
tpcds_q79/duckdb:vortex-file-compressed 🚀 37281190 42322130 0.88
tpcds_q80/duckdb:vortex-file-compressed 🚀 95560076 110129412 0.87
tpcds_q81/duckdb:vortex-file-compressed 🚀 34348095 40003133 0.86
tpcds_q82/duckdb:vortex-file-compressed 🚀 24628247 28656460 0.86
tpcds_q83/duckdb:vortex-file-compressed 🚀 29448012 33514462 0.88
tpcds_q84/duckdb:vortex-file-compressed 🚀 18135860 21421280 0.85
tpcds_q85/duckdb:vortex-file-compressed 🚀 45430510 57393357 0.79
tpcds_q86/duckdb:vortex-file-compressed 🚀 17488504 20377321 0.86
tpcds_q87/duckdb:vortex-file-compressed 🚀 40375190 51672313 0.78
tpcds_q88/duckdb:vortex-file-compressed 🚀 36641212 43045535 0.85
tpcds_q89/duckdb:vortex-file-compressed 🚀 19039232 22276152 0.85
tpcds_q90/duckdb:vortex-file-compressed 16135440 17845219 0.90
tpcds_q91/duckdb:vortex-file-compressed 🚀 28974921 32350408 0.90
tpcds_q92/duckdb:vortex-file-compressed 🚀 14517080 18324319 0.79
tpcds_q93/duckdb:vortex-file-compressed 🚀 31586771 36374713 0.87
tpcds_q94/duckdb:vortex-file-compressed 🚀 23036564 27111286 0.85
tpcds_q95/duckdb:vortex-file-compressed 161957926 153235150 1.06
tpcds_q96/duckdb:vortex-file-compressed 🚀 12378519 14688326 0.84
tpcds_q97/duckdb:vortex-file-compressed 42386528 44889047 0.94
tpcds_q98/duckdb:vortex-file-compressed 🚀 18963294 22671404 0.84
tpcds_q99/duckdb:vortex-file-compressed 🚀 33492198 38079182 0.88
duckdb / vortex-compact (0.878x ✅, 66↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚀 35407203 40665510 0.87
tpcds_q02/duckdb:vortex-compact 130586047 135819624 0.96
tpcds_q03/duckdb:vortex-compact 🚀 46926233 56001800 0.84
tpcds_q04/duckdb:vortex-compact 130130001 141261502 0.92
tpcds_q05/duckdb:vortex-compact 167767698 180268665 0.93
tpcds_q06/duckdb:vortex-compact 🚀 39386626 53894053 0.73
tpcds_q07/duckdb:vortex-compact 🚀 37799579 42855830 0.88
tpcds_q08/duckdb:vortex-compact 🚀 30738506 34733359 0.88
tpcds_q09/duckdb:vortex-compact 🚀 113716634 137229850 0.83
tpcds_q10/duckdb:vortex-compact 🚀 47192344 58728344 0.80
tpcds_q11/duckdb:vortex-compact 🚀 74384726 91500472 0.81
tpcds_q12/duckdb:vortex-compact 🚀 19955417 26620701 0.75
tpcds_q13/duckdb:vortex-compact 🚀 48921492 57815163 0.85
tpcds_q14/duckdb:vortex-compact 🚀 275916728 317205996 0.87
tpcds_q15/duckdb:vortex-compact 🚀 46618262 54842984 0.85
tpcds_q16/duckdb:vortex-compact 🚀 38162833 44184705 0.86
tpcds_q17/duckdb:vortex-compact 🚀 51957008 58993852 0.88
tpcds_q18/duckdb:vortex-compact 🚀 70541727 80319784 0.88
tpcds_q19/duckdb:vortex-compact 🚀 40051988 46274695 0.87
tpcds_q20/duckdb:vortex-compact 22387634 24508753 0.91
tpcds_q21/duckdb:vortex-compact 🚀 28902666 33234421 0.87
tpcds_q22/duckdb:vortex-compact 🚀 124699675 140968387 0.88
tpcds_q23/duckdb:vortex-compact 174099496 188960591 0.92
tpcds_q24/duckdb:vortex-compact 🚀 71478043 80499759 0.89
tpcds_q25/duckdb:vortex-compact 51076927 55753261 0.92
tpcds_q26/duckdb:vortex-compact 🚀 51063267 59756597 0.85
tpcds_q27/duckdb:vortex-compact 137097211 146374578 0.94
tpcds_q28/duckdb:vortex-compact 110608954 116012415 0.95
tpcds_q29/duckdb:vortex-compact 🚀 51230955 57214924 0.90
tpcds_q30/duckdb:vortex-compact 36830660 39822189 0.92
tpcds_q31/duckdb:vortex-compact 🚀 31192450 36530030 0.85
tpcds_q32/duckdb:vortex-compact 24351049 26976970 0.90
tpcds_q33/duckdb:vortex-compact 150155824 140952934 1.07
tpcds_q34/duckdb:vortex-compact 🚀 25429173 28888323 0.88
tpcds_q35/duckdb:vortex-compact 🚀 70916766 85026548 0.83
tpcds_q36/duckdb:vortex-compact 36214361 39336664 0.92
tpcds_q37/duckdb:vortex-compact 34290916 37123721 0.92
tpcds_q38/duckdb:vortex-compact 40736592 44930677 0.91
tpcds_q39/duckdb:vortex-compact 55276839 59881599 0.92
tpcds_q40/duckdb:vortex-compact 🚀 31974846 38041219 0.84
tpcds_q41/duckdb:vortex-compact 🚀 17759318 20905491 0.85
tpcds_q42/duckdb:vortex-compact 🚀 15641732 17806277 0.88
tpcds_q43/duckdb:vortex-compact 25110050 27863831 0.90
tpcds_q44/duckdb:vortex-compact 33858766 35350583 0.96
tpcds_q45/duckdb:vortex-compact 🚀 35354354 40771173 0.87
tpcds_q46/duckdb:vortex-compact 🚀 58797898 65448198 0.90
tpcds_q47/duckdb:vortex-compact 🚀 56793318 63748658 0.89
tpcds_q48/duckdb:vortex-compact 42445309 46608821 0.91
tpcds_q49/duckdb:vortex-compact 52104596 53342934 0.98
tpcds_q50/duckdb:vortex-compact 43161832 47151611 0.92
tpcds_q51/duckdb:vortex-compact 107392737 113800360 0.94
tpcds_q52/duckdb:vortex-compact 15782319 17088927 0.92
tpcds_q53/duckdb:vortex-compact 🚀 22837548 25651279 0.89
tpcds_q54/duckdb:vortex-compact 90194421 93294119 0.97
tpcds_q55/duckdb:vortex-compact 🚀 15318974 17050747 0.90
tpcds_q56/duckdb:vortex-compact 141585707 141638746 1.00
tpcds_q57/duckdb:vortex-compact 56794459 52918661 1.07
tpcds_q58/duckdb:vortex-compact 43534832 47234950 0.92
tpcds_q59/duckdb:vortex-compact 69069239 74194262 0.93
tpcds_q60/duckdb:vortex-compact 145678674 148349737 0.98
tpcds_q61/duckdb:vortex-compact 🚀 48901383 56057039 0.87
tpcds_q62/duckdb:vortex-compact 30133132 32186902 0.94
tpcds_q63/duckdb:vortex-compact 🚀 22854179 26524612 0.86
tpcds_q64/duckdb:vortex-compact 🚀 103653668 123646042 0.84
tpcds_q65/duckdb:vortex-compact 30707422 33708214 0.91
tpcds_q66/duckdb:vortex-compact 🚀 100415356 113052880 0.89
tpcds_q67/duckdb:vortex-compact 🚀 153462728 186438253 0.82
tpcds_q68/duckdb:vortex-compact 🚀 52291020 67676684 0.77
tpcds_q69/duckdb:vortex-compact 🚀 47079427 55559970 0.85
tpcds_q70/duckdb:vortex-compact 30783207 34123826 0.90
tpcds_q71/duckdb:vortex-compact 🚀 26414551 31120889 0.85
tpcds_q72/duckdb:vortex-compact 🚀 199435248 235383880 0.85
tpcds_q73/duckdb:vortex-compact 🚀 24704483 32215696 0.77
tpcds_q74/duckdb:vortex-compact 🚀 58487006 78362228 0.75
tpcds_q75/duckdb:vortex-compact 🚀 72927353 88905899 0.82
tpcds_q76/duckdb:vortex-compact 🚀 117477182 152124268 0.77
tpcds_q77/duckdb:vortex-compact 🚀 128752753 167363082 0.77
tpcds_q78/duckdb:vortex-compact 🚀 88351092 117867874 0.75
tpcds_q79/duckdb:vortex-compact 🚀 59185995 67962551 0.87
tpcds_q80/duckdb:vortex-compact 🚀 170922900 195527565 0.87
tpcds_q81/duckdb:vortex-compact 🚀 44101088 51595723 0.85
tpcds_q82/duckdb:vortex-compact 🚀 33128287 41716310 0.79
tpcds_q83/duckdb:vortex-compact 🚀 49973615 56294840 0.89
tpcds_q84/duckdb:vortex-compact 🚀 22020065 26153034 0.84
tpcds_q85/duckdb:vortex-compact 🚀 65637223 74906951 0.88
tpcds_q86/duckdb:vortex-compact 🚀 19858892 25796169 0.77
tpcds_q87/duckdb:vortex-compact 🚀 40150404 49011694 0.82
tpcds_q88/duckdb:vortex-compact 🚀 38966925 43630518 0.89
tpcds_q89/duckdb:vortex-compact 23649698 26111259 0.91
tpcds_q90/duckdb:vortex-compact 🚀 16401575 19553951 0.84
tpcds_q91/duckdb:vortex-compact 🚀 45996875 51407867 0.89
tpcds_q92/duckdb:vortex-compact 🚀 20892158 23737862 0.88
tpcds_q93/duckdb:vortex-compact 🚀 38304919 42666658 0.90
tpcds_q94/duckdb:vortex-compact 🚀 29554729 33391925 0.89
tpcds_q95/duckdb:vortex-compact 🚀 163907762 182948708 0.90
tpcds_q96/duckdb:vortex-compact 🚀 14290317 16114234 0.89
tpcds_q97/duckdb:vortex-compact 43001077 45465222 0.95
tpcds_q98/duckdb:vortex-compact 🚀 24549934 27928303 0.88
tpcds_q99/duckdb:vortex-compact 🚀 37898467 43086600 0.88
duckdb / parquet (0.892x ✅, 55↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 🚀 46911605 52233268 0.90
tpcds_q02/duckdb:parquet 🚀 62123253 69229214 0.90
tpcds_q03/duckdb:parquet 12115201 13281357 0.91
tpcds_q04/duckdb:parquet 127724885 141453044 0.90
tpcds_q05/duckdb:parquet 71818242 77093179 0.93
tpcds_q06/duckdb:parquet 🚀 29472306 35188887 0.84
tpcds_q07/duckdb:parquet 23972341 24693196 0.97
tpcds_q08/duckdb:parquet 28570397 31361342 0.91
tpcds_q09/duckdb:parquet 40299772 42462545 0.95
tpcds_q10/duckdb:parquet 🚀 34468471 41131161 0.84
tpcds_q11/duckdb:parquet 88082720 95688447 0.92
tpcds_q12/duckdb:parquet 15420891 16883525 0.91
tpcds_q13/duckdb:parquet 34767991 37225252 0.93
tpcds_q14/duckdb:parquet 168525372 182188183 0.93
tpcds_q15/duckdb:parquet 🚀 30684446 35537118 0.86
tpcds_q16/duckdb:parquet 🚀 22009842 25040291 0.88
tpcds_q17/duckdb:parquet 38718217 42715646 0.91
tpcds_q18/duckdb:parquet 🚀 45846220 52993574 0.87
tpcds_q19/duckdb:parquet 🚀 29206378 34203149 0.85
tpcds_q20/duckdb:parquet 🚀 15914683 18535518 0.86
tpcds_q21/duckdb:parquet 11784849 12745021 0.92
tpcds_q22/duckdb:parquet 🚀 68532869 86381045 0.79
tpcds_q23/duckdb:parquet 🚀 115132597 132005191 0.87
tpcds_q24/duckdb:parquet 🚀 46245884 52396012 0.88
tpcds_q25/duckdb:parquet 🚀 32929396 38691034 0.85
tpcds_q26/duckdb:parquet 38583731 42088483 0.92
tpcds_q27/duckdb:parquet 89979956 99159839 0.91
tpcds_q28/duckdb:parquet 37540460 40701933 0.92
tpcds_q29/duckdb:parquet 36526063 39088116 0.93
tpcds_q30/duckdb:parquet 🚀 40555200 45167710 0.90
tpcds_q31/duckdb:parquet 🚀 24163111 27990112 0.86
tpcds_q32/duckdb:parquet 🚀 10920939 12659224 0.86
tpcds_q33/duckdb:parquet 🚀 72707185 82698529 0.88
tpcds_q34/duckdb:parquet 🚀 21204862 24735935 0.86
tpcds_q35/duckdb:parquet 🚀 62946653 71500044 0.88
tpcds_q36/duckdb:parquet 21139889 23386816 0.90
tpcds_q37/duckdb:parquet 🚀 13981450 16071715 0.87
tpcds_q38/duckdb:parquet 🚀 33465953 38513235 0.87
tpcds_q39/duckdb:parquet 32868652 35406045 0.93
tpcds_q40/duckdb:parquet 19085816 19693952 0.97
tpcds_q41/duckdb:parquet 8114876 8508105 0.95
tpcds_q42/duckdb:parquet 🚀 10344389 11851424 0.87
tpcds_q43/duckdb:parquet 🚀 16293448 18243825 0.89
tpcds_q44/duckdb:parquet 🚀 21110380 24414884 0.86
tpcds_q45/duckdb:parquet 29266904 31971001 0.92
tpcds_q46/duckdb:parquet 🚀 48928715 60505012 0.81
tpcds_q47/duckdb:parquet 🚀 46715292 55674858 0.84
tpcds_q48/duckdb:parquet 🚀 30694830 35289730 0.87
tpcds_q49/duckdb:parquet 🚀 24068398 28819298 0.84
tpcds_q50/duckdb:parquet 25109027 27671212 0.91
tpcds_q51/duckdb:parquet 🚀 96864916 113798544 0.85
tpcds_q52/duckdb:parquet 🚀 12159294 13614639 0.89
tpcds_q53/duckdb:parquet 🚀 16583446 20395096 0.81
tpcds_q54/duckdb:parquet 🚀 41341602 48900113 0.85
tpcds_q55/duckdb:parquet 10990843 12173883 0.90
tpcds_q56/duckdb:parquet 🚀 70176958 78068525 0.90
tpcds_q57/duckdb:parquet 🚀 35736714 39933153 0.89
tpcds_q58/duckdb:parquet 🚀 21926312 25621097 0.86
tpcds_q59/duckdb:parquet 37291055 39850143 0.94
tpcds_q60/duckdb:parquet 🚀 73550567 83435335 0.88
tpcds_q61/duckdb:parquet 🚀 31156632 35975245 0.87
tpcds_q62/duckdb:parquet 12818360 13443962 0.95
tpcds_q63/duckdb:parquet 🚀 15795442 18178580 0.87
tpcds_q64/duckdb:parquet 🚀 74058773 86395557 0.86
tpcds_q65/duckdb:parquet 20915216 21975916 0.95
tpcds_q66/duckdb:parquet 55755094 60400937 0.92
tpcds_q67/duckdb:parquet 🚀 138458114 165159066 0.84
tpcds_q68/duckdb:parquet 38869366 42694556 0.91
tpcds_q69/duckdb:parquet 🚀 36010810 42180277 0.85
tpcds_q70/duckdb:parquet 20216268 21836458 0.93
tpcds_q71/duckdb:parquet 18938029 20759951 0.91
tpcds_q72/duckdb:parquet 166785290 176562081 0.94
tpcds_q73/duckdb:parquet 🚀 18444382 21410050 0.86
tpcds_q74/duckdb:parquet 🚀 50296032 58285475 0.86
tpcds_q75/duckdb:parquet 55237446 58985887 0.94
tpcds_q76/duckdb:parquet 70584878 75517405 0.93
tpcds_q77/duckdb:parquet 🚀 63680371 71116613 0.90
tpcds_q78/duckdb:parquet 76042727 83554136 0.91
tpcds_q79/duckdb:parquet 29708371 31200296 0.95
tpcds_q80/duckdb:parquet 84707772 88485721 0.96
tpcds_q81/duckdb:parquet 48092039 52910624 0.91
tpcds_q82/duckdb:parquet 16617158 17599031 0.94
tpcds_q83/duckdb:parquet 16889793 17390981 0.97
tpcds_q84/duckdb:parquet 19941796 22096608 0.90
tpcds_q85/duckdb:parquet 🚀 39048337 44882298 0.87
tpcds_q86/duckdb:parquet 🚀 12473735 14084542 0.89
tpcds_q87/duckdb:parquet 🚀 37636270 42941047 0.88
tpcds_q88/duckdb:parquet 29853273 31690641 0.94
tpcds_q89/duckdb:parquet 18162991 19369179 0.94
tpcds_q90/duckdb:parquet 🚀 7634997 8618513 0.89
tpcds_q91/duckdb:parquet 🚀 23247993 28406959 0.82
tpcds_q92/duckdb:parquet 🚀 12150655 14186183 0.86
tpcds_q93/duckdb:parquet 🚀 31441636 37920099 0.83
tpcds_q94/duckdb:parquet 🚀 16376387 19210727 0.85
tpcds_q95/duckdb:parquet 149014133 146824079 1.01
tpcds_q96/duckdb:parquet 🚀 9530212 11644513 0.82
tpcds_q97/duckdb:parquet 🚀 36439734 42096880 0.87
tpcds_q98/duckdb:parquet 🚀 18208282 20773616 0.88
tpcds_q99/duckdb:parquet 20108712 21560371 0.93
duckdb / duckdb (0.889x ✅, 57↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 20002628 24014151 0.83
tpcds_q02/duckdb:duckdb 18839433 19047037 0.99
tpcds_q03/duckdb:duckdb 🚀 8386168 10271552 0.82
tpcds_q04/duckdb:duckdb 164944522 174765000 0.94
tpcds_q05/duckdb:duckdb 🚀 18661196 23711514 0.79
tpcds_q06/duckdb:duckdb 🚀 24025621 27869258 0.86
tpcds_q07/duckdb:duckdb 🚀 38382717 43768187 0.88
tpcds_q08/duckdb:duckdb 120702695 123271792 0.98
tpcds_q09/duckdb:duckdb 19957869 20585944 0.97
tpcds_q10/duckdb:duckdb 23493797 25028032 0.94
tpcds_q11/duckdb:duckdb 142206105 153339635 0.93
tpcds_q12/duckdb:duckdb 12132141 12457578 0.97
tpcds_q13/duckdb:duckdb 23391162 25398665 0.92
tpcds_q14/duckdb:duckdb 93663730 103893876 0.90
tpcds_q15/duckdb:duckdb 🚀 24838701 29093216 0.85
tpcds_q16/duckdb:duckdb 🚀 17656898 20070399 0.88
tpcds_q17/duckdb:duckdb 🚀 22205912 25522665 0.87
tpcds_q18/duckdb:duckdb 45641367 48463696 0.94
tpcds_q19/duckdb:duckdb 🚀 16301389 19735242 0.83
tpcds_q20/duckdb:duckdb 🚀 11758549 13870398 0.85
tpcds_q21/duckdb:duckdb 🚀 7109328 8747775 0.81
tpcds_q22/duckdb:duckdb 🚀 62508228 83052001 0.75
tpcds_q23/duckdb:duckdb 🚀 75947762 88087418 0.86
tpcds_q24/duckdb:duckdb 24431557 26574152 0.92
tpcds_q25/duckdb:duckdb 🚀 17200475 19334761 0.89
tpcds_q26/duckdb:duckdb 🚀 25126057 28999172 0.87
tpcds_q27/duckdb:duckdb 40608073 44056698 0.92
tpcds_q28/duckdb:duckdb 22393190 23073280 0.97
tpcds_q29/duckdb:duckdb 20723066 21755368 0.95
tpcds_q30/duckdb:duckdb 🚀 29094321 32630517 0.89
tpcds_q31/duckdb:duckdb 🚀 19767689 22447355 0.88
tpcds_q32/duckdb:duckdb 🚀 7086220 8328815 0.85
tpcds_q33/duckdb:duckdb 13086022 14513250 0.90
tpcds_q34/duckdb:duckdb 🚀 14955453 16745533 0.89
tpcds_q35/duckdb:duckdb 🚀 31036820 35464248 0.88
tpcds_q36/duckdb:duckdb 71351294 78118097 0.91
tpcds_q37/duckdb:duckdb 7747835 8552740 0.91
tpcds_q38/duckdb:duckdb 🚀 29992835 34106914 0.88
tpcds_q39/duckdb:duckdb 🚀 26700833 30417843 0.88
tpcds_q40/duckdb:duckdb 🚀 13818985 16987887 0.81
tpcds_q41/duckdb:duckdb 🚀 8500793 9679128 0.88
tpcds_q42/duckdb:duckdb 6900710 7137917 0.97
tpcds_q43/duckdb:duckdb 10972293 11996083 0.91
tpcds_q44/duckdb:duckdb 14460489 15844050 0.91
tpcds_q45/duckdb:duckdb 🚀 16682898 20443659 0.82
tpcds_q46/duckdb:duckdb 🚀 38028810 42793808 0.89
tpcds_q47/duckdb:duckdb 🚀 40689592 51627965 0.79
tpcds_q48/duckdb:duckdb 🚀 23006694 25678612 0.90
tpcds_q49/duckdb:duckdb 16969471 17550974 0.97
tpcds_q50/duckdb:duckdb 14394452 15167235 0.95
tpcds_q51/duckdb:duckdb 🚀 95138350 105718231 0.90
tpcds_q52/duckdb:duckdb 🚀 7160809 8844431 0.81
tpcds_q53/duckdb:duckdb 🚀 11980860 14622728 0.82
tpcds_q54/duckdb:duckdb 🚀 17040037 21645171 0.79
tpcds_q55/duckdb:duckdb 🚀 6908149 8827615 0.78
tpcds_q56/duckdb:duckdb 🚀 13849970 15943879 0.87
tpcds_q57/duckdb:duckdb 🚀 31555141 37343319 0.85
tpcds_q58/duckdb:duckdb 🚀 12770182 15324006 0.83
tpcds_q59/duckdb:duckdb 35379003 38450924 0.92
tpcds_q60/duckdb:duckdb 🚀 14690124 16548339 0.89
tpcds_q61/duckdb:duckdb 🚀 13957000 16903411 0.83
tpcds_q62/duckdb:duckdb 9306267 10257722 0.91
tpcds_q63/duckdb:duckdb 🚀 11073592 12504447 0.89
tpcds_q64/duckdb:duckdb 54477178 58947723 0.92
tpcds_q65/duckdb:duckdb 🚀 34554594 38841230 0.89
tpcds_q66/duckdb:duckdb 25287911 26308506 0.96
tpcds_q67/duckdb:duckdb 🚀 130088603 153408257 0.85
tpcds_q68/duckdb:duckdb 25195372 27895072 0.90
tpcds_q69/duckdb:duckdb 🚀 24104115 26968290 0.89
tpcds_q70/duckdb:duckdb 🚀 14233646 16239497 0.88
tpcds_q71/duckdb:duckdb 🚀 12495575 14790772 0.84
tpcds_q72/duckdb:duckdb 🚀 40653167 46171763 0.88
tpcds_q73/duckdb:duckdb 11444269 11702382 0.98
tpcds_q74/duckdb:duckdb 97568082 105189502 0.93
tpcds_q75/duckdb:duckdb 42196514 45648323 0.92
tpcds_q76/duckdb:duckdb 12079530 12882311 0.94
tpcds_q77/duckdb:duckdb 🚀 11701748 13403611 0.87
tpcds_q78/duckdb:duckdb 63589064 70634531 0.90
tpcds_q79/duckdb:duckdb 18441546 20098452 0.92
tpcds_q80/duckdb:duckdb 🚀 27715022 31424173 0.88
tpcds_q81/duckdb:duckdb 🚀 35774086 42457641 0.84
tpcds_q82/duckdb:duckdb 8143104 9009016 0.90
tpcds_q83/duckdb:duckdb 🚀 8969768 10539022 0.85
tpcds_q84/duckdb:duckdb 13679180 14812268 0.92
tpcds_q85/duckdb:duckdb 🚀 23622195 27035723 0.87
tpcds_q86/duckdb:duckdb 🚀 10713048 12071876 0.89
tpcds_q87/duckdb:duckdb 🚀 32848871 38488013 0.85
tpcds_q88/duckdb:duckdb 24315419 25903929 0.94
tpcds_q89/duckdb:duckdb 🚀 13111410 15433601 0.85
tpcds_q90/duckdb:duckdb 5793878 6256612 0.93
tpcds_q91/duckdb:duckdb 12914718 14074823 0.92
tpcds_q92/duckdb:duckdb 8907171 9482673 0.94
tpcds_q93/duckdb:duckdb 22379626 23969651 0.93
tpcds_q94/duckdb:duckdb 🚀 12970677 14429194 0.90
tpcds_q95/duckdb:duckdb 124742955 118044563 1.06
tpcds_q96/duckdb:duckdb 🚀 4804404 5390676 0.89
tpcds_q97/duckdb:duckdb 🚀 29831475 34715388 0.86
tpcds_q98/duckdb:duckdb 🚀 13509139 15565021 0.87
tpcds_q99/duckdb:duckdb 16528607 17658817 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -13.6% -12.3% -1.5% +11.2% ➖ noise
1 datafusion:vortex-file-compressed -23.6% -12.3% -12.9% +11.2% ✅ faster
1 duckdb:duckdb -16.7% -12.3% -5.0% +11.2% ➖ noise
1 duckdb:vortex-compact -12.9% -12.3% -0.7% +12.8% ➖ noise
1 duckdb:vortex-file-compressed -13.8% -12.3% -1.8% +12.2% ➖ noise
2 datafusion:vortex-compact -11.5% -9.3% -2.4% +11.2% ➖ noise
2 datafusion:vortex-file-compressed -19.8% -9.3% -11.6% +11.3% ✅ faster
2 duckdb:duckdb -1.1% -9.3% +9.0% +14.2% ➖ noise
2 duckdb:vortex-compact -3.9% -9.3% +6.0% +11.2% ➖ noise
2 duckdb:vortex-file-compressed -15.4% -9.3% -6.7% +11.2% ➖ noise
3 datafusion:vortex-compact -11.5% -11.9% +0.4% +11.2% ➖ noise
3 datafusion:vortex-file-compressed -12.3% -11.9% -0.5% +13.4% ➖ noise
3 duckdb:duckdb -18.4% -11.9% -7.3% +16.6% ➖ noise
3 duckdb:vortex-compact -16.2% -11.9% -4.9% +12.7% ➖ noise
3 duckdb:vortex-file-compressed -8.6% -11.9% +3.8% +12.6% ➖ noise
4 datafusion:vortex-compact -10.0% -16.4% +7.7% +11.2% ➖ noise
4 datafusion:vortex-file-compressed -16.7% -16.4% -0.3% +11.2% ➖ noise
4 duckdb:duckdb -5.6% -16.4% +12.9% +11.2% 🚨 regression
4 duckdb:vortex-compact -7.9% -16.4% +10.2% +11.2% ➖ noise
4 duckdb:vortex-file-compressed -9.5% -16.4% +8.3% +11.2% ➖ noise
5 datafusion:vortex-compact -11.5% -8.9% -2.9% +11.2% ➖ noise
5 datafusion:vortex-file-compressed -7.2% -8.9% +1.9% +12.1% ➖ noise
5 duckdb:duckdb -21.3% -8.9% -13.6% +11.2% ✅ faster
5 duckdb:vortex-compact -6.9% -8.9% +2.1% +11.2% ➖ noise
5 duckdb:vortex-file-compressed -20.8% -8.9% -13.0% +17.1% ➖ noise
6 datafusion:vortex-compact -15.9% -9.1% -7.5% +11.2% ➖ noise
6 datafusion:vortex-file-compressed -12.5% -9.1% -3.7% +11.2% ➖ noise
6 duckdb:duckdb -13.8% -9.1% -5.1% +14.5% ➖ noise
6 duckdb:vortex-compact -26.9% -9.1% -19.6% +11.2% ✅ faster
6 duckdb:vortex-file-compressed -12.1% -9.1% -3.2% +11.2% ➖ noise
7 datafusion:vortex-compact -19.0% -7.9% -12.1% +11.2% ✅ faster
7 datafusion:vortex-file-compressed -14.5% -7.9% -7.2% +11.2% ➖ noise
7 duckdb:duckdb -12.3% -7.9% -4.8% +17.0% ➖ noise
7 duckdb:vortex-compact -11.8% -7.9% -4.3% +15.8% ➖ noise
7 duckdb:vortex-file-compressed -10.4% -7.9% -2.8% +12.5% ➖ noise
8 datafusion:vortex-compact -13.1% -10.4% -3.0% +11.2% ➖ noise
8 datafusion:vortex-file-compressed -13.9% -10.4% -3.9% +11.2% ➖ noise
8 duckdb:duckdb -2.1% -10.4% +9.3% +11.2% ➖ noise
8 duckdb:vortex-compact -11.5% -10.4% -1.2% +11.2% ➖ noise
8 duckdb:vortex-file-compressed -18.5% -10.4% -9.0% +11.2% ➖ noise
9 datafusion:vortex-compact -12.9% -8.5% -4.9% +11.2% ➖ noise
9 datafusion:vortex-file-compressed -13.8% -8.5% -5.8% +11.2% ➖ noise
9 duckdb:duckdb -3.1% -8.5% +6.0% +11.2% ➖ noise
9 duckdb:vortex-compact -17.1% -8.5% -9.4% +11.2% ➖ noise
9 duckdb:vortex-file-compressed -17.9% -8.5% -10.2% +17.7% ➖ noise
10 datafusion:vortex-compact -15.0% -14.1% -1.1% +11.2% ➖ noise
10 datafusion:vortex-file-compressed -13.9% -14.1% +0.3% +11.2% ➖ noise
10 duckdb:duckdb -6.1% -14.1% +9.3% +11.2% ➖ noise
10 duckdb:vortex-compact -19.6% -14.1% -6.4% +11.2% ➖ noise
10 duckdb:vortex-file-compressed -19.8% -14.1% -6.6% +11.2% ➖ noise
11 datafusion:vortex-compact -16.4% -12.1% -4.9% +11.2% ➖ noise
11 datafusion:vortex-file-compressed -13.3% -12.1% -1.4% +11.2% ➖ noise
11 duckdb:duckdb -7.3% -12.1% +5.5% +11.2% ➖ noise
11 duckdb:vortex-compact -18.7% -12.1% -7.5% +11.2% ➖ noise
11 duckdb:vortex-file-compressed -16.6% -12.1% -5.2% +11.2% ➖ noise
12 datafusion:vortex-compact -10.3% -9.8% -0.6% +11.2% ➖ noise
12 datafusion:vortex-file-compressed -15.4% -9.8% -6.2% +11.2% ➖ noise
12 duckdb:duckdb -2.6% -9.8% +8.0% +11.2% ➖ noise
12 duckdb:vortex-compact -25.0% -9.8% -16.9% +11.2% ✅ faster
12 duckdb:vortex-file-compressed -15.7% -9.8% -6.5% +11.2% ➖ noise
13 datafusion:vortex-compact -4.6% -7.0% +2.5% +11.2% ➖ noise
13 datafusion:vortex-file-compressed -9.4% -7.0% -2.6% +11.2% ➖ noise
13 duckdb:duckdb -7.9% -7.0% -1.0% +11.2% ➖ noise
13 duckdb:vortex-compact -15.4% -7.0% -9.0% +11.7% ➖ noise
13 duckdb:vortex-file-compressed -19.6% -7.0% -13.5% +11.2% ✅ faster
14 datafusion:vortex-compact -16.3% -11.4% -5.5% +12.4% ➖ noise
14 datafusion:vortex-file-compressed -13.7% -11.4% -2.6% +11.2% ➖ noise
14 duckdb:duckdb -9.8% -11.4% +1.8% +11.2% ➖ noise
14 duckdb:vortex-compact -13.0% -11.4% -1.8% +11.2% ➖ noise
14 duckdb:vortex-file-compressed -5.3% -11.4% +6.9% +11.2% ➖ noise
15 datafusion:vortex-compact -30.1% -11.2% -21.3% +11.2% ✅ faster
15 datafusion:vortex-file-compressed -14.6% -11.2% -3.9% +11.2% ➖ noise
15 duckdb:duckdb -14.6% -11.2% -3.9% +11.2% ➖ noise
15 duckdb:vortex-compact -15.0% -11.2% -4.3% +11.9% ➖ noise
15 duckdb:vortex-file-compressed -12.7% -11.2% -1.7% +13.7% ➖ noise
16 datafusion:vortex-compact -26.8% -13.6% -15.3% +11.2% ✅ faster
16 datafusion:vortex-file-compressed -10.1% -13.6% +4.0% +11.8% ➖ noise
16 duckdb:duckdb -12.0% -13.6% +1.8% +13.0% ➖ noise
16 duckdb:vortex-compact -13.6% -13.6% -0.1% +12.9% ➖ noise
16 duckdb:vortex-file-compressed -19.5% -13.6% -6.8% +11.3% ➖ noise
17 datafusion:vortex-compact -24.4% -8.8% -17.2% +11.2% ✅ faster
17 datafusion:vortex-file-compressed -12.3% -8.8% -3.9% +11.2% ➖ noise
17 duckdb:duckdb -13.0% -8.8% -4.6% +11.5% ➖ noise
17 duckdb:vortex-compact -11.9% -8.8% -3.5% +11.2% ➖ noise
17 duckdb:vortex-file-compressed -14.2% -8.8% -6.0% +11.2% ➖ noise
18 datafusion:vortex-compact -22.7% -12.3% -11.8% +11.2% ✅ faster
18 datafusion:vortex-file-compressed -10.0% -12.3% +2.6% +11.2% ➖ noise
18 duckdb:duckdb -5.8% -12.3% +7.4% +11.2% ➖ noise
18 duckdb:vortex-compact -12.2% -12.3% +0.1% +11.2% ➖ noise
18 duckdb:vortex-file-compressed -20.3% -12.3% -9.1% +11.2% ➖ noise
19 datafusion:vortex-compact -18.3% -10.0% -9.2% +11.2% ➖ noise
19 datafusion:vortex-file-compressed -9.3% -10.0% +0.9% +14.6% ➖ noise
19 duckdb:duckdb -17.4% -10.0% -8.2% +14.1% ➖ noise
19 duckdb:vortex-compact -13.4% -10.0% -3.8% +11.2% ➖ noise
19 duckdb:vortex-file-compressed -20.6% -10.0% -11.7% +11.2% ✅ faster
20 datafusion:vortex-compact -19.9% -15.2% -5.5% +11.2% ➖ noise
20 datafusion:vortex-file-compressed -9.7% -15.2% +6.6% +11.2% ➖ noise
20 duckdb:duckdb -15.2% -15.2% +0.0% +13.9% ➖ noise
20 duckdb:vortex-compact -8.7% -15.2% +7.8% +11.2% ➖ noise
20 duckdb:vortex-file-compressed -24.9% -15.2% -11.4% +18.4% ➖ noise
21 datafusion:vortex-compact -13.0% -10.4% -3.0% +11.2% ➖ noise
21 datafusion:vortex-file-compressed -8.5% -10.4% +2.0% +11.2% ➖ noise
21 duckdb:duckdb -18.7% -10.4% -9.3% +20.5% ➖ noise
21 duckdb:vortex-compact -13.0% -10.4% -3.0% +20.7% ➖ noise
21 duckdb:vortex-file-compressed -15.3% -10.4% -5.5% +17.1% ➖ noise
22 datafusion:vortex-compact -9.0% -21.0% +15.2% +11.2% 🚨 regression
22 datafusion:vortex-file-compressed -11.5% -21.0% +12.0% +11.2% 🚨 regression
22 duckdb:duckdb -24.7% -21.0% -4.7% +11.9% ➖ noise
22 duckdb:vortex-compact -11.5% -21.0% +12.0% +11.2% 🚨 regression
22 duckdb:vortex-file-compressed -13.1% -21.0% +10.1% +11.2% ➖ noise
23 datafusion:vortex-compact -14.4% -14.2% -0.2% +11.2% ➖ noise
23 datafusion:vortex-file-compressed -14.3% -14.2% -0.1% +11.2% ➖ noise
23 duckdb:duckdb -13.8% -14.2% +0.5% +16.8% ➖ noise
23 duckdb:vortex-compact -7.9% -14.2% +7.4% +12.7% ➖ noise
23 duckdb:vortex-file-compressed -21.1% -14.2% -8.0% +11.2% ➖ noise
24 datafusion:vortex-compact -12.0% -11.7% -0.3% +11.2% ➖ noise
24 datafusion:vortex-file-compressed -16.0% -11.7% -4.8% +11.2% ➖ noise
24 duckdb:duckdb -8.1% -11.7% +4.2% +14.4% ➖ noise
24 duckdb:vortex-compact -11.2% -11.7% +0.6% +11.2% ➖ noise
24 duckdb:vortex-file-compressed -17.4% -11.7% -6.4% +11.2% ➖ noise
25 datafusion:vortex-compact -13.1% -10.5% -2.9% +11.2% ➖ noise
25 datafusion:vortex-file-compressed -19.7% -10.5% -10.3% +11.2% ✅ faster
25 duckdb:duckdb -11.0% -10.5% -0.6% +11.2% ➖ noise
25 duckdb:vortex-compact -8.4% -10.5% +2.3% +11.2% ➖ noise
25 duckdb:vortex-file-compressed -17.4% -10.5% -7.8% +13.8% ➖ noise
26 datafusion:vortex-compact -16.3% -9.8% -7.2% +11.2% ➖ noise
26 datafusion:vortex-file-compressed -15.9% -9.8% -6.8% +11.2% ➖ noise
26 duckdb:duckdb -13.4% -9.8% -3.9% +13.1% ➖ noise
26 duckdb:vortex-compact -14.5% -9.8% -5.2% +12.5% ➖ noise
26 duckdb:vortex-file-compressed -29.1% -9.8% -21.4% +11.2% ✅ faster
27 datafusion:vortex-compact -13.1% -11.2% -2.2% +11.2% ➖ noise
27 datafusion:vortex-file-compressed -18.0% -11.2% -7.6% +11.2% ➖ noise
27 duckdb:duckdb -7.8% -11.2% +3.8% +24.0% ➖ noise
27 duckdb:vortex-compact -6.3% -11.2% +5.5% +11.2% ➖ noise
27 duckdb:vortex-file-compressed -26.2% -11.2% -16.9% +11.2% ✅ faster
28 datafusion:vortex-compact -6.1% -9.3% +3.6% +11.2% ➖ noise
28 datafusion:vortex-file-compressed -11.9% -9.3% -2.9% +11.2% ➖ noise
28 duckdb:duckdb -2.9% -9.3% +7.0% +11.2% ➖ noise
28 duckdb:vortex-compact -4.7% -9.3% +5.2% +11.2% ➖ noise
28 duckdb:vortex-file-compressed -25.8% -9.3% -18.2% +13.2% ✅ faster
29 datafusion:vortex-compact -7.1% -7.6% +0.5% +11.9% ➖ noise
29 datafusion:vortex-file-compressed -10.5% -7.6% -3.2% +11.2% ➖ noise
29 duckdb:duckdb -4.7% -7.6% +3.1% +11.8% ➖ noise
29 duckdb:vortex-compact -10.5% -7.6% -3.1% +11.2% ➖ noise
29 duckdb:vortex-file-compressed -27.4% -7.6% -21.4% +18.1% ✅ faster
30 datafusion:vortex-compact -14.9% -10.1% -5.4% +11.2% ➖ noise
30 datafusion:vortex-file-compressed -16.5% -10.1% -7.1% +11.2% ➖ noise
30 duckdb:duckdb -10.8% -10.1% -0.8% +11.2% ➖ noise
30 duckdb:vortex-compact -7.5% -10.1% +2.9% +11.6% ➖ noise
30 duckdb:vortex-file-compressed -31.5% -10.1% -23.8% +11.2% ✅ faster
31 datafusion:vortex-compact -12.8% -11.8% -1.1% +11.2% ➖ noise
31 datafusion:vortex-file-compressed -10.5% -11.8% +1.4% +11.2% ➖ noise
31 duckdb:duckdb -11.9% -11.8% -0.2% +16.2% ➖ noise
31 duckdb:vortex-compact -14.6% -11.8% -3.2% +11.2% ➖ noise
31 duckdb:vortex-file-compressed -26.5% -11.8% -16.7% +11.2% ✅ faster
32 datafusion:vortex-compact -12.4% -8.9% -3.9% +11.2% ➖ noise
32 datafusion:vortex-file-compressed -12.0% -8.9% -3.4% +11.2% ➖ noise
32 duckdb:duckdb -14.9% -8.9% -6.6% +11.2% ➖ noise
32 duckdb:vortex-compact -9.7% -8.9% -0.9% +12.1% ➖ noise
32 duckdb:vortex-file-compressed -29.5% -8.9% -22.7% +11.2% ✅ faster
33 datafusion:vortex-compact -12.0% -12.7% +0.9% +11.2% ➖ noise
33 datafusion:vortex-file-compressed -12.3% -12.7% +0.5% +11.2% ➖ noise
33 duckdb:duckdb -9.8% -12.7% +3.3% +11.2% ➖ noise
33 duckdb:vortex-compact +6.5% -12.7% +22.1% +11.9% 🚨 regression
33 duckdb:vortex-file-compressed -30.2% -12.7% -20.1% +15.0% ✅ faster
34 datafusion:vortex-compact -14.3% -12.9% -1.7% +11.2% ➖ noise
34 datafusion:vortex-file-compressed -15.6% -12.9% -3.1% +11.2% ➖ noise
34 duckdb:duckdb -10.7% -12.9% +2.5% +11.2% ➖ noise
34 duckdb:vortex-compact -12.0% -12.9% +1.0% +11.2% ➖ noise
34 duckdb:vortex-file-compressed -18.6% -12.9% -6.6% +16.7% ➖ noise
35 datafusion:vortex-compact -18.5% -11.4% -8.0% +11.2% ➖ noise
35 datafusion:vortex-file-compressed -18.4% -11.4% -7.9% +11.2% ➖ noise
35 duckdb:duckdb -12.5% -11.4% -1.2% +14.8% ➖ noise
35 duckdb:vortex-compact -16.6% -11.4% -5.9% +11.2% ➖ noise
35 duckdb:vortex-file-compressed -19.6% -11.4% -9.2% +11.2% ➖ noise
36 datafusion:vortex-compact -21.7% -9.8% -13.2% +11.2% ✅ faster
36 datafusion:vortex-file-compressed -16.6% -9.8% -7.6% +11.2% ➖ noise
36 duckdb:duckdb -8.7% -9.8% +1.3% +11.2% ➖ noise
36 duckdb:vortex-compact -7.9% -9.8% +2.1% +11.2% ➖ noise
36 duckdb:vortex-file-compressed -14.0% -9.8% -4.6% +11.4% ➖ noise
37 datafusion:vortex-compact -27.9% -12.5% -17.6% +11.2% ✅ faster
37 datafusion:vortex-file-compressed -20.2% -12.5% -8.8% +11.2% ➖ noise
37 duckdb:duckdb -9.4% -12.5% +3.5% +15.7% ➖ noise
37 duckdb:vortex-compact -7.6% -12.5% +5.6% +12.1% ➖ noise
37 duckdb:vortex-file-compressed -14.7% -12.5% -2.5% +17.5% ➖ noise
38 datafusion:vortex-compact -12.9% -10.7% -2.5% +11.2% ➖ noise
38 datafusion:vortex-file-compressed -10.0% -10.7% +0.8% +11.2% ➖ noise
38 duckdb:duckdb -12.1% -10.7% -1.5% +11.2% ➖ noise
38 duckdb:vortex-compact -9.3% -10.7% +1.6% +11.5% ➖ noise
38 duckdb:vortex-file-compressed -10.6% -10.7% +0.2% +11.2% ➖ noise
39 datafusion:vortex-compact -23.3% -19.9% -4.2% +16.9% ➖ noise
39 datafusion:vortex-file-compressed -16.1% -19.9% +4.8% +16.8% ➖ noise
39 duckdb:duckdb -12.2% -19.9% +9.6% +23.9% ➖ noise
39 duckdb:vortex-compact -7.7% -19.9% +15.3% +17.7% ➖ noise
39 duckdb:vortex-file-compressed -10.3% -19.9% +12.0% +23.3% ➖ noise
40 datafusion:vortex-compact -16.3% -11.7% -5.2% +12.0% ➖ noise
40 datafusion:vortex-file-compressed -20.9% -11.7% -10.4% +14.6% ➖ noise
40 duckdb:duckdb -18.7% -11.7% -7.9% +16.2% ➖ noise
40 duckdb:vortex-compact -15.9% -11.7% -4.8% +14.1% ➖ noise
40 duckdb:vortex-file-compressed -9.9% -11.7% +2.0% +15.6% ➖ noise
41 datafusion:vortex-compact -11.1% -8.0% -3.4% +11.2% ➖ noise
41 datafusion:vortex-file-compressed -18.4% -8.0% -11.2% +13.3% ➖ noise
41 duckdb:duckdb -12.2% -8.0% -4.5% +11.2% ➖ noise
41 duckdb:vortex-compact -15.0% -8.0% -7.6% +11.2% ➖ noise
41 duckdb:vortex-file-compressed -18.3% -8.0% -11.2% +11.2% ✅ faster
42 datafusion:vortex-compact -4.1% -12.7% +9.9% +13.8% ➖ noise
42 datafusion:vortex-file-compressed -20.3% -12.7% -8.6% +11.2% ➖ noise
42 duckdb:duckdb -3.3% -12.7% +10.8% +17.5% ➖ noise
42 duckdb:vortex-compact -12.2% -12.7% +0.6% +15.7% ➖ noise
42 duckdb:vortex-file-compressed -16.7% -12.7% -4.5% +11.2% ➖ noise
43 datafusion:vortex-compact -10.5% -15.1% +5.4% +11.2% ➖ noise
43 datafusion:vortex-file-compressed -17.9% -15.1% -3.3% +11.2% ➖ noise
43 duckdb:duckdb -8.5% -15.1% +7.7% +11.4% ➖ noise
43 duckdb:vortex-compact -9.9% -15.1% +6.1% +11.2% ➖ noise
43 duckdb:vortex-file-compressed -9.7% -15.1% +6.3% +13.9% ➖ noise
44 datafusion:vortex-compact -10.1% -14.5% +5.1% +11.2% ➖ noise
44 datafusion:vortex-file-compressed -15.3% -14.5% -0.9% +11.2% ➖ noise
44 duckdb:duckdb -8.7% -14.5% +6.7% +15.7% ➖ noise
44 duckdb:vortex-compact -4.2% -14.5% +12.0% +15.7% ➖ noise
44 duckdb:vortex-file-compressed -9.2% -14.5% +6.2% +11.2% ➖ noise
45 datafusion:vortex-compact -11.4% -7.3% -4.4% +13.7% ➖ noise
45 datafusion:vortex-file-compressed -15.1% -7.3% -8.4% +11.2% ➖ noise
45 duckdb:duckdb -18.4% -7.3% -12.0% +11.8% ✅ faster
45 duckdb:vortex-compact -13.3% -7.3% -6.5% +12.4% ➖ noise
45 duckdb:vortex-file-compressed -20.8% -7.3% -14.6% +15.0% ✅ faster
46 datafusion:vortex-compact -13.6% -16.6% +3.6% +11.2% ➖ noise
46 datafusion:vortex-file-compressed -12.9% -16.6% +4.5% +11.2% ➖ noise
46 duckdb:duckdb -11.1% -16.6% +6.6% +12.5% ➖ noise
46 duckdb:vortex-compact -10.2% -16.6% +7.7% +11.2% ➖ noise
46 duckdb:vortex-file-compressed -16.4% -16.6% +0.2% +11.2% ➖ noise
47 datafusion:vortex-compact -15.4% -15.0% -0.4% +11.2% ➖ noise
47 datafusion:vortex-file-compressed -19.2% -15.0% -4.9% +11.2% ➖ noise
47 duckdb:duckdb -21.2% -15.0% -7.2% +11.2% ➖ noise
47 duckdb:vortex-compact -10.9% -15.0% +4.9% +11.2% ➖ noise
47 duckdb:vortex-file-compressed -11.3% -15.0% +4.4% +11.2% ➖ noise
48 datafusion:vortex-compact -4.3% -14.2% +11.5% +11.2% 🚨 regression
48 datafusion:vortex-file-compressed -19.2% -14.2% -5.8% +11.2% ➖ noise
48 duckdb:duckdb -10.4% -14.2% +4.4% +11.2% ➖ noise
48 duckdb:vortex-compact -8.9% -14.2% +6.1% +11.2% ➖ noise
48 duckdb:vortex-file-compressed -15.1% -14.2% -1.1% +13.4% ➖ noise
49 datafusion:vortex-compact -9.1% -18.9% +12.0% +13.2% ➖ noise
49 datafusion:vortex-file-compressed -19.3% -18.9% -0.5% +11.2% ➖ noise
49 duckdb:duckdb -3.3% -18.9% +19.1% +12.7% 🚨 regression
49 duckdb:vortex-compact -2.3% -18.9% +20.4% +13.3% 🚨 regression
49 duckdb:vortex-file-compressed -13.0% -18.9% +7.3% +14.5% ➖ noise
50 datafusion:vortex-compact -13.0% -12.2% -0.9% +11.2% ➖ noise
50 datafusion:vortex-file-compressed -24.4% -12.2% -13.9% +11.2% ✅ faster
50 duckdb:duckdb -5.1% -12.2% +8.1% +11.2% ➖ noise
50 duckdb:vortex-compact -8.5% -12.2% +4.3% +11.2% ➖ noise
50 duckdb:vortex-file-compressed -11.5% -12.2% +0.8% +11.2% ➖ noise
51 datafusion:vortex-compact -16.1% -18.1% +2.5% +14.9% ➖ noise
51 datafusion:vortex-file-compressed -25.3% -18.1% -8.7% +12.8% ➖ noise
51 duckdb:duckdb -10.0% -18.1% +9.9% +18.2% ➖ noise
51 duckdb:vortex-compact -5.6% -18.1% +15.3% +11.2% 🚨 regression
51 duckdb:vortex-file-compressed -11.0% -18.1% +8.7% +25.3% ➖ noise
52 datafusion:vortex-compact -13.9% -19.7% +7.3% +13.7% ➖ noise
52 datafusion:vortex-file-compressed -26.6% -19.7% -8.5% +11.8% ➖ noise
52 duckdb:duckdb -19.0% -19.7% +0.9% +17.1% ➖ noise
52 duckdb:vortex-compact -7.6% -19.7% +15.1% +19.1% ➖ noise
52 duckdb:vortex-file-compressed -12.0% -19.7% +9.7% +14.5% ➖ noise
53 datafusion:vortex-compact -13.1% -19.6% +8.1% +11.2% ➖ noise
53 datafusion:vortex-file-compressed -31.5% -19.6% -14.8% +11.2% ✅ faster
53 duckdb:duckdb -18.1% -19.6% +1.9% +11.2% ➖ noise
53 duckdb:vortex-compact -11.0% -19.6% +10.7% +11.2% ➖ noise
53 duckdb:vortex-file-compressed -13.2% -19.6% +7.9% +11.2% ➖ noise
54 datafusion:vortex-compact -11.1% -16.6% +6.6% +11.2% ➖ noise
54 datafusion:vortex-file-compressed -24.0% -16.6% -8.9% +11.2% ➖ noise
54 duckdb:duckdb -21.3% -16.6% -5.6% +14.1% ➖ noise
54 duckdb:vortex-compact -3.3% -16.6% +15.9% +11.2% 🚨 regression
54 duckdb:vortex-file-compressed -12.8% -16.6% +4.5% +11.2% ➖ noise
55 datafusion:vortex-compact -6.6% -16.0% +11.2% +14.6% ➖ noise
55 datafusion:vortex-file-compressed -22.5% -16.0% -7.7% +11.7% ➖ noise
55 duckdb:duckdb -21.7% -16.0% -6.8% +15.9% ➖ noise
55 duckdb:vortex-compact -10.2% -16.0% +7.0% +15.2% ➖ noise
55 duckdb:vortex-file-compressed -5.4% -16.0% +12.6% +23.4% ➖ noise
56 datafusion:vortex-compact -12.0% -17.4% +6.5% +11.2% ➖ noise
56 datafusion:vortex-file-compressed -23.8% -17.4% -7.8% +11.2% ➖ noise
56 duckdb:duckdb -13.1% -17.4% +5.2% +15.5% ➖ noise
56 duckdb:vortex-compact -0.0% -17.4% +21.0% +12.7% 🚨 regression
56 duckdb:vortex-file-compressed -11.4% -17.4% +7.3% +19.3% ➖ noise
57 datafusion:vortex-compact -11.0% -21.1% +12.7% +11.2% 🚨 regression
57 datafusion:vortex-file-compressed -24.5% -21.1% -4.4% +11.2% ➖ noise
57 duckdb:duckdb -15.5% -21.1% +7.0% +13.1% ➖ noise
57 duckdb:vortex-compact +7.3% -21.1% +35.9% +21.6% 🚨 regression
57 duckdb:vortex-file-compressed -10.9% -21.1% +12.9% +18.0% ➖ noise
58 datafusion:vortex-compact -13.0% -18.0% +6.1% +11.2% ➖ noise
58 datafusion:vortex-file-compressed -12.7% -18.0% +6.5% +11.2% ➖ noise
58 duckdb:duckdb -16.7% -18.0% +1.7% +18.7% ➖ noise
58 duckdb:vortex-compact -7.8% -18.0% +12.4% +13.6% ➖ noise
58 duckdb:vortex-file-compressed -9.8% -18.0% +10.0% +11.2% ➖ noise
59 datafusion:vortex-compact -17.3% -12.6% -5.4% +11.2% ➖ noise
59 datafusion:vortex-file-compressed -10.6% -12.6% +2.2% +11.2% ➖ noise
59 duckdb:duckdb -8.0% -12.6% +5.3% +11.2% ➖ noise
59 duckdb:vortex-compact -6.9% -12.6% +6.5% +11.2% ➖ noise
59 duckdb:vortex-file-compressed -5.5% -12.6% +8.1% +11.2% ➖ noise
60 datafusion:vortex-compact -12.8% -13.4% +0.8% +11.2% ➖ noise
60 datafusion:vortex-file-compressed -8.8% -13.4% +5.3% +11.2% ➖ noise
60 duckdb:duckdb -11.2% -13.4% +2.5% +38.4% ➖ noise
60 duckdb:vortex-compact -1.8% -13.4% +13.4% +11.2% 🚨 regression
60 duckdb:vortex-file-compressed -15.8% -13.4% -2.8% +14.1% ➖ noise
61 datafusion:vortex-compact -16.3% -14.9% -1.6% +11.2% ➖ noise
61 datafusion:vortex-file-compressed -10.9% -14.9% +4.8% +11.2% ➖ noise
61 duckdb:duckdb -17.4% -14.9% -3.0% +11.2% ➖ noise
61 duckdb:vortex-compact -12.8% -14.9% +2.5% +11.2% ➖ noise
61 duckdb:vortex-file-compressed -20.0% -14.9% -6.0% +18.8% ➖ noise
62 datafusion:vortex-compact -18.6% -12.3% -7.2% +11.3% ➖ noise
62 datafusion:vortex-file-compressed -9.0% -12.3% +3.7% +11.2% ➖ noise
62 duckdb:duckdb -9.3% -12.3% +3.4% +14.3% ➖ noise
62 duckdb:vortex-compact -6.4% -12.3% +6.7% +26.1% ➖ noise
62 duckdb:vortex-file-compressed -2.5% -12.3% +11.2% +26.1% ➖ noise
63 datafusion:vortex-compact -12.5% -12.0% -0.7% +11.2% ➖ noise
63 datafusion:vortex-file-compressed -11.3% -12.0% +0.8% +11.2% ➖ noise
63 duckdb:duckdb -11.4% -12.0% +0.6% +13.3% ➖ noise
63 duckdb:vortex-compact -13.8% -12.0% -2.1% +11.5% ➖ noise
63 duckdb:vortex-file-compressed -18.5% -12.0% -7.5% +11.2% ➖ noise
64 datafusion:vortex-compact -17.2% -12.8% -5.1% +11.2% ➖ noise
64 datafusion:vortex-file-compressed -12.6% -12.8% +0.2% +11.2% ➖ noise
64 duckdb:duckdb -7.6% -12.8% +6.0% +11.2% ➖ noise
64 duckdb:vortex-compact -16.2% -12.8% -3.9% +11.2% ➖ noise
64 duckdb:vortex-file-compressed -17.6% -12.8% -5.5% +11.2% ➖ noise
65 datafusion:vortex-compact -15.2% -12.7% -2.8% +11.2% ➖ noise
65 datafusion:vortex-file-compressed -17.3% -12.7% -5.2% +15.2% ➖ noise
65 duckdb:duckdb -11.0% -12.7% +1.9% +14.6% ➖ noise
65 duckdb:vortex-compact -8.9% -12.7% +4.4% +11.2% ➖ noise
65 duckdb:vortex-file-compressed -19.0% -12.7% -7.2% +11.2% ➖ noise
66 datafusion:vortex-compact -13.2% -8.9% -4.7% +11.2% ➖ noise
66 datafusion:vortex-file-compressed -9.5% -8.9% -0.6% +12.9% ➖ noise
66 duckdb:duckdb -3.9% -8.9% +5.5% +15.0% ➖ noise
66 duckdb:vortex-compact -11.2% -8.9% -2.5% +11.2% ➖ noise
66 duckdb:vortex-file-compressed -17.7% -8.9% -9.6% +18.6% ➖ noise
67 datafusion:vortex-compact -14.4% -16.3% +2.2% +11.2% ➖ noise
67 datafusion:vortex-file-compressed -9.0% -16.3% +8.7% +11.2% ➖ noise
67 duckdb:duckdb -15.2% -16.3% +1.3% +11.2% ➖ noise
67 duckdb:vortex-compact -17.7% -16.3% -1.7% +11.2% ➖ noise
67 duckdb:vortex-file-compressed -20.9% -16.3% -5.5% +11.6% ➖ noise
68 datafusion:vortex-compact -14.1% -12.8% -1.5% +11.2% ➖ noise
68 datafusion:vortex-file-compressed -12.4% -12.8% +0.4% +11.2% ➖ noise
68 duckdb:duckdb -9.7% -12.8% +3.5% +11.2% ➖ noise
68 duckdb:vortex-compact -22.7% -12.8% -11.4% +11.2% ✅ faster
68 duckdb:vortex-file-compressed -12.2% -12.8% +0.6% +11.2% ➖ noise
69 datafusion:vortex-compact -11.8% -19.1% +9.0% +11.2% ➖ noise
69 datafusion:vortex-file-compressed -15.5% -19.1% +4.5% +13.4% ➖ noise
69 duckdb:duckdb -10.6% -19.1% +10.5% +11.2% ➖ noise
69 duckdb:vortex-compact -15.3% -19.1% +4.8% +11.2% ➖ noise
69 duckdb:vortex-file-compressed -12.0% -19.1% +8.8% +11.2% ➖ noise
70 datafusion:vortex-compact -15.1% -13.5% -1.9% +11.8% ➖ noise
70 datafusion:vortex-file-compressed -18.4% -13.5% -5.7% +14.1% ➖ noise
70 duckdb:duckdb -12.4% -13.5% +1.3% +16.9% ➖ noise
70 duckdb:vortex-compact -9.8% -13.5% +4.2% +13.8% ➖ noise
70 duckdb:vortex-file-compressed -5.8% -13.5% +8.8% +16.7% ➖ noise
71 datafusion:vortex-compact -14.6% -9.1% -6.1% +11.2% ➖ noise
71 datafusion:vortex-file-compressed -25.3% -9.1% -17.8% +11.2% ✅ faster
71 duckdb:duckdb -15.5% -9.1% -7.0% +11.2% ➖ noise
71 duckdb:vortex-compact -15.1% -9.1% -6.6% +11.2% ➖ noise
71 duckdb:vortex-file-compressed -15.1% -9.1% -6.5% +14.4% ➖ noise
72 datafusion:vortex-compact -25.4% -11.4% -15.8% +11.2% ✅ faster
72 datafusion:vortex-file-compressed -31.3% -11.4% -22.5% +11.2% ✅ faster
72 duckdb:duckdb -12.0% -11.4% -0.6% +12.0% ➖ noise
72 duckdb:vortex-compact -15.3% -11.4% -4.4% +11.2% ➖ noise
72 duckdb:vortex-file-compressed -7.7% -11.4% +4.2% +11.2% ➖ noise
73 datafusion:vortex-compact -23.6% -8.7% -16.3% +27.3% ➖ noise
73 datafusion:vortex-file-compressed -24.7% -8.7% -17.5% +28.4% ➖ noise
73 duckdb:duckdb -2.2% -8.7% +7.1% +15.4% ➖ noise
73 duckdb:vortex-compact -23.3% -8.7% -16.0% +14.5% ✅ faster
73 duckdb:vortex-file-compressed -12.3% -8.7% -4.0% +13.1% ➖ noise
74 datafusion:vortex-compact -22.8% -13.8% -10.5% +11.2% ✅ faster
74 datafusion:vortex-file-compressed -21.0% -13.8% -8.4% +11.2% ➖ noise
74 duckdb:duckdb -7.2% -13.8% +7.6% +11.2% ➖ noise
74 duckdb:vortex-compact -25.4% -13.8% -13.4% +11.2% ✅ faster
74 duckdb:vortex-file-compressed -12.0% -13.8% +2.1% +11.2% ➖ noise
75 datafusion:vortex-compact -17.9% -10.1% -8.6% +11.2% ➖ noise
75 datafusion:vortex-file-compressed -21.6% -10.1% -12.8% +16.2% ➖ noise
75 duckdb:duckdb -7.6% -10.1% +2.8% +11.2% ➖ noise
75 duckdb:vortex-compact -18.0% -10.1% -8.7% +11.5% ➖ noise
75 duckdb:vortex-file-compressed -10.9% -10.1% -0.9% +11.2% ➖ noise
76 datafusion:vortex-compact -8.2% -9.5% +1.4% +11.2% ➖ noise
76 datafusion:vortex-file-compressed -13.2% -9.5% -4.1% +11.2% ➖ noise
76 duckdb:duckdb -6.2% -9.5% +3.6% +16.9% ➖ noise
76 duckdb:vortex-compact -22.8% -9.5% -14.7% +11.2% ✅ faster
76 duckdb:vortex-file-compressed -16.1% -9.5% -7.3% +17.6% ➖ noise
77 datafusion:vortex-compact -9.1% -10.1% +1.1% +11.2% ➖ noise
77 datafusion:vortex-file-compressed -24.7% -10.1% -16.2% +11.2% ✅ faster
77 duckdb:duckdb -12.7% -10.1% -2.9% +13.0% ➖ noise
77 duckdb:vortex-compact -23.1% -10.1% -14.4% +11.2% ✅ faster
77 duckdb:vortex-file-compressed -16.0% -10.1% -6.5% +11.2% ➖ noise
78 datafusion:vortex-compact -13.9% -12.1% -2.1% +11.2% ➖ noise
78 datafusion:vortex-file-compressed -20.2% -12.1% -9.3% +11.2% ➖ noise
78 duckdb:duckdb -10.0% -12.1% +2.4% +11.2% ➖ noise
78 duckdb:vortex-compact -25.0% -12.1% -14.8% +11.2% ✅ faster
78 duckdb:vortex-file-compressed -14.8% -12.1% -3.2% +11.2% ➖ noise
79 datafusion:vortex-compact -11.9% -11.9% +0.0% +11.2% ➖ noise
79 datafusion:vortex-file-compressed -16.9% -11.9% -5.6% +11.2% ➖ noise
79 duckdb:duckdb -8.2% -11.9% +4.2% +11.2% ➖ noise
79 duckdb:vortex-compact -12.9% -11.9% -1.1% +13.5% ➖ noise
79 duckdb:vortex-file-compressed -11.9% -11.9% +0.0% +11.2% ➖ noise
80 datafusion:vortex-compact -14.1% -10.2% -4.3% +11.2% ➖ noise
80 datafusion:vortex-file-compressed -14.7% -10.2% -5.0% +11.2% ➖ noise
80 duckdb:duckdb -11.8% -10.2% -1.8% +13.7% ➖ noise
80 duckdb:vortex-compact -12.6% -10.2% -2.7% +11.2% ➖ noise
80 duckdb:vortex-file-compressed -13.2% -10.2% -3.4% +11.2% ➖ noise
81 datafusion:vortex-compact -16.5% -9.4% -7.8% +11.2% ➖ noise
81 datafusion:vortex-file-compressed -21.9% -9.4% -13.8% +11.9% ✅ faster
81 duckdb:duckdb -15.7% -9.4% -7.0% +11.5% ➖ noise
81 duckdb:vortex-compact -14.5% -9.4% -5.6% +15.1% ➖ noise
81 duckdb:vortex-file-compressed -14.1% -9.4% -5.2% +18.1% ➖ noise
82 datafusion:vortex-compact -13.8% -6.5% -7.9% +11.2% ➖ noise
82 datafusion:vortex-file-compressed -14.3% -6.5% -8.4% +11.2% ➖ noise
82 duckdb:duckdb -9.6% -6.5% -3.4% +13.6% ➖ noise
82 duckdb:vortex-compact -20.6% -6.5% -15.1% +17.9% ➖ noise
82 duckdb:vortex-file-compressed -14.1% -6.5% -8.1% +16.4% ➖ noise
83 datafusion:vortex-compact -17.3% -8.1% -10.0% +11.2% ➖ noise
83 datafusion:vortex-file-compressed -11.1% -8.1% -3.3% +11.2% ➖ noise
83 duckdb:duckdb -14.9% -8.1% -7.4% +12.2% ➖ noise
83 duckdb:vortex-compact -11.2% -8.1% -3.4% +11.2% ➖ noise
83 duckdb:vortex-file-compressed -12.1% -8.1% -4.4% +11.2% ➖ noise
84 datafusion:vortex-compact -11.4% -9.5% -2.1% +11.2% ➖ noise
84 datafusion:vortex-file-compressed -15.0% -9.5% -6.0% +11.2% ➖ noise
84 duckdb:duckdb -7.6% -9.5% +2.1% +11.4% ➖ noise
84 duckdb:vortex-compact -15.8% -9.5% -7.0% +11.4% ➖ noise
84 duckdb:vortex-file-compressed -15.3% -9.5% -6.4% +11.3% ➖ noise
85 datafusion:vortex-compact -12.2% -10.9% -1.6% +11.2% ➖ noise
85 datafusion:vortex-file-compressed -11.7% -10.9% -0.9% +11.2% ➖ noise
85 duckdb:duckdb -12.6% -10.9% -2.0% +11.2% ➖ noise
85 duckdb:vortex-compact -12.4% -10.9% -1.7% +11.2% ➖ noise
85 duckdb:vortex-file-compressed -20.8% -10.9% -11.2% +11.2% ✅ faster
86 datafusion:vortex-compact -14.6% -12.8% -2.1% +11.2% ➖ noise
86 datafusion:vortex-file-compressed -10.3% -12.8% +2.8% +11.2% ➖ noise
86 duckdb:duckdb -11.3% -12.8% +1.8% +15.1% ➖ noise
86 duckdb:vortex-compact -23.0% -12.8% -11.7% +22.0% ➖ noise
86 duckdb:vortex-file-compressed -14.2% -12.8% -1.6% +11.7% ➖ noise
87 datafusion:vortex-compact -9.5% -12.1% +2.9% +11.2% ➖ noise
87 datafusion:vortex-file-compressed -7.3% -12.1% +5.5% +11.2% ➖ noise
87 duckdb:duckdb -14.7% -12.1% -2.9% +11.2% ➖ noise
87 duckdb:vortex-compact -18.1% -12.1% -6.8% +11.2% ➖ noise
87 duckdb:vortex-file-compressed -21.9% -12.1% -11.1% +11.2% ✅ faster
88 datafusion:vortex-compact -10.3% -7.6% -2.9% +11.2% ➖ noise
88 datafusion:vortex-file-compressed -9.6% -7.6% -2.2% +11.2% ➖ noise
88 duckdb:duckdb -6.1% -7.6% +1.6% +11.2% ➖ noise
88 duckdb:vortex-compact -10.7% -7.6% -3.4% +11.2% ➖ noise
88 duckdb:vortex-file-compressed -14.9% -7.6% -7.9% +11.2% ➖ noise
89 datafusion:vortex-compact -14.2% -6.4% -8.4% +11.2% ➖ noise
89 datafusion:vortex-file-compressed -12.9% -6.4% -6.9% +11.3% ➖ noise
89 duckdb:duckdb -15.0% -6.4% -9.3% +13.8% ➖ noise
89 duckdb:vortex-compact -9.4% -6.4% -3.3% +11.2% ➖ noise
89 duckdb:vortex-file-compressed -14.5% -6.4% -8.7% +16.7% ➖ noise
90 datafusion:vortex-compact -12.3% -11.1% -1.3% +11.2% ➖ noise
90 datafusion:vortex-file-compressed -13.7% -11.1% -3.0% +12.0% ➖ noise
90 duckdb:duckdb -7.4% -11.1% +4.2% +13.3% ➖ noise
90 duckdb:vortex-compact -16.1% -11.1% -5.7% +13.7% ➖ noise
90 duckdb:vortex-file-compressed -9.6% -11.1% +1.7% +14.6% ➖ noise
91 datafusion:vortex-compact -14.9% -12.6% -2.7% +11.2% ➖ noise
91 datafusion:vortex-file-compressed -14.9% -12.6% -2.6% +13.7% ➖ noise
91 duckdb:duckdb -8.2% -12.6% +5.0% +11.2% ➖ noise
91 duckdb:vortex-compact -10.5% -12.6% +2.4% +11.2% ➖ noise
91 duckdb:vortex-file-compressed -10.4% -12.6% +2.5% +16.7% ➖ noise
92 datafusion:vortex-compact -13.3% -13.4% +0.1% +11.2% ➖ noise
92 datafusion:vortex-file-compressed -12.2% -13.4% +1.4% +11.2% ➖ noise
92 duckdb:duckdb -6.1% -13.4% +8.5% +11.2% ➖ noise
92 duckdb:vortex-compact -12.0% -13.4% +1.7% +17.9% ➖ noise
92 duckdb:vortex-file-compressed -20.8% -13.4% -8.5% +12.8% ➖ noise
93 datafusion:vortex-compact -19.5% -15.7% -4.5% +13.8% ➖ noise
93 datafusion:vortex-file-compressed -15.0% -15.7% +0.8% +12.4% ➖ noise
93 duckdb:duckdb -6.6% -15.7% +10.7% +15.1% ➖ noise
93 duckdb:vortex-compact -10.2% -15.7% +6.5% +18.4% ➖ noise
93 duckdb:vortex-file-compressed -13.2% -15.7% +3.0% +13.0% ➖ noise
94 datafusion:vortex-compact -11.4% -20.1% +10.8% +11.2% ➖ noise
94 datafusion:vortex-file-compressed -13.5% -20.1% +8.1% +11.2% ➖ noise
94 duckdb:duckdb -10.1% -20.1% +12.4% +32.5% ➖ noise
94 duckdb:vortex-compact -11.5% -20.1% +10.7% +19.1% ➖ noise
94 duckdb:vortex-file-compressed -15.0% -20.1% +6.3% +13.1% ➖ noise
95 datafusion:vortex-compact -12.9% -4.0% -9.2% +11.2% ➖ noise
95 datafusion:vortex-file-compressed -9.9% -4.0% -6.1% +11.2% ➖ noise
95 duckdb:duckdb +5.7% -4.0% +10.1% +20.3% ➖ noise
95 duckdb:vortex-compact -10.4% -4.0% -6.6% +15.4% ➖ noise
95 duckdb:vortex-file-compressed +5.7% -4.0% +10.1% +17.6% ➖ noise
96 datafusion:vortex-compact -18.7% -17.0% -2.0% +11.2% ➖ noise
96 datafusion:vortex-file-compressed -17.9% -17.0% -1.0% +13.2% ➖ noise
96 duckdb:duckdb -10.9% -17.0% +7.4% +12.0% ➖ noise
96 duckdb:vortex-compact -11.3% -17.0% +6.9% +11.2% ➖ noise
96 duckdb:vortex-file-compressed -15.7% -17.0% +1.6% +13.0% ➖ noise
97 datafusion:vortex-compact -25.1% -15.6% -11.2% +11.2% ✅ faster
97 datafusion:vortex-file-compressed -17.9% -15.6% -2.7% +12.3% ➖ noise
97 duckdb:duckdb -14.1% -15.6% +1.9% +11.2% ➖ noise
97 duckdb:vortex-compact -5.4% -15.6% +12.1% +15.2% ➖ noise
97 duckdb:vortex-file-compressed -5.6% -15.6% +11.9% +14.3% ➖ noise
98 datafusion:vortex-compact -20.0% -14.7% -6.2% +11.2% ➖ noise
98 datafusion:vortex-file-compressed -15.5% -14.7% -0.9% +11.2% ➖ noise
98 duckdb:duckdb -13.2% -14.7% +1.7% +12.6% ➖ noise
98 duckdb:vortex-compact -12.1% -14.7% +3.0% +11.3% ➖ noise
98 duckdb:vortex-file-compressed -16.4% -14.7% -2.0% +15.1% ➖ noise
99 datafusion:vortex-compact -23.8% -12.0% -13.3% +14.0% ✅ faster
99 datafusion:vortex-file-compressed -9.3% -12.0% +3.1% +12.8% ➖ noise
99 duckdb:duckdb -6.4% -12.0% +6.4% +25.5% ➖ noise
99 duckdb:vortex-compact -12.0% -12.0% -0.0% +31.0% ➖ noise
99 duckdb:vortex-file-compressed -12.0% -12.0% -0.0% +14.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.4%
Vortex (geomean): 1.068x ➖
Parquet (geomean): 1.098x ➖
Shifts: Parquet (control) +9.8% · Median polish +7.1%


datafusion / vortex-file-compressed (1.146x ❌, 0↑ 16↓)
name PR 1bcc137 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 430332754 411092811 1.05
tpch_q02/datafusion:vortex-file-compressed 🚨 159295766 117930039 1.35
tpch_q03/datafusion:vortex-file-compressed 🚨 251587417 205939078 1.22
tpch_q04/datafusion:vortex-file-compressed 108126301 101150728 1.07
tpch_q05/datafusion:vortex-file-compressed 🚨 464476967 382813372 1.21
tpch_q06/datafusion:vortex-file-compressed 40852540 40154881 1.02
tpch_q07/datafusion:vortex-file-compressed 🚨 646725940 571112906 1.13
tpch_q08/datafusion:vortex-file-compressed 🚨 471384773 377768723 1.25
tpch_q09/datafusion:vortex-file-compressed 🚨 804358728 670100065 1.20
tpch_q10/datafusion:vortex-file-compressed 🚨 287455530 236119729 1.22
tpch_q11/datafusion:vortex-file-compressed 🚨 116953174 85786147 1.36
tpch_q12/datafusion:vortex-file-compressed 🚨 127543736 112607858 1.13
tpch_q13/datafusion:vortex-file-compressed 227769300 223468944 1.02
tpch_q14/datafusion:vortex-file-compressed 🚨 73881595 59948367 1.23
tpch_q15/datafusion:vortex-file-compressed 109819351 111145086 0.99
tpch_q16/datafusion:vortex-file-compressed 🚨 95017041 79149717 1.20
tpch_q17/datafusion:vortex-file-compressed 🚨 744362667 653548501 1.14
tpch_q18/datafusion:vortex-file-compressed 🚨 987978521 894629489 1.10
tpch_q19/datafusion:vortex-file-compressed 🚨 135904136 117230044 1.16
tpch_q20/datafusion:vortex-file-compressed 🚨 199071750 172602621 1.15
tpch_q21/datafusion:vortex-file-compressed 🚨 759443745 665139461 1.14
tpch_q22/datafusion:vortex-file-compressed 59774868 61567810 0.97
datafusion / vortex-compact (1.139x ❌, 0↑ 14↓)
name PR 1bcc137 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 458506184 430957470 1.06
tpch_q02/datafusion:vortex-compact 🚨 163953887 119082493 1.38
tpch_q03/datafusion:vortex-compact 🚨 265430699 220229284 1.21
tpch_q04/datafusion:vortex-compact 127403625 120620702 1.06
tpch_q05/datafusion:vortex-compact 🚨 475169191 394161201 1.21
tpch_q06/datafusion:vortex-compact 64208971 64190345 1.00
tpch_q07/datafusion:vortex-compact 🚨 676081479 588959781 1.15
tpch_q08/datafusion:vortex-compact 🚨 480011214 393631927 1.22
tpch_q09/datafusion:vortex-compact 🚨 837016021 694705706 1.20
tpch_q10/datafusion:vortex-compact 🚨 330233394 273573259 1.21
tpch_q11/datafusion:vortex-compact 🚨 121031851 91371401 1.32
tpch_q12/datafusion:vortex-compact 182687039 172324571 1.06
tpch_q13/datafusion:vortex-compact 276807077 277722407 1.00
tpch_q14/datafusion:vortex-compact 🚨 90612508 76841890 1.18
tpch_q15/datafusion:vortex-compact 168018574 167685839 1.00
tpch_q16/datafusion:vortex-compact 🚨 103654126 81871118 1.27
tpch_q17/datafusion:vortex-compact 🚨 744813758 651851416 1.14
tpch_q18/datafusion:vortex-compact 980232111 895662896 1.09
tpch_q19/datafusion:vortex-compact 🚨 239789062 207034041 1.16
tpch_q20/datafusion:vortex-compact 🚨 228159144 200087246 1.14
tpch_q21/datafusion:vortex-compact 🚨 807812109 709650395 1.14
tpch_q22/datafusion:vortex-compact 71401352 73752200 0.97
datafusion / parquet (1.201x ❌, 0↑ 19↓)
name PR 1bcc137 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 457943482 449818668 1.02
tpch_q02/datafusion:parquet 🚨 253170655 188978620 1.34
tpch_q03/datafusion:parquet 🚨 390276665 301345019 1.30
tpch_q04/datafusion:parquet 🚨 153296653 136925562 1.12
tpch_q05/datafusion:parquet 🚨 587063153 454715377 1.29
tpch_q06/datafusion:parquet 🚨 136833374 119179229 1.15
tpch_q07/datafusion:parquet 🚨 792533854 645659691 1.23
tpch_q08/datafusion:parquet 🚨 648706157 495834738 1.31
tpch_q09/datafusion:parquet 🚨 978997361 784159669 1.25
tpch_q10/datafusion:parquet 🚨 605975498 507906943 1.19
tpch_q11/datafusion:parquet 🚨 190882048 131780992 1.45
tpch_q12/datafusion:parquet 🚨 244802364 208312496 1.18
tpch_q13/datafusion:parquet 337251225 341085385 0.99
tpch_q14/datafusion:parquet 🚨 204647915 156500930 1.31
tpch_q15/datafusion:parquet 🚨 269447879 244895378 1.10
tpch_q16/datafusion:parquet 🚨 181457254 138128253 1.31
tpch_q17/datafusion:parquet 🚨 853223686 692619036 1.23
tpch_q18/datafusion:parquet 🚨 1057720500 919530545 1.15
tpch_q19/datafusion:parquet 🚨 325590944 271862304 1.20
tpch_q20/datafusion:parquet 🚨 370057441 309499119 1.20
tpch_q21/datafusion:parquet 🚨 898797843 746731020 1.20
tpch_q22/datafusion:parquet 226132198 221004340 1.02
datafusion / arrow (1.159x ❌, 0↑ 20↓)
name PR 1bcc137 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 734273013 606288279 1.21
tpch_q02/datafusion:arrow 🚨 206736244 170358300 1.21
tpch_q03/datafusion:arrow 🚨 549154994 462606549 1.19
tpch_q04/datafusion:arrow 🚨 387251315 348525755 1.11
tpch_q05/datafusion:arrow 🚨 1050286575 931445531 1.13
tpch_q06/datafusion:arrow 🚨 318736493 273989573 1.16
tpch_q07/datafusion:arrow 🚨 1380961076 1155884131 1.19
tpch_q08/datafusion:arrow 🚨 1299096024 1154291203 1.13
tpch_q09/datafusion:arrow 🚨 1560474281 1345963250 1.16
tpch_q10/datafusion:arrow 679513838 620331303 1.10
tpch_q11/datafusion:arrow 🚨 180523546 155482947 1.16
tpch_q12/datafusion:arrow 🚨 821155772 721177122 1.14
tpch_q13/datafusion:arrow 520116027 537458167 0.97
tpch_q14/datafusion:arrow 🚨 360380400 314794024 1.14
tpch_q15/datafusion:arrow 🚨 769324181 663115524 1.16
tpch_q16/datafusion:arrow 🚨 122778258 111491308 1.10
tpch_q17/datafusion:arrow 🚨 1566893634 1340726206 1.17
tpch_q18/datafusion:arrow 🚨 2136032621 1830609646 1.17
tpch_q19/datafusion:arrow 🚨 588355705 498161619 1.18
tpch_q20/datafusion:arrow 🚨 567892202 493034184 1.15
tpch_q21/datafusion:arrow 🚨 3965861114 2863195519 1.39
tpch_q22/datafusion:arrow 🚨 177403288 145172398 1.22
duckdb / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 177881777 177203375 1.00
tpch_q02/duckdb:vortex-file-compressed 52747780 53547069 0.99
tpch_q03/duckdb:vortex-file-compressed 130493044 129860729 1.00
tpch_q04/duckdb:vortex-file-compressed 150377080 153746582 0.98
tpch_q05/duckdb:vortex-file-compressed 131405344 131308920 1.00
tpch_q06/duckdb:vortex-file-compressed 49570049 48557192 1.02
tpch_q07/duckdb:vortex-file-compressed 149940504 147796483 1.01
tpch_q08/duckdb:vortex-file-compressed 175578419 175760174 1.00
tpch_q09/duckdb:vortex-file-compressed 335179291 337862574 0.99
tpch_q10/duckdb:vortex-file-compressed 158125975 155928912 1.01
tpch_q11/duckdb:vortex-file-compressed 35702727 35609519 1.00
tpch_q12/duckdb:vortex-file-compressed 94824867 93957741 1.01
tpch_q13/duckdb:vortex-file-compressed 247350692 252111577 0.98
tpch_q14/duckdb:vortex-file-compressed 70474679 71677434 0.98
tpch_q15/duckdb:vortex-file-compressed 98170039 98242445 1.00
tpch_q16/duckdb:vortex-file-compressed 81206820 80747216 1.01
tpch_q17/duckdb:vortex-file-compressed 102995211 101319499 1.02
tpch_q18/duckdb:vortex-file-compressed 277396552 277163580 1.00
tpch_q19/duckdb:vortex-file-compressed 92014475 92177471 1.00
tpch_q20/duckdb:vortex-file-compressed 164193775 164177580 1.00
tpch_q21/duckdb:vortex-file-compressed 562774579 567808240 0.99
tpch_q22/duckdb:vortex-file-compressed 77965928 77689078 1.00
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229142114 231419624 0.99
tpch_q02/duckdb:vortex-compact 58175498 61789700 0.94
tpch_q03/duckdb:vortex-compact 141208715 143589628 0.98
tpch_q04/duckdb:vortex-compact 179613141 177161725 1.01
tpch_q05/duckdb:vortex-compact 149725032 148777546 1.01
tpch_q06/duckdb:vortex-compact 85684422 83873402 1.02
tpch_q07/duckdb:vortex-compact 207440758 208385533 1.00
tpch_q08/duckdb:vortex-compact 192822957 197671320 0.98
tpch_q09/duckdb:vortex-compact 364000402 365031507 1.00
tpch_q10/duckdb:vortex-compact 190034621 189516961 1.00
tpch_q11/duckdb:vortex-compact 41898578 43249856 0.97
tpch_q12/duckdb:vortex-compact 209230282 208503869 1.00
tpch_q13/duckdb:vortex-compact 299316296 297432835 1.01
tpch_q14/duckdb:vortex-compact 105076310 103921081 1.01
tpch_q15/duckdb:vortex-compact 122344351 118886759 1.03
tpch_q16/duckdb:vortex-compact 86143375 84975669 1.01
tpch_q17/duckdb:vortex-compact 119549698 118171397 1.01
tpch_q18/duckdb:vortex-compact 295632388 298194883 0.99
tpch_q19/duckdb:vortex-compact 118007908 116365633 1.01
tpch_q20/duckdb:vortex-compact 209669180 209105850 1.00
tpch_q21/duckdb:vortex-compact 643986608 644988946 1.00
tpch_q22/duckdb:vortex-compact 88924592 90314790 0.98
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 262793052 259705039 1.01
tpch_q02/duckdb:parquet 106561538 106314737 1.00
tpch_q03/duckdb:parquet 213374485 215261832 0.99
tpch_q04/duckdb:parquet 136069072 134588746 1.01
tpch_q05/duckdb:parquet 222755493 221029558 1.01
tpch_q06/duckdb:parquet 67956180 65542655 1.04
tpch_q07/duckdb:parquet 181349252 181771284 1.00
tpch_q08/duckdb:parquet 258183348 254897917 1.01
tpch_q09/duckdb:parquet 472287947 452855160 1.04
tpch_q10/duckdb:parquet 606440985 604366875 1.00
tpch_q11/duckdb:parquet 42941397 42824064 1.00
tpch_q12/duckdb:parquet 124984104 127470063 0.98
tpch_q13/duckdb:parquet 464024109 443315179 1.05
tpch_q14/duckdb:parquet 174283889 192476885 0.91
tpch_q15/duckdb:parquet 97327006 98745937 0.99
tpch_q16/duckdb:parquet 163083639 164055115 0.99
tpch_q17/duckdb:parquet 182337317 179603755 1.02
tpch_q18/duckdb:parquet 347108647 348457618 1.00
tpch_q19/duckdb:parquet 282928261 275670731 1.03
tpch_q20/duckdb:parquet 232537437 229615093 1.01
tpch_q21/duckdb:parquet 571056303 569032867 1.00
tpch_q22/duckdb:parquet 292753719 290351236 1.01
duckdb / duckdb (1.000x ➖, 0↑ 1↓)
name PR 1bcc137 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117241354 116334091 1.01
tpch_q02/duckdb:duckdb 46640790 48336939 0.96
tpch_q03/duckdb:duckdb 96614866 95665868 1.01
tpch_q04/duckdb:duckdb 132060940 128811071 1.03
tpch_q05/duckdb:duckdb 110674684 109723266 1.01
tpch_q06/duckdb:duckdb 39423636 39859641 0.99
tpch_q07/duckdb:duckdb 86221289 86342236 1.00
tpch_q08/duckdb:duckdb 110254821 110000279 1.00
tpch_q09/duckdb:duckdb 275575594 277699292 0.99
tpch_q10/duckdb:duckdb 197795417 200044929 0.99
tpch_q11/duckdb:duckdb 15409541 15547946 0.99
tpch_q12/duckdb:duckdb 81585869 85066642 0.96
tpch_q13/duckdb:duckdb 246844300 246916391 1.00
tpch_q14/duckdb:duckdb 69742260 71753905 0.97
tpch_q15/duckdb:duckdb 78629590 79362098 0.99
tpch_q16/duckdb:duckdb 72465365 72372982 1.00
tpch_q17/duckdb:duckdb 84737270 84923227 1.00
tpch_q18/duckdb:duckdb 213573454 214915111 0.99
tpch_q19/duckdb:duckdb 115216042 114436967 1.01
tpch_q20/duckdb:duckdb 110664353 110530314 1.00
tpch_q21/duckdb:duckdb 305314110 306209354 1.00
tpch_q22/duckdb:duckdb 🚨 71226846 64181076 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +21.1% +1.5% +19.3% +12.4% 🚨 regression
1 datafusion:vortex-compact +6.4% +1.5% +4.8% +12.4% ➖ noise
1 datafusion:vortex-file-compressed +4.7% +1.5% +3.1% +12.5% ➖ noise
1 duckdb:duckdb +0.8% +1.5% -0.7% +12.4% ➖ noise
1 duckdb:vortex-compact -1.0% +1.5% -2.4% +12.4% ➖ noise
1 duckdb:vortex-file-compressed +0.4% +1.5% -1.1% +12.6% ➖ noise
2 datafusion:arrow +21.4% +15.9% +4.7% +12.4% ➖ noise
2 datafusion:vortex-compact +37.7% +15.9% +18.8% +12.4% 🚨 regression
2 datafusion:vortex-file-compressed +35.1% +15.9% +16.6% +12.4% 🚨 regression
2 duckdb:duckdb -3.5% +15.9% -16.7% +12.4% ✅ faster
2 duckdb:vortex-compact -5.8% +15.9% -18.8% +12.4% ✅ faster
2 duckdb:vortex-file-compressed -1.5% +15.9% -15.0% +12.4% ✅ faster
3 datafusion:arrow +18.7% +13.3% +4.8% +12.4% ➖ noise
3 datafusion:vortex-compact +20.5% +13.3% +6.4% +12.4% ➖ noise
3 datafusion:vortex-file-compressed +22.2% +13.3% +7.8% +12.4% ➖ noise
3 duckdb:duckdb +1.0% +13.3% -10.9% +12.4% ➖ noise
3 duckdb:vortex-compact -1.7% +13.3% -13.2% +12.4% ✅ faster
3 duckdb:vortex-file-compressed +0.5% +13.3% -11.3% +12.4% ✅ faster
4 datafusion:arrow +11.1% +6.4% +4.4% +12.4% ➖ noise
4 datafusion:vortex-compact +5.6% +6.4% -0.7% +12.4% ➖ noise
4 datafusion:vortex-file-compressed +6.9% +6.4% +0.5% +12.4% ➖ noise
4 duckdb:duckdb +2.5% +6.4% -3.6% +12.4% ➖ noise
4 duckdb:vortex-compact +1.4% +6.4% -4.7% +12.4% ➖ noise
4 duckdb:vortex-file-compressed -2.2% +6.4% -8.1% +12.4% ➖ noise
5 datafusion:arrow +12.8% +14.1% -1.1% +12.4% ➖ noise
5 datafusion:vortex-compact +20.6% +14.1% +5.7% +12.4% ➖ noise
5 datafusion:vortex-file-compressed +21.3% +14.1% +6.4% +12.4% ➖ noise
5 duckdb:duckdb +0.9% +14.1% -11.6% +12.4% ✅ faster
5 duckdb:vortex-compact +0.6% +14.1% -11.8% +12.4% ✅ faster
5 duckdb:vortex-file-compressed +0.1% +14.1% -12.3% +12.4% ✅ faster
6 datafusion:arrow +16.3% +9.1% +6.6% +12.4% ➖ noise
6 datafusion:vortex-compact +0.0% +9.1% -8.3% +12.4% ➖ noise
6 datafusion:vortex-file-compressed +1.7% +9.1% -6.8% +12.4% ➖ noise
6 duckdb:duckdb -1.1% +9.1% -9.3% +15.1% ➖ noise
6 duckdb:vortex-compact +2.2% +9.1% -6.4% +12.4% ➖ noise
6 duckdb:vortex-file-compressed +2.1% +9.1% -6.4% +12.4% ➖ noise
7 datafusion:arrow +19.5% +10.7% +8.0% +12.4% ➖ noise
7 datafusion:vortex-compact +14.8% +10.7% +3.7% +12.4% ➖ noise
7 datafusion:vortex-file-compressed +13.2% +10.7% +2.3% +12.4% ➖ noise
7 duckdb:duckdb -0.1% +10.7% -9.8% +12.4% ➖ noise
7 duckdb:vortex-compact -0.5% +10.7% -10.0% +12.4% ➖ noise
7 duckdb:vortex-file-compressed +1.5% +10.7% -8.3% +12.4% ➖ noise
8 datafusion:arrow +12.5% +15.1% -2.2% +12.4% ➖ noise
8 datafusion:vortex-compact +21.9% +15.1% +5.9% +12.4% ➖ noise
8 datafusion:vortex-file-compressed +24.8% +15.1% +8.4% +12.4% ➖ noise
8 duckdb:duckdb +0.2% +15.1% -12.9% +12.4% ✅ faster
8 duckdb:vortex-compact -2.5% +15.1% -15.3% +12.4% ✅ faster
8 duckdb:vortex-file-compressed -0.1% +15.1% -13.2% +12.4% ✅ faster
9 datafusion:arrow +15.9% +14.1% +1.6% +12.4% ➖ noise
9 datafusion:vortex-compact +20.5% +14.1% +5.6% +12.4% ➖ noise
9 datafusion:vortex-file-compressed +20.0% +14.1% +5.2% +12.4% ➖ noise
9 duckdb:duckdb -0.8% +14.1% -13.0% +12.4% ✅ faster
9 duckdb:vortex-compact -0.3% +14.1% -12.6% +12.4% ✅ faster
9 duckdb:vortex-file-compressed -0.8% +14.1% -13.1% +12.4% ✅ faster
10 datafusion:arrow +9.5% +9.4% +0.1% +12.4% ➖ noise
10 datafusion:vortex-compact +20.7% +9.4% +10.3% +12.4% ➖ noise
10 datafusion:vortex-file-compressed +21.7% +9.4% +11.3% +12.4% ➖ noise
10 duckdb:duckdb -1.1% +9.4% -9.6% +12.4% ➖ noise
10 duckdb:vortex-compact +0.3% +9.4% -8.4% +12.4% ➖ noise
10 duckdb:vortex-file-compressed +1.4% +9.4% -7.3% +12.4% ➖ noise
11 datafusion:arrow +16.1% +20.5% -3.7% +12.4% ➖ noise
11 datafusion:vortex-compact +32.5% +20.5% +9.9% +12.4% ➖ noise
11 datafusion:vortex-file-compressed +36.3% +20.5% +13.1% +12.4% 🚨 regression
11 duckdb:duckdb -0.9% +20.5% -17.8% +18.3% ✅ faster
11 duckdb:vortex-compact -3.1% +20.5% -19.6% +12.4% ✅ faster
11 duckdb:vortex-file-compressed +0.3% +20.5% -16.8% +12.4% ✅ faster
12 datafusion:arrow +13.9% +7.3% +6.1% +40.6% ➖ noise
12 datafusion:vortex-compact +6.0% +7.3% -1.2% +12.4% ➖ noise
12 datafusion:vortex-file-compressed +13.3% +7.3% +5.5% +12.4% ➖ noise
12 duckdb:duckdb -4.1% +7.3% -10.7% +12.4% ➖ noise
12 duckdb:vortex-compact +0.3% +7.3% -6.5% +12.4% ➖ noise
12 duckdb:vortex-file-compressed +0.9% +7.3% -6.0% +12.4% ➖ noise
13 datafusion:arrow -3.2% +1.7% -4.9% +12.4% ➖ noise
13 datafusion:vortex-compact -0.3% +1.7% -2.0% +12.4% ➖ noise
13 datafusion:vortex-file-compressed +1.9% +1.7% +0.2% +12.4% ➖ noise
13 duckdb:duckdb -0.0% +1.7% -1.7% +12.4% ➖ noise
13 duckdb:vortex-compact +0.6% +1.7% -1.1% +12.4% ➖ noise
13 duckdb:vortex-file-compressed -1.9% +1.7% -3.6% +12.4% ➖ noise
14 datafusion:arrow +14.5% +8.8% +5.2% +12.4% ➖ noise
14 datafusion:vortex-compact +17.9% +8.8% +8.4% +12.4% ➖ noise
14 datafusion:vortex-file-compressed +23.2% +8.8% +13.3% +12.4% 🚨 regression
14 duckdb:duckdb -2.8% +8.8% -10.7% +12.4% ➖ noise
14 duckdb:vortex-compact +1.1% +8.8% -7.1% +12.4% ➖ noise
14 duckdb:vortex-file-compressed -1.7% +8.8% -9.6% +12.4% ➖ noise
15 datafusion:arrow +16.0% +4.1% +11.4% +12.4% ➖ noise
15 datafusion:vortex-compact +0.2% +4.1% -3.8% +12.4% ➖ noise
15 datafusion:vortex-file-compressed -1.2% +4.1% -5.1% +12.4% ➖ noise
15 duckdb:duckdb -0.9% +4.1% -4.9% +12.4% ➖ noise
15 duckdb:vortex-compact +2.9% +4.1% -1.2% +12.4% ➖ noise
15 duckdb:vortex-file-compressed -0.1% +4.1% -4.0% +12.4% ➖ noise
16 datafusion:arrow +10.1% +14.3% -3.6% +12.4% ➖ noise
16 datafusion:vortex-compact +26.6% +14.3% +10.8% +12.4% ➖ noise
16 datafusion:vortex-file-compressed +20.0% +14.3% +5.0% +12.4% ➖ noise
16 duckdb:duckdb +0.1% +14.3% -12.4% +12.4% ✅ faster
16 duckdb:vortex-compact +1.4% +14.3% -11.3% +12.4% ✅ faster
16 duckdb:vortex-file-compressed +0.6% +14.3% -12.0% +12.4% ✅ faster
17 datafusion:arrow +16.9% +11.8% +4.5% +12.4% ➖ noise
17 datafusion:vortex-compact +14.3% +11.8% +2.2% +12.4% ➖ noise
17 datafusion:vortex-file-compressed +13.9% +11.8% +1.8% +12.4% ➖ noise
17 duckdb:duckdb -0.2% +11.8% -10.8% +12.4% ➖ noise
17 duckdb:vortex-compact +1.2% +11.8% -9.5% +12.4% ➖ noise
17 duckdb:vortex-file-compressed +1.7% +11.8% -9.1% +12.4% ➖ noise
18 datafusion:arrow +16.7% +7.0% +9.0% +12.4% ➖ noise
18 datafusion:vortex-compact +9.4% +7.0% +2.2% +12.4% ➖ noise
18 datafusion:vortex-file-compressed +10.4% +7.0% +3.2% +12.4% ➖ noise
18 duckdb:duckdb -0.6% +7.0% -7.2% +12.4% ➖ noise
18 duckdb:vortex-compact -0.9% +7.0% -7.4% +12.4% ➖ noise
18 duckdb:vortex-file-compressed +0.1% +7.0% -6.5% +12.4% ➖ noise
19 datafusion:arrow +18.1% +10.9% +6.5% +12.4% ➖ noise
19 datafusion:vortex-compact +15.8% +10.9% +4.5% +12.4% ➖ noise
19 datafusion:vortex-file-compressed +15.9% +10.9% +4.6% +12.4% ➖ noise
19 duckdb:duckdb +0.7% +10.9% -9.2% +12.4% ➖ noise
19 duckdb:vortex-compact +1.4% +10.9% -8.5% +12.4% ➖ noise
19 duckdb:vortex-file-compressed -0.2% +10.9% -10.0% +12.4% ➖ noise
20 datafusion:arrow +15.2% +10.0% +4.7% +12.4% ➖ noise
20 datafusion:vortex-compact +14.0% +10.0% +3.6% +12.4% ➖ noise
20 datafusion:vortex-file-compressed +15.3% +10.0% +4.8% +12.4% ➖ noise
20 duckdb:duckdb +0.1% +10.0% -9.0% +12.4% ➖ noise
20 duckdb:vortex-compact +0.3% +10.0% -8.9% +12.4% ➖ noise
20 duckdb:vortex-file-compressed +0.0% +10.0% -9.1% +12.4% ➖ noise
21 datafusion:arrow +38.5% +9.9% +26.0% +12.4% 🚨 regression
21 datafusion:vortex-compact +13.8% +9.9% +3.6% +12.4% ➖ noise
21 datafusion:vortex-file-compressed +14.2% +9.9% +3.9% +12.4% ➖ noise
21 duckdb:duckdb -0.3% +9.9% -9.3% +12.4% ➖ noise
21 duckdb:vortex-compact -0.2% +9.9% -9.2% +12.4% ➖ noise
21 duckdb:vortex-file-compressed -0.9% +9.9% -9.8% +12.4% ➖ noise
22 datafusion:arrow +22.2% +1.6% +20.3% +12.4% 🚨 regression
22 datafusion:vortex-compact -3.2% +1.6% -4.7% +12.4% ➖ noise
22 datafusion:vortex-file-compressed -2.9% +1.6% -4.4% +12.4% ➖ noise
22 duckdb:duckdb +11.0% +1.6% +9.3% +12.4% ➖ noise
22 duckdb:vortex-compact -1.5% +1.6% -3.1% +12.4% ➖ noise
22 duckdb:vortex-file-compressed +0.4% +1.6% -1.2% +12.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.7%
Vortex (geomean): 0.954x ➖
Parquet (geomean): 1.045x ➖
Shifts: Parquet (control) +4.5% · Median polish -1.8%


datafusion / vortex-file-compressed (0.902x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 195698352 192620899 1.02
tpch_q02/datafusion:vortex-file-compressed 439790009 502804692 0.87
tpch_q03/datafusion:vortex-file-compressed 388105709 470280389 0.83
tpch_q04/datafusion:vortex-file-compressed 204115260 281479661 0.73
tpch_q05/datafusion:vortex-file-compressed 413128117 477557153 0.87
tpch_q06/datafusion:vortex-file-compressed 355995999 335580972 1.06
tpch_q07/datafusion:vortex-file-compressed 542180996 516312823 1.05
tpch_q08/datafusion:vortex-file-compressed 623789406 613525671 1.02
tpch_q09/datafusion:vortex-file-compressed 501967827 660513166 0.76
tpch_q10/datafusion:vortex-file-compressed 493678547 644967453 0.77
tpch_q11/datafusion:vortex-file-compressed 340279755 296619016 1.15
tpch_q12/datafusion:vortex-file-compressed 386919271 473793384 0.82
tpch_q13/datafusion:vortex-file-compressed 221772871 219271820 1.01
tpch_q14/datafusion:vortex-file-compressed 196804578 217186155 0.91
tpch_q15/datafusion:vortex-file-compressed 285151789 372667069 0.77
tpch_q16/datafusion:vortex-file-compressed 205977906 199126380 1.03
tpch_q17/datafusion:vortex-file-compressed 403517616 484858617 0.83
tpch_q18/datafusion:vortex-file-compressed 288694127 315500677 0.92
tpch_q19/datafusion:vortex-file-compressed 400018614 458712580 0.87
tpch_q20/datafusion:vortex-file-compressed 443268817 520988501 0.85
tpch_q21/datafusion:vortex-file-compressed 560411190 645087302 0.87
tpch_q22/datafusion:vortex-file-compressed 210434689 206285150 1.02
datafusion / vortex-compact (0.946x ➖, 2↑ 3↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 256911536 261384341 0.98
tpch_q02/datafusion:vortex-compact 🚨 697075303 505443382 1.38
tpch_q03/datafusion:vortex-compact 🚨 551032608 315819662 1.74
tpch_q04/datafusion:vortex-compact 🚨 396573032 230296993 1.72
tpch_q05/datafusion:vortex-compact 382439987 479680581 0.80
tpch_q06/datafusion:vortex-compact 348781226 469966956 0.74
tpch_q07/datafusion:vortex-compact 🚀 405216711 579872881 0.70
tpch_q08/datafusion:vortex-compact 606508232 507833279 1.19
tpch_q09/datafusion:vortex-compact 511059235 545569855 0.94
tpch_q10/datafusion:vortex-compact 524599791 674417261 0.78
tpch_q11/datafusion:vortex-compact 🚀 248700642 385838736 0.64
tpch_q12/datafusion:vortex-compact 442636107 455915915 0.97
tpch_q13/datafusion:vortex-compact 210233017 244435616 0.86
tpch_q14/datafusion:vortex-compact 316227576 369812529 0.86
tpch_q15/datafusion:vortex-compact 469432611 657409502 0.71
tpch_q16/datafusion:vortex-compact 179942466 193803573 0.93
tpch_q17/datafusion:vortex-compact 372735687 374053420 1.00
tpch_q18/datafusion:vortex-compact 297543139 374413895 0.79
tpch_q19/datafusion:vortex-compact 388923809 450298104 0.86
tpch_q20/datafusion:vortex-compact 451508619 477059284 0.95
tpch_q21/datafusion:vortex-compact 524519241 543832515 0.96
tpch_q22/datafusion:vortex-compact 123295905 115595253 1.07
datafusion / parquet (1.086x ➖, 0↑ 3↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 305978126 225089397 1.36
tpch_q02/datafusion:parquet 549286836 447168944 1.23
tpch_q03/datafusion:parquet 390518508 309370467 1.26
tpch_q04/datafusion:parquet 🚨 194276578 146643342 1.32
tpch_q05/datafusion:parquet 651322756 518500712 1.26
tpch_q06/datafusion:parquet 166267342 149160076 1.11
tpch_q07/datafusion:parquet 615532571 553292006 1.11
tpch_q08/datafusion:parquet 635091350 703373949 0.90
tpch_q09/datafusion:parquet 576151420 557271174 1.03
tpch_q10/datafusion:parquet 592648614 655580109 0.90
tpch_q11/datafusion:parquet 🚨 508617390 369137670 1.38
tpch_q12/datafusion:parquet 331988719 269425078 1.23
tpch_q13/datafusion:parquet 443147279 432196950 1.03
tpch_q14/datafusion:parquet 259014307 214096922 1.21
tpch_q15/datafusion:parquet 313269313 372584684 0.84
tpch_q16/datafusion:parquet 199303570 175119415 1.14
tpch_q17/datafusion:parquet 509840573 545051655 0.94
tpch_q18/datafusion:parquet 556805819 730933654 0.76
tpch_q19/datafusion:parquet 405740945 419780477 0.97
tpch_q20/datafusion:parquet 459683760 406401101 1.13
tpch_q21/datafusion:parquet 686999704 653162300 1.05
tpch_q22/datafusion:parquet 131321584 129305516 1.02
duckdb / vortex-file-compressed (0.972x ➖, 0↑ 1↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 257964623 302126889 0.85
tpch_q02/duckdb:vortex-file-compressed 906894940 916021981 0.99
tpch_q03/duckdb:vortex-file-compressed 550240295 672548998 0.82
tpch_q04/duckdb:vortex-file-compressed 387515544 459804065 0.84
tpch_q05/duckdb:vortex-file-compressed 857052428 1172166157 0.73
tpch_q06/duckdb:vortex-file-compressed 499316500 384305774 1.30
tpch_q07/duckdb:vortex-file-compressed 793652849 759815715 1.04
tpch_q08/duckdb:vortex-file-compressed 895635970 920585559 0.97
tpch_q09/duckdb:vortex-file-compressed 970171257 930568144 1.04
tpch_q10/duckdb:vortex-file-compressed 727020686 753634398 0.96
tpch_q11/duckdb:vortex-file-compressed 481390106 519199467 0.93
tpch_q12/duckdb:vortex-file-compressed 467347888 585251839 0.80
tpch_q13/duckdb:vortex-file-compressed 489675482 454573334 1.08
tpch_q14/duckdb:vortex-file-compressed 🚨 561282447 426145802 1.32
tpch_q15/duckdb:vortex-file-compressed 290008938 266708825 1.09
tpch_q16/duckdb:vortex-file-compressed 339663033 334317840 1.02
tpch_q17/duckdb:vortex-file-compressed 576700866 729356765 0.79
tpch_q18/duckdb:vortex-file-compressed 525322979 544081741 0.97
tpch_q19/duckdb:vortex-file-compressed 421388405 467249780 0.90
tpch_q20/duckdb:vortex-file-compressed 893232747 815302836 1.10
tpch_q21/duckdb:vortex-file-compressed 1101530532 1129934550 0.97
tpch_q22/duckdb:vortex-file-compressed 377880715 341477316 1.11
duckdb / vortex-compact (0.999x ➖, 0↑ 1↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 364309733 276745513 1.32
tpch_q02/duckdb:vortex-compact 940705823 952731022 0.99
tpch_q03/duckdb:vortex-compact 585831054 507428568 1.15
tpch_q04/duckdb:vortex-compact 342560697 382669380 0.90
tpch_q05/duckdb:vortex-compact 899663360 898425417 1.00
tpch_q06/duckdb:vortex-compact 399407022 431568674 0.93
tpch_q07/duckdb:vortex-compact 633398168 679437487 0.93
tpch_q08/duckdb:vortex-compact 870168124 828969799 1.05
tpch_q09/duckdb:vortex-compact 838985382 963811553 0.87
tpch_q10/duckdb:vortex-compact 661551658 713614632 0.93
tpch_q11/duckdb:vortex-compact 537857713 502856949 1.07
tpch_q12/duckdb:vortex-compact 419512681 422285541 0.99
tpch_q13/duckdb:vortex-compact 439688830 465871752 0.94
tpch_q14/duckdb:vortex-compact 473529304 402322046 1.18
tpch_q15/duckdb:vortex-compact 280223956 322216618 0.87
tpch_q16/duckdb:vortex-compact 327678934 317329046 1.03
tpch_q17/duckdb:vortex-compact 814872651 663557273 1.23
tpch_q18/duckdb:vortex-compact 517964631 508604164 1.02
tpch_q19/duckdb:vortex-compact 414714722 477211833 0.87
tpch_q20/duckdb:vortex-compact 800825103 903237951 0.89
tpch_q21/duckdb:vortex-compact 1151587108 1061045727 1.09
tpch_q22/duckdb:vortex-compact 345937120 381316096 0.91
duckdb / parquet (1.005x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 535405366 715581185 0.75
tpch_q02/duckdb:parquet 1463539112 1342849037 1.09
tpch_q03/duckdb:parquet 1324042458 1068733973 1.24
tpch_q04/duckdb:parquet 770677325 648329848 1.19
tpch_q05/duckdb:parquet 1606322162 1550259666 1.04
tpch_q06/duckdb:parquet 381144613 417074748 0.91
tpch_q07/duckdb:parquet 1207317692 1259049619 0.96
tpch_q08/duckdb:parquet 1900739426 1593448255 1.19
tpch_q09/duckdb:parquet 1297767933 1365755040 0.95
tpch_q10/duckdb:parquet 1398236695 1559155999 0.90
tpch_q11/duckdb:parquet 853149938 852672640 1.00
tpch_q12/duckdb:parquet 642198352 611656617 1.05
tpch_q13/duckdb:parquet 930342256 941300602 0.99
tpch_q14/duckdb:parquet 723155879 673676323 1.07
tpch_q15/duckdb:parquet 566394719 605502407 0.94
tpch_q16/duckdb:parquet 543514470 544386836 1.00
tpch_q17/duckdb:parquet 774932817 739930849 1.05
tpch_q18/duckdb:parquet 830396999 819413366 1.01
tpch_q19/duckdb:parquet 776854519 748419144 1.04
tpch_q20/duckdb:parquet 1051263119 1107811487 0.95
tpch_q21/duckdb:parquet 1317226326 1367065614 0.96
tpch_q22/duckdb:parquet 527983883 546576310 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.7% +0.9% -2.5% +189.3% ➖ noise
1 datafusion:vortex-file-compressed +1.6% +0.9% +0.7% +174.7% ➖ noise
1 duckdb:vortex-compact +31.6% +0.9% +30.5% +59.9% ➖ noise
1 duckdb:vortex-file-compressed -14.6% +0.9% -15.3% +63.6% ➖ noise
2 datafusion:vortex-compact +37.9% +15.7% +19.2% +47.1% ➖ noise
2 datafusion:vortex-file-compressed -12.5% +15.7% -24.4% +35.4% ➖ noise
2 duckdb:vortex-compact -1.3% +15.7% -14.7% +35.1% ➖ noise
2 duckdb:vortex-file-compressed -1.0% +15.7% -14.4% +30.0% ➖ noise
3 datafusion:vortex-compact +74.5% +25.1% +39.5% +86.0% ➖ noise
3 datafusion:vortex-file-compressed -17.5% +25.1% -34.0% +77.1% ➖ noise
3 duckdb:vortex-compact +15.5% +25.1% -7.7% +40.9% ➖ noise
3 duckdb:vortex-file-compressed -18.2% +25.1% -34.6% +40.8% ✅ faster
4 datafusion:vortex-compact +72.2% +25.5% +37.2% +71.0% ➖ noise
4 datafusion:vortex-file-compressed -27.5% +25.5% -42.2% +33.2% ✅ faster
4 duckdb:vortex-compact -10.5% +25.5% -28.7% +30.0% ✅ faster
4 duckdb:vortex-file-compressed -15.7% +25.5% -32.8% +36.2% ✅ faster
5 datafusion:vortex-compact -20.3% +14.1% -30.1% +44.6% ➖ noise
5 datafusion:vortex-file-compressed -13.5% +14.1% -24.2% +30.0% ✅ faster
5 duckdb:vortex-compact +0.1% +14.1% -12.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -26.9% +14.1% -35.9% +63.1% ➖ noise
6 datafusion:vortex-compact -25.8% +0.9% -26.5% +30.0% ✅ faster
6 datafusion:vortex-file-compressed +6.1% +0.9% +5.1% +38.7% ➖ noise
6 duckdb:vortex-compact -7.5% +0.9% -8.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +29.9% +0.9% +28.7% +60.0% ➖ noise
7 datafusion:vortex-compact -30.1% +3.3% -32.3% +52.2% ➖ noise
7 datafusion:vortex-file-compressed +5.0% +3.3% +1.7% +30.0% ➖ noise
7 duckdb:vortex-compact -6.8% +3.3% -9.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +4.5% +3.3% +1.1% +30.0% ➖ noise
8 datafusion:vortex-compact +19.4% +3.8% +15.1% +62.2% ➖ noise
8 datafusion:vortex-file-compressed +1.7% +3.8% -2.0% +45.2% ➖ noise
8 duckdb:vortex-compact +5.0% +3.8% +1.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -2.7% +3.8% -6.3% +30.0% ➖ noise
9 datafusion:vortex-compact -6.3% -0.9% -5.5% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -24.0% -0.9% -23.3% +32.9% ➖ noise
9 duckdb:vortex-compact -13.0% -0.9% -12.2% +38.7% ➖ noise
9 duckdb:vortex-file-compressed +4.3% -0.9% +5.2% +37.7% ➖ noise
10 datafusion:vortex-compact -22.2% -10.0% -13.6% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -23.5% -10.0% -15.0% +33.1% ➖ noise
10 duckdb:vortex-compact -7.3% -10.0% +3.0% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -3.5% -10.0% +7.1% +30.0% ➖ noise
11 datafusion:vortex-compact -35.5% +17.4% -45.1% +30.0% ✅ faster
11 datafusion:vortex-file-compressed +14.7% +17.4% -2.3% +45.3% ➖ noise
11 duckdb:vortex-compact +7.0% +17.4% -8.9% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -7.3% +17.4% -21.0% +30.0% ➖ noise
12 datafusion:vortex-compact -2.9% +13.7% -14.6% +40.0% ➖ noise
12 datafusion:vortex-file-compressed -18.3% +13.7% -28.2% +30.0% ✅ faster
12 duckdb:vortex-compact -0.7% +13.7% -12.7% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -20.1% +13.7% -29.8% +64.6% ➖ noise
13 datafusion:vortex-compact -14.0% +0.7% -14.6% +71.7% ➖ noise
13 datafusion:vortex-file-compressed +1.1% +0.7% +0.5% +63.7% ➖ noise
13 duckdb:vortex-compact -5.6% +0.7% -6.2% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +7.7% +0.7% +7.0% +58.9% ➖ noise
14 datafusion:vortex-compact -14.5% +14.0% -25.0% +51.7% ➖ noise
14 datafusion:vortex-file-compressed -9.4% +14.0% -20.5% +72.9% ➖ noise
14 duckdb:vortex-compact +17.7% +14.0% +3.3% +51.4% ➖ noise
14 duckdb:vortex-file-compressed +31.7% +14.0% +15.6% +62.1% ➖ noise
15 datafusion:vortex-compact -28.6% -11.3% -19.5% +39.6% ➖ noise
15 datafusion:vortex-file-compressed -23.5% -11.3% -13.7% +59.8% ➖ noise
15 duckdb:vortex-compact -13.0% -11.3% -1.9% +45.5% ➖ noise
15 duckdb:vortex-file-compressed +8.7% -11.3% +22.6% +63.2% ➖ noise
16 datafusion:vortex-compact -7.2% +6.6% -12.9% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +3.4% +6.6% -3.0% +51.8% ➖ noise
16 duckdb:vortex-compact +3.3% +6.6% -3.1% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +1.6% +6.6% -4.7% +30.0% ➖ noise
17 datafusion:vortex-compact -0.4% -1.0% +0.7% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -16.8% -1.0% -15.9% +66.5% ➖ noise
17 duckdb:vortex-compact +22.8% -1.0% +24.1% +30.6% ➖ noise
17 duckdb:vortex-file-compressed -20.9% -1.0% -20.1% +30.0% ➖ noise
18 datafusion:vortex-compact -20.5% -12.1% -9.6% +32.5% ➖ noise
18 datafusion:vortex-file-compressed -8.5% -12.1% +4.1% +30.0% ➖ noise
18 duckdb:vortex-compact +1.8% -12.1% +15.9% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -3.4% -12.1% +9.9% +30.0% ➖ noise
19 datafusion:vortex-compact -13.6% +0.2% -13.8% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -12.8% +0.2% -12.9% +30.0% ➖ noise
19 duckdb:vortex-compact -13.1% +0.2% -13.2% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -9.8% +0.2% -10.0% +30.4% ➖ noise
20 datafusion:vortex-compact -5.4% +3.6% -8.6% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -14.9% +3.6% -17.9% +34.1% ➖ noise
20 duckdb:vortex-compact -11.3% +3.6% -14.4% +68.7% ➖ noise
20 duckdb:vortex-file-compressed +9.6% +3.6% +5.7% +30.0% ➖ noise
21 datafusion:vortex-compact -3.6% +0.7% -4.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -13.1% +0.7% -13.7% +32.5% ➖ noise
21 duckdb:vortex-compact +8.5% +0.7% +7.8% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.5% +0.7% -3.2% +30.0% ➖ noise
22 datafusion:vortex-compact +6.7% -1.0% +7.7% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +2.0% -1.0% +3.0% +39.4% ➖ noise
22 duckdb:vortex-compact -9.3% -1.0% -8.4% +35.9% ➖ noise
22 duckdb:vortex-file-compressed +10.7% -1.0% +11.7% +66.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.5%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.958x ➖
Shifts: Parquet (control) -4.2% · Median polish -2.7%


datafusion / vortex-file-compressed (0.959x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 38468708 46066666 0.84
fineweb_q01/datafusion:vortex-file-compressed 562833182 548995321 1.03
fineweb_q02/datafusion:vortex-file-compressed 516167316 520852197 0.99
fineweb_q03/datafusion:vortex-file-compressed 1383645973 1418227902 0.98
fineweb_q04/datafusion:vortex-file-compressed 1366043765 1404607519 0.97
fineweb_q05/datafusion:vortex-file-compressed 1337538297 1341456609 1.00
fineweb_q06/datafusion:vortex-file-compressed 1499708797 1625700203 0.92
fineweb_q07/datafusion:vortex-file-compressed 1348089873 1402370325 0.96
fineweb_q08/datafusion:vortex-file-compressed 524814964 545653492 0.96
datafusion / vortex-compact (0.862x ➖, 2↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 39439676 35896530 1.10
fineweb_q01/datafusion:vortex-compact 🚀 514985623 1126740437 0.46
fineweb_q02/datafusion:vortex-compact 🚀 664741425 1281400282 0.52
fineweb_q03/datafusion:vortex-compact 1870044935 1820668422 1.03
fineweb_q04/datafusion:vortex-compact 2251517585 2232146249 1.01
fineweb_q05/datafusion:vortex-compact 1732433610 1695950594 1.02
fineweb_q06/datafusion:vortex-compact 1443252833 1447862290 1.00
fineweb_q07/datafusion:vortex-compact 1305257660 1363380888 0.96
fineweb_q08/datafusion:vortex-compact 389845225 391413111 1.00
datafusion / parquet (0.927x ➖, 1↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 1098224919 1664731770 0.66
fineweb_q01/datafusion:parquet 1950320491 2130356459 0.92
fineweb_q02/datafusion:parquet 1717212488 1919016929 0.89
fineweb_q03/datafusion:parquet 1891129348 1785418626 1.06
fineweb_q04/datafusion:parquet 1873207108 1778841885 1.05
fineweb_q05/datafusion:parquet 2047105046 1971544184 1.04
fineweb_q06/datafusion:parquet 1792690642 1919373880 0.93
fineweb_q07/datafusion:parquet 1900947516 2434878152 0.78
fineweb_q08/datafusion:parquet 1912767819 1720466755 1.11
duckdb / vortex-file-compressed (1.054x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 101269008 105711532 0.96
fineweb_q01/duckdb:vortex-file-compressed 526491031 572358991 0.92
fineweb_q02/duckdb:vortex-file-compressed 460813622 433802964 1.06
fineweb_q03/duckdb:vortex-file-compressed 1751327998 1434645939 1.22
fineweb_q04/duckdb:vortex-file-compressed 1801895608 1490257908 1.21
fineweb_q05/duckdb:vortex-file-compressed 1641192350 1457875279 1.13
fineweb_q06/duckdb:vortex-file-compressed 1802674618 1651616785 1.09
fineweb_q07/duckdb:vortex-file-compressed 1600840479 1744149802 0.92
fineweb_q08/duckdb:vortex-file-compressed 694001950 675932017 1.03
duckdb / vortex-compact (1.025x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 109082262 97394823 1.12
fineweb_q01/duckdb:vortex-compact 629403601 584411619 1.08
fineweb_q02/duckdb:vortex-compact 599137515 554350185 1.08
fineweb_q03/duckdb:vortex-compact 1626358810 1720928980 0.95
fineweb_q04/duckdb:vortex-compact 1715851117 1721000298 1.00
fineweb_q05/duckdb:vortex-compact 1456227817 1488387328 0.98
fineweb_q06/duckdb:vortex-compact 1423334782 1505646376 0.95
fineweb_q07/duckdb:vortex-compact 1321248681 1334772901 0.99
fineweb_q08/duckdb:vortex-compact 515245593 462509176 1.11
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1083294994 1087038536 1.00
fineweb_q01/duckdb:parquet 1626082960 1641684485 0.99
fineweb_q02/duckdb:parquet 1582965658 1702774974 0.93
fineweb_q03/duckdb:parquet 4255885607 4434711081 0.96
fineweb_q04/duckdb:parquet 1831537372 1794123108 1.02
fineweb_q05/duckdb:parquet 2772954635 2580310057 1.07
fineweb_q06/duckdb:parquet 3411090853 3475226953 0.98
fineweb_q07/duckdb:parquet 3988906435 4292555858 0.93
fineweb_q08/duckdb:parquet 1116344445 1079720705 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +9.9% -18.9% +35.5% +202.7% ➖ noise
0 datafusion:vortex-file-compressed -16.5% -18.9% +3.0% +193.3% ➖ noise
0 duckdb:vortex-compact +12.0% -18.9% +38.1% +44.4% ➖ noise
0 duckdb:vortex-file-compressed -4.2% -18.9% +18.1% +39.6% ➖ noise
1 datafusion:vortex-compact -54.3% -4.8% -52.0% +49.8% ✅ faster
1 datafusion:vortex-file-compressed +2.5% -4.8% +7.7% +94.8% ➖ noise
1 duckdb:vortex-compact +7.7% -4.8% +13.1% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -8.0% -4.8% -3.4% +30.0% ➖ noise
2 datafusion:vortex-compact -48.1% -8.8% -43.1% +39.6% ✅ faster
2 datafusion:vortex-file-compressed -0.9% -8.8% +8.7% +53.7% ➖ noise
2 duckdb:vortex-compact +8.1% -8.8% +18.5% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +6.2% -8.8% +16.5% +30.0% ➖ noise
3 datafusion:vortex-compact +2.7% +0.8% +1.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -2.4% +0.8% -3.2% +30.0% ➖ noise
3 duckdb:vortex-compact -5.5% +0.8% -6.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +22.1% +0.8% +21.1% +30.0% ➖ noise
4 datafusion:vortex-compact +0.9% +3.7% -2.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -2.7% +3.7% -6.2% +30.0% ➖ noise
4 duckdb:vortex-compact -0.3% +3.7% -3.8% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +20.9% +3.7% +16.6% +30.0% ➖ noise
5 datafusion:vortex-compact +2.2% +5.6% -3.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.3% +5.6% -5.6% +30.0% ➖ noise
5 duckdb:vortex-compact -2.2% +5.6% -7.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +12.6% +5.6% +6.6% +30.0% ➖ noise
6 datafusion:vortex-compact -0.3% -4.3% +4.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -7.7% -4.3% -3.7% +30.0% ➖ noise
6 duckdb:vortex-compact -5.5% -4.3% -1.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +9.1% -4.3% +14.0% +30.0% ➖ noise
7 datafusion:vortex-compact -4.3% -14.8% +12.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -3.9% -14.8% +12.9% +30.0% ➖ noise
7 duckdb:vortex-compact -1.0% -14.8% +16.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -8.2% -14.8% +7.8% +30.0% ➖ noise
8 datafusion:vortex-compact -0.4% +7.2% -7.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -3.8% +7.2% -10.3% +30.0% ➖ noise
8 duckdb:vortex-compact +11.4% +7.2% +3.9% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +2.7% +7.2% -4.2% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Vortex (geomean): 1.028x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +1.4%


duckdb / vortex-file-compressed (1.018x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11427759 10650026 1.07
statpopgen_q01/duckdb:vortex-file-compressed 19360372 18804686 1.03
statpopgen_q02/duckdb:vortex-file-compressed 1302765841 1302527283 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3045883242 3128643245 0.97
statpopgen_q04/duckdb:vortex-file-compressed 3114999370 3073008041 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1397810752 1399045540 1.00
statpopgen_q06/duckdb:vortex-file-compressed 2047681385 2048236687 1.00
statpopgen_q07/duckdb:vortex-file-compressed 202232905 189001357 1.07
statpopgen_q08/duckdb:vortex-file-compressed 216718909 210653304 1.03
statpopgen_q09/duckdb:vortex-file-compressed 2857976436 2823203249 1.01
statpopgen_q10/duckdb:vortex-file-compressed 4638525845 4613101837 1.01
duckdb / vortex-compact (1.038x ➖, 0↑ 1↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10883300 10634381 1.02
statpopgen_q01/duckdb:vortex-compact 🚨 170166635 124572621 1.37
statpopgen_q02/duckdb:vortex-compact 1827666686 1812079901 1.01
statpopgen_q03/duckdb:vortex-compact 3441975826 3477677558 0.99
statpopgen_q04/duckdb:vortex-compact 3540502883 3489208741 1.01
statpopgen_q05/duckdb:vortex-compact 1827286067 1794461705 1.02
statpopgen_q06/duckdb:vortex-compact 2689814549 2656376169 1.01
statpopgen_q07/duckdb:vortex-compact 960867868 955967225 1.01
statpopgen_q08/duckdb:vortex-compact 1002574299 989639263 1.01
statpopgen_q09/duckdb:vortex-compact 3317467575 3290657713 1.01
statpopgen_q10/duckdb:vortex-compact 5357757283 5309059680 1.01
duckdb / parquet (1.013x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 318163741 312816594 1.02
statpopgen_q01/duckdb:parquet 404638775 391682971 1.03
statpopgen_q02/duckdb:parquet 987085148 991913359 1.00
statpopgen_q03/duckdb:parquet 1495447791 1483972861 1.01
statpopgen_q04/duckdb:parquet 1515892648 1520752942 1.00
statpopgen_q05/duckdb:parquet 1011729500 990404737 1.02
statpopgen_q06/duckdb:parquet 1485557713 1473747930 1.01
statpopgen_q07/duckdb:parquet 1904777208 1856794915 1.03
statpopgen_q08/duckdb:parquet 1894876853 1864641263 1.02
statpopgen_q09/duckdb:parquet 1378414744 1382415785 1.00
statpopgen_q10/duckdb:parquet 2692071784 2628801836 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +2.3% +1.7% +0.6% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +7.3% +1.7% +5.5% +10.0% ➖ noise
1 duckdb:vortex-compact +36.6% +3.3% +32.2% +33.8% ➖ noise
1 duckdb:vortex-file-compressed +3.0% +3.3% -0.3% +212.1% ➖ noise
2 duckdb:vortex-compact +0.9% -0.5% +1.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.0% -0.5% +0.5% +10.0% ➖ noise
3 duckdb:vortex-compact -1.0% +0.8% -1.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.6% +0.8% -3.4% +10.0% ➖ noise
4 duckdb:vortex-compact +1.5% -0.3% +1.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.4% -0.3% +1.7% +10.0% ➖ noise
5 duckdb:vortex-compact +1.8% +2.2% -0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.1% +2.2% -2.2% +10.0% ➖ noise
6 duckdb:vortex-compact +1.3% +0.8% +0.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.0% +0.8% -0.8% +10.0% ➖ noise
7 duckdb:vortex-compact +0.5% +2.6% -2.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +7.0% +2.6% +4.3% +10.0% ➖ noise
8 duckdb:vortex-compact +1.3% +1.6% -0.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.9% +1.6% +1.2% +10.0% ➖ noise
9 duckdb:vortex-compact +0.8% -0.3% +1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.2% -0.3% +1.5% +10.0% ➖ noise
10 duckdb:vortex-compact +0.9% +2.4% -1.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.6% +2.4% -1.8% +10.0% ➖ noise

@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Mar 26, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: Random Access

Vortex (geomean): 0.910x ➖
Parquet (geomean): 1.042x ➖


unknown / unknown (1.010x ➖, 7↑ 11↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 3114694 2975109 1.05
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1405272 1278587 1.10
random-access/feature-vectors/correlated/parquet-tokio-local-disk 14126825166 13892328826 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13560370787 13537343309 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7678760 7821779 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6062636 6163860 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚨 1652832 1438639 1.15
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚨 2642699 2330084 1.13
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13500179772 13564946909 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13509302399 13552792713 1.00
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13178264 13595739 0.97
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13342511 13781556 0.97
random-access/lance-tokio-local-disk 787094 744179 1.06
random-access/lance-tokio-local-disk-footer 1454193 1348136 1.08
random-access/nested-lists/correlated/lance-tokio-local-disk 276213 269732 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 779256 714379 1.09
random-access/nested-lists/correlated/parquet-tokio-local-disk 165632637 157846209 1.05
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 165356651 161137337 1.03
random-access/nested-lists/correlated/vortex-tokio-local-disk 727842 692681 1.05
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 725518 894710 0.81
random-access/nested-lists/uniform/lance-tokio-local-disk 🚨 1263583 1142086 1.11
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚨 1811984 1625645 1.11
random-access/nested-lists/uniform/parquet-tokio-local-disk 165998156 157441626 1.05
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 165999816 157441089 1.05
random-access/nested-lists/uniform/vortex-tokio-local-disk 2394548 2324176 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2519035 2517753 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk 455358 430404 1.06
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 682980 641234 1.07
random-access/nested-structs/correlated/parquet-tokio-local-disk 28916803 26324161 1.10
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 28694225 25766094 1.11
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚨 941210 848412 1.11
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 926680 890113 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk 🚨 3072732 2742883 1.12
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚨 3333793 2991113 1.11
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 28785725 25614488 1.12
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 28564929 25569477 1.12
random-access/nested-structs/uniform/vortex-tokio-local-disk 1818089 1737612 1.05
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1807869 1732049 1.04
random-access/parquet-tokio-local-disk 191293508 186429004 1.03
random-access/parquet-tokio-local-disk-footer 190832544 185513361 1.03
random-access/taxi/correlated/lance-tokio-local-disk 1025739 970366 1.06
random-access/taxi/correlated/lance-tokio-local-disk-footer 1779735 1657276 1.07
random-access/taxi/correlated/parquet-tokio-local-disk 287317224 279483523 1.03
random-access/taxi/correlated/parquet-tokio-local-disk-footer 282890038 284263822 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1695993 2540881 0.67
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1785792 2500115 0.71
random-access/taxi/uniform/lance-tokio-local-disk 🚨 9182883 8317164 1.10
random-access/taxi/uniform/lance-tokio-local-disk-footer 9848925 8998396 1.09
random-access/taxi/uniform/parquet-tokio-local-disk 302282529 295218820 1.02
random-access/taxi/uniform/parquet-tokio-local-disk-footer 301463224 297671943 1.01
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4524291 5308458 0.85
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4549258 5316864 0.86
random-access/vortex-tokio-local-disk 🚀 1268870 1739440 0.73
random-access/vortex-tokio-local-disk-footer 🚀 1290600 1797700 0.72

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.3%
Vortex (geomean): 1.025x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish +1.7%


datafusion / vortex-file-compressed (1.013x ➖, 2↑ 5↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 769660552 917905241 0.84
tpch_q02/datafusion:vortex-file-compressed 909177106 930641226 0.98
tpch_q03/datafusion:vortex-file-compressed 890288116 887965199 1.00
tpch_q04/datafusion:vortex-file-compressed 611638823 638899242 0.96
tpch_q05/datafusion:vortex-file-compressed 🚀 1074093637 1618796753 0.66
tpch_q06/datafusion:vortex-file-compressed 🚀 632934223 1821405964 0.35
tpch_q07/datafusion:vortex-file-compressed 1293786918 1676795026 0.77
tpch_q08/datafusion:vortex-file-compressed 1411051062 1342999644 1.05
tpch_q09/datafusion:vortex-file-compressed 1541353953 1815895672 0.85
tpch_q10/datafusion:vortex-file-compressed 🚨 1300862781 977995611 1.33
tpch_q11/datafusion:vortex-file-compressed 🚨 699267935 466445956 1.50
tpch_q12/datafusion:vortex-file-compressed 1013747427 913745356 1.11
tpch_q13/datafusion:vortex-file-compressed 452274377 442281921 1.02
tpch_q14/datafusion:vortex-file-compressed 684337186 598646262 1.14
tpch_q15/datafusion:vortex-file-compressed 1113890225 1176460986 0.95
tpch_q16/datafusion:vortex-file-compressed 🚨 475317105 339056565 1.40
tpch_q17/datafusion:vortex-file-compressed 1384666236 1184861896 1.17
tpch_q18/datafusion:vortex-file-compressed 🚨 1816487248 1355752347 1.34
tpch_q19/datafusion:vortex-file-compressed 🚨 1114931933 749722982 1.49
tpch_q20/datafusion:vortex-file-compressed 1177862262 925695585 1.27
tpch_q21/datafusion:vortex-file-compressed 1743004703 1725933196 1.01
tpch_q22/datafusion:vortex-file-compressed 425105868 409285803 1.04
datafusion / vortex-compact (1.060x ➖, 0↑ 1↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 747450168 719605167 1.04
tpch_q02/datafusion:vortex-compact 769889400 667799801 1.15
tpch_q03/datafusion:vortex-compact 770033946 727877920 1.06
tpch_q04/datafusion:vortex-compact 605640234 513784208 1.18
tpch_q05/datafusion:vortex-compact 1127942326 946871166 1.19
tpch_q06/datafusion:vortex-compact 727921519 671225294 1.08
tpch_q07/datafusion:vortex-compact 1210473547 1100839233 1.10
tpch_q08/datafusion:vortex-compact 1355107128 1258685736 1.08
tpch_q09/datafusion:vortex-compact 1362390915 1378410518 0.99
tpch_q10/datafusion:vortex-compact 912258731 1159354896 0.79
tpch_q11/datafusion:vortex-compact 476658833 492728539 0.97
tpch_q12/datafusion:vortex-compact 961848884 865538101 1.11
tpch_q13/datafusion:vortex-compact 467729058 425673235 1.10
tpch_q14/datafusion:vortex-compact 644376270 604143231 1.07
tpch_q15/datafusion:vortex-compact 1312866217 1110438494 1.18
tpch_q16/datafusion:vortex-compact 🚨 569860669 327322307 1.74
tpch_q17/datafusion:vortex-compact 1210787284 1230444315 0.98
tpch_q18/datafusion:vortex-compact 1221193484 1184280116 1.03
tpch_q19/datafusion:vortex-compact 785073512 669566902 1.17
tpch_q20/datafusion:vortex-compact 1063400197 1227099140 0.87
tpch_q21/datafusion:vortex-compact 1495317330 1662162903 0.90
tpch_q22/datafusion:vortex-compact 414068168 490798474 0.84
datafusion / parquet (1.052x ➖, 0↑ 1↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 876113603 962274811 0.91
tpch_q02/datafusion:parquet 950128185 1130392500 0.84
tpch_q03/datafusion:parquet 1047010055 1038016716 1.01
tpch_q04/datafusion:parquet 482312808 432379139 1.12
tpch_q05/datafusion:parquet 1371146066 1204984558 1.14
tpch_q06/datafusion:parquet 559964148 472397726 1.19
tpch_q07/datafusion:parquet 1481365874 1522897141 0.97
tpch_q08/datafusion:parquet 🚨 2047714301 1545383987 1.33
tpch_q09/datafusion:parquet 2081274505 1748829920 1.19
tpch_q10/datafusion:parquet 2385403306 2190168383 1.09
tpch_q11/datafusion:parquet 661597062 586564121 1.13
tpch_q12/datafusion:parquet 778857531 745492426 1.04
tpch_q13/datafusion:parquet 788149575 834901920 0.94
tpch_q14/datafusion:parquet 892821016 962475487 0.93
tpch_q15/datafusion:parquet 1271148312 1244052346 1.02
tpch_q16/datafusion:parquet 622602722 492322664 1.26
tpch_q17/datafusion:parquet 1646843724 1481460949 1.11
tpch_q18/datafusion:parquet 1943931093 1742042018 1.12
tpch_q19/datafusion:parquet 1229777584 1119703086 1.10
tpch_q20/datafusion:parquet 1154601810 1153100607 1.00
tpch_q21/datafusion:parquet 1771033227 1858001977 0.95
tpch_q22/datafusion:parquet 785908916 870959813 0.90
duckdb / vortex-file-compressed (0.973x ➖, 0↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 657502880 603500450 1.09
tpch_q02/duckdb:vortex-file-compressed 1083539150 1304737461 0.83
tpch_q03/duckdb:vortex-file-compressed 887690324 1043116452 0.85
tpch_q04/duckdb:vortex-file-compressed 653835163 874797371 0.75
tpch_q05/duckdb:vortex-file-compressed 1197734916 1034676799 1.16
tpch_q06/duckdb:vortex-file-compressed 767872168 880840624 0.87
tpch_q07/duckdb:vortex-file-compressed 1122152257 1098158746 1.02
tpch_q08/duckdb:vortex-file-compressed 1509941159 1313118519 1.15
tpch_q09/duckdb:vortex-file-compressed 1425650378 1547641693 0.92
tpch_q10/duckdb:vortex-file-compressed 1158571061 1227279006 0.94
tpch_q11/duckdb:vortex-file-compressed 609560607 656914637 0.93
tpch_q12/duckdb:vortex-file-compressed 686894819 660418801 1.04
tpch_q13/duckdb:vortex-file-compressed 1024594435 1053728680 0.97
tpch_q14/duckdb:vortex-file-compressed 901635190 1130055759 0.80
tpch_q15/duckdb:vortex-file-compressed 589135380 575344911 1.02
tpch_q16/duckdb:vortex-file-compressed 411946925 467034153 0.88
tpch_q17/duckdb:vortex-file-compressed 984425704 952735358 1.03
tpch_q18/duckdb:vortex-file-compressed 1026345321 885265481 1.16
tpch_q19/duckdb:vortex-file-compressed 750842425 769161305 0.98
tpch_q20/duckdb:vortex-file-compressed 1247141473 1134305736 1.10
tpch_q21/duckdb:vortex-file-compressed 2061334779 1953139746 1.06
tpch_q22/duckdb:vortex-file-compressed 608080679 601147301 1.01
duckdb / vortex-compact (1.055x ➖, 0↑ 1↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 625530581 632167885 0.99
tpch_q02/duckdb:vortex-compact 1004807452 1195556974 0.84
tpch_q03/duckdb:vortex-compact 938259492 779585440 1.20
tpch_q04/duckdb:vortex-compact 549046624 595319746 0.92
tpch_q05/duckdb:vortex-compact 1075121030 1052754874 1.02
tpch_q06/duckdb:vortex-compact 860236775 720154668 1.19
tpch_q07/duckdb:vortex-compact 1149914150 974443912 1.18
tpch_q08/duckdb:vortex-compact 1374911510 1312128545 1.05
tpch_q09/duckdb:vortex-compact 1403935600 1313270209 1.07
tpch_q10/duckdb:vortex-compact 1311846404 1069756643 1.23
tpch_q11/duckdb:vortex-compact 767251322 626064584 1.23
tpch_q12/duckdb:vortex-compact 🚨 775220662 585718238 1.32
tpch_q13/duckdb:vortex-compact 876809036 893223619 0.98
tpch_q14/duckdb:vortex-compact 851164705 831954948 1.02
tpch_q15/duckdb:vortex-compact 565703655 547378447 1.03
tpch_q16/duckdb:vortex-compact 387166399 421712027 0.92
tpch_q17/duckdb:vortex-compact 973374309 966005132 1.01
tpch_q18/duckdb:vortex-compact 888049422 854237886 1.04
tpch_q19/duckdb:vortex-compact 790115207 735973303 1.07
tpch_q20/duckdb:vortex-compact 1195197201 1145527281 1.04
tpch_q21/duckdb:vortex-compact 1663378333 1686761267 0.99
tpch_q22/duckdb:vortex-compact 609678063 610672327 1.00
duckdb / parquet (0.936x ➖, 1↑ 0↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 878984501 1206889367 0.73
tpch_q02/duckdb:parquet 1609569006 1707844704 0.94
tpch_q03/duckdb:parquet 🚀 1539906559 2250433017 0.68
tpch_q04/duckdb:parquet 1061712121 1314670240 0.81
tpch_q05/duckdb:parquet 2135198992 2543483267 0.84
tpch_q06/duckdb:parquet 786257339 958424807 0.82
tpch_q07/duckdb:parquet 1725254476 1942122689 0.89
tpch_q08/duckdb:parquet 2571897837 2579102360 1.00
tpch_q09/duckdb:parquet 2651087741 2580051019 1.03
tpch_q10/duckdb:parquet 3189253064 3280267064 0.97
tpch_q11/duckdb:parquet 961384626 896656243 1.07
tpch_q12/duckdb:parquet 923103932 1087835068 0.85
tpch_q13/duckdb:parquet 1307389414 1274227352 1.03
tpch_q14/duckdb:parquet 1198101904 1185550916 1.01
tpch_q15/duckdb:parquet 877746531 848554777 1.03
tpch_q16/duckdb:parquet 821071651 925308124 0.89
tpch_q17/duckdb:parquet 1397424457 1312916565 1.06
tpch_q18/duckdb:parquet 1415064986 1242873049 1.14
tpch_q19/duckdb:parquet 1717241753 1576094268 1.09
tpch_q20/duckdb:parquet 1986819230 2078690343 0.96
tpch_q21/duckdb:parquet 1896023198 1996951401 0.95
tpch_q22/duckdb:parquet 1135805558 1155187718 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +3.9% -18.6% +27.6% +73.8% ➖ noise
1 datafusion:vortex-file-compressed -16.2% -18.6% +3.0% +69.3% ➖ noise
1 duckdb:vortex-compact -1.0% -18.6% +21.5% +50.9% ➖ noise
1 duckdb:vortex-file-compressed +8.9% -18.6% +33.8% +30.0% 🚨 regression
2 datafusion:vortex-compact +15.3% -11.0% +29.5% +50.7% ➖ noise
2 datafusion:vortex-file-compressed -2.3% -11.0% +9.8% +49.7% ➖ noise
2 duckdb:vortex-compact -16.0% -11.0% -5.6% +44.2% ➖ noise
2 duckdb:vortex-file-compressed -17.0% -11.0% -6.7% +46.9% ➖ noise
3 datafusion:vortex-compact +5.8% -16.9% +27.3% +84.6% ➖ noise
3 datafusion:vortex-file-compressed +0.3% -16.9% +20.7% +101.8% ➖ noise
3 duckdb:vortex-compact +20.4% -16.9% +44.9% +68.4% ➖ noise
3 duckdb:vortex-file-compressed -14.9% -16.9% +2.4% +60.4% ➖ noise
4 datafusion:vortex-compact +17.9% -5.1% +24.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -4.3% -5.1% +0.9% +30.0% ➖ noise
4 duckdb:vortex-compact -7.8% -5.1% -2.8% +38.1% ➖ noise
4 duckdb:vortex-file-compressed -25.3% -5.1% -21.3% +30.0% ➖ noise
5 datafusion:vortex-compact +19.1% -2.3% +21.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -33.6% -2.3% -32.1% +32.2% ✅ faster
5 duckdb:vortex-compact +2.1% -2.3% +4.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +15.8% -2.3% +18.4% +30.0% ➖ noise
6 datafusion:vortex-compact +8.4% -1.4% +10.0% +63.0% ➖ noise
6 datafusion:vortex-file-compressed -65.3% -1.4% -64.8% +57.1% ✅ faster
6 duckdb:vortex-compact +19.5% -1.4% +21.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -12.8% -1.4% -11.6% +30.0% ➖ noise
7 datafusion:vortex-compact +10.0% -7.0% +18.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -22.8% -7.0% -17.0% +39.9% ➖ noise
7 duckdb:vortex-compact +18.0% -7.0% +26.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +2.2% -7.0% +9.9% +30.0% ➖ noise
8 datafusion:vortex-compact +7.7% +15.0% -6.3% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +5.1% +15.0% -8.6% +52.2% ➖ noise
8 duckdb:vortex-compact +4.8% +15.0% -8.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +15.0% +15.0% +0.0% +30.0% ➖ noise
9 datafusion:vortex-compact -1.2% +10.6% -10.6% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -15.1% +10.6% -23.2% +30.0% ✅ faster
9 duckdb:vortex-compact +6.9% +10.6% -3.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -7.9% +10.6% -16.7% +30.0% ➖ noise
10 datafusion:vortex-compact -21.3% +2.9% -23.5% +30.0% ✅ faster
10 datafusion:vortex-file-compressed +33.0% +2.9% +29.3% +42.9% ➖ noise
10 duckdb:vortex-compact +22.6% +2.9% +19.2% +30.4% ➖ noise
10 duckdb:vortex-file-compressed -5.6% +2.9% -8.3% +52.5% ➖ noise
11 datafusion:vortex-compact -3.3% +10.0% -12.0% +37.2% ➖ noise
11 datafusion:vortex-file-compressed +49.9% +10.0% +36.3% +44.3% ➖ noise
11 duckdb:vortex-compact +22.6% +10.0% +11.4% +31.8% ➖ noise
11 duckdb:vortex-file-compressed -7.2% +10.0% -15.6% +35.6% ➖ noise
12 datafusion:vortex-compact +11.1% -5.8% +18.0% +35.2% ➖ noise
12 datafusion:vortex-file-compressed +10.9% -5.8% +17.8% +30.0% ➖ noise
12 duckdb:vortex-compact +32.4% -5.8% +40.6% +48.7% ➖ noise
12 duckdb:vortex-file-compressed +4.0% -5.8% +10.5% +30.0% ➖ noise
13 datafusion:vortex-compact +9.9% -1.6% +11.6% +50.9% ➖ noise
13 datafusion:vortex-file-compressed +2.3% -1.6% +3.9% +43.8% ➖ noise
13 duckdb:vortex-compact -1.8% -1.6% -0.3% +70.0% ➖ noise
13 duckdb:vortex-file-compressed -2.8% -1.6% -1.2% +67.0% ➖ noise
14 datafusion:vortex-compact +6.7% -3.2% +10.2% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +14.3% -3.2% +18.1% +30.0% ➖ noise
14 duckdb:vortex-compact +2.3% -3.2% +5.7% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -20.2% -3.2% -17.6% +30.0% ➖ noise
15 datafusion:vortex-compact +18.2% +2.8% +15.0% +49.4% ➖ noise
15 datafusion:vortex-file-compressed -5.3% +2.8% -7.9% +30.0% ➖ noise
15 duckdb:vortex-compact +3.3% +2.8% +0.5% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +2.4% +2.8% -0.4% +30.0% ➖ noise
16 datafusion:vortex-compact +74.1% +5.9% +64.3% +47.3% 🚨 regression
16 datafusion:vortex-file-compressed +40.2% +5.9% +32.3% +43.4% ➖ noise
16 duckdb:vortex-compact -8.2% +5.9% -13.3% +34.9% ➖ noise
16 duckdb:vortex-file-compressed -11.8% +5.9% -16.7% +30.0% ➖ noise
17 datafusion:vortex-compact -1.6% +8.8% -9.5% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +16.9% +8.8% +7.4% +30.0% ➖ noise
17 duckdb:vortex-compact +0.8% +8.8% -7.4% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +3.3% +8.8% -5.0% +30.0% ➖ noise
18 datafusion:vortex-compact +3.1% +12.7% -8.5% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +34.0% +12.7% +18.9% +30.0% ➖ noise
18 duckdb:vortex-compact +4.0% +12.7% -7.8% +33.3% ➖ noise
18 duckdb:vortex-file-compressed +15.9% +12.7% +2.9% +30.0% ➖ noise
19 datafusion:vortex-compact +17.3% +9.4% +7.2% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +48.7% +9.4% +35.9% +30.0% 🚨 regression
19 duckdb:vortex-compact +7.4% +9.4% -1.9% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -2.4% +9.4% -10.8% +30.0% ➖ noise
20 datafusion:vortex-compact -13.3% -2.2% -11.4% +53.0% ➖ noise
20 datafusion:vortex-file-compressed +27.2% -2.2% +30.1% +34.6% ➖ noise
20 duckdb:vortex-compact +4.3% -2.2% +6.7% +33.4% ➖ noise
20 duckdb:vortex-file-compressed +9.9% -2.2% +12.4% +30.0% ➖ noise
21 datafusion:vortex-compact -10.0% -4.9% -5.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +1.0% -4.9% +6.2% +30.0% ➖ noise
21 duckdb:vortex-compact -1.4% -4.9% +3.7% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +5.5% -4.9% +10.9% +30.0% ➖ noise
22 datafusion:vortex-compact -15.6% -5.8% -10.4% +31.8% ➖ noise
22 datafusion:vortex-file-compressed +3.9% -5.8% +10.3% +35.8% ➖ noise
22 duckdb:vortex-compact -0.2% -5.8% +6.0% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +1.2% -5.8% +7.4% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026

Benchmarks: Compression

Vortex (geomean): 1.004x ➖
Parquet (geomean): 1.010x ➖


unknown / unknown (1.013x ➖, 6↑ 13↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
compress time/Arade 1138880610 1163050449 0.98
compress time/Bimbo 7187593247 7667762849 0.94
compress time/CMSprovider 3110009489 3048112886 1.02
compress time/Euro2016 450032893 439581040 1.02
compress time/Food 374580288 409716310 0.91
compress time/HashTags 1014096903 967915657 1.05
compress time/TPC-H l_comment canonical 1309610865 1338543542 0.98
compress time/TPC-H l_comment chunked 1356904248 1353367015 1.00
compress time/taxi 757980630 748527614 1.01
compress time/wide table cols=100 chunks=1 rows=1000 18193684 17042490 1.07
compress time/wide table cols=100 chunks=50 rows=1000 15477045 16970153 0.91
compress time/wide table cols=1000 chunks=1 rows=1000 179238785 164795284 1.09
compress time/wide table cols=1000 chunks=50 rows=1000 158950375 154644605 1.03
compress time/wide table cols=10000 chunks=1 rows=1000 1580106977 1609385038 0.98
compress time/wide table cols=10000 chunks=50 rows=1000 1723128984 1581992245 1.09
decompress time/Arade 🚨 39233163 31979648 1.23
decompress time/Bimbo 🚨 126123231 105555448 1.19
decompress time/CMSprovider 89119537 88176068 1.01
decompress time/Euro2016 🚨 25933971 21883438 1.19
decompress time/Food 🚀 8815887 10251520 0.86
decompress time/HashTags 🚨 97779320 82950896 1.18
decompress time/TPC-H l_comment canonical 46546038 43878594 1.06
decompress time/TPC-H l_comment chunked 51006518 46583485 1.09
decompress time/taxi 🚨 25072520 21031322 1.19
decompress time/wide table cols=100 chunks=1 rows=1000 2881919 2979521 0.97
decompress time/wide table cols=100 chunks=50 rows=1000 2448692 2649643 0.92
decompress time/wide table cols=1000 chunks=1 rows=1000 26000771 24770739 1.05
decompress time/wide table cols=1000 chunks=50 rows=1000 22478558 23407270 0.96
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 233705371 260935893 0.90
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 291064581 257903570 1.13
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 2587088592 2598209730 1.00
parquet_rs-zstd compress time/Bimbo 16971558703 16424190909 1.03
parquet_rs-zstd compress time/CMSprovider 8143782600 8239583845 0.99
parquet_rs-zstd compress time/Euro2016 1583174082 1500618270 1.06
parquet_rs-zstd compress time/Food 983721366 948359772 1.04
parquet_rs-zstd compress time/HashTags 2967218539 2754630857 1.08
parquet_rs-zstd compress time/TPC-H l_comment canonical 3251518974 3306289319 0.98
parquet_rs-zstd compress time/TPC-H l_comment chunked 3216857529 3266893283 0.98
parquet_rs-zstd compress time/taxi 1483191566 1406063207 1.05
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 8170694 8256802 0.99
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6555121 7480389 0.88
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚨 98569739 88667359 1.11
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 84602511 88713304 0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 987882860 924207952 1.07
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 939688633 912576789 1.03
parquet_rs-zstd decompress time/Arade 667020507 687639252 0.97
parquet_rs-zstd decompress time/Bimbo 2332147049 2278599614 1.02
parquet_rs-zstd decompress time/CMSprovider 2337116645 2162759569 1.08
parquet_rs-zstd decompress time/Euro2016 445421420 426571875 1.04
parquet_rs-zstd decompress time/Food 251304492 244621061 1.03
parquet_rs-zstd decompress time/HashTags 🚨 808565417 733423630 1.10
parquet_rs-zstd decompress time/TPC-H l_comment canonical 719047178 715403992 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 748984799 725112581 1.03
parquet_rs-zstd decompress time/taxi 302731109 295004316 1.03
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2852117 2810408 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2577089 2635838 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 33997927 30213405 1.13
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 28698914 31199617 0.92
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 366907197 356799383 1.03
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 362952298 350691017 1.03
vortex-file-compressed size/Arade 143435604 143435604 1.00
vortex-file-compressed size/Bimbo 526882596 526882596 1.00
vortex-file-compressed size/CMSprovider 448399308 448399308 1.00
vortex-file-compressed size/Euro2016 164915236 164966252 1.00
vortex-file-compressed size/Food 44208064 44208064 1.00
vortex-file-compressed size/HashTags 195421908 195421908 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179481808 179481808 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179481808 179481808 1.00
vortex-file-compressed size/taxi 51543292 51543292 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.98
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.91
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.97
vortex:parquet-zstd ratio compress time/Food 🚀 0 0 0.88
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.97
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 0.96
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 1.08
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.04
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.92
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.26
vortex:parquet-zstd ratio decompress time/Bimbo 🚨 0 0 1.17
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.94
vortex:parquet-zstd ratio decompress time/Euro2016 🚨 0 0 1.13
vortex:parquet-zstd ratio decompress time/Food 🚀 0 0 0.84
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.07
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.06
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.06
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.16
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 1 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 0 0 0.87
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.09
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 26, 2026
@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.3%
Vortex (geomean): 1.002x ➖
Parquet (geomean): 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish -1.3%


datafusion / vortex-file-compressed (0.973x ➖, 4↑ 5↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1732250 1751880 0.99
clickbench_q01/datafusion:vortex-file-compressed 🚨 27320412 14712008 1.86
clickbench_q02/datafusion:vortex-file-compressed 33810298 36361142 0.93
clickbench_q03/datafusion:vortex-file-compressed 37412001 40776270 0.92
clickbench_q04/datafusion:vortex-file-compressed 318067736 350175491 0.91
clickbench_q05/datafusion:vortex-file-compressed 318757355 338495078 0.94
clickbench_q06/datafusion:vortex-file-compressed 🚀 1676742 2653677 0.63
clickbench_q07/datafusion:vortex-file-compressed 17667478 19528953 0.90
clickbench_q08/datafusion:vortex-file-compressed 396259682 414533811 0.96
clickbench_q09/datafusion:vortex-file-compressed 575140075 628448842 0.92
clickbench_q10/datafusion:vortex-file-compressed 74443247 74770023 1.00
clickbench_q11/datafusion:vortex-file-compressed 84350337 88505321 0.95
clickbench_q12/datafusion:vortex-file-compressed 280334122 303997562 0.92
clickbench_q13/datafusion:vortex-file-compressed 424109300 468870464 0.90
clickbench_q14/datafusion:vortex-file-compressed 255512674 283586273 0.90
clickbench_q15/datafusion:vortex-file-compressed 374795257 406450405 0.92
clickbench_q16/datafusion:vortex-file-compressed 733018724 801678043 0.91
clickbench_q17/datafusion:vortex-file-compressed 721875717 791645073 0.91
clickbench_q18/datafusion:vortex-file-compressed 1499466099 1568912291 0.96
clickbench_q19/datafusion:vortex-file-compressed 25906842 24707312 1.05
clickbench_q20/datafusion:vortex-file-compressed 389685494 367650138 1.06
clickbench_q21/datafusion:vortex-file-compressed 🚨 482996804 424533600 1.14
clickbench_q22/datafusion:vortex-file-compressed 643361436 586537777 1.10
clickbench_q23/datafusion:vortex-file-compressed 787850467 725801895 1.09
clickbench_q24/datafusion:vortex-file-compressed 🚨 53726205 47598666 1.13
clickbench_q25/datafusion:vortex-file-compressed 79029102 75838890 1.04
clickbench_q26/datafusion:vortex-file-compressed 🚨 59678685 49845653 1.20
clickbench_q27/datafusion:vortex-file-compressed 🚨 904600487 804278619 1.12
clickbench_q28/datafusion:vortex-file-compressed 7102604029 6812247902 1.04
clickbench_q29/datafusion:vortex-file-compressed 233509298 231465887 1.01
clickbench_q30/datafusion:vortex-file-compressed 238221518 260113588 0.92
clickbench_q31/datafusion:vortex-file-compressed 277293998 294744635 0.94
clickbench_q32/datafusion:vortex-file-compressed 1408523840 1475699124 0.95
clickbench_q33/datafusion:vortex-file-compressed 🚀 1409781963 1568566604 0.90
clickbench_q34/datafusion:vortex-file-compressed 🚀 1407153029 1579632025 0.89
clickbench_q35/datafusion:vortex-file-compressed 529541996 584997145 0.91
clickbench_q36/datafusion:vortex-file-compressed 🚀 77346360 86207351 0.90
clickbench_q37/datafusion:vortex-file-compressed 38550164 39293366 0.98
clickbench_q38/datafusion:vortex-file-compressed 23934550 26071001 0.92
clickbench_q39/datafusion:vortex-file-compressed 148769110 162980035 0.91
clickbench_q40/datafusion:vortex-file-compressed 20309698 21712774 0.94
clickbench_q41/datafusion:vortex-file-compressed 18940761 20635323 0.92
clickbench_q42/datafusion:vortex-file-compressed 22338948 24414000 0.92
datafusion / parquet (1.011x ➖, 2↑ 10↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1791211 2173936 0.82
clickbench_q01/datafusion:parquet 22931948 22031520 1.04
clickbench_q02/datafusion:parquet 52990691 49594564 1.07
clickbench_q03/datafusion:parquet 46390442 42315497 1.10
clickbench_q04/datafusion:parquet 🚨 412461759 366939834 1.12
clickbench_q05/datafusion:parquet 🚨 462804724 398487266 1.16
clickbench_q06/datafusion:parquet 🚨 1936422 1637617 1.18
clickbench_q07/datafusion:parquet 🚨 30132238 27142973 1.11
clickbench_q08/datafusion:parquet 🚨 515255062 450772931 1.14
clickbench_q09/datafusion:parquet 🚨 789803838 695884513 1.13
clickbench_q10/datafusion:parquet 137702399 125290956 1.10
clickbench_q11/datafusion:parquet 150959016 156288612 0.97
clickbench_q12/datafusion:parquet 372063594 404088863 0.92
clickbench_q13/datafusion:parquet 532960421 570407375 0.93
clickbench_q14/datafusion:parquet 376175792 396097075 0.95
clickbench_q15/datafusion:parquet 398458385 426947044 0.93
clickbench_q16/datafusion:parquet 734320867 799437144 0.92
clickbench_q17/datafusion:parquet 729109466 792135438 0.92
clickbench_q18/datafusion:parquet 1605076904 1686363915 0.95
clickbench_q19/datafusion:parquet 32278537 35199029 0.92
clickbench_q20/datafusion:parquet 631440274 658337963 0.96
clickbench_q21/datafusion:parquet 695169669 703102139 0.99
clickbench_q22/datafusion:parquet 993641199 1035934235 0.96
clickbench_q23/datafusion:parquet 3878672346 4068761367 0.95
clickbench_q24/datafusion:parquet 104019937 100521227 1.03
clickbench_q25/datafusion:parquet 🚨 172104996 154350419 1.12
clickbench_q26/datafusion:parquet 104577825 97836017 1.07
clickbench_q27/datafusion:parquet 1217509515 1126200025 1.08
clickbench_q28/datafusion:parquet 7020977477 6706170338 1.05
clickbench_q29/datafusion:parquet 255566543 241034759 1.06
clickbench_q30/datafusion:parquet 🚨 464327919 396662774 1.17
clickbench_q31/datafusion:parquet 🚨 498960888 447371748 1.12
clickbench_q32/datafusion:parquet 🚨 1717861872 1406523480 1.22
clickbench_q33/datafusion:parquet 1784639925 1659278857 1.08
clickbench_q34/datafusion:parquet 1584188838 1673379788 0.95
clickbench_q35/datafusion:parquet 550359681 592809855 0.93
clickbench_q36/datafusion:parquet 🚀 140750061 159922517 0.88
clickbench_q37/datafusion:parquet 59166447 63240313 0.94
clickbench_q38/datafusion:parquet 91883186 95371798 0.96
clickbench_q39/datafusion:parquet 281192606 299842121 0.94
clickbench_q40/datafusion:parquet 34667602 37355864 0.93
clickbench_q41/datafusion:parquet 30200686 31859321 0.95
clickbench_q42/datafusion:parquet 32528156 33818044 0.96
duckdb / vortex-file-compressed (1.033x ➖, 5↑ 11↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6163845 6350784 0.97
clickbench_q01/duckdb:vortex-file-compressed 🚀 13249827 14889073 0.89
clickbench_q02/duckdb:vortex-file-compressed 23963346 24684203 0.97
clickbench_q03/duckdb:vortex-file-compressed 30523863 31706084 0.96
clickbench_q04/duckdb:vortex-file-compressed 174220610 180003720 0.97
clickbench_q05/duckdb:vortex-file-compressed 197896838 206577944 0.96
clickbench_q06/duckdb:vortex-file-compressed 19745384 20281916 0.97
clickbench_q07/duckdb:vortex-file-compressed 15086648 15626782 0.97
clickbench_q08/duckdb:vortex-file-compressed 270800975 270096714 1.00
clickbench_q09/duckdb:vortex-file-compressed 421639432 386390826 1.09
clickbench_q10/duckdb:vortex-file-compressed 83792444 76458092 1.10
clickbench_q11/duckdb:vortex-file-compressed 91343506 86787025 1.05
clickbench_q12/duckdb:vortex-file-compressed 🚨 260929177 221237963 1.18
clickbench_q13/duckdb:vortex-file-compressed 🚨 514741853 450905333 1.14
clickbench_q14/duckdb:vortex-file-compressed 🚨 285648174 255295201 1.12
clickbench_q15/duckdb:vortex-file-compressed 🚨 255309280 223054779 1.14
clickbench_q16/duckdb:vortex-file-compressed 🚨 856636779 740449951 1.16
clickbench_q17/duckdb:vortex-file-compressed 🚨 713912110 559650396 1.28
clickbench_q18/duckdb:vortex-file-compressed 1400919466 1282415856 1.09
clickbench_q19/duckdb:vortex-file-compressed 23872359 22882658 1.04
clickbench_q20/duckdb:vortex-file-compressed 🚨 459537445 409933726 1.12
clickbench_q21/duckdb:vortex-file-compressed 🚨 491899846 427553571 1.15
clickbench_q22/duckdb:vortex-file-compressed 🚨 820805625 600241841 1.37
clickbench_q23/duckdb:vortex-file-compressed 🚨 1346777583 996713139 1.35
clickbench_q24/duckdb:vortex-file-compressed 47300423 46718307 1.01
clickbench_q25/duckdb:vortex-file-compressed 75979415 76010942 1.00
clickbench_q26/duckdb:vortex-file-compressed 🚨 47930866 40982905 1.17
clickbench_q27/duckdb:vortex-file-compressed 540749566 547809315 0.99
clickbench_q28/duckdb:vortex-file-compressed 3029012500 3063372503 0.99
clickbench_q29/duckdb:vortex-file-compressed 27449315 28931311 0.95
clickbench_q30/duckdb:vortex-file-compressed 174924102 183728067 0.95
clickbench_q31/duckdb:vortex-file-compressed 257514372 266926389 0.96
clickbench_q32/duckdb:vortex-file-compressed 1437548377 1411076051 1.02
clickbench_q33/duckdb:vortex-file-compressed 1748190854 1621215444 1.08
clickbench_q34/duckdb:vortex-file-compressed 1751781483 1687133843 1.04
clickbench_q35/duckdb:vortex-file-compressed 372473895 371774676 1.00
clickbench_q36/duckdb:vortex-file-compressed 35665660 34654715 1.03
clickbench_q37/duckdb:vortex-file-compressed 🚀 21298380 25942152 0.82
clickbench_q38/duckdb:vortex-file-compressed 🚀 22679095 26881623 0.84
clickbench_q39/duckdb:vortex-file-compressed 49140815 47569943 1.03
clickbench_q40/duckdb:vortex-file-compressed 🚀 23035822 25905977 0.89
clickbench_q41/duckdb:vortex-file-compressed 🚀 21102551 24150989 0.87
clickbench_q42/duckdb:vortex-file-compressed 25338921 25634144 0.99
duckdb / parquet (0.994x ➖, 2↑ 2↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 221150289 256320364 0.86
clickbench_q01/duckdb:parquet 50835079 52719095 0.96
clickbench_q02/duckdb:parquet 65839403 69793867 0.94
clickbench_q03/duckdb:parquet 65402392 66515032 0.98
clickbench_q04/duckdb:parquet 206984062 213093078 0.97
clickbench_q05/duckdb:parquet 282067382 288210906 0.98
clickbench_q06/duckdb:parquet 60094517 62839434 0.96
clickbench_q07/duckdb:parquet 52719263 54522545 0.97
clickbench_q08/duckdb:parquet 271181659 276619044 0.98
clickbench_q09/duckdb:parquet 399670803 410214296 0.97
clickbench_q10/duckdb:parquet 95276126 100505688 0.95
clickbench_q11/duckdb:parquet 109946060 111056655 0.99
clickbench_q12/duckdb:parquet 298091600 307850445 0.97
clickbench_q13/duckdb:parquet 508004624 548741361 0.93
clickbench_q14/duckdb:parquet 335104097 339391991 0.99
clickbench_q15/duckdb:parquet 🚨 275457335 248143599 1.11
clickbench_q16/duckdb:parquet 704262877 644628135 1.09
clickbench_q17/duckdb:parquet 577444334 530683954 1.09
clickbench_q18/duckdb:parquet 🚨 1213844179 1093407702 1.11
clickbench_q19/duckdb:parquet 53762233 51452267 1.04
clickbench_q20/duckdb:parquet 475919802 446587208 1.07
clickbench_q21/duckdb:parquet 612093685 575748920 1.06
clickbench_q22/duckdb:parquet 1008989943 941550128 1.07
clickbench_q23/duckdb:parquet 333690381 327557193 1.02
clickbench_q24/duckdb:parquet 82701745 80973622 1.02
clickbench_q25/duckdb:parquet 148208390 141757374 1.05
clickbench_q26/duckdb:parquet 56940329 54765451 1.04
clickbench_q27/duckdb:parquet 705214942 656136404 1.07
clickbench_q28/duckdb:parquet 5270253738 4919695699 1.07
clickbench_q29/duckdb:parquet 61591446 63365527 0.97
clickbench_q30/duckdb:parquet 308194611 314981900 0.98
clickbench_q31/duckdb:parquet 355842843 363919956 0.98
clickbench_q32/duckdb:parquet 1193025309 1257187904 0.95
clickbench_q33/duckdb:parquet 1321310992 1356350226 0.97
clickbench_q34/duckdb:parquet 1288269455 1404131389 0.92
clickbench_q35/duckdb:parquet 353921695 360275960 0.98
clickbench_q36/duckdb:parquet 64212435 66168178 0.97
clickbench_q37/duckdb:parquet 54108177 55832702 0.97
clickbench_q38/duckdb:parquet 58240602 60225017 0.97
clickbench_q39/duckdb:parquet 101281255 103616398 0.98
clickbench_q40/duckdb:parquet 57364024 57966296 0.99
clickbench_q41/duckdb:parquet 🚀 54881235 62784689 0.87
clickbench_q42/duckdb:parquet 53316546 54428306 0.98
duckdb / duckdb (1.043x ➖, 0↑ 6↓)
name PR 1bcc137 (ns) base c256ccd (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17473051 18196039 0.96
clickbench_q01/duckdb:duckdb 33110874 34777810 0.95
clickbench_q02/duckdb:duckdb 45521683 46067946 0.99
clickbench_q03/duckdb:duckdb 46535466 47833597 0.97
clickbench_q04/duckdb:duckdb 228330119 228681959 1.00
clickbench_q05/duckdb:duckdb 343053580 338400065 1.01
clickbench_q06/duckdb:duckdb 34365356 36685272 0.94
clickbench_q07/duckdb:duckdb 35220702 36444766 0.97
clickbench_q08/duckdb:duckdb 346868038 323917035 1.07
clickbench_q09/duckdb:duckdb 519476561 507611149 1.02
clickbench_q10/duckdb:duckdb 98011117 100179420 0.98
clickbench_q11/duckdb:duckdb 107067808 108823001 0.98
clickbench_q12/duckdb:duckdb 323156725 314879904 1.03
clickbench_q13/duckdb:duckdb 628716221 573280877 1.10
clickbench_q14/duckdb:duckdb 375610590 364283050 1.03
clickbench_q15/duckdb:duckdb 282272777 278002231 1.02
clickbench_q16/duckdb:duckdb 759486857 711929035 1.07
clickbench_q17/duckdb:duckdb 🚨 700151815 597996244 1.17
clickbench_q18/duckdb:duckdb 🚨 1487922516 1309611112 1.14
clickbench_q19/duckdb:duckdb 36206358 35117908 1.03
clickbench_q20/duckdb:duckdb 🚨 1255606372 954320000 1.32
clickbench_q21/duckdb:duckdb 🚨 1293866255 1028688870 1.26
clickbench_q22/duckdb:duckdb 🚨 1324009412 1182082261 1.12
clickbench_q23/duckdb:duckdb 279839995 263496551 1.06
clickbench_q24/duckdb:duckdb 64214085 62224027 1.03
clickbench_q25/duckdb:duckdb 131129013 127047834 1.03
clickbench_q26/duckdb:duckdb 58903247 59002617 1.00
clickbench_q27/duckdb:duckdb 🚨 1267302737 1041301690 1.22
clickbench_q28/duckdb:duckdb 5015957086 4664777792 1.08
clickbench_q29/duckdb:duckdb 49989733 49161169 1.02
clickbench_q30/duckdb:duckdb 320712087 294029145 1.09
clickbench_q31/duckdb:duckdb 419678690 442654371 0.95
clickbench_q32/duckdb:duckdb 1456574938 1521802056 0.96
clickbench_q33/duckdb:duckdb 2190513287 2036869554 1.08
clickbench_q34/duckdb:duckdb 2311379845 2119020650 1.09
clickbench_q35/duckdb:duckdb 294120748 270439268 1.09
clickbench_q36/duckdb:duckdb 43463128 41738847 1.04
clickbench_q37/duckdb:duckdb 32527192 31818756 1.02
clickbench_q38/duckdb:duckdb 32447039 32042826 1.01
clickbench_q39/duckdb:duckdb 67833350 67955516 1.00
clickbench_q40/duckdb:duckdb 32706900 32434823 1.01
clickbench_q41/duckdb:duckdb 32013252 30669138 1.04
clickbench_q42/duckdb:duckdb 33133120 32072756 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -1.1% -15.7% +17.3% +612.4% ➖ noise
0 duckdb:duckdb -4.0% -15.7% +13.9% +297.7% ➖ noise
0 duckdb:vortex-file-compressed -2.9% -15.7% +15.1% +348.0% ➖ noise
1 datafusion:vortex-file-compressed +85.7% +0.2% +85.4% +65.3% 🚨 regression
1 duckdb:duckdb -4.8% +0.2% -5.0% +55.6% ➖ noise
1 duckdb:vortex-file-compressed -11.0% +0.2% -11.2% +18.5% ➖ noise
2 datafusion:vortex-file-compressed -7.0% +0.4% -7.4% +31.9% ➖ noise
2 duckdb:duckdb -1.2% +0.4% -1.6% +23.8% ➖ noise
2 duckdb:vortex-file-compressed -2.9% +0.4% -3.3% +14.9% ➖ noise
3 datafusion:vortex-file-compressed -8.3% +3.8% -11.6% +169.5% ➖ noise
3 duckdb:duckdb -2.7% +3.8% -6.3% +53.3% ➖ noise
3 duckdb:vortex-file-compressed -3.7% +3.8% -7.3% +31.4% ➖ noise
4 datafusion:vortex-file-compressed -9.2% +4.5% -13.1% +14.9% ✅ faster
4 duckdb:duckdb -0.2% +4.5% -4.4% +14.9% ➖ noise
4 duckdb:vortex-file-compressed -3.2% +4.5% -7.4% +14.9% ➖ noise
5 datafusion:vortex-file-compressed -5.8% +6.6% -11.7% +14.9% ➖ noise
5 duckdb:duckdb +1.4% +6.6% -4.9% +14.9% ➖ noise
5 duckdb:vortex-file-compressed -4.2% +6.6% -10.1% +14.9% ➖ noise
6 datafusion:vortex-file-compressed -36.8% +6.3% -40.6% +42.3% ✅ faster
6 duckdb:duckdb -6.3% +6.3% -11.9% +28.4% ➖ noise
6 duckdb:vortex-file-compressed -2.6% +6.3% -8.4% +19.2% ➖ noise
7 datafusion:vortex-file-compressed -9.5% +3.6% -12.7% +15.4% ➖ noise
7 duckdb:duckdb -3.4% +3.6% -6.7% +14.9% ➖ noise
7 duckdb:vortex-file-compressed -3.5% +3.6% -6.8% +14.9% ➖ noise
8 datafusion:vortex-file-compressed -4.4% +5.9% -9.7% +14.9% ➖ noise
8 duckdb:duckdb +7.1% +5.9% +1.2% +14.9% ➖ noise
8 duckdb:vortex-file-compressed +0.3% +5.9% -5.3% +14.9% ➖ noise
9 datafusion:vortex-file-compressed -8.5% +5.2% -13.0% +14.9% ✅ faster
9 duckdb:duckdb +2.3% +5.2% -2.7% +14.9% ➖ noise
9 duckdb:vortex-file-compressed +9.1% +5.2% +3.8% +14.9% ➖ noise
10 datafusion:vortex-file-compressed -0.4% +2.1% -2.5% +14.9% ➖ noise
10 duckdb:duckdb -2.2% +2.1% -4.2% +14.9% ➖ noise
10 duckdb:vortex-file-compressed +9.6% +2.1% +7.4% +14.9% ➖ noise
11 datafusion:vortex-file-compressed -4.7% -2.2% -2.5% +14.9% ➖ noise
11 duckdb:duckdb -1.6% -2.2% +0.6% +14.9% ➖ noise
11 duckdb:vortex-file-compressed +5.3% -2.2% +7.6% +14.9% ➖ noise
12 datafusion:vortex-file-compressed -7.8% -5.6% -2.3% +14.9% ➖ noise
12 duckdb:duckdb +2.6% -5.6% +8.7% +14.9% ➖ noise
12 duckdb:vortex-file-compressed +17.9% -5.6% +24.9% +14.9% 🚨 regression
13 datafusion:vortex-file-compressed -9.5% -7.0% -2.7% +14.9% ➖ noise
13 duckdb:duckdb +9.7% -7.0% +17.9% +14.9% 🚨 regression
13 duckdb:vortex-file-compressed +14.2% -7.0% +22.7% +14.9% 🚨 regression
14 datafusion:vortex-file-compressed -9.9% -3.2% -7.0% +14.9% ➖ noise
14 duckdb:duckdb +3.1% -3.2% +6.5% +14.9% ➖ noise
14 duckdb:vortex-file-compressed +11.9% -3.2% +15.5% +14.9% 🚨 regression
15 datafusion:vortex-file-compressed -7.8% +1.8% -9.4% +14.9% ➖ noise
15 duckdb:duckdb +1.5% +1.8% -0.2% +14.9% ➖ noise
15 duckdb:vortex-file-compressed +14.5% +1.8% +12.5% +14.9% ➖ noise
16 datafusion:vortex-file-compressed -8.6% +0.2% -8.7% +14.9% ➖ noise
16 duckdb:duckdb +6.7% +0.2% +6.5% +14.9% ➖ noise
16 duckdb:vortex-file-compressed +15.7% +0.2% +15.5% +17.1% ➖ noise
17 datafusion:vortex-file-compressed -8.8% +0.1% -8.9% +14.9% ➖ noise
17 duckdb:duckdb +17.1% +0.1% +17.0% +14.9% 🚨 regression
17 duckdb:vortex-file-compressed +27.6% +0.1% +27.5% +14.9% 🚨 regression
18 datafusion:vortex-file-compressed -4.4% +2.8% -7.0% +14.9% ➖ noise
18 duckdb:duckdb +13.6% +2.8% +10.5% +14.9% ➖ noise
18 duckdb:vortex-file-compressed +9.2% +2.8% +6.3% +14.9% ➖ noise
19 datafusion:vortex-file-compressed +4.9% -2.1% +7.1% +15.6% ➖ noise
19 duckdb:duckdb +3.1% -2.1% +5.3% +14.9% ➖ noise
19 duckdb:vortex-file-compressed +4.3% -2.1% +6.6% +28.3% ➖ noise
20 datafusion:vortex-file-compressed +6.0% +1.1% +4.8% +174.5% ➖ noise
20 duckdb:duckdb +31.6% +1.1% +30.1% +21.2% 🚨 regression
20 duckdb:vortex-file-compressed +12.1% +1.1% +10.9% +14.9% ➖ noise
21 datafusion:vortex-file-compressed +13.8% +2.5% +11.0% +14.9% ➖ noise
21 duckdb:duckdb +25.8% +2.5% +22.7% +14.9% 🚨 regression
21 duckdb:vortex-file-compressed +15.0% +2.5% +12.2% +14.9% ➖ noise
22 datafusion:vortex-file-compressed +9.7% +1.4% +8.2% +14.9% ➖ noise
22 duckdb:duckdb +12.0% +1.4% +10.5% +14.9% ➖ noise
22 duckdb:vortex-file-compressed +36.7% +1.4% +34.9% +14.9% 🚨 regression
23 datafusion:vortex-file-compressed +8.5% -1.5% +10.2% +40.0% ➖ noise
23 duckdb:duckdb +6.2% -1.5% +7.8% +14.9% ➖ noise
23 duckdb:vortex-file-compressed +35.1% -1.5% +37.1% +15.7% 🚨 regression
24 datafusion:vortex-file-compressed +12.9% +2.8% +9.8% +14.9% ➖ noise
24 duckdb:duckdb +3.2% +2.8% +0.4% +14.9% ➖ noise
24 duckdb:vortex-file-compressed +1.2% +2.8% -1.5% +38.3% ➖ noise
25 datafusion:vortex-file-compressed +4.2% +8.0% -3.5% +16.0% ➖ noise
25 duckdb:duckdb +3.2% +8.0% -4.4% +14.9% ➖ noise
25 duckdb:vortex-file-compressed -0.0% +8.0% -7.4% +14.9% ➖ noise
26 datafusion:vortex-file-compressed +19.7% +5.4% +13.6% +21.9% ➖ noise
26 duckdb:duckdb -0.2% +5.4% -5.3% +14.9% ➖ noise
26 duckdb:vortex-file-compressed +17.0% +5.4% +10.9% +34.8% ➖ noise
27 datafusion:vortex-file-compressed +12.5% +7.8% +4.3% +14.9% ➖ noise
27 duckdb:duckdb +21.7% +7.8% +12.9% +14.9% ➖ noise
27 duckdb:vortex-file-compressed -1.3% +7.8% -8.4% +14.9% ➖ noise
28 datafusion:vortex-file-compressed +4.3% +5.9% -1.5% +14.9% ➖ noise
28 duckdb:duckdb +7.5% +5.9% +1.5% +14.9% ➖ noise
28 duckdb:vortex-file-compressed -1.1% +5.9% -6.6% +14.9% ➖ noise
29 datafusion:vortex-file-compressed +0.9% +1.5% -0.6% +14.9% ➖ noise
29 duckdb:duckdb +1.7% +1.5% +0.2% +14.9% ➖ noise
29 duckdb:vortex-file-compressed -5.1% +1.5% -6.5% +16.0% ➖ noise
30 datafusion:vortex-file-compressed -8.4% +7.0% -14.4% +14.9% ✅ faster
30 duckdb:duckdb +9.1% +7.0% +1.9% +14.9% ➖ noise
30 duckdb:vortex-file-compressed -4.8% +7.0% -11.0% +14.9% ➖ noise
31 datafusion:vortex-file-compressed -5.9% +4.4% -9.9% +14.9% ➖ noise
31 duckdb:duckdb -5.2% +4.4% -9.2% +14.9% ➖ noise
31 duckdb:vortex-file-compressed -3.5% +4.4% -7.6% +14.9% ➖ noise
32 datafusion:vortex-file-compressed -4.6% +7.7% -11.3% +19.1% ➖ noise
32 duckdb:duckdb -4.3% +7.7% -11.1% +14.9% ➖ noise
32 duckdb:vortex-file-compressed +1.9% +7.7% -5.4% +14.9% ➖ noise
33 datafusion:vortex-file-compressed -10.1% +2.4% -12.2% +14.9% ➖ noise
33 duckdb:duckdb +7.5% +2.4% +5.1% +14.9% ➖ noise
33 duckdb:vortex-file-compressed +7.8% +2.4% +5.3% +14.9% ➖ noise
34 datafusion:vortex-file-compressed -10.9% -6.8% -4.4% +14.9% ➖ noise
34 duckdb:duckdb +9.1% -6.8% +17.0% +14.9% 🚨 regression
34 duckdb:vortex-file-compressed +3.8% -6.8% +11.4% +14.9% ➖ noise
35 datafusion:vortex-file-compressed -9.5% -4.5% -5.2% +14.9% ➖ noise
35 duckdb:duckdb +8.8% -4.5% +13.9% +14.9% ➖ noise
35 duckdb:vortex-file-compressed +0.2% -4.5% +4.9% +14.9% ➖ noise
36 datafusion:vortex-file-compressed -10.3% -7.6% -2.9% +14.9% ➖ noise
36 duckdb:duckdb +4.1% -7.6% +12.7% +14.9% ➖ noise
36 duckdb:vortex-file-compressed +2.9% -7.6% +11.4% +22.7% ➖ noise
37 datafusion:vortex-file-compressed -1.9% -4.8% +3.0% +14.9% ➖ noise
37 duckdb:duckdb +2.2% -4.8% +7.4% +14.9% ➖ noise
37 duckdb:vortex-file-compressed -17.9% -4.8% -13.8% +15.9% ✅ faster
38 datafusion:vortex-file-compressed -8.2% -3.5% -4.9% +14.9% ➖ noise
38 duckdb:duckdb +1.3% -3.5% +4.9% +14.9% ➖ noise
38 duckdb:vortex-file-compressed -15.6% -3.5% -12.6% +14.9% ➖ noise
39 datafusion:vortex-file-compressed -8.7% -4.3% -4.7% +14.9% ➖ noise
39 duckdb:duckdb -0.2% -4.3% +4.3% +19.3% ➖ noise
39 duckdb:vortex-file-compressed +3.3% -4.3% +7.9% +14.9% ➖ noise
40 datafusion:vortex-file-compressed -6.5% -4.2% -2.4% +14.9% ➖ noise
40 duckdb:duckdb +0.8% -4.2% +5.2% +14.9% ➖ noise
40 duckdb:vortex-file-compressed -11.1% -4.2% -7.2% +14.9% ➖ noise
41 datafusion:vortex-file-compressed -8.2% -9.0% +0.8% +14.9% ➖ noise
41 duckdb:duckdb +4.4% -9.0% +14.7% +14.9% ➖ noise
41 duckdb:vortex-file-compressed -12.6% -9.0% -4.0% +14.9% ➖ noise
42 datafusion:vortex-file-compressed -8.5% -2.9% -5.7% +14.9% ➖ noise
42 duckdb:duckdb +3.3% -2.9% +6.4% +14.9% ➖ noise
42 duckdb:vortex-file-compressed -1.2% -2.9% +1.8% +14.9% ➖ noise

@AdamGS AdamGS marked this pull request as ready for review March 26, 2026 15:51
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/update-fsst-0-5-9 branch from 1bcc137 to dca3fac Compare March 26, 2026 15:52
@AdamGS AdamGS enabled auto-merge (squash) March 26, 2026 15:52
@AdamGS AdamGS merged commit 1e0e6d0 into develop Mar 26, 2026
62 checks passed
@AdamGS AdamGS deleted the adamg/update-fsst-0-5-9 branch March 26, 2026 15:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/chore A trivial change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants