Skip to content

array slots#6870

Draft
joseph-isaacs wants to merge 19 commits intodevelopfrom
ji/slots-for-arrays
Draft

array slots#6870
joseph-isaacs wants to merge 19 commits intodevelopfrom
ji/slots-for-arrays

Conversation

@joseph-isaacs
Copy link
Contributor

Summary

Closes: #000

Testing

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs changed the title fix array slots Mar 10, 2026
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
# Conflicts:
#	vortex-array/src/arrays/extension/array.rs
#	vortex-array/src/arrays/extension/vtable/mod.rs
#	vortex-array/src/arrays/extension/vtable/validity.rs
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 11, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 11, 2026
@codspeed-hq
Copy link

codspeed-hq bot commented Mar 11, 2026

Merging this PR will degrade performance by 31.92%

⚡ 10 improved benchmarks
❌ 2 regressed benchmarks
✅ 997 untouched benchmarks
⏩ 1515 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_constant_i32_append_to_builder[(1000, 10)] 43.1 µs 32.8 µs +31.13%
Simulation chunked_opt_bool_canonical_into[(10, 1000)] 2.2 ms 1.9 ms +15.83%
Simulation chunked_opt_bool_into_canonical[(10, 1000)] 2.5 ms 2.1 ms +15.88%
Simulation chunked_opt_bool_canonical_into[(100, 100)] 404 µs 365.3 µs +10.6%
Simulation chunked_opt_bool_into_canonical[(100, 100)] 439.6 µs 396.6 µs +10.83%
Simulation chunked_opt_bool_into_canonical[(1000, 10)] 107.2 µs 157.5 µs -31.92%
Simulation bench_many_nulls[0.5] 365.5 µs 327.5 µs +11.58%
Simulation bench_many_nulls[0.9] 533.5 µs 466.4 µs +14.4%
Simulation scalar_at_struct_simple 673.3 µs 837.7 µs -19.63%
Simulation new_alp_prim_test_between[f64, 32768] 251.9 µs 195.4 µs +28.88%
Simulation bitwise_not_vortex_buffer_mut[1024] 564.7 ns 506.4 ns +11.52%
Simulation bitwise_not_vortex_buffer_mut[128] 405.3 ns 346.9 ns +16.81%

Comparing ji/slots-for-arrays (e089aa4) with develop (4b7207e)

Open in CodSpeed

Footnotes

  1. 1515 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done a5632e2 2 Explore Profiling Data
Previous Runs (5)
Status Commit Job Attempt Link
🟢 Done a5632e2 1 Explore Profiling Data
🟢 Done dcc6d7e 1 Explore Profiling Data
🟢 Done 94368be 1 Explore Profiling Data
🟢 Done f7239da 1 Explore Profiling Data
🟢 Done dcfd745 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-H SF=1 on NVME

Summary

  • Overall: 0.997x ➖
  • Vortex: 0.997x ➖
  • Parquet: 1.009x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -1.6%
  • Confidence: low
  • Environment shift: +0.9%

Statistical Summary

  • Systemic shift (parquet controls): +0.9%
  • Control sigma: +4.6%
  • Residual noise: +2.6%
  • Median polish overall: -0.9%
datafusion / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 53880754 50454042 1.07
tpch_q02/datafusion:vortex-file-compressed 48094018 49354556 0.97
tpch_q03/datafusion:vortex-file-compressed 27135020 27672188 0.98
tpch_q04/datafusion:vortex-file-compressed 18058661 18194870 0.99
tpch_q05/datafusion:vortex-file-compressed 79497268 77001674 1.03
tpch_q06/datafusion:vortex-file-compressed 9737537 10612039 0.92
tpch_q07/datafusion:vortex-file-compressed 91228176 88016153 1.04
tpch_q08/datafusion:vortex-file-compressed 66410826 64913795 1.02
tpch_q09/datafusion:vortex-file-compressed 87040097 86884033 1.00
tpch_q10/datafusion:vortex-file-compressed 74835945 77076682 0.97
tpch_q11/datafusion:vortex-file-compressed 18330257 18535460 0.99
tpch_q12/datafusion:vortex-file-compressed 34026639 32855723 1.04
tpch_q13/datafusion:vortex-file-compressed 28047941 27125464 1.03
tpch_q14/datafusion:vortex-file-compressed 27121182 27541436 0.98
tpch_q15/datafusion:vortex-file-compressed 25177864 25931983 0.97
tpch_q16/datafusion:vortex-file-compressed 32925058 34742206 0.95
tpch_q17/datafusion:vortex-file-compressed 73134073 71952433 1.02
tpch_q18/datafusion:vortex-file-compressed 99806293 100498872 0.99
tpch_q19/datafusion:vortex-file-compressed 34377185 34985614 0.98
tpch_q20/datafusion:vortex-file-compressed 49640919 48419814 1.03
tpch_q21/datafusion:vortex-file-compressed 93876607 94064892 1.00
tpch_q22/datafusion:vortex-file-compressed 14613198 14425822 1.01
datafusion / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 63414990 61420502 1.03
tpch_q02/datafusion:vortex-compact 53360262 50640955 1.05
tpch_q03/datafusion:vortex-compact 32358298 31522867 1.03
tpch_q04/datafusion:vortex-compact 23325298 23265410 1.00
tpch_q05/datafusion:vortex-compact 79428924 82021875 0.97
tpch_q06/datafusion:vortex-compact 14149054 14340617 0.99
tpch_q07/datafusion:vortex-compact 96099159 93699695 1.03
tpch_q08/datafusion:vortex-compact 73440936 72024274 1.02
tpch_q09/datafusion:vortex-compact 95681754 96913656 0.99
tpch_q10/datafusion:vortex-compact 82016122 78679914 1.04
tpch_q11/datafusion:vortex-compact 19734594 20651500 0.96
tpch_q12/datafusion:vortex-compact 43913866 43265504 1.01
tpch_q13/datafusion:vortex-compact 35680568 36432774 0.98
tpch_q14/datafusion:vortex-compact 31908691 31008378 1.03
tpch_q15/datafusion:vortex-compact 32102805 33832702 0.95
tpch_q16/datafusion:vortex-compact 39265953 39706893 0.99
tpch_q17/datafusion:vortex-compact 79663391 82575518 0.96
tpch_q18/datafusion:vortex-compact 108480346 108632159 1.00
tpch_q19/datafusion:vortex-compact 46229625 44728986 1.03
tpch_q20/datafusion:vortex-compact 56091093 54737329 1.02
tpch_q21/datafusion:vortex-compact 104932698 108166754 0.97
tpch_q22/datafusion:vortex-compact 15994225 16755130 0.95
datafusion / parquet (1.006x ➖, 0↑ 1↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 145556097 145891135 1.00
tpch_q02/datafusion:parquet 81431551 80104188 1.02
tpch_q03/datafusion:parquet 85415157 85815692 1.00
tpch_q04/datafusion:parquet 54829952 55536333 0.99
tpch_q05/datafusion:parquet 157417177 161201352 0.98
tpch_q06/datafusion:parquet 46993631 48029224 0.98
tpch_q07/datafusion:parquet 179991967 179101027 1.00
tpch_q08/datafusion:parquet 155871955 162495701 0.96
tpch_q09/datafusion:parquet 214041998 209256592 1.02
tpch_q10/datafusion:parquet 185540042 187327916 0.99
tpch_q11/datafusion:parquet 59283085 58965582 1.01
tpch_q12/datafusion:parquet 🚨 121200800 106529045 1.14
tpch_q13/datafusion:parquet 198174020 202063361 0.98
tpch_q14/datafusion:parquet 77857644 83187082 0.94
tpch_q15/datafusion:parquet 67085377 64243421 1.04
tpch_q16/datafusion:parquet 55094804 54719821 1.01
tpch_q17/datafusion:parquet 163478517 173194574 0.94
tpch_q18/datafusion:parquet 223950637 229321451 0.98
tpch_q19/datafusion:parquet 101758288 93479233 1.09
tpch_q20/datafusion:parquet 119134356 115183893 1.03
tpch_q21/datafusion:parquet 180808187 178178151 1.01
tpch_q22/datafusion:parquet 41098225 38921209 1.06
datafusion / arrow (0.981x ➖, 1↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 62914263 68635337 0.92
tpch_q02/datafusion:arrow 22475804 23034041 0.98
tpch_q03/datafusion:arrow 36612632 36986948 0.99
tpch_q04/datafusion:arrow 29161877 29894861 0.98
tpch_q05/datafusion:arrow 89762304 90302802 0.99
tpch_q06/datafusion:arrow 23288709 21421763 1.09
tpch_q07/datafusion:arrow 187077156 176625732 1.06
tpch_q08/datafusion:arrow 45651871 48351760 0.94
tpch_q09/datafusion:arrow 76872322 77823832 0.99
tpch_q10/datafusion:arrow 57183623 57164844 1.00
tpch_q11/datafusion:arrow 12099001 11998482 1.01
tpch_q12/datafusion:arrow 57259905 57817611 0.99
tpch_q13/datafusion:arrow 50333674 50099859 1.00
tpch_q14/datafusion:arrow 25142667 26801301 0.94
tpch_q15/datafusion:arrow 49000069 52329191 0.94
tpch_q16/datafusion:arrow 23172035 25193745 0.92
tpch_q17/datafusion:arrow 🚀 78246148 88830335 0.88
tpch_q18/datafusion:arrow 158536594 157094234 1.01
tpch_q19/datafusion:arrow 42627163 40398068 1.06
tpch_q20/datafusion:arrow 41074860 41066802 1.00
tpch_q21/datafusion:arrow 227655392 236763126 0.96
tpch_q22/datafusion:arrow 20618565 21115363 0.98
duckdb / vortex-file-compressed (0.991x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31960610 33751083 0.95
tpch_q02/duckdb:vortex-file-compressed 28687511 27322553 1.05
tpch_q03/duckdb:vortex-file-compressed 29816031 30329412 0.98
tpch_q04/duckdb:vortex-file-compressed 29147520 29957015 0.97
tpch_q05/duckdb:vortex-file-compressed 32498974 34042557 0.95
tpch_q06/duckdb:vortex-file-compressed 10294692 10676568 0.96
tpch_q07/duckdb:vortex-file-compressed 35526004 36414189 0.98
tpch_q08/duckdb:vortex-file-compressed 39122381 39881358 0.98
tpch_q09/duckdb:vortex-file-compressed 81791318 78343756 1.04
tpch_q10/duckdb:vortex-file-compressed 35828731 36969455 0.97
tpch_q11/duckdb:vortex-file-compressed 16223502 15553393 1.04
tpch_q12/duckdb:vortex-file-compressed 23643886 23138018 1.02
tpch_q13/duckdb:vortex-file-compressed 36922075 37825660 0.98
tpch_q14/duckdb:vortex-file-compressed 20887018 21139348 0.99
tpch_q15/duckdb:vortex-file-compressed 15950729 16416172 0.97
tpch_q16/duckdb:vortex-file-compressed 29999507 29273668 1.02
tpch_q17/duckdb:vortex-file-compressed 24765795 24923242 0.99
tpch_q18/duckdb:vortex-file-compressed 47194626 48444190 0.97
tpch_q19/duckdb:vortex-file-compressed 32618561 32307040 1.01
tpch_q20/duckdb:vortex-file-compressed 34376143 34440164 1.00
tpch_q21/duckdb:vortex-file-compressed 99693738 102234531 0.98
tpch_q22/duckdb:vortex-file-compressed 17822865 17756619 1.00
duckdb / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39655261 39488003 1.00
tpch_q02/duckdb:vortex-compact 35440048 37680125 0.94
tpch_q03/duckdb:vortex-compact 32745004 31821107 1.03
tpch_q04/duckdb:vortex-compact 34843522 34678720 1.00
tpch_q05/duckdb:vortex-compact 37699334 37477095 1.01
tpch_q06/duckdb:vortex-compact 15376656 14276328 1.08
tpch_q07/duckdb:vortex-compact 42656895 43345998 0.98
tpch_q08/duckdb:vortex-compact 45004445 47105772 0.96
tpch_q09/duckdb:vortex-compact 89104311 91315665 0.98
tpch_q10/duckdb:vortex-compact 40517670 41445680 0.98
tpch_q11/duckdb:vortex-compact 20473621 20403702 1.00
tpch_q12/duckdb:vortex-compact 37252843 35957784 1.04
tpch_q13/duckdb:vortex-compact 45872767 47119116 0.97
tpch_q14/duckdb:vortex-compact 30658625 31348151 0.98
tpch_q15/duckdb:vortex-compact 19544010 19719940 0.99
tpch_q16/duckdb:vortex-compact 35797107 35870025 1.00
tpch_q17/duckdb:vortex-compact 30489562 30559276 1.00
tpch_q18/duckdb:vortex-compact 50349945 51998941 0.97
tpch_q19/duckdb:vortex-compact 37046771 36433553 1.02
tpch_q20/duckdb:vortex-compact 44738331 43547447 1.03
tpch_q21/duckdb:vortex-compact 111423268 113318404 0.98
tpch_q22/duckdb:vortex-compact 20822125 20487013 1.02
duckdb / parquet (1.013x ➖, 2↑ 4↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 105548079 91629048 1.15
tpch_q02/duckdb:parquet 39082304 39388645 0.99
tpch_q03/duckdb:parquet 🚀 69431256 79311685 0.88
tpch_q04/duckdb:parquet 49799947 46746251 1.07
tpch_q05/duckdb:parquet 65998735 67271089 0.98
tpch_q06/duckdb:parquet 20557688 20305443 1.01
tpch_q07/duckdb:parquet 67024295 66696013 1.00
tpch_q08/duckdb:parquet 81071099 82359111 0.98
tpch_q09/duckdb:parquet 152931035 156380037 0.98
tpch_q10/duckdb:parquet 126975534 127049443 1.00
tpch_q11/duckdb:parquet 21866751 22426073 0.98
tpch_q12/duckdb:parquet 🚨 52624690 46717804 1.13
tpch_q13/duckdb:parquet 259538657 260694190 1.00
tpch_q14/duckdb:parquet 🚨 60514382 48613300 1.24
tpch_q15/duckdb:parquet 34271888 32948318 1.04
tpch_q16/duckdb:parquet 57284154 56168028 1.02
tpch_q17/duckdb:parquet 🚨 57339651 50885873 1.13
tpch_q18/duckdb:parquet 🚀 117525246 136522321 0.86
tpch_q19/duckdb:parquet 80744398 88161812 0.92
tpch_q20/duckdb:parquet 63000048 64612998 0.98
tpch_q21/duckdb:parquet 187286829 175971713 1.06
tpch_q22/duckdb:parquet 51170697 52700481 0.97
duckdb / duckdb (0.992x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16525106 16330316 1.01
tpch_q02/duckdb:duckdb 12369535 13090632 0.94
tpch_q03/duckdb:duckdb 19716515 18636992 1.06
tpch_q04/duckdb:duckdb 19427497 19774732 0.98
tpch_q05/duckdb:duckdb 20033114 20742790 0.97
tpch_q06/duckdb:duckdb 5330474 5384459 0.99
tpch_q07/duckdb:duckdb 22811043 22559297 1.01
tpch_q08/duckdb:duckdb 20144968 20790400 0.97
tpch_q09/duckdb:duckdb 50678750 54636109 0.93
tpch_q10/duckdb:duckdb 41503905 44003489 0.94
tpch_q11/duckdb:duckdb 5627956 5649950 1.00
tpch_q12/duckdb:duckdb 13447117 13803947 0.97
tpch_q13/duckdb:duckdb 37188883 36708518 1.01
tpch_q14/duckdb:duckdb 15621654 15477516 1.01
tpch_q15/duckdb:duckdb 11761603 11649870 1.01
tpch_q16/duckdb:duckdb 23181442 23171712 1.00
tpch_q17/duckdb:duckdb 13485663 13614295 0.99
tpch_q18/duckdb:duckdb 38268063 38068513 1.01
tpch_q19/duckdb:duckdb 26992471 26280146 1.03
tpch_q20/duckdb:duckdb 21567471 22445458 0.96
tpch_q21/duckdb:duckdb 56622340 54520809 1.04
tpch_q22/duckdb:duckdb 24076912 24195014 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -8.3% +7.2% -14.5% +26.9% ➖ noise
1 datafusion:vortex-compact +3.2% +7.2% -3.7% +27.6% ➖ noise
1 datafusion:vortex-file-compressed +6.8% +7.2% -0.4% +28.4% ➖ noise
1 duckdb:duckdb +1.2% +7.2% -5.6% +24.9% ➖ noise
1 duckdb:vortex-compact +0.4% +7.2% -6.3% +24.7% ➖ noise
1 duckdb:vortex-file-compressed -5.3% +7.2% -11.7% +25.1% ➖ noise
2 datafusion:arrow -2.4% +0.4% -2.8% +12.4% ➖ noise
2 datafusion:vortex-compact +5.4% +0.4% +4.9% +12.4% ➖ noise
2 datafusion:vortex-file-compressed -2.6% +0.4% -3.0% +12.4% ➖ noise
2 duckdb:duckdb -5.5% +0.4% -5.9% +17.2% ➖ noise
2 duckdb:vortex-compact -5.9% +0.4% -6.3% +12.4% ➖ noise
2 duckdb:vortex-file-compressed +5.0% +0.4% +4.5% +12.4% ➖ noise
3 datafusion:arrow -1.0% -6.7% +6.0% +12.4% ➖ noise
3 datafusion:vortex-compact +2.7% -6.7% +10.0% +14.1% ➖ noise
3 datafusion:vortex-file-compressed -1.9% -6.7% +5.0% +13.8% ➖ noise
3 duckdb:duckdb +5.8% -6.7% +13.3% +17.0% ➖ noise
3 duckdb:vortex-compact +2.9% -6.7% +10.2% +17.8% ➖ noise
3 duckdb:vortex-file-compressed -1.7% -6.7% +5.3% +16.4% ➖ noise
4 datafusion:arrow -2.5% +2.6% -4.9% +12.4% ➖ noise
4 datafusion:vortex-compact +0.3% +2.6% -2.2% +12.4% ➖ noise
4 datafusion:vortex-file-compressed -0.7% +2.6% -3.2% +12.4% ➖ noise
4 duckdb:duckdb -1.8% +2.6% -4.2% +12.4% ➖ noise
4 duckdb:vortex-compact +0.5% +2.6% -2.0% +12.4% ➖ noise
4 duckdb:vortex-file-compressed -2.7% +2.6% -5.1% +12.4% ➖ noise
5 datafusion:arrow -0.6% -2.1% +1.6% +12.4% ➖ noise
5 datafusion:vortex-compact -3.2% -2.1% -1.1% +12.4% ➖ noise
5 datafusion:vortex-file-compressed +3.2% -2.1% +5.5% +12.4% ➖ noise
5 duckdb:duckdb -3.4% -2.1% -1.3% +15.0% ➖ noise
5 duckdb:vortex-compact +0.6% -2.1% +2.8% +12.4% ➖ noise
5 duckdb:vortex-file-compressed -4.5% -2.1% -2.5% +12.4% ➖ noise
6 datafusion:arrow +8.7% -0.5% +9.2% +25.4% ➖ noise
6 datafusion:vortex-compact -1.3% -0.5% -0.9% +20.9% ➖ noise
6 datafusion:vortex-file-compressed -8.2% -0.5% -7.8% +24.1% ➖ noise
6 duckdb:duckdb -1.0% -0.5% -0.5% +22.5% ➖ noise
6 duckdb:vortex-compact +7.7% -0.5% +8.2% +20.9% ➖ noise
6 duckdb:vortex-file-compressed -3.6% -0.5% -3.1% +19.7% ➖ noise
7 datafusion:arrow +5.9% +0.5% +5.4% +13.3% ➖ noise
7 datafusion:vortex-compact +2.6% +0.5% +2.1% +12.4% ➖ noise
7 datafusion:vortex-file-compressed +3.6% +0.5% +3.1% +12.4% ➖ noise
7 duckdb:duckdb +1.1% +0.5% +0.6% +17.5% ➖ noise
7 duckdb:vortex-compact -1.6% +0.5% -2.1% +12.4% ➖ noise
7 duckdb:vortex-file-compressed -2.4% +0.5% -2.9% +12.4% ➖ noise
8 datafusion:arrow -5.6% -2.8% -2.8% +12.9% ➖ noise
8 datafusion:vortex-compact +2.0% -2.8% +4.9% +12.4% ➖ noise
8 datafusion:vortex-file-compressed +2.3% -2.8% +5.3% +12.4% ➖ noise
8 duckdb:duckdb -3.1% -2.8% -0.3% +12.8% ➖ noise
8 duckdb:vortex-compact -4.5% -2.8% -1.7% +12.4% ➖ noise
8 duckdb:vortex-file-compressed -1.9% -2.8% +1.0% +12.4% ➖ noise
9 datafusion:arrow -1.2% +0.0% -1.2% +12.4% ➖ noise
9 datafusion:vortex-compact -1.3% +0.0% -1.3% +12.4% ➖ noise
9 datafusion:vortex-file-compressed +0.2% +0.0% +0.2% +12.4% ➖ noise
9 duckdb:duckdb -7.2% +0.0% -7.3% +13.5% ➖ noise
9 duckdb:vortex-compact -2.4% +0.0% -2.4% +12.4% ➖ noise
9 duckdb:vortex-file-compressed +4.4% +0.0% +4.4% +12.4% ➖ noise
10 datafusion:arrow +0.0% -0.5% +0.5% +12.4% ➖ noise
10 datafusion:vortex-compact +4.2% -0.5% +4.8% +12.4% ➖ noise
10 datafusion:vortex-file-compressed -2.9% -0.5% -2.4% +12.4% ➖ noise
10 duckdb:duckdb -5.7% -0.5% -5.2% +17.0% ➖ noise
10 duckdb:vortex-compact -2.2% -0.5% -1.7% +12.4% ➖ noise
10 duckdb:vortex-file-compressed -3.1% -0.5% -2.6% +12.4% ➖ noise
11 datafusion:arrow +0.8% -1.0% +1.8% +13.3% ➖ noise
11 datafusion:vortex-compact -4.4% -1.0% -3.5% +12.9% ➖ noise
11 datafusion:vortex-file-compressed -1.1% -1.0% -0.1% +12.4% ➖ noise
11 duckdb:duckdb -0.4% -1.0% +0.6% +14.1% ➖ noise
11 duckdb:vortex-compact +0.3% -1.0% +1.3% +12.4% ➖ noise
11 duckdb:vortex-file-compressed +4.3% -1.0% +5.4% +12.4% ➖ noise
12 datafusion:arrow -1.0% +13.2% -12.5% +15.5% ➖ noise
12 datafusion:vortex-compact +1.5% +13.2% -10.3% +14.4% ➖ noise
12 datafusion:vortex-file-compressed +3.6% +13.2% -8.5% +14.4% ➖ noise
12 duckdb:duckdb -2.6% +13.2% -13.9% +17.4% ➖ noise
12 duckdb:vortex-compact +3.6% +13.2% -8.5% +14.2% ➖ noise
12 duckdb:vortex-file-compressed +2.2% +13.2% -9.7% +14.4% ➖ noise
13 datafusion:arrow +0.5% -1.2% +1.7% +12.4% ➖ noise
13 datafusion:vortex-compact -2.1% -1.2% -0.9% +12.4% ➖ noise
13 datafusion:vortex-file-compressed +3.4% -1.2% +4.6% +12.4% ➖ noise
13 duckdb:duckdb +1.3% -1.2% +2.5% +22.7% ➖ noise
13 duckdb:vortex-compact -2.6% -1.2% -1.5% +12.4% ➖ noise
13 duckdb:vortex-file-compressed -2.4% -1.2% -1.2% +12.4% ➖ noise
14 datafusion:arrow -6.2% +7.9% -13.1% +15.1% ➖ noise
14 datafusion:vortex-compact +2.9% +7.9% -4.7% +15.5% ➖ noise
14 datafusion:vortex-file-compressed -1.5% +7.9% -8.8% +13.4% ➖ noise
14 duckdb:duckdb +0.9% +7.9% -6.5% +24.8% ➖ noise
14 duckdb:vortex-compact -2.2% +7.9% -9.4% +12.7% ➖ noise
14 duckdb:vortex-file-compressed -1.2% +7.9% -8.5% +16.7% ➖ noise
15 datafusion:arrow -6.4% +4.2% -10.2% +16.7% ➖ noise
15 datafusion:vortex-compact -5.1% +4.2% -9.0% +16.7% ➖ noise
15 datafusion:vortex-file-compressed -2.9% +4.2% -6.8% +18.4% ➖ noise
15 duckdb:duckdb +1.0% +4.2% -3.1% +20.0% ➖ noise
15 duckdb:vortex-compact -0.9% +4.2% -4.9% +16.7% ➖ noise
15 duckdb:vortex-file-compressed -2.8% +4.2% -6.8% +16.4% ➖ noise
16 datafusion:arrow -8.0% +1.3% -9.2% +12.4% ➖ noise
16 datafusion:vortex-compact -1.1% +1.3% -2.4% +12.4% ➖ noise
16 datafusion:vortex-file-compressed -5.2% +1.3% -6.5% +12.4% ➖ noise
16 duckdb:duckdb +0.0% +1.3% -1.3% +12.4% ➖ noise
16 duckdb:vortex-compact -0.2% +1.3% -1.5% +12.4% ➖ noise
16 duckdb:vortex-file-compressed +2.5% +1.3% +1.1% +12.9% ➖ noise
17 datafusion:arrow -11.9% +3.1% -14.6% +16.0% ✅ faster
17 datafusion:vortex-compact -3.5% +3.1% -6.5% +15.5% ➖ noise
17 datafusion:vortex-file-compressed +1.6% +3.1% -1.4% +16.8% ➖ noise
17 duckdb:duckdb -0.9% +3.1% -4.0% +17.1% ➖ noise
17 duckdb:vortex-compact -0.2% +3.1% -3.3% +14.4% ➖ noise
17 duckdb:vortex-file-compressed -0.6% +3.1% -3.6% +15.8% ➖ noise
18 datafusion:arrow +0.9% -8.3% +10.1% +12.4% ➖ noise
18 datafusion:vortex-compact -0.1% -8.3% +8.9% +12.4% ➖ noise
18 datafusion:vortex-file-compressed -0.7% -8.3% +8.3% +12.4% ➖ noise
18 duckdb:duckdb +0.5% -8.3% +9.6% +12.4% ➖ noise
18 duckdb:vortex-compact -3.2% -8.3% +5.6% +12.4% ➖ noise
18 duckdb:vortex-file-compressed -2.6% -8.3% +6.3% +12.5% ➖ noise
19 datafusion:arrow +5.5% -0.2% +5.7% +17.8% ➖ noise
19 datafusion:vortex-compact +3.4% -0.2% +3.5% +21.1% ➖ noise
19 datafusion:vortex-file-compressed -1.7% -0.2% -1.6% +18.8% ➖ noise
19 duckdb:duckdb +2.7% -0.2% +2.9% +22.6% ➖ noise
19 duckdb:vortex-compact +1.7% -0.2% +1.8% +17.9% ➖ noise
19 duckdb:vortex-file-compressed +1.0% -0.2% +1.1% +21.3% ➖ noise
20 datafusion:arrow +0.0% +0.4% -0.4% +15.4% ➖ noise
20 datafusion:vortex-compact +2.5% +0.4% +2.0% +15.4% ➖ noise
20 datafusion:vortex-file-compressed +2.5% +0.4% +2.1% +16.6% ➖ noise
20 duckdb:duckdb -3.9% +0.4% -4.3% +17.3% ➖ noise
20 duckdb:vortex-compact +2.7% +0.4% +2.3% +17.3% ➖ noise
20 duckdb:vortex-file-compressed -0.2% +0.4% -0.6% +20.1% ➖ noise
21 datafusion:arrow -3.8% +3.9% -7.5% +12.4% ➖ noise
21 datafusion:vortex-compact -3.0% +3.9% -6.7% +12.4% ➖ noise
21 datafusion:vortex-file-compressed -0.2% +3.9% -4.0% +12.4% ➖ noise
21 duckdb:duckdb +3.9% +3.9% -0.1% +12.4% ➖ noise
21 duckdb:vortex-compact -1.7% +3.9% -5.4% +12.4% ➖ noise
21 duckdb:vortex-file-compressed -2.5% +3.9% -6.2% +12.4% ➖ noise
22 datafusion:arrow -2.4% +1.3% -3.6% +20.9% ➖ noise
22 datafusion:vortex-compact -4.5% +1.3% -5.7% +14.2% ➖ noise
22 datafusion:vortex-file-compressed +1.3% +1.3% +0.0% +12.4% ➖ noise
22 duckdb:duckdb -0.5% +1.3% -1.7% +12.4% ➖ noise
22 duckdb:vortex-compact +1.6% +1.3% +0.4% +12.4% ➖ noise
22 duckdb:vortex-file-compressed +0.4% +1.3% -0.9% +12.4% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: PolarSignals Profiling

Summary

  • Overall: 1.069x ➖
  • Vortex: 1.069x ➖
datafusion / vortex-file-compressed (1.069x ➖, 0↑ 2↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 121698548 113777969 1.07
polarsignals_q01/datafusion:vortex-file-compressed 348330246 347823686 1.00
polarsignals_q02/datafusion:vortex-file-compressed 22408468 20987293 1.07
polarsignals_q03/datafusion:vortex-file-compressed 360892173 347291394 1.04
polarsignals_q04/datafusion:vortex-file-compressed 12421371 11567780 1.07
polarsignals_q05/datafusion:vortex-file-compressed 17108438 16130606 1.06
polarsignals_q06/datafusion:vortex-file-compressed 21163649 20479258 1.03
polarsignals_q07/datafusion:vortex-file-compressed 🚨 14251328 12239904 1.16
polarsignals_q08/datafusion:vortex-file-compressed 445196916 427776674 1.04
polarsignals_q09/datafusion:vortex-file-compressed 🚨 11867891 10314245 1.15

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: FineWeb NVMe

Summary

  • Overall: 0.965x ➖
  • Vortex: 0.970x ➖
  • Parquet: 0.956x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +1.4%
  • Confidence: low
  • Environment shift: -4.4%

Statistical Summary

  • Systemic shift (parquet controls): -4.4%
  • Control sigma: +2.0%
  • Residual noise: +1.7%
  • Median polish overall: -2.6%
datafusion / vortex-file-compressed (0.956x ➖, 1↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4229529 5253096 0.81
fineweb_q01/datafusion:vortex-file-compressed 25220709 26518669 0.95
fineweb_q02/datafusion:vortex-file-compressed 26851603 27624430 0.97
fineweb_q03/datafusion:vortex-file-compressed 82060747 83033981 0.99
fineweb_q04/datafusion:vortex-file-compressed 221156993 227877723 0.97
fineweb_q05/datafusion:vortex-file-compressed 199650140 205051350 0.97
fineweb_q06/datafusion:vortex-file-compressed 68708620 71427908 0.96
fineweb_q07/datafusion:vortex-file-compressed 70399187 66328168 1.06
fineweb_q08/datafusion:vortex-file-compressed 25395680 27030628 0.94
datafusion / vortex-compact (0.972x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4525510 4553186 0.99
fineweb_q01/datafusion:vortex-compact 161153296 166450502 0.97
fineweb_q02/datafusion:vortex-compact 163335249 167086729 0.98
fineweb_q03/datafusion:vortex-compact 1432678721 1475630158 0.97
fineweb_q04/datafusion:vortex-compact 1545269467 1581301562 0.98
fineweb_q05/datafusion:vortex-compact 1228056895 1268587112 0.97
fineweb_q06/datafusion:vortex-compact 687503483 705657951 0.97
fineweb_q07/datafusion:vortex-compact 719704126 734989955 0.98
fineweb_q08/datafusion:vortex-compact 22499387 23870222 0.94
datafusion / parquet (0.942x ➖, 1↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6404807 6430208 1.00
fineweb_q01/datafusion:parquet 🚀 266891055 300086561 0.89
fineweb_q02/datafusion:parquet 271480511 289578203 0.94
fineweb_q03/datafusion:parquet 283333928 292602685 0.97
fineweb_q04/datafusion:parquet 284687370 313530314 0.91
fineweb_q05/datafusion:parquet 282751845 298951478 0.95
fineweb_q06/datafusion:parquet 274367179 296045167 0.93
fineweb_q07/datafusion:parquet 275101682 295219822 0.93
fineweb_q08/datafusion:parquet 268148086 274211770 0.98
duckdb / vortex-file-compressed (0.973x ➖, 1↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3318534 3357410 0.99
fineweb_q01/duckdb:vortex-file-compressed 26929645 28469731 0.95
fineweb_q02/duckdb:vortex-file-compressed 27909158 27880574 1.00
fineweb_q03/duckdb:vortex-file-compressed 🚀 114361099 132487010 0.86
fineweb_q04/duckdb:vortex-file-compressed 202484050 216787214 0.93
fineweb_q05/duckdb:vortex-file-compressed 190236750 178856421 1.06
fineweb_q06/duckdb:vortex-file-compressed 72526640 68323953 1.06
fineweb_q07/duckdb:vortex-file-compressed 67178528 70404127 0.95
fineweb_q08/duckdb:vortex-file-compressed 26617175 27661036 0.96
duckdb / vortex-compact (0.979x ➖, 1↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 4132914 4610981 0.90
fineweb_q01/duckdb:vortex-compact 107637486 113497946 0.95
fineweb_q02/duckdb:vortex-compact 116904069 119703668 0.98
fineweb_q03/duckdb:vortex-compact 856509073 878109910 0.98
fineweb_q04/duckdb:vortex-compact 907663114 923281308 0.98
fineweb_q05/duckdb:vortex-compact 810087548 830326318 0.98
fineweb_q06/duckdb:vortex-compact 465711791 466054981 1.00
fineweb_q07/duckdb:vortex-compact 479189902 480324910 1.00
fineweb_q08/duckdb:vortex-compact 24773633 23272169 1.06
duckdb / parquet (0.971x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35759719 37236527 0.96
fineweb_q01/duckdb:parquet 92548065 96120883 0.96
fineweb_q02/duckdb:parquet 95099455 99292199 0.96
fineweb_q03/duckdb:parquet 305044685 308856692 0.99
fineweb_q04/duckdb:parquet 438663026 445034788 0.99
fineweb_q05/duckdb:parquet 408004526 417173378 0.98
fineweb_q06/duckdb:parquet 197945691 208245629 0.95
fineweb_q07/duckdb:parquet 210038023 214737853 0.98
fineweb_q08/duckdb:parquet 56121353 57439719 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -0.6% -2.2% +1.6% +42.1% ➖ noise
0 datafusion:vortex-file-compressed -19.5% -2.2% -17.7% +74.3% ➖ noise
0 duckdb:vortex-compact -10.4% -2.2% -8.4% +40.9% ➖ noise
0 duckdb:vortex-file-compressed -1.2% -2.2% +1.1% +55.5% ➖ noise
1 datafusion:vortex-compact -3.2% -7.5% +4.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -4.9% -7.5% +2.8% +13.5% ➖ noise
1 duckdb:vortex-compact -5.2% -7.5% +2.5% +20.3% ➖ noise
1 duckdb:vortex-file-compressed -5.4% -7.5% +2.2% +41.7% ➖ noise
2 datafusion:vortex-compact -2.2% -5.2% +3.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.8% -5.2% +2.6% +18.0% ➖ noise
2 duckdb:vortex-compact -2.3% -5.2% +3.1% +12.5% ➖ noise
2 duckdb:vortex-file-compressed +0.1% -5.2% +5.6% +10.8% ➖ noise
3 datafusion:vortex-compact -2.9% -2.2% -0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.2% -2.2% +1.1% +29.6% ➖ noise
3 duckdb:vortex-compact -2.5% -2.2% -0.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -13.7% -2.2% -11.7% +30.2% ➖ noise
4 datafusion:vortex-compact -2.3% -5.4% +3.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.9% -5.4% +2.6% +10.0% ➖ noise
4 duckdb:vortex-compact -1.7% -5.4% +3.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -6.6% -5.4% -1.3% +10.0% ➖ noise
5 datafusion:vortex-compact -3.2% -3.8% +0.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.6% -3.8% +1.2% +10.0% ➖ noise
5 duckdb:vortex-compact -2.4% -3.8% +1.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +6.4% -3.8% +10.6% +10.0% 🚨 regression
6 datafusion:vortex-compact -2.6% -6.1% +3.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.8% -6.1% +2.5% +10.6% ➖ noise
6 duckdb:vortex-compact -0.1% -6.1% +6.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.2% -6.1% +13.1% +17.1% ➖ noise
7 datafusion:vortex-compact -2.1% -4.5% +2.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +6.1% -4.5% +11.2% +14.5% ➖ noise
7 duckdb:vortex-compact -0.2% -4.5% +4.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.6% -4.5% -0.1% +10.0% ➖ noise
8 datafusion:vortex-compact -5.7% -2.3% -3.6% +18.1% ➖ noise
8 datafusion:vortex-file-compressed -6.0% -2.3% -3.9% +25.4% ➖ noise
8 duckdb:vortex-compact +6.5% -2.3% +8.9% +12.6% ➖ noise
8 duckdb:vortex-file-compressed -3.8% -2.3% -1.6% +20.1% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-H SF=1 on S3

Summary

  • Overall: 1.147x ➖
  • Vortex: 1.157x ➖
  • Parquet: 1.127x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +2.7%
  • Confidence: environment too noisy
  • Environment shift: +12.7%

Statistical Summary

  • Systemic shift (parquet controls): +12.7%
  • Control sigma: +10.8%
  • Residual noise: +10.3%
  • Median polish overall: +10.5%
datafusion / vortex-file-compressed (1.422x ❌, 0↑ 12↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 324992853 181234068 1.79
tpch_q02/datafusion:vortex-file-compressed 🚨 658079982 454163453 1.45
tpch_q03/datafusion:vortex-file-compressed 334340903 369103860 0.91
tpch_q04/datafusion:vortex-file-compressed 🚨 368883828 236229371 1.56
tpch_q05/datafusion:vortex-file-compressed 🚨 631478144 403833084 1.56
tpch_q06/datafusion:vortex-file-compressed 🚨 519467285 259703027 2.00
tpch_q07/datafusion:vortex-file-compressed 🚨 638217911 386604746 1.65
tpch_q08/datafusion:vortex-file-compressed 672417052 662992164 1.01
tpch_q09/datafusion:vortex-file-compressed 608813933 592842927 1.03
tpch_q10/datafusion:vortex-file-compressed 🚨 1130467025 477184452 2.37
tpch_q11/datafusion:vortex-file-compressed 🚨 692854071 271910635 2.55
tpch_q12/datafusion:vortex-file-compressed 🚨 599390714 342982778 1.75
tpch_q13/datafusion:vortex-file-compressed 278937215 226602628 1.23
tpch_q14/datafusion:vortex-file-compressed 🚨 325804169 179583538 1.81
tpch_q15/datafusion:vortex-file-compressed 🚨 506598496 299299253 1.69
tpch_q16/datafusion:vortex-file-compressed 🚨 285195003 195834940 1.46
tpch_q17/datafusion:vortex-file-compressed 387567224 317150789 1.22
tpch_q18/datafusion:vortex-file-compressed 342396215 314296851 1.09
tpch_q19/datafusion:vortex-file-compressed 384261042 326974427 1.18
tpch_q20/datafusion:vortex-file-compressed 404669852 377082547 1.07
tpch_q21/datafusion:vortex-file-compressed 587997055 549723582 1.07
tpch_q22/datafusion:vortex-file-compressed 226226664 201184961 1.12
datafusion / vortex-compact (1.138x ➖, 0↑ 6↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 245219626 238859609 1.03
tpch_q02/datafusion:vortex-compact 483279900 459137827 1.05
tpch_q03/datafusion:vortex-compact 🚨 394371999 299081323 1.32
tpch_q04/datafusion:vortex-compact 242113222 209009060 1.16
tpch_q05/datafusion:vortex-compact 476376459 508466598 0.94
tpch_q06/datafusion:vortex-compact 376755852 443274434 0.85
tpch_q07/datafusion:vortex-compact 475110372 499024015 0.95
tpch_q08/datafusion:vortex-compact 🚨 764532436 573504595 1.33
tpch_q09/datafusion:vortex-compact 476408383 490902497 0.97
tpch_q10/datafusion:vortex-compact 🚨 666689646 468925453 1.42
tpch_q11/datafusion:vortex-compact 351685098 281429117 1.25
tpch_q12/datafusion:vortex-compact 609878406 517311553 1.18
tpch_q13/datafusion:vortex-compact 237260971 224678517 1.06
tpch_q14/datafusion:vortex-compact 🚨 411860021 311170520 1.32
tpch_q15/datafusion:vortex-compact 578565836 445494490 1.30
tpch_q16/datafusion:vortex-compact 219533050 223503743 0.98
tpch_q17/datafusion:vortex-compact 387699905 350452113 1.11
tpch_q18/datafusion:vortex-compact 342290826 308293296 1.11
tpch_q19/datafusion:vortex-compact 🚨 587133087 410538729 1.43
tpch_q20/datafusion:vortex-compact 🚨 613109785 447795329 1.37
tpch_q21/datafusion:vortex-compact 536033449 584630362 0.92
tpch_q22/datafusion:vortex-compact 150807282 117925749 1.28
datafusion / parquet (1.176x ➖, 0↑ 6↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 221589704 247787066 0.89
tpch_q02/datafusion:parquet 505143329 461744364 1.09
tpch_q03/datafusion:parquet 311210181 314120406 0.99
tpch_q04/datafusion:parquet 157711306 188302404 0.84
tpch_q05/datafusion:parquet 587112616 535684804 1.10
tpch_q06/datafusion:parquet 🚨 226815889 137888982 1.64
tpch_q07/datafusion:parquet 663185227 591698253 1.12
tpch_q08/datafusion:parquet 🚨 882117338 629253664 1.40
tpch_q09/datafusion:parquet 🚨 735268348 538557010 1.37
tpch_q10/datafusion:parquet 740529409 592715244 1.25
tpch_q11/datafusion:parquet 🚨 566967655 341338539 1.66
tpch_q12/datafusion:parquet 289860879 262152503 1.11
tpch_q13/datafusion:parquet 467303390 430870784 1.08
tpch_q14/datafusion:parquet 207927501 194044008 1.07
tpch_q15/datafusion:parquet 316533226 303418055 1.04
tpch_q16/datafusion:parquet 177617230 175983953 1.01
tpch_q17/datafusion:parquet 454224620 494909756 0.92
tpch_q18/datafusion:parquet 593926818 517690828 1.15
tpch_q19/datafusion:parquet 🚨 487268416 346172248 1.41
tpch_q20/datafusion:parquet 492327716 391328731 1.26
tpch_q21/datafusion:parquet 721136779 558543474 1.29
tpch_q22/datafusion:parquet 🚨 219315901 131610288 1.67
duckdb / vortex-file-compressed (1.063x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 233575233 217197049 1.08
tpch_q02/duckdb:vortex-file-compressed 919767701 874905419 1.05
tpch_q03/duckdb:vortex-file-compressed 589719429 593712652 0.99
tpch_q04/duckdb:vortex-file-compressed 363872438 354693273 1.03
tpch_q05/duckdb:vortex-file-compressed 826631670 887503315 0.93
tpch_q06/duckdb:vortex-file-compressed 452579097 358635271 1.26
tpch_q07/duckdb:vortex-file-compressed 785526611 755537736 1.04
tpch_q08/duckdb:vortex-file-compressed 1057000853 951703049 1.11
tpch_q09/duckdb:vortex-file-compressed 870800675 864844534 1.01
tpch_q10/duckdb:vortex-file-compressed 806694565 668514281 1.21
tpch_q11/duckdb:vortex-file-compressed 517183273 498177533 1.04
tpch_q12/duckdb:vortex-file-compressed 548224122 485834486 1.13
tpch_q13/duckdb:vortex-file-compressed 530833899 457421914 1.16
tpch_q14/duckdb:vortex-file-compressed 539525782 488488920 1.10
tpch_q15/duckdb:vortex-file-compressed 288359443 239109262 1.21
tpch_q16/duckdb:vortex-file-compressed 312749778 330764333 0.95
tpch_q17/duckdb:vortex-file-compressed 576846592 562349047 1.03
tpch_q18/duckdb:vortex-file-compressed 609312420 538129225 1.13
tpch_q19/duckdb:vortex-file-compressed 479021338 510040939 0.94
tpch_q20/duckdb:vortex-file-compressed 809568938 828746227 0.98
tpch_q21/duckdb:vortex-file-compressed 1134490582 1037473295 1.09
tpch_q22/duckdb:vortex-file-compressed 365889425 357967306 1.02
duckdb / vortex-compact (1.040x ➖, 0↑ 1↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 299694043 266806052 1.12
tpch_q02/duckdb:vortex-compact 999547006 839833588 1.19
tpch_q03/duckdb:vortex-compact 612342297 532025016 1.15
tpch_q04/duckdb:vortex-compact 363198945 333714845 1.09
tpch_q05/duckdb:vortex-compact 852811745 848360636 1.01
tpch_q06/duckdb:vortex-compact 358967089 459828120 0.78
tpch_q07/duckdb:vortex-compact 659140563 633025872 1.04
tpch_q08/duckdb:vortex-compact 960933665 912123339 1.05
tpch_q09/duckdb:vortex-compact 951506642 919227950 1.04
tpch_q10/duckdb:vortex-compact 682996662 795694258 0.86
tpch_q11/duckdb:vortex-compact 495045653 482575291 1.03
tpch_q12/duckdb:vortex-compact 🚨 593062731 381919739 1.55
tpch_q13/duckdb:vortex-compact 437018472 450185285 0.97
tpch_q14/duckdb:vortex-compact 552878703 452173261 1.22
tpch_q15/duckdb:vortex-compact 297116193 270091303 1.10
tpch_q16/duckdb:vortex-compact 289601465 331888622 0.87
tpch_q17/duckdb:vortex-compact 583583279 584142002 1.00
tpch_q18/duckdb:vortex-compact 482336468 484358065 1.00
tpch_q19/duckdb:vortex-compact 442589221 513775511 0.86
tpch_q20/duckdb:vortex-compact 682531848 774651432 0.88
tpch_q21/duckdb:vortex-compact 1193540488 971723903 1.23
tpch_q22/duckdb:vortex-compact 351648844 319140898 1.10
duckdb / parquet (1.079x ➖, 0↑ 1↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 610595789 470970935 1.30
tpch_q02/duckdb:parquet 1270189829 1292414694 0.98
tpch_q03/duckdb:parquet 949389208 1014786211 0.94
tpch_q04/duckdb:parquet 649832348 613775321 1.06
tpch_q05/duckdb:parquet 1385298864 1463951736 0.95
tpch_q06/duckdb:parquet 423015247 368294571 1.15
tpch_q07/duckdb:parquet 1503655407 1320608645 1.14
tpch_q08/duckdb:parquet 1814717343 1591299651 1.14
tpch_q09/duckdb:parquet 1529383588 1378242295 1.11
tpch_q10/duckdb:parquet 1435859573 1350636374 1.06
tpch_q11/duckdb:parquet 802144599 846843789 0.95
tpch_q12/duckdb:parquet 643017266 551342389 1.17
tpch_q13/duckdb:parquet 832024156 873131573 0.95
tpch_q14/duckdb:parquet 709891655 610484081 1.16
tpch_q15/duckdb:parquet 🚨 752232400 512989969 1.47
tpch_q16/duckdb:parquet 606539242 588070475 1.03
tpch_q17/duckdb:parquet 845766060 712988275 1.19
tpch_q18/duckdb:parquet 828426523 839496771 0.99
tpch_q19/duckdb:parquet 888621205 867593624 1.02
tpch_q20/duckdb:parquet 1043290034 971898548 1.07
tpch_q21/duckdb:parquet 1216780445 1204471654 1.01
tpch_q22/duckdb:parquet 484157697 456382342 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.7% +7.7% -4.7% +152.4% ➖ noise
1 datafusion:vortex-file-compressed +79.3% +7.7% +66.5% +137.2% ➖ noise
1 duckdb:vortex-compact +12.3% +7.7% +4.3% +106.0% ➖ noise
1 duckdb:vortex-file-compressed +7.5% +7.7% -0.1% +38.0% ➖ noise
2 datafusion:vortex-compact +5.3% +3.7% +1.5% +34.1% ➖ noise
2 datafusion:vortex-file-compressed +44.9% +3.7% +39.7% +34.8% 🚨 regression
2 duckdb:vortex-compact +19.0% +3.7% +14.8% +30.2% ➖ noise
2 duckdb:vortex-file-compressed +5.1% +3.7% +1.4% +32.4% ➖ noise
3 datafusion:vortex-compact +31.9% -3.7% +37.0% +71.9% ➖ noise
3 datafusion:vortex-file-compressed -9.4% -3.7% -5.9% +83.6% ➖ noise
3 duckdb:vortex-compact +15.1% -3.7% +19.5% +31.8% ➖ noise
3 duckdb:vortex-file-compressed -0.7% -3.7% +3.2% +30.9% ➖ noise
4 datafusion:vortex-compact +15.8% -5.8% +23.0% +33.1% ➖ noise
4 datafusion:vortex-file-compressed +56.2% -5.8% +65.8% +83.7% ➖ noise
4 duckdb:vortex-compact +8.8% -5.8% +15.6% +30.2% ➖ noise
4 duckdb:vortex-file-compressed +2.6% -5.8% +8.9% +30.2% ➖ noise
5 datafusion:vortex-compact -6.3% +1.8% -8.0% +39.3% ➖ noise
5 datafusion:vortex-file-compressed +56.4% +1.8% +53.5% +54.3% ➖ noise
5 duckdb:vortex-compact +0.5% +1.8% -1.3% +31.4% ➖ noise
5 duckdb:vortex-file-compressed -6.9% +1.8% -8.5% +31.2% ➖ noise
6 datafusion:vortex-compact -15.0% +37.5% -38.2% +44.9% ✅ faster
6 datafusion:vortex-file-compressed +100.0% +37.5% +45.5% +62.7% ➖ noise
6 duckdb:vortex-compact -21.9% +37.5% -43.2% +38.4% ✅ faster
6 duckdb:vortex-file-compressed +26.2% +37.5% -8.2% +48.6% ➖ noise
7 datafusion:vortex-compact -4.8% +13.0% -15.7% +36.1% ➖ noise
7 datafusion:vortex-file-compressed +65.1% +13.0% +46.1% +39.3% 🚨 regression
7 duckdb:vortex-compact +4.1% +13.0% -7.8% +30.2% ➖ noise
7 duckdb:vortex-file-compressed +4.0% +13.0% -8.0% +40.8% ➖ noise
8 datafusion:vortex-compact +33.3% +26.4% +5.4% +49.1% ➖ noise
8 datafusion:vortex-file-compressed +1.4% +26.4% -19.8% +30.2% ➖ noise
8 duckdb:vortex-compact +5.4% +26.4% -16.7% +30.2% ➖ noise
8 duckdb:vortex-file-compressed +11.1% +26.4% -12.2% +30.2% ➖ noise
9 datafusion:vortex-compact -3.0% +23.1% -21.2% +33.2% ➖ noise
9 datafusion:vortex-file-compressed +2.7% +23.1% -16.6% +62.0% ➖ noise
9 duckdb:vortex-compact +3.5% +23.1% -15.9% +30.2% ➖ noise
9 duckdb:vortex-file-compressed +0.7% +23.1% -18.2% +30.2% ➖ noise
10 datafusion:vortex-compact +42.2% +15.2% +23.4% +41.8% ➖ noise
10 datafusion:vortex-file-compressed +136.9% +15.2% +105.6% +30.2% 🚨 regression
10 duckdb:vortex-compact -14.2% +15.2% -25.5% +30.2% ✅ faster
10 duckdb:vortex-file-compressed +20.7% +15.2% +4.7% +30.2% ➖ noise
11 datafusion:vortex-compact +25.0% +25.4% -0.4% +34.4% ➖ noise
11 datafusion:vortex-file-compressed +154.8% +25.4% +103.1% +30.5% 🚨 regression
11 duckdb:vortex-compact +2.6% +25.4% -18.2% +30.2% ➖ noise
11 duckdb:vortex-file-compressed +3.8% +25.4% -17.2% +43.5% ➖ noise
12 datafusion:vortex-compact +17.9% +13.6% +3.8% +42.9% ➖ noise
12 datafusion:vortex-file-compressed +74.8% +13.6% +53.9% +40.6% 🚨 regression
12 duckdb:vortex-compact +55.3% +13.6% +36.7% +39.1% ➖ noise
12 duckdb:vortex-file-compressed +12.8% +13.6% -0.6% +31.8% ➖ noise
13 datafusion:vortex-compact +5.6% +1.7% +3.9% +65.9% ➖ noise
13 datafusion:vortex-file-compressed +23.1% +1.7% +21.1% +30.2% ➖ noise
13 duckdb:vortex-compact -2.9% +1.7% -4.5% +52.6% ➖ noise
13 duckdb:vortex-file-compressed +16.0% +1.7% +14.2% +30.2% ➖ noise
14 datafusion:vortex-compact +32.4% +11.6% +18.6% +44.5% ➖ noise
14 datafusion:vortex-file-compressed +81.4% +11.6% +62.5% +61.7% 🚨 regression
14 duckdb:vortex-compact +22.3% +11.6% +9.5% +33.8% ➖ noise
14 duckdb:vortex-file-compressed +10.4% +11.6% -1.1% +46.4% ➖ noise
15 datafusion:vortex-compact +29.9% +23.7% +5.0% +45.9% ➖ noise
15 datafusion:vortex-file-compressed +69.3% +23.7% +36.9% +43.9% ➖ noise
15 duckdb:vortex-compact +10.0% +23.7% -11.1% +34.2% ➖ noise
15 duckdb:vortex-file-compressed +20.6% +23.7% -2.5% +30.2% ➖ noise
16 datafusion:vortex-compact -1.8% +2.0% -3.7% +57.5% ➖ noise
16 datafusion:vortex-file-compressed +45.6% +2.0% +42.7% +30.2% 🚨 regression
16 duckdb:vortex-compact -12.7% +2.0% -14.5% +30.2% ➖ noise
16 duckdb:vortex-file-compressed -5.4% +2.0% -7.3% +30.2% ➖ noise
17 datafusion:vortex-compact +10.6% +4.3% +6.0% +30.3% ➖ noise
17 datafusion:vortex-file-compressed +22.2% +4.3% +17.1% +36.5% ➖ noise
17 duckdb:vortex-compact -0.1% +4.3% -4.3% +30.2% ➖ noise
17 duckdb:vortex-file-compressed +2.6% +4.3% -1.7% +35.5% ➖ noise
18 datafusion:vortex-compact +11.0% +6.4% +4.3% +30.2% ➖ noise
18 datafusion:vortex-file-compressed +8.9% +6.4% +2.4% +37.2% ➖ noise
18 duckdb:vortex-compact -0.4% +6.4% -6.4% +30.2% ➖ noise
18 duckdb:vortex-file-compressed +13.2% +6.4% +6.4% +30.2% ➖ noise
19 datafusion:vortex-compact +43.0% +20.1% +19.1% +30.2% ➖ noise
19 datafusion:vortex-file-compressed +17.5% +20.1% -2.1% +30.2% ➖ noise
19 duckdb:vortex-compact -13.9% +20.1% -28.3% +30.2% ✅ faster
19 duckdb:vortex-file-compressed -6.1% +20.1% -21.8% +30.2% ➖ noise
20 datafusion:vortex-compact +36.9% +16.2% +17.8% +30.2% ➖ noise
20 datafusion:vortex-file-compressed +7.3% +16.2% -7.7% +30.2% ➖ noise
20 duckdb:vortex-compact -11.9% +16.2% -24.2% +30.2% ✅ faster
20 duckdb:vortex-file-compressed -2.3% +16.2% -15.9% +31.1% ➖ noise
21 datafusion:vortex-compact -8.3% +14.2% -19.7% +30.2% ➖ noise
21 datafusion:vortex-file-compressed +7.0% +14.2% -6.3% +30.2% ➖ noise
21 duckdb:vortex-compact +22.8% +14.2% +7.5% +30.2% ➖ noise
21 duckdb:vortex-file-compressed +9.4% +14.2% -4.3% +30.2% ➖ noise
22 datafusion:vortex-compact +27.9% +33.0% -3.8% +43.7% ➖ noise
22 datafusion:vortex-file-compressed +12.4% +33.0% -15.4% +44.3% ➖ noise
22 duckdb:vortex-compact +10.2% +33.0% -17.1% +31.7% ➖ noise
22 duckdb:vortex-file-compressed +2.2% +33.0% -23.1% +40.7% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-DS SF=1 on NVME

Summary

  • Overall: 0.951x ➖
  • Vortex: 0.948x ➖
  • Parquet: 0.973x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -3.1%
  • Confidence: low
  • Environment shift: -2.7%

Statistical Summary

  • Systemic shift (parquet controls): -2.7%
  • Control sigma: +3.3%
  • Residual noise: +3.3%
  • Median polish overall: -5.3%
datafusion / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 29056233 28107365 1.03
tpcds_q02/datafusion:vortex-file-compressed 74985253 76156743 0.98
tpcds_q03/datafusion:vortex-file-compressed 26888914 27314941 0.98
tpcds_q04/datafusion:vortex-file-compressed 393122038 394659980 1.00
tpcds_q05/datafusion:vortex-file-compressed 70463105 74575533 0.94
tpcds_q06/datafusion:vortex-file-compressed 74138742 75310552 0.98
tpcds_q07/datafusion:vortex-file-compressed 77295807 76792294 1.01
tpcds_q08/datafusion:vortex-file-compressed 40265744 39198797 1.03
tpcds_q09/datafusion:vortex-file-compressed 47570012 46188884 1.03
tpcds_q10/datafusion:vortex-file-compressed 47610533 47851330 0.99
tpcds_q11/datafusion:vortex-file-compressed 230998570 226642236 1.02
tpcds_q12/datafusion:vortex-file-compressed 34473440 35183354 0.98
tpcds_q13/datafusion:vortex-file-compressed 75271608 76390516 0.99
tpcds_q14/datafusion:vortex-file-compressed 208528197 211240942 0.99
tpcds_q15/datafusion:vortex-file-compressed 48765124 49908853 0.98
tpcds_q16/datafusion:vortex-file-compressed 29357796 28838919 1.02
tpcds_q17/datafusion:vortex-file-compressed 107784820 115354789 0.93
tpcds_q18/datafusion:vortex-file-compressed 102307904 100464151 1.02
tpcds_q19/datafusion:vortex-file-compressed 46123387 47366612 0.97
tpcds_q20/datafusion:vortex-file-compressed 40671732 39176102 1.04
tpcds_q21/datafusion:vortex-file-compressed 171329645 178576420 0.96
tpcds_q22/datafusion:vortex-file-compressed 70410091 70720602 1.00
tpcds_q23/datafusion:vortex-file-compressed 184193771 187003906 0.98
tpcds_q24/datafusion:vortex-file-compressed 182352879 181994746 1.00
tpcds_q25/datafusion:vortex-file-compressed 111290173 111341309 1.00
tpcds_q26/datafusion:vortex-file-compressed 62196906 62927597 0.99
tpcds_q27/datafusion:vortex-file-compressed 171036642 161879765 1.06
tpcds_q28/datafusion:vortex-file-compressed 50272648 48821153 1.03
tpcds_q29/datafusion:vortex-file-compressed 108983112 110239643 0.99
tpcds_q30/datafusion:vortex-file-compressed 29803513 31312427 0.95
tpcds_q31/datafusion:vortex-file-compressed 177027626 177997210 0.99
tpcds_q32/datafusion:vortex-file-compressed 23760070 23291811 1.02
tpcds_q33/datafusion:vortex-file-compressed 38707678 36654648 1.06
tpcds_q34/datafusion:vortex-file-compressed 36922535 36741129 1.00
tpcds_q35/datafusion:vortex-file-compressed 60137128 58547981 1.03
tpcds_q36/datafusion:vortex-file-compressed 105753981 103719070 1.02
tpcds_q37/datafusion:vortex-file-compressed 38179151 38755368 0.99
tpcds_q38/datafusion:vortex-file-compressed 88077955 86591562 1.02
tpcds_q39/datafusion:vortex-file-compressed 185214898 194030086 0.95
tpcds_q40/datafusion:vortex-file-compressed 55554027 55924272 0.99
tpcds_q41/datafusion:vortex-file-compressed 13362532 13529078 0.99
tpcds_q42/datafusion:vortex-file-compressed 31087422 30511998 1.02
tpcds_q43/datafusion:vortex-file-compressed 49207793 48300445 1.02
tpcds_q44/datafusion:vortex-file-compressed 41192816 41688196 0.99
tpcds_q45/datafusion:vortex-file-compressed 48588352 48444020 1.00
tpcds_q46/datafusion:vortex-file-compressed 65803258 64411655 1.02
tpcds_q47/datafusion:vortex-file-compressed 273554679 274188703 1.00
tpcds_q48/datafusion:vortex-file-compressed 68308645 67960415 1.01
tpcds_q49/datafusion:vortex-file-compressed 70638280 68735280 1.03
tpcds_q50/datafusion:vortex-file-compressed 73598660 73123295 1.01
tpcds_q51/datafusion:vortex-file-compressed 96177172 92172985 1.04
tpcds_q52/datafusion:vortex-file-compressed 29596661 28912194 1.02
tpcds_q53/datafusion:vortex-file-compressed 29466086 29037140 1.01
tpcds_q54/datafusion:vortex-file-compressed 48337086 47263421 1.02
tpcds_q55/datafusion:vortex-file-compressed 30887125 30666088 1.01
tpcds_q56/datafusion:vortex-file-compressed 48304929 45425520 1.06
tpcds_q57/datafusion:vortex-file-compressed 183400126 179850007 1.02
tpcds_q58/datafusion:vortex-file-compressed 109567710 109612165 1.00
tpcds_q59/datafusion:vortex-file-compressed 90525245 91419013 0.99
tpcds_q60/datafusion:vortex-file-compressed 46935521 47525051 0.99
tpcds_q61/datafusion:vortex-file-compressed 56521349 56652539 1.00
tpcds_q62/datafusion:vortex-file-compressed 44594460 43418589 1.03
tpcds_q63/datafusion:vortex-file-compressed 29493259 28653501 1.03
tpcds_q64/datafusion:vortex-file-compressed 716726743 714326482 1.00
tpcds_q65/datafusion:vortex-file-compressed 50053064 51803179 0.97
tpcds_q66/datafusion:vortex-file-compressed 109087405 107031027 1.02
tpcds_q67/datafusion:vortex-file-compressed 140632681 143028551 0.98
tpcds_q68/datafusion:vortex-file-compressed 64535535 66958987 0.96
tpcds_q69/datafusion:vortex-file-compressed 45656837 44873694 1.02
tpcds_q70/datafusion:vortex-file-compressed 130496467 132741680 0.98
tpcds_q71/datafusion:vortex-file-compressed 29590025 29287820 1.01
tpcds_q72/datafusion:vortex-file-compressed 3385179645 3388269580 1.00
tpcds_q73/datafusion:vortex-file-compressed 38321502 38358136 1.00
tpcds_q74/datafusion:vortex-file-compressed 169026645 165305321 1.02
tpcds_q75/datafusion:vortex-file-compressed 130335716 131400019 0.99
tpcds_q76/datafusion:vortex-file-compressed 65959881 68703408 0.96
tpcds_q77/datafusion:vortex-file-compressed 54076506 54028953 1.00
tpcds_q78/datafusion:vortex-file-compressed 181584842 177070644 1.03
tpcds_q79/datafusion:vortex-file-compressed 43098052 42624387 1.01
tpcds_q80/datafusion:vortex-file-compressed 116196702 115999490 1.00
tpcds_q81/datafusion:vortex-file-compressed 36247045 38052143 0.95
tpcds_q82/datafusion:vortex-file-compressed 40309169 39863349 1.01
tpcds_q83/datafusion:vortex-file-compressed 65928133 67154255 0.98
tpcds_q84/datafusion:vortex-file-compressed 14852507 15323089 0.97
tpcds_q85/datafusion:vortex-file-compressed 134677053 133753177 1.01
tpcds_q86/datafusion:vortex-file-compressed 31412049 30263809 1.04
tpcds_q87/datafusion:vortex-file-compressed 89918884 88660014 1.01
tpcds_q88/datafusion:vortex-file-compressed 81042746 79050387 1.03
tpcds_q89/datafusion:vortex-file-compressed 55476568 56697135 0.98
tpcds_q90/datafusion:vortex-file-compressed 16413430 16203441 1.01
tpcds_q91/datafusion:vortex-file-compressed 27553477 25996037 1.06
tpcds_q92/datafusion:vortex-file-compressed 19446482 19460677 1.00
tpcds_q93/datafusion:vortex-file-compressed 36760839 35633947 1.03
tpcds_q94/datafusion:vortex-file-compressed 26204764 25496908 1.03
tpcds_q95/datafusion:vortex-file-compressed 88006041 87944106 1.00
tpcds_q96/datafusion:vortex-file-compressed 14932408 14764369 1.01
tpcds_q97/datafusion:vortex-file-compressed 30922728 31763659 0.97
tpcds_q98/datafusion:vortex-file-compressed 51153594 50129284 1.02
tpcds_q99/datafusion:vortex-file-compressed 62931112 59640187 1.06
datafusion / vortex-compact (0.891x ✅, 63↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 33987449 36481055 0.93
tpcds_q02/datafusion:vortex-compact 79630549 80722905 0.99
tpcds_q03/datafusion:vortex-compact 33486039 32010641 1.05
tpcds_q04/datafusion:vortex-compact 433415202 444580398 0.97
tpcds_q05/datafusion:vortex-compact 80240727 83179076 0.96
tpcds_q06/datafusion:vortex-compact 81329866 80172989 1.01
tpcds_q07/datafusion:vortex-compact 89956013 92083203 0.98
tpcds_q08/datafusion:vortex-compact 49052530 48080352 1.02
tpcds_q09/datafusion:vortex-compact 98884469 99555174 0.99
tpcds_q10/datafusion:vortex-compact 68093169 67807628 1.00
tpcds_q11/datafusion:vortex-compact 257042210 257710295 1.00
tpcds_q12/datafusion:vortex-compact 🚀 37504847 41752627 0.90
tpcds_q13/datafusion:vortex-compact 143161975 149301398 0.96
tpcds_q14/datafusion:vortex-compact 🚀 269560486 311509068 0.87
tpcds_q15/datafusion:vortex-compact 🚀 52845746 62863019 0.84
tpcds_q16/datafusion:vortex-compact 🚀 39840961 44355903 0.90
tpcds_q17/datafusion:vortex-compact 🚀 128540780 144773128 0.89
tpcds_q18/datafusion:vortex-compact 🚀 111382093 133643528 0.83
tpcds_q19/datafusion:vortex-compact 62409191 69082919 0.90
tpcds_q20/datafusion:vortex-compact 🚀 44588452 50197082 0.89
tpcds_q21/datafusion:vortex-compact 🚀 174264720 208602908 0.84
tpcds_q22/datafusion:vortex-compact 🚀 74512551 88566866 0.84
tpcds_q23/datafusion:vortex-compact 🚀 231061078 276999041 0.83
tpcds_q24/datafusion:vortex-compact 🚀 210444388 245174546 0.86
tpcds_q25/datafusion:vortex-compact 🚀 132389753 149985070 0.88
tpcds_q26/datafusion:vortex-compact 🚀 76238881 85050468 0.90
tpcds_q27/datafusion:vortex-compact 🚀 210206123 247755697 0.85
tpcds_q28/datafusion:vortex-compact 🚀 102077969 114719461 0.89
tpcds_q29/datafusion:vortex-compact 🚀 128597647 147607660 0.87
tpcds_q30/datafusion:vortex-compact 🚀 36616276 42332516 0.86
tpcds_q31/datafusion:vortex-compact 217379162 238217156 0.91
tpcds_q32/datafusion:vortex-compact 🚀 28585571 35356417 0.81
tpcds_q33/datafusion:vortex-compact 🚀 51185596 61038966 0.84
tpcds_q34/datafusion:vortex-compact 🚀 57430359 66543851 0.86
tpcds_q35/datafusion:vortex-compact 🚀 73909407 89985424 0.82
tpcds_q36/datafusion:vortex-compact 131682720 145515805 0.90
tpcds_q37/datafusion:vortex-compact 🚀 48200993 57685354 0.84
tpcds_q38/datafusion:vortex-compact 🚀 100954232 113134833 0.89
tpcds_q39/datafusion:vortex-compact 🚀 190213278 230186897 0.83
tpcds_q40/datafusion:vortex-compact 🚀 59550197 75066433 0.79
tpcds_q41/datafusion:vortex-compact 🚀 15308144 20396756 0.75
tpcds_q42/datafusion:vortex-compact 🚀 36186815 42133763 0.86
tpcds_q43/datafusion:vortex-compact 🚀 55513819 63243018 0.88
tpcds_q44/datafusion:vortex-compact 71735999 79179684 0.91
tpcds_q45/datafusion:vortex-compact 🚀 52860542 60116704 0.88
tpcds_q46/datafusion:vortex-compact 🚀 89993933 106653404 0.84
tpcds_q47/datafusion:vortex-compact 🚀 295236642 372100680 0.79
tpcds_q48/datafusion:vortex-compact 🚀 107602152 122036296 0.88
tpcds_q49/datafusion:vortex-compact 🚀 97617045 113333917 0.86
tpcds_q50/datafusion:vortex-compact 🚀 93720995 109355148 0.86
tpcds_q51/datafusion:vortex-compact 🚀 102564391 120649240 0.85
tpcds_q52/datafusion:vortex-compact 37145720 39997048 0.93
tpcds_q53/datafusion:vortex-compact 🚀 40724131 45970091 0.89
tpcds_q54/datafusion:vortex-compact 🚀 63213436 72382278 0.87
tpcds_q55/datafusion:vortex-compact 37417648 39348157 0.95
tpcds_q56/datafusion:vortex-compact 🚀 59675489 67816864 0.88
tpcds_q57/datafusion:vortex-compact 🚀 197943133 225933181 0.88
tpcds_q58/datafusion:vortex-compact 🚀 118172100 134994767 0.88
tpcds_q59/datafusion:vortex-compact 🚀 108279106 131986037 0.82
tpcds_q60/datafusion:vortex-compact 🚀 58971212 67917430 0.87
tpcds_q61/datafusion:vortex-compact 🚀 82978801 94639906 0.88
tpcds_q62/datafusion:vortex-compact 🚀 46015685 52396904 0.88
tpcds_q63/datafusion:vortex-compact 🚀 40124068 46845228 0.86
tpcds_q64/datafusion:vortex-compact 🚀 798700025 914071185 0.87
tpcds_q65/datafusion:vortex-compact 🚀 70770487 84277063 0.84
tpcds_q66/datafusion:vortex-compact 🚀 109775277 131118125 0.84
tpcds_q67/datafusion:vortex-compact 🚀 149025898 176675126 0.84
tpcds_q68/datafusion:vortex-compact 🚀 90973012 105226025 0.86
tpcds_q69/datafusion:vortex-compact 🚀 62529872 72791273 0.86
tpcds_q70/datafusion:vortex-compact 🚀 139282840 162096615 0.86
tpcds_q71/datafusion:vortex-compact 🚀 45390728 53091123 0.85
tpcds_q72/datafusion:vortex-compact 🚀 3694791477 4398647669 0.84
tpcds_q73/datafusion:vortex-compact 🚀 59680445 66855190 0.89
tpcds_q74/datafusion:vortex-compact 194436327 211216836 0.92
tpcds_q75/datafusion:vortex-compact 🚀 189075708 211332087 0.89
tpcds_q76/datafusion:vortex-compact 83792744 91886064 0.91
tpcds_q77/datafusion:vortex-compact 🚀 70561118 78561413 0.90
tpcds_q78/datafusion:vortex-compact 🚀 215963689 247654569 0.87
tpcds_q79/datafusion:vortex-compact 72535027 78391066 0.93
tpcds_q80/datafusion:vortex-compact 152550891 159897772 0.95
tpcds_q81/datafusion:vortex-compact 🚀 45709164 51436115 0.89
tpcds_q82/datafusion:vortex-compact 55276401 60279666 0.92
tpcds_q83/datafusion:vortex-compact 69132812 75407872 0.92
tpcds_q84/datafusion:vortex-compact 🚀 19200826 21441978 0.90
tpcds_q85/datafusion:vortex-compact 167081456 172934493 0.97
tpcds_q86/datafusion:vortex-compact 🚀 33663664 37479477 0.90
tpcds_q87/datafusion:vortex-compact 106347855 113695558 0.94
tpcds_q88/datafusion:vortex-compact 134934980 147899519 0.91
tpcds_q89/datafusion:vortex-compact 69484982 74843745 0.93
tpcds_q90/datafusion:vortex-compact 23451228 24940443 0.94
tpcds_q91/datafusion:vortex-compact 42590164 46559511 0.91
tpcds_q92/datafusion:vortex-compact 24054558 26363498 0.91
tpcds_q93/datafusion:vortex-compact 55977868 60917301 0.92
tpcds_q94/datafusion:vortex-compact 35207920 35272713 1.00
tpcds_q95/datafusion:vortex-compact 102798109 107050535 0.96
tpcds_q96/datafusion:vortex-compact 🚀 24825858 27827281 0.89
tpcds_q97/datafusion:vortex-compact 46203070 50251123 0.92
tpcds_q98/datafusion:vortex-compact 59912697 65702429 0.91
tpcds_q99/datafusion:vortex-compact 🚀 68347231 77210115 0.89
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 37028155 37834882 0.98
tpcds_q02/datafusion:parquet 50145906 49936014 1.00
tpcds_q03/datafusion:parquet 17135632 17303673 0.99
tpcds_q04/datafusion:parquet 350380541 361921091 0.97
tpcds_q05/datafusion:parquet 93959483 90395113 1.04
tpcds_q06/datafusion:parquet 96677174 94872724 1.02
tpcds_q07/datafusion:parquet 138818845 130154081 1.07
tpcds_q08/datafusion:parquet 38386105 37800377 1.02
tpcds_q09/datafusion:parquet 55636717 53858353 1.03
tpcds_q10/datafusion:parquet 103261428 103973988 0.99
tpcds_q11/datafusion:parquet 224633270 228901283 0.98
tpcds_q12/datafusion:parquet 30589912 33218085 0.92
tpcds_q13/datafusion:parquet 142488538 140919053 1.01
tpcds_q14/datafusion:parquet 207509633 213568431 0.97
tpcds_q15/datafusion:parquet 53711952 55101905 0.97
tpcds_q16/datafusion:parquet 33234254 33157052 1.00
tpcds_q17/datafusion:parquet 172650201 173567524 0.99
tpcds_q18/datafusion:parquet 178238641 180361788 0.99
tpcds_q19/datafusion:parquet 34356974 35483946 0.97
tpcds_q20/datafusion:parquet 24783899 24935411 0.99
tpcds_q21/datafusion:parquet 27390239 27737924 0.99
tpcds_q22/datafusion:parquet 148932486 152383134 0.98
tpcds_q23/datafusion:parquet 179538252 179803002 1.00
tpcds_q24/datafusion:parquet 220557143 213993691 1.03
tpcds_q25/datafusion:parquet 180574608 176433036 1.02
tpcds_q26/datafusion:parquet 116314426 116220374 1.00
tpcds_q27/datafusion:parquet 262667534 259026647 1.01
tpcds_q28/datafusion:parquet 53922541 51844364 1.04
tpcds_q29/datafusion:parquet 181829161 181207563 1.00
tpcds_q30/datafusion:parquet 44867509 44696056 1.00
tpcds_q31/datafusion:parquet 109946137 104915841 1.05
tpcds_q32/datafusion:parquet 30991848 28646042 1.08
tpcds_q33/datafusion:parquet 38324696 35702266 1.07
tpcds_q34/datafusion:parquet 35670305 35950901 0.99
tpcds_q35/datafusion:parquet 96521211 96657317 1.00
tpcds_q36/datafusion:parquet 83194213 83258391 1.00
tpcds_q37/datafusion:parquet 25568512 25430472 1.01
tpcds_q38/datafusion:parquet 62596200 65243859 0.96
tpcds_q39/datafusion:parquet 98400435 98734128 1.00
tpcds_q40/datafusion:parquet 35958583 37146186 0.97
tpcds_q41/datafusion:parquet 12206477 12649473 0.96
tpcds_q42/datafusion:parquet 15305840 15110148 1.01
tpcds_q43/datafusion:parquet 26708673 26347446 1.01
tpcds_q44/datafusion:parquet 41473843 41427392 1.00
tpcds_q45/datafusion:parquet 69595234 65058031 1.07
tpcds_q46/datafusion:parquet 49583669 50593956 0.98
tpcds_q47/datafusion:parquet 194733595 184697751 1.05
tpcds_q48/datafusion:parquet 133810621 127362523 1.05
tpcds_q49/datafusion:parquet 73849234 74422680 0.99
tpcds_q50/datafusion:parquet 110181743 113511963 0.97
tpcds_q51/datafusion:parquet 97637197 98606060 0.99
tpcds_q52/datafusion:parquet 15267820 15789836 0.97
tpcds_q53/datafusion:parquet 29946980 31210978 0.96
tpcds_q54/datafusion:parquet 49805026 46552101 1.07
tpcds_q55/datafusion:parquet 16945116 15750936 1.08
tpcds_q56/datafusion:parquet 37180838 36013447 1.03
tpcds_q57/datafusion:parquet 134076192 133870560 1.00
tpcds_q58/datafusion:parquet 70422580 71425093 0.99
tpcds_q59/datafusion:parquet 70783789 65597640 1.08
tpcds_q60/datafusion:parquet 38512172 37091745 1.04
tpcds_q61/datafusion:parquet 66161945 65059317 1.02
tpcds_q62/datafusion:parquet 47479861 45307362 1.05
tpcds_q63/datafusion:parquet 31838200 30186876 1.05
tpcds_q64/datafusion:parquet 1000320229 999555379 1.00
tpcds_q65/datafusion:parquet 50147040 50771077 0.99
tpcds_q66/datafusion:parquet 83637700 90664431 0.92
tpcds_q67/datafusion:parquet 177556794 181001469 0.98
tpcds_q68/datafusion:parquet 50977364 50410663 1.01
tpcds_q69/datafusion:parquet 93957446 94279323 1.00
tpcds_q70/datafusion:parquet 110696833 110411342 1.00
tpcds_q71/datafusion:parquet 28707075 28749568 1.00
tpcds_q72/datafusion:parquet 862413787 864906831 1.00
tpcds_q73/datafusion:parquet 35524870 38158978 0.93
tpcds_q74/datafusion:parquet 131069032 133144108 0.98
tpcds_q75/datafusion:parquet 131962990 129541260 1.02
tpcds_q76/datafusion:parquet 84542380 87619880 0.96
tpcds_q77/datafusion:parquet 58712620 57662351 1.02
tpcds_q78/datafusion:parquet 181520889 180106821 1.01
tpcds_q79/datafusion:parquet 39840978 40464333 0.98
tpcds_q80/datafusion:parquet 113222906 111647271 1.01
tpcds_q81/datafusion:parquet 45145129 43957423 1.03
tpcds_q82/datafusion:parquet 28902261 28725053 1.01
tpcds_q83/datafusion:parquet 58251622 53228842 1.09
tpcds_q84/datafusion:parquet 49903775 48461148 1.03
tpcds_q85/datafusion:parquet 246318029 246750656 1.00
tpcds_q86/datafusion:parquet 21456572 20788799 1.03
tpcds_q87/datafusion:parquet 63203010 65252041 0.97
tpcds_q88/datafusion:parquet 79283173 79996366 0.99
tpcds_q89/datafusion:parquet 38788968 36874047 1.05
tpcds_q90/datafusion:parquet 19086966 18483610 1.03
tpcds_q91/datafusion:parquet 76472882 79051357 0.97
tpcds_q92/datafusion:parquet 26925850 25037531 1.08
tpcds_q93/datafusion:parquet 40459507 38680260 1.05
tpcds_q94/datafusion:parquet 29793591 27421892 1.09
tpcds_q95/datafusion:parquet 133786057 136374148 0.98
tpcds_q96/datafusion:parquet 15017613 15299326 0.98
tpcds_q97/datafusion:parquet 35696459 35047838 1.02
tpcds_q98/datafusion:parquet 36778207 37600613 0.98
tpcds_q99/datafusion:parquet 46174552 46640176 0.99
duckdb / vortex-file-compressed (0.969x ➖, 5↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 27588247 29088524 0.95
tpcds_q02/duckdb:vortex-file-compressed 89295394 89750955 0.99
tpcds_q03/duckdb:vortex-file-compressed 24840423 24548387 1.01
tpcds_q04/duckdb:vortex-file-compressed 111584073 120931051 0.92
tpcds_q05/duckdb:vortex-file-compressed 103018916 114167861 0.90
tpcds_q06/duckdb:vortex-file-compressed 37488087 40051775 0.94
tpcds_q07/duckdb:vortex-file-compressed 24904108 26652419 0.93
tpcds_q08/duckdb:vortex-file-compressed 24876777 27388512 0.91
tpcds_q09/duckdb:vortex-file-compressed 42403677 45022664 0.94
tpcds_q10/duckdb:vortex-file-compressed 40454016 40772021 0.99
tpcds_q11/duckdb:vortex-file-compressed 63333831 67289197 0.94
tpcds_q12/duckdb:vortex-file-compressed 16539000 16734468 0.99
tpcds_q13/duckdb:vortex-file-compressed 35338330 37649011 0.94
tpcds_q14/duckdb:vortex-file-compressed 202591849 203417145 1.00
tpcds_q15/duckdb:vortex-file-compressed 43825780 45432321 0.96
tpcds_q16/duckdb:vortex-file-compressed 32460744 33601139 0.97
tpcds_q17/duckdb:vortex-file-compressed 40598672 42685868 0.95
tpcds_q18/duckdb:vortex-file-compressed 48615164 49707937 0.98
tpcds_q19/duckdb:vortex-file-compressed 35975338 36846841 0.98
tpcds_q20/duckdb:vortex-file-compressed 17941531 18239999 0.98
tpcds_q21/duckdb:vortex-file-compressed 22773330 21704698 1.05
tpcds_q22/duckdb:vortex-file-compressed 111881011 121134946 0.92
tpcds_q23/duckdb:vortex-file-compressed 134339641 143485710 0.94
tpcds_q24/duckdb:vortex-file-compressed 63322801 60246185 1.05
tpcds_q25/duckdb:vortex-file-compressed 41173371 40677882 1.01
tpcds_q26/duckdb:vortex-file-compressed 42346979 45418623 0.93
tpcds_q27/duckdb:vortex-file-compressed 92467347 94770437 0.98
tpcds_q28/duckdb:vortex-file-compressed 38914511 38916538 1.00
tpcds_q29/duckdb:vortex-file-compressed 41174803 40655985 1.01
tpcds_q30/duckdb:vortex-file-compressed 31857484 34031894 0.94
tpcds_q31/duckdb:vortex-file-compressed 26330666 27328160 0.96
tpcds_q32/duckdb:vortex-file-compressed 18948013 18304873 1.04
tpcds_q33/duckdb:vortex-file-compressed 75849519 73785533 1.03
tpcds_q34/duckdb:vortex-file-compressed 19704957 21510410 0.92
tpcds_q35/duckdb:vortex-file-compressed 71193929 75399058 0.94
tpcds_q36/duckdb:vortex-file-compressed 29685741 31418327 0.94
tpcds_q37/duckdb:vortex-file-compressed 24604313 25308676 0.97
tpcds_q38/duckdb:vortex-file-compressed 41441946 42176143 0.98
tpcds_q39/duckdb:vortex-file-compressed 47707753 46636600 1.02
tpcds_q40/duckdb:vortex-file-compressed 24952294 24813568 1.01
tpcds_q41/duckdb:vortex-file-compressed 15153885 15195861 1.00
tpcds_q42/duckdb:vortex-file-compressed 12516319 13272985 0.94
tpcds_q43/duckdb:vortex-file-compressed 21149488 21475406 0.98
tpcds_q44/duckdb:vortex-file-compressed 26738576 25920530 1.03
tpcds_q45/duckdb:vortex-file-compressed 30807255 31267292 0.99
tpcds_q46/duckdb:vortex-file-compressed 51825109 52145388 0.99
tpcds_q47/duckdb:vortex-file-compressed 53323437 56405377 0.95
tpcds_q48/duckdb:vortex-file-compressed 32731399 33567562 0.98
tpcds_q49/duckdb:vortex-file-compressed 33465652 34146514 0.98
tpcds_q50/duckdb:vortex-file-compressed 36826580 39252220 0.94
tpcds_q51/duckdb:vortex-file-compressed 104242199 106830198 0.98
tpcds_q52/duckdb:vortex-file-compressed 🚀 12941690 14654459 0.88
tpcds_q53/duckdb:vortex-file-compressed 18466063 19347808 0.95
tpcds_q54/duckdb:vortex-file-compressed 53110427 55881325 0.95
tpcds_q55/duckdb:vortex-file-compressed 🚀 11606889 13407811 0.87
tpcds_q56/duckdb:vortex-file-compressed 72763330 75433370 0.96
tpcds_q57/duckdb:vortex-file-compressed 46083785 48247766 0.96
tpcds_q58/duckdb:vortex-file-compressed 34515621 34985663 0.99
tpcds_q59/duckdb:vortex-file-compressed 59848647 60094483 1.00
tpcds_q60/duckdb:vortex-file-compressed 74622136 80430302 0.93
tpcds_q61/duckdb:vortex-file-compressed 39792860 40991572 0.97
tpcds_q62/duckdb:vortex-file-compressed 19380042 19697194 0.98
tpcds_q63/duckdb:vortex-file-compressed 18814828 19293741 0.98
tpcds_q64/duckdb:vortex-file-compressed 85417445 87700885 0.97
tpcds_q65/duckdb:vortex-file-compressed 🚀 23963023 27022701 0.89
tpcds_q66/duckdb:vortex-file-compressed 63470605 64309670 0.99
tpcds_q67/duckdb:vortex-file-compressed 151683315 159038446 0.95
tpcds_q68/duckdb:vortex-file-compressed 42155294 44301389 0.95
tpcds_q69/duckdb:vortex-file-compressed 40647937 42611651 0.95
tpcds_q70/duckdb:vortex-file-compressed 26197188 26586936 0.99
tpcds_q71/duckdb:vortex-file-compressed 22227878 21975452 1.01
tpcds_q72/duckdb:vortex-file-compressed 179494535 183525224 0.98
tpcds_q73/duckdb:vortex-file-compressed 20028595 21567648 0.93
tpcds_q74/duckdb:vortex-file-compressed 50856094 56008910 0.91
tpcds_q75/duckdb:vortex-file-compressed 63307160 65213519 0.97
tpcds_q76/duckdb:vortex-file-compressed 🚀 65312060 74002573 0.88
tpcds_q77/duckdb:vortex-file-compressed 71874213 67283248 1.07
tpcds_q78/duckdb:vortex-file-compressed 83819067 84100885 1.00
tpcds_q79/duckdb:vortex-file-compressed 35781099 37765419 0.95
tpcds_q80/duckdb:vortex-file-compressed 100207732 100275344 1.00
tpcds_q81/duckdb:vortex-file-compressed 37776955 38012589 0.99
tpcds_q82/duckdb:vortex-file-compressed 25164437 26476154 0.95
tpcds_q83/duckdb:vortex-file-compressed 30503743 29794021 1.02
tpcds_q84/duckdb:vortex-file-compressed 19454115 19769489 0.98
tpcds_q85/duckdb:vortex-file-compressed 49067309 50403111 0.97
tpcds_q86/duckdb:vortex-file-compressed 🚀 17791855 19851208 0.90
tpcds_q87/duckdb:vortex-file-compressed 42976952 42801003 1.00
tpcds_q88/duckdb:vortex-file-compressed 42569834 44513347 0.96
tpcds_q89/duckdb:vortex-file-compressed 19280148 20871074 0.92
tpcds_q90/duckdb:vortex-file-compressed 16717449 16480490 1.01
tpcds_q91/duckdb:vortex-file-compressed 29877072 31293620 0.95
tpcds_q92/duckdb:vortex-file-compressed 15790058 16989190 0.93
tpcds_q93/duckdb:vortex-file-compressed 34113824 33749622 1.01
tpcds_q94/duckdb:vortex-file-compressed 25247706 25796417 0.98
tpcds_q95/duckdb:vortex-file-compressed 156472282 147771532 1.06
tpcds_q96/duckdb:vortex-file-compressed 18748987 19851712 0.94
tpcds_q97/duckdb:vortex-file-compressed 43294299 41692369 1.04
tpcds_q98/duckdb:vortex-file-compressed 19796189 19332856 1.02
tpcds_q99/duckdb:vortex-file-compressed 33485994 34369353 0.97
duckdb / vortex-compact (0.934x ➖, 16↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 38601789 36474994 1.06
tpcds_q02/duckdb:vortex-compact 128311149 133356443 0.96
tpcds_q03/duckdb:vortex-compact 51767580 54328112 0.95
tpcds_q04/duckdb:vortex-compact 126291937 132712991 0.95
tpcds_q05/duckdb:vortex-compact 🚀 171319114 194097144 0.88
tpcds_q06/duckdb:vortex-compact 41859796 45010614 0.93
tpcds_q07/duckdb:vortex-compact 41533150 39289910 1.06
tpcds_q08/duckdb:vortex-compact 29421267 31421231 0.94
tpcds_q09/duckdb:vortex-compact 114783619 120068369 0.96
tpcds_q10/duckdb:vortex-compact 🚀 47833497 54023080 0.89
tpcds_q11/duckdb:vortex-compact 76613562 85052328 0.90
tpcds_q12/duckdb:vortex-compact 21139759 20816791 1.02
tpcds_q13/duckdb:vortex-compact 56196376 57378843 0.98
tpcds_q14/duckdb:vortex-compact 282634193 299300961 0.94
tpcds_q15/duckdb:vortex-compact 45500544 49701625 0.92
tpcds_q16/duckdb:vortex-compact 37608218 41035582 0.92
tpcds_q17/duckdb:vortex-compact 🚀 52013324 58128387 0.89
tpcds_q18/duckdb:vortex-compact 68715300 74921044 0.92
tpcds_q19/duckdb:vortex-compact 41455189 44641282 0.93
tpcds_q20/duckdb:vortex-compact 21052709 22064527 0.95
tpcds_q21/duckdb:vortex-compact 27822842 29246737 0.95
tpcds_q22/duckdb:vortex-compact 111718870 123521924 0.90
tpcds_q23/duckdb:vortex-compact 167912316 184145312 0.91
tpcds_q24/duckdb:vortex-compact 77035910 84801624 0.91
tpcds_q25/duckdb:vortex-compact 51720128 54427373 0.95
tpcds_q26/duckdb:vortex-compact 54019672 53154612 1.02
tpcds_q27/duckdb:vortex-compact 146747499 151797712 0.97
tpcds_q28/duckdb:vortex-compact 108071700 113001297 0.96
tpcds_q29/duckdb:vortex-compact 52427728 57188904 0.92
tpcds_q30/duckdb:vortex-compact 34955629 38581852 0.91
tpcds_q31/duckdb:vortex-compact 🚀 30556950 34357813 0.89
tpcds_q32/duckdb:vortex-compact 23090351 23823846 0.97
tpcds_q33/duckdb:vortex-compact 149270779 151663785 0.98
tpcds_q34/duckdb:vortex-compact 🚀 29494384 33245842 0.89
tpcds_q35/duckdb:vortex-compact 🚀 70769734 79336016 0.89
tpcds_q36/duckdb:vortex-compact 35176361 36806784 0.96
tpcds_q37/duckdb:vortex-compact 31849154 32990351 0.97
tpcds_q38/duckdb:vortex-compact 🚀 38844632 44007001 0.88
tpcds_q39/duckdb:vortex-compact 55956930 54781228 1.02
tpcds_q40/duckdb:vortex-compact 31248994 34343510 0.91
tpcds_q41/duckdb:vortex-compact 🚀 17405087 19618452 0.89
tpcds_q42/duckdb:vortex-compact 15253595 16777604 0.91
tpcds_q43/duckdb:vortex-compact 24189578 25297751 0.96
tpcds_q44/duckdb:vortex-compact 34962838 37689078 0.93
tpcds_q45/duckdb:vortex-compact 32500582 34721358 0.94
tpcds_q46/duckdb:vortex-compact 63165307 66911699 0.94
tpcds_q47/duckdb:vortex-compact 54531874 58673767 0.93
tpcds_q48/duckdb:vortex-compact 45240775 49118355 0.92
tpcds_q49/duckdb:vortex-compact 49733454 50920067 0.98
tpcds_q50/duckdb:vortex-compact 54442977 58946376 0.92
tpcds_q51/duckdb:vortex-compact 104478845 109412563 0.95
tpcds_q52/duckdb:vortex-compact 16197581 16612162 0.98
tpcds_q53/duckdb:vortex-compact 22733009 24545641 0.93
tpcds_q54/duckdb:vortex-compact 86422914 94317164 0.92
tpcds_q55/duckdb:vortex-compact 15170046 15866529 0.96
tpcds_q56/duckdb:vortex-compact 144051325 153903086 0.94
tpcds_q57/duckdb:vortex-compact 47646353 51712056 0.92
tpcds_q58/duckdb:vortex-compact 40523612 42437692 0.95
tpcds_q59/duckdb:vortex-compact 65742374 69413468 0.95
tpcds_q60/duckdb:vortex-compact 146368807 154284514 0.95
tpcds_q61/duckdb:vortex-compact 54912903 57080610 0.96
tpcds_q62/duckdb:vortex-compact 22957626 23709488 0.97
tpcds_q63/duckdb:vortex-compact 22775298 23502587 0.97
tpcds_q64/duckdb:vortex-compact 104804863 116175170 0.90
tpcds_q65/duckdb:vortex-compact 28579561 29822400 0.96
tpcds_q66/duckdb:vortex-compact 95263820 102477924 0.93
tpcds_q67/duckdb:vortex-compact 🚀 149895716 167062790 0.90
tpcds_q68/duckdb:vortex-compact 58223083 60313057 0.97
tpcds_q69/duckdb:vortex-compact 49566398 52764109 0.94
tpcds_q70/duckdb:vortex-compact 29035669 31187758 0.93
tpcds_q71/duckdb:vortex-compact 26408416 28905562 0.91
tpcds_q72/duckdb:vortex-compact 195612993 203047922 0.96
tpcds_q73/duckdb:vortex-compact 29219194 29656118 0.99
tpcds_q74/duckdb:vortex-compact 🚀 59224676 66215823 0.89
tpcds_q75/duckdb:vortex-compact 69929753 74791072 0.94
tpcds_q76/duckdb:vortex-compact 134215704 141508197 0.95
tpcds_q77/duckdb:vortex-compact 133514779 144735627 0.92
tpcds_q78/duckdb:vortex-compact 87495495 90053782 0.97
tpcds_q79/duckdb:vortex-compact 61007464 66945443 0.91
tpcds_q80/duckdb:vortex-compact 174602180 187439030 0.93
tpcds_q81/duckdb:vortex-compact 🚀 39085666 46763932 0.84
tpcds_q82/duckdb:vortex-compact 33109506 34965368 0.95
tpcds_q83/duckdb:vortex-compact 46466724 51061295 0.91
tpcds_q84/duckdb:vortex-compact 21869005 23168996 0.94
tpcds_q85/duckdb:vortex-compact 🚀 60424013 67950963 0.89
tpcds_q86/duckdb:vortex-compact 🚀 18919880 21288376 0.89
tpcds_q87/duckdb:vortex-compact 44013256 47635072 0.92
tpcds_q88/duckdb:vortex-compact 45831663 50382460 0.91
tpcds_q89/duckdb:vortex-compact 23815894 25782573 0.92
tpcds_q90/duckdb:vortex-compact 16209423 17096777 0.95
tpcds_q91/duckdb:vortex-compact 45323298 49678287 0.91
tpcds_q92/duckdb:vortex-compact 21841775 23495676 0.93
tpcds_q93/duckdb:vortex-compact 38359039 42243710 0.91
tpcds_q94/duckdb:vortex-compact 🚀 28635498 33518454 0.85
tpcds_q95/duckdb:vortex-compact 149713278 154780662 0.97
tpcds_q96/duckdb:vortex-compact 🚀 18736118 20957342 0.89
tpcds_q97/duckdb:vortex-compact 40861797 45096083 0.91
tpcds_q98/duckdb:vortex-compact 23141917 24396098 0.95
tpcds_q99/duckdb:vortex-compact 🚀 34503450 40815884 0.85
duckdb / parquet (0.940x ➖, 17↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 50600874 48318528 1.05
tpcds_q02/duckdb:parquet 60645168 66256111 0.92
tpcds_q03/duckdb:parquet 12619512 13704915 0.92
tpcds_q04/duckdb:parquet 128931088 140929008 0.91
tpcds_q05/duckdb:parquet 77579418 78541360 0.99
tpcds_q06/duckdb:parquet 🚀 30419916 35756230 0.85
tpcds_q07/duckdb:parquet 24572927 25398830 0.97
tpcds_q08/duckdb:parquet 28958030 31442124 0.92
tpcds_q09/duckdb:parquet 40231302 42249195 0.95
tpcds_q10/duckdb:parquet 36280796 40295870 0.90
tpcds_q11/duckdb:parquet 91796342 98615015 0.93
tpcds_q12/duckdb:parquet 14806801 16245608 0.91
tpcds_q13/duckdb:parquet 35123850 37855089 0.93
tpcds_q14/duckdb:parquet 164166831 178024442 0.92
tpcds_q15/duckdb:parquet 🚀 30250442 35866560 0.84
tpcds_q16/duckdb:parquet 🚀 22176468 25386515 0.87
tpcds_q17/duckdb:parquet 39740153 43034489 0.92
tpcds_q18/duckdb:parquet 🚀 45724619 52320650 0.87
tpcds_q19/duckdb:parquet 🚀 29729120 33141678 0.90
tpcds_q20/duckdb:parquet 🚀 15796129 18516269 0.85
tpcds_q21/duckdb:parquet 12621413 13297007 0.95
tpcds_q22/duckdb:parquet 🚀 65970359 81383495 0.81
tpcds_q23/duckdb:parquet 🚀 114864928 129974769 0.88
tpcds_q24/duckdb:parquet 🚀 45429587 52102318 0.87
tpcds_q25/duckdb:parquet 🚀 32631516 36577972 0.89
tpcds_q26/duckdb:parquet 🚀 35583645 41883094 0.85
tpcds_q27/duckdb:parquet 91115845 97344761 0.94
tpcds_q28/duckdb:parquet 36614843 40208561 0.91
tpcds_q29/duckdb:parquet 🚀 36823401 41380827 0.89
tpcds_q30/duckdb:parquet 40521980 44735391 0.91
tpcds_q31/duckdb:parquet 23188041 25359813 0.91
tpcds_q32/duckdb:parquet 11770952 12953732 0.91
tpcds_q33/duckdb:parquet 71456294 73667651 0.97
tpcds_q34/duckdb:parquet 22400121 23333309 0.96
tpcds_q35/duckdb:parquet 🚀 62077662 69274015 0.90
tpcds_q36/duckdb:parquet 21778217 23788781 0.92
tpcds_q37/duckdb:parquet 15071063 15442931 0.98
tpcds_q38/duckdb:parquet 🚀 34548214 39193591 0.88
tpcds_q39/duckdb:parquet 34616463 36317483 0.95
tpcds_q40/duckdb:parquet 19908200 21104935 0.94
tpcds_q41/duckdb:parquet 8333445 9234149 0.90
tpcds_q42/duckdb:parquet 11193406 11636415 0.96
tpcds_q43/duckdb:parquet 16398698 17438859 0.94
tpcds_q44/duckdb:parquet 23311220 25262484 0.92
tpcds_q45/duckdb:parquet 🚀 28071970 32544645 0.86
tpcds_q46/duckdb:parquet 48626913 52299723 0.93
tpcds_q47/duckdb:parquet 48162325 51106185 0.94
tpcds_q48/duckdb:parquet 31326066 32864537 0.95
tpcds_q49/duckdb:parquet 27220504 28704766 0.95
tpcds_q50/duckdb:parquet 26312197 27305851 0.96
tpcds_q51/duckdb:parquet 97917716 103151892 0.95
tpcds_q52/duckdb:parquet 11701185 12674453 0.92
tpcds_q53/duckdb:parquet 16658180 17741085 0.94
tpcds_q54/duckdb:parquet 41433355 43429859 0.95
tpcds_q55/duckdb:parquet 12083223 11702930 1.03
tpcds_q56/duckdb:parquet 76204505 73127380 1.04
tpcds_q57/duckdb:parquet 36612263 38716941 0.95
tpcds_q58/duckdb:parquet 24145587 23731974 1.02
tpcds_q59/duckdb:parquet 36406496 38074507 0.96
tpcds_q60/duckdb:parquet 76070622 80204427 0.95
tpcds_q61/duckdb:parquet 🚀 30429783 33846205 0.90
tpcds_q62/duckdb:parquet 12846882 12903121 1.00
tpcds_q63/duckdb:parquet 16517447 16872738 0.98
tpcds_q64/duckdb:parquet 76489592 81120003 0.94
tpcds_q65/duckdb:parquet 20722364 21289731 0.97
tpcds_q66/duckdb:parquet 57647690 58788722 0.98
tpcds_q67/duckdb:parquet 142258557 153402994 0.93
tpcds_q68/duckdb:parquet 39328925 40498378 0.97
tpcds_q69/duckdb:parquet 37303817 39634103 0.94
tpcds_q70/duckdb:parquet 20964217 21767684 0.96
tpcds_q71/duckdb:parquet 19202953 20196883 0.95
tpcds_q72/duckdb:parquet 169534612 173390032 0.98
tpcds_q73/duckdb:parquet 18806132 19123990 0.98
tpcds_q74/duckdb:parquet 52191062 53944142 0.97
tpcds_q75/duckdb:parquet 55031304 58723627 0.94
tpcds_q76/duckdb:parquet 71401826 69784478 1.02
tpcds_q77/duckdb:parquet 64183787 66446740 0.97
tpcds_q78/duckdb:parquet 76831596 81222391 0.95
tpcds_q79/duckdb:parquet 28244374 30147414 0.94
tpcds_q80/duckdb:parquet 85749824 89668819 0.96
tpcds_q81/duckdb:parquet 49358158 49782340 0.99
tpcds_q82/duckdb:parquet 16305511 17884387 0.91
tpcds_q83/duckdb:parquet 17144892 16568861 1.03
tpcds_q84/duckdb:parquet 20203695 20276375 1.00
tpcds_q85/duckdb:parquet 42130875 42269621 1.00
tpcds_q86/duckdb:parquet 12970841 13724849 0.95
tpcds_q87/duckdb:parquet 🚀 36936631 42060267 0.88
tpcds_q88/duckdb:parquet 30055973 30236314 0.99
tpcds_q89/duckdb:parquet 17939519 18603270 0.96
tpcds_q90/duckdb:parquet 7857428 8228807 0.95
tpcds_q91/duckdb:parquet 23934123 24023626 1.00
tpcds_q92/duckdb:parquet 12414668 13544983 0.92
tpcds_q93/duckdb:parquet 31740201 34481453 0.92
tpcds_q94/duckdb:parquet 17117383 17452843 0.98
tpcds_q95/duckdb:parquet 139163796 137971005 1.01
tpcds_q96/duckdb:parquet 9657685 10486666 0.92
tpcds_q97/duckdb:parquet 36718111 38862600 0.94
tpcds_q98/duckdb:parquet 18343138 19044174 0.96
tpcds_q99/duckdb:parquet 20996269 20666753 1.02
duckdb / duckdb (0.919x ➖, 29↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚀 19428714 22325454 0.87
tpcds_q02/duckdb:duckdb 18099104 19340822 0.94
tpcds_q03/duckdb:duckdb 8379735 9102881 0.92
tpcds_q04/duckdb:duckdb 163784348 172157099 0.95
tpcds_q05/duckdb:duckdb 18917605 19687969 0.96
tpcds_q06/duckdb:duckdb 22315388 24220583 0.92
tpcds_q07/duckdb:duckdb 37348280 41433107 0.90
tpcds_q08/duckdb:duckdb 119650534 122882273 0.97
tpcds_q09/duckdb:duckdb 19385979 20740558 0.93
tpcds_q10/duckdb:duckdb 23290385 24853695 0.94
tpcds_q11/duckdb:duckdb 138053122 146681964 0.94
tpcds_q12/duckdb:duckdb 11362642 11362457 1.00
tpcds_q13/duckdb:duckdb 23950169 24984516 0.96
tpcds_q14/duckdb:duckdb 93852184 99164807 0.95
tpcds_q15/duckdb:duckdb 🚀 24175251 27228855 0.89
tpcds_q16/duckdb:duckdb 17693627 18391387 0.96
tpcds_q17/duckdb:duckdb 21000895 23221755 0.90
tpcds_q18/duckdb:duckdb 43941231 48025595 0.91
tpcds_q19/duckdb:duckdb 16691270 18482950 0.90
tpcds_q20/duckdb:duckdb 11618419 12808020 0.91
tpcds_q21/duckdb:duckdb 🚀 6466168 8181104 0.79
tpcds_q22/duckdb:duckdb 🚀 60213950 75130195 0.80
tpcds_q23/duckdb:duckdb 81765814 85969550 0.95
tpcds_q24/duckdb:duckdb 🚀 22411825 28151263 0.80
tpcds_q25/duckdb:duckdb 17166410 18643969 0.92
tpcds_q26/duckdb:duckdb 26678404 29072411 0.92
tpcds_q27/duckdb:duckdb 40131631 43018232 0.93
tpcds_q28/duckdb:duckdb 21640469 22564190 0.96
tpcds_q29/duckdb:duckdb 19993861 21373082 0.94
tpcds_q30/duckdb:duckdb 🚀 28674280 33001333 0.87
tpcds_q31/duckdb:duckdb 19764634 21940427 0.90
tpcds_q32/duckdb:duckdb 7172490 7917786 0.91
tpcds_q33/duckdb:duckdb 13351559 13261002 1.01
tpcds_q34/duckdb:duckdb 🚀 14660152 17397468 0.84
tpcds_q35/duckdb:duckdb 33519210 35035857 0.96
tpcds_q36/duckdb:duckdb 🚀 68063081 77310220 0.88
tpcds_q37/duckdb:duckdb 7401659 8108774 0.91
tpcds_q38/duckdb:duckdb 30588197 32190640 0.95
tpcds_q39/duckdb:duckdb 26143111 27703706 0.94
tpcds_q40/duckdb:duckdb 🚀 12121347 14274113 0.85
tpcds_q41/duckdb:duckdb 8722770 9179520 0.95
tpcds_q42/duckdb:duckdb 🚀 6416380 7470263 0.86
tpcds_q43/duckdb:duckdb 🚀 10916249 12258575 0.89
tpcds_q44/duckdb:duckdb 🚀 12632143 14353475 0.88
tpcds_q45/duckdb:duckdb 🚀 16901944 19699489 0.86
tpcds_q46/duckdb:duckdb 🚀 34889226 42851311 0.81
tpcds_q47/duckdb:duckdb 40137580 44286051 0.91
tpcds_q48/duckdb:duckdb 21993164 23071605 0.95
tpcds_q49/duckdb:duckdb 16320119 16296007 1.00
tpcds_q50/duckdb:duckdb 13670753 15010283 0.91
tpcds_q51/duckdb:duckdb 91044910 96272240 0.95
tpcds_q52/duckdb:duckdb 7138695 7829817 0.91
tpcds_q53/duckdb:duckdb 🚀 11515580 12831184 0.90
tpcds_q54/duckdb:duckdb 16953990 16687590 1.02
tpcds_q55/duckdb:duckdb 6994136 7221130 0.97
tpcds_q56/duckdb:duckdb 13192129 14250041 0.93
tpcds_q57/duckdb:duckdb 30591916 33228612 0.92
tpcds_q58/duckdb:duckdb 12155766 12898649 0.94
tpcds_q59/duckdb:duckdb 34941861 35754878 0.98
tpcds_q60/duckdb:duckdb 14605486 16157400 0.90
tpcds_q61/duckdb:duckdb 14544276 14923821 0.97
tpcds_q62/duckdb:duckdb 8940010 9682149 0.92
tpcds_q63/duckdb:duckdb 11092224 12138515 0.91
tpcds_q64/duckdb:duckdb 53804840 55015419 0.98
tpcds_q65/duckdb:duckdb 🚀 32188490 37472890 0.86
tpcds_q66/duckdb:duckdb 24572248 25072342 0.98
tpcds_q67/duckdb:duckdb 🚀 127195633 145385527 0.87
tpcds_q68/duckdb:duckdb 🚀 24706681 28839543 0.86
tpcds_q69/duckdb:duckdb 23685849 25979369 0.91
tpcds_q70/duckdb:duckdb 14474736 15224325 0.95
tpcds_q71/duckdb:duckdb 13299250 13595688 0.98
tpcds_q72/duckdb:duckdb 41704720 43653573 0.96
tpcds_q73/duckdb:duckdb 🚀 10299365 11548838 0.89
tpcds_q74/duckdb:duckdb 97505835 104035046 0.94
tpcds_q75/duckdb:duckdb 🚀 39757771 44888278 0.89
tpcds_q76/duckdb:duckdb 11995005 13307623 0.90
tpcds_q77/duckdb:duckdb 11896308 12767709 0.93
tpcds_q78/duckdb:duckdb 60946099 66092150 0.92
tpcds_q79/duckdb:duckdb 🚀 17753764 21581027 0.82
tpcds_q80/duckdb:duckdb 🚀 27586380 30938184 0.89
tpcds_q81/duckdb:duckdb 🚀 37707123 42606216 0.89
tpcds_q82/duckdb:duckdb 8472642 8363356 1.01
tpcds_q83/duckdb:duckdb 9197350 9619644 0.96
tpcds_q84/duckdb:duckdb 🚀 13208172 15480921 0.85
tpcds_q85/duckdb:duckdb 🚀 23355117 26295152 0.89
tpcds_q86/duckdb:duckdb 🚀 10345648 12340223 0.84
tpcds_q87/duckdb:duckdb 🚀 32365348 37545279 0.86
tpcds_q88/duckdb:duckdb 23562544 25191858 0.94
tpcds_q89/duckdb:duckdb 12884242 13852379 0.93
tpcds_q90/duckdb:duckdb 🚀 5381372 5994505 0.90
tpcds_q91/duckdb:duckdb 12487211 13050739 0.96
tpcds_q92/duckdb:duckdb 9239159 9237406 1.00
tpcds_q93/duckdb:duckdb 21689118 23075495 0.94
tpcds_q94/duckdb:duckdb 12442914 12850297 0.97
tpcds_q95/duckdb:duckdb 125246224 118782231 1.05
tpcds_q96/duckdb:duckdb 🚀 4471070 5192147 0.86
tpcds_q97/duckdb:duckdb 30012962 31485125 0.95
tpcds_q98/duckdb:duckdb 12719726 13648270 0.93
tpcds_q99/duckdb:duckdb 15932201 16129848 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -6.8% +1.2% -8.0% +13.5% ➖ noise
1 datafusion:vortex-file-compressed +3.4% +1.2% +2.1% +21.7% ➖ noise
1 duckdb:duckdb -13.0% +1.2% -14.0% +13.9% ✅ faster
1 duckdb:vortex-compact +5.8% +1.2% +4.5% +15.8% ➖ noise
1 duckdb:vortex-file-compressed -5.2% +1.2% -6.3% +12.2% ➖ noise
2 datafusion:vortex-compact -1.4% -4.1% +2.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.5% -4.1% +2.7% +11.8% ➖ noise
2 duckdb:duckdb -6.4% -4.1% -2.4% +14.5% ➖ noise
2 duckdb:vortex-compact -3.8% -4.1% +0.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.5% -4.1% +3.8% +10.4% ➖ noise
3 datafusion:vortex-compact +4.6% -4.5% +9.5% +18.5% ➖ noise
3 datafusion:vortex-file-compressed -1.6% -4.5% +3.1% +11.3% ➖ noise
3 duckdb:duckdb -7.9% -4.5% -3.6% +14.7% ➖ noise
3 duckdb:vortex-compact -4.7% -4.5% -0.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.2% -4.5% +6.0% +12.4% ➖ noise
4 datafusion:vortex-compact -2.5% -5.9% +3.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.4% -5.9% +5.8% +10.0% ➖ noise
4 duckdb:duckdb -4.9% -5.9% +1.1% +10.0% ➖ noise
4 duckdb:vortex-compact -4.8% -5.9% +1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -7.7% -5.9% -2.0% +10.0% ➖ noise
5 datafusion:vortex-compact -3.5% +1.3% -4.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -5.5% +1.3% -6.8% +10.0% ➖ noise
5 duckdb:duckdb -3.9% +1.3% -5.2% +15.0% ➖ noise
5 duckdb:vortex-compact -11.7% +1.3% -12.9% +14.2% ✅ faster
5 duckdb:vortex-file-compressed -9.8% +1.3% -10.9% +13.7% ➖ noise
6 datafusion:vortex-compact +1.4% -6.9% +9.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.6% -6.9% +5.7% +10.0% ➖ noise
6 duckdb:duckdb -7.9% -6.9% -1.0% +13.7% ➖ noise
6 duckdb:vortex-compact -7.0% -6.9% -0.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -6.4% -6.9% +0.5% +10.0% ➖ noise
7 datafusion:vortex-compact -2.3% +1.6% -3.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.7% +1.6% -0.9% +10.0% ➖ noise
7 duckdb:duckdb -9.9% +1.6% -11.3% +13.3% ➖ noise
7 duckdb:vortex-compact +5.7% +1.6% +4.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -6.6% +1.6% -8.0% +10.0% ➖ noise
8 datafusion:vortex-compact +2.0% -3.3% +5.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.7% -3.3% +6.2% +10.0% ➖ noise
8 duckdb:duckdb -2.6% -3.3% +0.7% +10.0% ➖ noise
8 duckdb:vortex-compact -6.4% -3.3% -3.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -9.2% -3.3% -6.1% +10.0% ➖ noise
9 datafusion:vortex-compact -0.7% -0.8% +0.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.0% -0.8% +3.8% +10.0% ➖ noise
9 duckdb:duckdb -6.5% -0.8% -5.8% +10.0% ➖ noise
9 duckdb:vortex-compact -4.4% -0.8% -3.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -5.8% -0.8% -5.0% +10.0% ➖ noise
10 datafusion:vortex-compact +0.4% -5.4% +6.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.5% -5.4% +5.2% +10.0% ➖ noise
10 duckdb:duckdb -6.3% -5.4% -0.9% +10.0% ➖ noise
10 duckdb:vortex-compact -11.5% -5.4% -6.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.8% -5.4% +4.9% +10.0% ➖ noise
11 datafusion:vortex-compact -0.3% -4.4% +4.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.9% -4.4% +6.6% +10.0% ➖ noise
11 duckdb:duckdb -5.9% -4.4% -1.5% +10.0% ➖ noise
11 duckdb:vortex-compact -9.9% -4.4% -5.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -5.9% -4.4% -1.5% +10.0% ➖ noise
12 datafusion:vortex-compact -10.2% -8.4% -2.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.0% -8.4% +7.0% +10.0% ➖ noise
12 duckdb:duckdb +0.0% -8.4% +9.2% +10.0% ➖ noise
12 duckdb:vortex-compact +1.6% -8.4% +10.8% +12.5% ➖ noise
12 duckdb:vortex-file-compressed -1.2% -8.4% +7.9% +13.5% ➖ noise
13 datafusion:vortex-compact -4.1% -3.1% -1.0% +10.3% ➖ noise
13 datafusion:vortex-file-compressed -1.5% -3.1% +1.7% +10.0% ➖ noise
13 duckdb:duckdb -4.1% -3.1% -1.0% +10.0% ➖ noise
13 duckdb:vortex-compact -2.1% -3.1% +1.1% +16.3% ➖ noise
13 duckdb:vortex-file-compressed -6.1% -3.1% -3.1% +10.0% ➖ noise
14 datafusion:vortex-compact -13.5% -5.3% -8.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.3% -5.3% +4.3% +10.0% ➖ noise
14 duckdb:duckdb -5.4% -5.3% -0.0% +10.0% ➖ noise
14 duckdb:vortex-compact -5.6% -5.3% -0.2% +14.2% ➖ noise
14 duckdb:vortex-file-compressed -0.4% -5.3% +5.2% +13.3% ➖ noise
15 datafusion:vortex-compact -15.9% -9.3% -7.3% +10.6% ➖ noise
15 datafusion:vortex-file-compressed -2.3% -9.3% +7.8% +10.9% ➖ noise
15 duckdb:duckdb -11.2% -9.3% -2.1% +16.7% ➖ noise
15 duckdb:vortex-compact -8.5% -9.3% +1.0% +17.3% ➖ noise
15 duckdb:vortex-file-compressed -3.5% -9.3% +6.4% +10.9% ➖ noise
16 datafusion:vortex-compact -10.2% -6.4% -4.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.8% -6.4% +8.8% +10.0% ➖ noise
16 duckdb:duckdb -3.8% -6.4% +2.8% +10.6% ➖ noise
16 duckdb:vortex-compact -8.4% -6.4% -2.1% +14.4% ➖ noise
16 duckdb:vortex-file-compressed -3.4% -6.4% +3.2% +11.3% ➖ noise
17 datafusion:vortex-compact -11.2% -4.2% -7.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -6.6% -4.2% -2.5% +10.0% ➖ noise
17 duckdb:duckdb -9.6% -4.2% -5.6% +10.3% ➖ noise
17 duckdb:vortex-compact -10.5% -4.2% -6.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -4.9% -4.2% -0.8% +10.0% ➖ noise
18 datafusion:vortex-compact -16.7% -7.1% -10.3% +10.0% ✅ faster
18 datafusion:vortex-file-compressed +1.8% -7.1% +9.6% +10.0% ➖ noise
18 duckdb:duckdb -8.5% -7.1% -1.5% +10.9% ➖ noise
18 duckdb:vortex-compact -8.3% -7.1% -1.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.2% -7.1% +5.2% +11.4% ➖ noise
19 datafusion:vortex-compact -9.7% -6.8% -3.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -2.6% -6.8% +4.5% +10.6% ➖ noise
19 duckdb:duckdb -9.7% -6.8% -3.1% +22.9% ➖ noise
19 duckdb:vortex-compact -7.1% -6.8% -0.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -2.4% -6.8% +4.8% +14.2% ➖ noise
20 datafusion:vortex-compact -11.2% -7.9% -3.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.8% -7.9% +12.7% +10.0% 🚨 regression
20 duckdb:duckdb -9.3% -7.9% -1.5% +11.1% ➖ noise
20 duckdb:vortex-compact -4.6% -7.9% +3.6% +18.1% ➖ noise
20 duckdb:vortex-file-compressed -1.6% -7.9% +6.8% +10.0% ➖ noise
21 datafusion:vortex-compact -16.5% -3.2% -13.7% +10.6% ✅ faster
21 datafusion:vortex-file-compressed -4.1% -3.2% -0.9% +10.0% ➖ noise
21 duckdb:duckdb -21.0% -3.2% -18.4% +15.7% ✅ faster
21 duckdb:vortex-compact -4.9% -3.2% -1.7% +12.9% ➖ noise
21 duckdb:vortex-file-compressed +4.9% -3.2% +8.4% +15.5% ➖ noise
22 datafusion:vortex-compact -15.9% -11.0% -5.5% +11.1% ➖ noise
22 datafusion:vortex-file-compressed -0.4% -11.0% +11.9% +11.9% ➖ noise
22 duckdb:duckdb -19.9% -11.0% -10.0% +11.7% ➖ noise
22 duckdb:vortex-compact -9.6% -11.0% +1.6% +11.0% ➖ noise
22 duckdb:vortex-file-compressed -7.6% -11.0% +3.8% +10.8% ➖ noise
23 datafusion:vortex-compact -16.6% -6.1% -11.2% +10.0% ✅ faster
23 datafusion:vortex-file-compressed -1.5% -6.1% +4.9% +10.0% ➖ noise
23 duckdb:duckdb -4.9% -6.1% +1.2% +12.5% ➖ noise
23 duckdb:vortex-compact -8.8% -6.1% -2.9% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -6.4% -6.1% -0.3% +11.6% ➖ noise
24 datafusion:vortex-compact -14.2% -5.2% -9.5% +10.0% ✅ faster
24 datafusion:vortex-file-compressed +0.2% -5.2% +5.7% +10.0% ➖ noise
24 duckdb:duckdb -20.4% -5.2% -16.0% +10.2% ✅ faster
24 duckdb:vortex-compact -9.2% -5.2% -4.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +5.1% -5.2% +10.9% +12.1% ➖ noise
25 datafusion:vortex-compact -11.7% -4.4% -7.6% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -0.0% -4.4% +4.6% +10.0% ➖ noise
25 duckdb:duckdb -7.9% -4.4% -3.6% +10.0% ➖ noise
25 duckdb:vortex-compact -5.0% -4.4% -0.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.2% -4.4% +5.9% +10.0% ➖ noise
26 datafusion:vortex-compact -10.4% -7.8% -2.8% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -1.2% -7.8% +7.2% +10.6% ➖ noise
26 duckdb:duckdb -8.2% -7.8% -0.5% +25.1% ➖ noise
26 duckdb:vortex-compact +1.6% -7.8% +10.2% +14.8% ➖ noise
26 duckdb:vortex-file-compressed -6.8% -7.8% +1.1% +10.0% ➖ noise
27 datafusion:vortex-compact -15.2% -2.6% -12.9% +10.0% ✅ faster
27 datafusion:vortex-file-compressed +5.7% -2.6% +8.4% +10.0% ➖ noise
27 duckdb:duckdb -6.7% -2.6% -4.2% +13.9% ➖ noise
27 duckdb:vortex-compact -3.3% -2.6% -0.8% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -2.4% -2.6% +0.1% +10.0% ➖ noise
28 datafusion:vortex-compact -11.0% -2.7% -8.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +3.0% -2.7% +5.8% +10.0% ➖ noise
28 duckdb:duckdb -4.1% -2.7% -1.5% +10.0% ➖ noise
28 duckdb:vortex-compact -4.4% -2.7% -1.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.0% -2.7% +2.7% +10.0% ➖ noise
29 datafusion:vortex-compact -12.9% -5.5% -7.8% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -1.1% -5.5% +4.6% +10.0% ➖ noise
29 duckdb:duckdb -6.5% -5.5% -1.0% +10.0% ➖ noise
29 duckdb:vortex-compact -8.3% -5.5% -3.0% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.3% -5.5% +7.2% +11.8% ➖ noise
30 datafusion:vortex-compact -13.5% -4.6% -9.3% +10.0% ✅ faster
30 datafusion:vortex-file-compressed -4.8% -4.6% -0.2% +10.0% ➖ noise
30 duckdb:duckdb -13.1% -4.6% -8.9% +10.0% ➖ noise
30 duckdb:vortex-compact -9.4% -4.6% -5.0% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -6.4% -4.6% -1.8% +10.0% ➖ noise
31 datafusion:vortex-compact -8.7% -2.1% -6.8% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.5% -2.1% +1.6% +10.0% ➖ noise
31 duckdb:duckdb -9.9% -2.1% -8.0% +13.9% ➖ noise
31 duckdb:vortex-compact -11.1% -2.1% -9.1% +10.6% ➖ noise
31 duckdb:vortex-file-compressed -3.7% -2.1% -1.6% +10.0% ➖ noise
32 datafusion:vortex-compact -19.2% -0.8% -18.5% +15.4% ✅ faster
32 datafusion:vortex-file-compressed +2.0% -0.8% +2.9% +10.0% ➖ noise
32 duckdb:duckdb -9.4% -0.8% -8.6% +11.8% ➖ noise
32 duckdb:vortex-compact -3.1% -0.8% -2.2% +10.4% ➖ noise
32 duckdb:vortex-file-compressed +3.5% -0.8% +4.4% +12.3% ➖ noise
33 datafusion:vortex-compact -16.1% +2.0% -17.8% +10.0% ✅ faster
33 datafusion:vortex-file-compressed +5.6% +2.0% +3.5% +11.3% ➖ noise
33 duckdb:duckdb +0.7% +2.0% -1.3% +10.0% ➖ noise
33 duckdb:vortex-compact -1.6% +2.0% -3.5% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +2.8% +2.0% +0.7% +11.6% ➖ noise
34 datafusion:vortex-compact -13.7% -2.4% -11.6% +10.0% ✅ faster
34 datafusion:vortex-file-compressed +0.5% -2.4% +3.0% +10.0% ➖ noise
34 duckdb:duckdb -15.7% -2.4% -13.7% +11.2% ✅ faster
34 duckdb:vortex-compact -11.3% -2.4% -9.1% +10.0% ✅ faster
34 duckdb:vortex-file-compressed -8.4% -2.4% -6.1% +11.4% ➖ noise
35 datafusion:vortex-compact -17.9% -5.4% -13.2% +10.0% ✅ faster
35 datafusion:vortex-file-compressed +2.7% -5.4% +8.6% +10.0% ➖ noise
35 duckdb:duckdb -4.3% -5.4% +1.1% +11.5% ➖ noise
35 duckdb:vortex-compact -10.8% -5.4% -5.7% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -5.6% -5.4% -0.2% +10.0% ➖ noise
36 datafusion:vortex-compact -9.5% -4.4% -5.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +2.0% -4.4% +6.6% +10.0% ➖ noise
36 duckdb:duckdb -12.0% -4.4% -8.0% +10.0% ➖ noise
36 duckdb:vortex-compact -4.4% -4.4% -0.1% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -5.5% -4.4% -1.2% +10.0% ➖ noise
37 datafusion:vortex-compact -16.4% -0.9% -15.6% +12.0% ✅ faster
37 datafusion:vortex-file-compressed -1.5% -0.9% -0.5% +12.6% ➖ noise
37 duckdb:duckdb -8.7% -0.9% -7.9% +16.4% ➖ noise
37 duckdb:vortex-compact -3.5% -0.9% -2.5% +13.2% ➖ noise
37 duckdb:vortex-file-compressed -2.8% -0.9% -1.9% +13.2% ➖ noise
38 datafusion:vortex-compact -10.8% -8.0% -3.0% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +1.7% -8.0% +10.6% +10.0% 🚨 regression
38 duckdb:duckdb -5.0% -8.0% +3.3% +13.0% ➖ noise
38 duckdb:vortex-compact -11.7% -8.0% -4.0% +15.4% ➖ noise
38 duckdb:vortex-file-compressed -1.7% -8.0% +6.8% +10.4% ➖ noise
39 datafusion:vortex-compact -17.4% -2.5% -15.2% +20.6% ➖ noise
39 datafusion:vortex-file-compressed -4.5% -2.5% -2.1% +19.9% ➖ noise
39 duckdb:duckdb -5.6% -2.5% -3.2% +17.4% ➖ noise
39 duckdb:vortex-compact +2.1% -2.5% +4.8% +20.0% ➖ noise
39 duckdb:vortex-file-compressed +2.3% -2.5% +5.0% +16.1% ➖ noise
40 datafusion:vortex-compact -20.7% -4.4% -17.0% +12.6% ✅ faster
40 datafusion:vortex-file-compressed -0.7% -4.4% +4.0% +11.3% ➖ noise
40 duckdb:duckdb -15.1% -4.4% -11.1% +20.8% ➖ noise
40 duckdb:vortex-compact -9.0% -4.4% -4.8% +11.1% ➖ noise
40 duckdb:vortex-file-compressed +0.6% -4.4% +5.2% +11.7% ➖ noise
41 datafusion:vortex-compact -24.9% -6.7% -19.6% +10.2% ✅ faster
41 datafusion:vortex-file-compressed -1.2% -6.7% +5.8% +17.2% ➖ noise
41 duckdb:duckdb -5.0% -6.7% +1.8% +10.0% ➖ noise
41 duckdb:vortex-compact -11.3% -6.7% -4.9% +10.8% ➖ noise
41 duckdb:vortex-file-compressed -0.3% -6.7% +6.9% +10.0% ➖ noise
42 datafusion:vortex-compact -14.1% -1.3% -13.0% +13.3% ✅ faster
42 datafusion:vortex-file-compressed +1.9% -1.3% +3.2% +13.1% ➖ noise
42 duckdb:duckdb -14.1% -1.3% -13.0% +13.1% ✅ faster
42 duckdb:vortex-compact -9.1% -1.3% -7.9% +17.8% ➖ noise
42 duckdb:vortex-file-compressed -5.7% -1.3% -4.5% +17.9% ➖ noise
43 datafusion:vortex-compact -12.2% -2.4% -10.1% +10.0% ✅ faster
43 datafusion:vortex-file-compressed +1.9% -2.4% +4.3% +10.0% ➖ noise
43 duckdb:duckdb -11.0% -2.4% -8.8% +12.9% ➖ noise
43 duckdb:vortex-compact -4.4% -2.4% -2.1% +11.0% ➖ noise
43 duckdb:vortex-file-compressed -1.5% -2.4% +0.9% +10.0% ➖ noise
44 datafusion:vortex-compact -9.4% -3.9% -5.7% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -1.2% -3.9% +2.8% +10.0% ➖ noise
44 duckdb:duckdb -12.0% -3.9% -8.4% +13.6% ➖ noise
44 duckdb:vortex-compact -7.2% -3.9% -3.5% +10.6% ➖ noise
44 duckdb:vortex-file-compressed +3.2% -3.9% +7.3% +15.1% ➖ noise
45 datafusion:vortex-compact -12.1% -3.9% -8.5% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +0.3% -3.9% +4.4% +10.0% ➖ noise
45 duckdb:duckdb -14.2% -3.9% -10.7% +18.1% ➖ noise
45 duckdb:vortex-compact -6.4% -3.9% -2.6% +11.5% ➖ noise
45 duckdb:vortex-file-compressed -1.5% -3.9% +2.6% +11.2% ➖ noise
46 datafusion:vortex-compact -15.6% -4.5% -11.6% +10.0% ✅ faster
46 datafusion:vortex-file-compressed +2.2% -4.5% +7.0% +10.0% ➖ noise
46 duckdb:duckdb -18.6% -4.5% -14.7% +10.0% ✅ faster
46 duckdb:vortex-compact -5.6% -4.5% -1.1% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -0.6% -4.5% +4.1% +10.0% ➖ noise
47 datafusion:vortex-compact -20.7% -0.3% -20.4% +10.0% ✅ faster
47 datafusion:vortex-file-compressed -0.2% -0.3% +0.1% +10.0% ➖ noise
47 duckdb:duckdb -9.4% -0.3% -9.1% +10.0% ➖ noise
47 duckdb:vortex-compact -7.1% -0.3% -6.8% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -5.5% -0.3% -5.2% +10.0% ➖ noise
48 datafusion:vortex-compact -11.8% +0.1% -11.9% +10.0% ✅ faster
48 datafusion:vortex-file-compressed +0.5% +0.1% +0.4% +10.0% ➖ noise
48 duckdb:duckdb -4.7% +0.1% -4.7% +10.0% ➖ noise
48 duckdb:vortex-compact -7.9% +0.1% -8.0% +13.7% ➖ noise
48 duckdb:vortex-file-compressed -2.5% +0.1% -2.6% +10.0% ➖ noise
49 datafusion:vortex-compact -13.9% -3.0% -11.2% +10.0% ✅ faster
49 datafusion:vortex-file-compressed +2.8% -3.0% +5.9% +10.9% ➖ noise
49 duckdb:duckdb +0.1% -3.0% +3.2% +10.6% ➖ noise
49 duckdb:vortex-compact -2.3% -3.0% +0.7% +12.7% ➖ noise
49 duckdb:vortex-file-compressed -2.0% -3.0% +1.0% +11.4% ➖ noise
50 datafusion:vortex-compact -14.3% -3.3% -11.4% +10.0% ✅ faster
50 datafusion:vortex-file-compressed +0.7% -3.3% +4.1% +10.0% ➖ noise
50 duckdb:duckdb -8.9% -3.3% -5.8% +10.1% ➖ noise
50 duckdb:vortex-compact -7.6% -3.3% -4.5% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -6.2% -3.3% -3.0% +10.0% ➖ noise
51 datafusion:vortex-compact -15.0% -3.0% -12.3% +12.4% ✅ faster
51 datafusion:vortex-file-compressed +4.3% -3.0% +7.6% +11.8% ➖ noise
51 duckdb:duckdb -5.4% -3.0% -2.5% +10.1% ➖ noise
51 duckdb:vortex-compact -4.5% -3.0% -1.5% +12.8% ➖ noise
51 duckdb:vortex-file-compressed -2.4% -3.0% +0.6% +10.0% ➖ noise
52 datafusion:vortex-compact -7.1% -5.5% -1.7% +12.3% ➖ noise
52 datafusion:vortex-file-compressed +2.4% -5.5% +8.3% +13.6% ➖ noise
52 duckdb:duckdb -8.8% -5.5% -3.5% +15.7% ➖ noise
52 duckdb:vortex-compact -2.5% -5.5% +3.2% +15.5% ➖ noise
52 duckdb:vortex-file-compressed -11.7% -5.5% -6.5% +16.1% ➖ noise
53 datafusion:vortex-compact -11.4% -5.1% -6.7% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +1.5% -5.1% +6.9% +10.0% ➖ noise
53 duckdb:duckdb -10.3% -5.1% -5.4% +15.7% ➖ noise
53 duckdb:vortex-compact -7.4% -5.1% -2.4% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -4.6% -5.1% +0.6% +11.5% ➖ noise
54 datafusion:vortex-compact -12.7% +1.0% -13.6% +10.0% ✅ faster
54 datafusion:vortex-file-compressed +2.3% +1.0% +1.2% +10.0% ➖ noise
54 duckdb:duckdb +1.6% +1.0% +0.6% +10.0% ➖ noise
54 duckdb:vortex-compact -8.4% +1.0% -9.3% +10.0% ✅ faster
54 duckdb:vortex-file-compressed -5.0% +1.0% -5.9% +10.6% ➖ noise
55 datafusion:vortex-compact -4.9% +5.4% -9.8% +14.0% ➖ noise
55 datafusion:vortex-file-compressed +0.7% +5.4% -4.4% +12.1% ➖ noise
55 duckdb:duckdb -3.1% +5.4% -8.1% +16.5% ➖ noise
55 duckdb:vortex-compact -4.4% +5.4% -9.3% +12.2% ➖ noise
55 duckdb:vortex-file-compressed -13.4% +5.4% -17.9% +19.8% ✅ faster
56 datafusion:vortex-compact -12.0% +3.7% -15.2% +10.0% ✅ faster
56 datafusion:vortex-file-compressed +6.3% +3.7% +2.5% +10.0% ➖ noise
56 duckdb:duckdb -7.4% +3.7% -10.7% +10.6% ✅ faster
56 duckdb:vortex-compact -6.4% +3.7% -9.8% +10.0% ✅ faster
56 duckdb:vortex-file-compressed -3.5% +3.7% -7.0% +10.0% ➖ noise
57 datafusion:vortex-compact -12.4% -2.7% -10.0% +10.0% ✅ faster
57 datafusion:vortex-file-compressed +2.0% -2.7% +4.8% +10.0% ➖ noise
57 duckdb:duckdb -7.9% -2.7% -5.4% +19.7% ➖ noise
57 duckdb:vortex-compact -7.9% -2.7% -5.3% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -4.5% -2.7% -1.9% +18.1% ➖ noise
58 datafusion:vortex-compact -12.5% +0.2% -12.6% +10.0% ✅ faster
58 datafusion:vortex-file-compressed -0.0% +0.2% -0.2% +10.0% ➖ noise
58 duckdb:duckdb -5.8% +0.2% -5.9% +12.4% ➖ noise
58 duckdb:vortex-compact -4.5% +0.2% -4.7% +17.2% ➖ noise
58 duckdb:vortex-file-compressed -1.3% +0.2% -1.5% +13.3% ➖ noise
59 datafusion:vortex-compact -18.0% +1.6% -19.2% +10.0% ✅ faster
59 datafusion:vortex-file-compressed -1.0% +1.6% -2.5% +10.0% ➖ noise
59 duckdb:duckdb -2.3% +1.6% -3.8% +10.0% ➖ noise
59 duckdb:vortex-compact -5.3% +1.6% -6.8% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -0.4% +1.6% -2.0% +10.0% ➖ noise
60 datafusion:vortex-compact -13.2% -0.8% -12.5% +10.0% ✅ faster
60 datafusion:vortex-file-compressed -1.2% -0.8% -0.5% +10.0% ➖ noise
60 duckdb:duckdb -9.6% -0.8% -8.9% +11.2% ➖ noise
60 duckdb:vortex-compact -5.1% -0.8% -4.4% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -7.2% -0.8% -6.5% +13.3% ➖ noise
61 datafusion:vortex-compact -12.3% -4.4% -8.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -0.2% -4.4% +4.3% +10.0% ➖ noise
61 duckdb:duckdb -2.5% -4.4% +1.9% +10.0% ➖ noise
61 duckdb:vortex-compact -3.8% -4.4% +0.6% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -2.9% -4.4% +1.5% +10.0% ➖ noise
62 datafusion:vortex-compact -12.2% +2.1% -14.0% +15.7% ✅ faster
62 datafusion:vortex-file-compressed +2.7% +2.1% +0.6% +14.2% ➖ noise
62 duckdb:duckdb -7.7% +2.1% -9.6% +24.3% ➖ noise
62 duckdb:vortex-compact -3.2% +2.1% -5.2% +29.9% ➖ noise
62 duckdb:vortex-file-compressed -1.6% +2.1% -3.7% +22.7% ➖ noise
63 datafusion:vortex-compact -14.3% +1.6% -15.7% +10.1% ✅ faster
63 datafusion:vortex-file-compressed +2.9% +1.6% +1.3% +10.0% ➖ noise
63 duckdb:duckdb -8.6% +1.6% -10.1% +10.9% ✅ faster
63 duckdb:vortex-compact -3.1% +1.6% -4.6% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -2.5% +1.6% -4.0% +13.9% ➖ noise
64 datafusion:vortex-compact -12.6% -2.9% -10.1% +10.0% ✅ faster
64 datafusion:vortex-file-compressed +0.3% -2.9% +3.3% +10.0% ➖ noise
64 duckdb:duckdb -2.2% -2.9% +0.7% +10.0% ➖ noise
64 duckdb:vortex-compact -9.8% -2.9% -7.1% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -2.6% -2.9% +0.3% +10.0% ➖ noise
65 datafusion:vortex-compact -16.0% -1.9% -14.4% +10.8% ✅ faster
65 datafusion:vortex-file-compressed -3.4% -1.9% -1.5% +10.0% ➖ noise
65 duckdb:duckdb -14.1% -1.9% -12.4% +17.7% ➖ noise
65 duckdb:vortex-compact -4.2% -1.9% -2.3% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -11.3% -1.9% -9.6% +11.2% ➖ noise
66 datafusion:vortex-compact -16.3% -4.9% -12.0% +10.7% ✅ faster
66 datafusion:vortex-file-compressed +1.9% -4.9% +7.2% +11.8% ➖ noise
66 duckdb:duckdb -2.0% -4.9% +3.0% +14.2% ➖ noise
66 duckdb:vortex-compact -7.0% -4.9% -2.3% +10.7% ➖ noise
66 duckdb:vortex-file-compressed -1.3% -4.9% +3.8% +13.6% ➖ noise
67 datafusion:vortex-compact -15.6% -4.6% -11.6% +10.0% ✅ faster
67 datafusion:vortex-file-compressed -1.7% -4.6% +3.1% +10.0% ➖ noise
67 duckdb:duckdb -12.5% -4.6% -8.3% +10.0% ➖ noise
67 duckdb:vortex-compact -10.3% -4.6% -5.9% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -4.6% -4.6% -0.0% +10.0% ➖ noise
68 datafusion:vortex-compact -13.5% -0.9% -12.8% +10.0% ✅ faster
68 datafusion:vortex-file-compressed -3.6% -0.9% -2.7% +10.0% ➖ noise
68 duckdb:duckdb -14.3% -0.9% -13.6% +10.0% ✅ faster
68 duckdb:vortex-compact -3.5% -0.9% -2.6% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -4.8% -0.9% -4.0% +10.0% ➖ noise
69 datafusion:vortex-compact -14.1% -3.2% -11.3% +10.0% ✅ faster
69 datafusion:vortex-file-compressed +1.7% -3.2% +5.1% +10.0% ➖ noise
69 duckdb:duckdb -8.8% -3.2% -5.9% +11.7% ➖ noise
69 duckdb:vortex-compact -6.1% -3.2% -3.0% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -4.6% -3.2% -1.5% +10.0% ➖ noise
70 datafusion:vortex-compact -14.1% -1.7% -12.6% +10.8% ✅ faster
70 datafusion:vortex-file-compressed -1.7% -1.7% +0.0% +10.4% ➖ noise
70 duckdb:duckdb -4.9% -1.7% -3.2% +13.7% ➖ noise
70 duckdb:vortex-compact -6.9% -1.7% -5.3% +10.0% ➖ noise
70 duckdb:vortex-file-compressed -1.5% -1.7% +0.3% +10.9% ➖ noise
71 datafusion:vortex-compact -14.5% -2.6% -12.3% +10.0% ✅ faster
71 datafusion:vortex-file-compressed +1.0% -2.6% +3.7% +10.0% ➖ noise
71 duckdb:duckdb -2.2% -2.6% +0.4% +14.0% ➖ noise
71 duckdb:vortex-compact -8.6% -2.6% -6.2% +10.0% ➖ noise
71 duckdb:vortex-file-compressed +1.1% -2.6% +3.8% +16.1% ➖ noise
72 datafusion:vortex-compact -16.0% -1.3% -14.9% +10.0% ✅ faster
72 datafusion:vortex-file-compressed -0.1% -1.3% +1.2% +10.0% ➖ noise
72 duckdb:duckdb -4.5% -1.3% -3.2% +11.5% ➖ noise
72 duckdb:vortex-compact -3.7% -1.3% -2.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -2.2% -1.3% -0.9% +10.0% ➖ noise
73 datafusion:vortex-compact -10.7% -4.3% -6.7% +14.3% ➖ noise
73 datafusion:vortex-file-compressed -0.1% -4.3% +4.4% +19.2% ➖ noise
73 duckdb:duckdb -10.8% -4.3% -6.8% +11.3% ➖ noise
73 duckdb:vortex-compact -1.5% -4.3% +3.0% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -7.1% -4.3% -2.9% +13.1% ➖ noise
74 datafusion:vortex-compact -7.9% -2.4% -5.7% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +2.3% -2.4% +4.8% +10.0% ➖ noise
74 duckdb:duckdb -6.3% -2.4% -4.0% +17.0% ➖ noise
74 duckdb:vortex-compact -10.6% -2.4% -8.4% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -9.2% -2.4% -7.0% +10.2% ➖ noise
75 datafusion:vortex-compact -10.5% -2.3% -8.4% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -0.8% -2.3% +1.5% +10.0% ➖ noise
75 duckdb:duckdb -11.4% -2.3% -9.3% +10.5% ➖ noise
75 duckdb:vortex-compact -6.5% -2.3% -4.3% +10.7% ➖ noise
75 duckdb:vortex-file-compressed -2.9% -2.3% -0.6% +11.2% ➖ noise
76 datafusion:vortex-compact -8.8% -0.6% -8.2% +11.6% ➖ noise
76 datafusion:vortex-file-compressed -4.0% -0.6% -3.4% +14.4% ➖ noise
76 duckdb:duckdb -9.9% -0.6% -9.3% +16.4% ➖ noise
76 duckdb:vortex-compact -5.2% -0.6% -4.5% +12.3% ➖ noise
76 duckdb:vortex-file-compressed -11.7% -0.6% -11.2% +22.7% ➖ noise
77 datafusion:vortex-compact -10.2% -0.8% -9.4% +10.0% ✅ faster
77 datafusion:vortex-file-compressed +0.1% -0.8% +0.9% +10.0% ➖ noise
77 duckdb:duckdb -6.8% -0.8% -6.0% +10.0% ➖ noise
77 duckdb:vortex-compact -7.8% -0.8% -7.0% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +6.8% -0.8% +7.7% +10.0% ➖ noise
78 datafusion:vortex-compact -12.8% -2.4% -10.7% +10.0% ✅ faster
78 datafusion:vortex-file-compressed +2.5% -2.4% +5.0% +10.0% ➖ noise
78 duckdb:duckdb -7.8% -2.4% -5.6% +10.0% ➖ noise
78 duckdb:vortex-compact -2.8% -2.4% -0.5% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -0.3% -2.4% +2.1% +10.0% ➖ noise
79 datafusion:vortex-compact -7.5% -4.0% -3.7% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +1.1% -4.0% +5.3% +11.4% ➖ noise
79 duckdb:duckdb -17.7% -4.0% -14.3% +10.0% ✅ faster
79 duckdb:vortex-compact -8.9% -4.0% -5.1% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -5.3% -4.0% -1.4% +10.7% ➖ noise
80 datafusion:vortex-compact -4.6% -1.5% -3.1% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +0.2% -1.5% +1.7% +10.0% ➖ noise
80 duckdb:duckdb -10.8% -1.5% -9.5% +12.0% ➖ noise
80 duckdb:vortex-compact -6.8% -1.5% -5.4% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -0.1% -1.5% +1.5% +13.8% ➖ noise
81 datafusion:vortex-compact -11.1% +0.9% -11.9% +10.3% ✅ faster
81 datafusion:vortex-file-compressed -4.7% +0.9% -5.6% +10.0% ➖ noise
81 duckdb:duckdb -11.5% +0.9% -12.3% +10.3% ✅ faster
81 duckdb:vortex-compact -16.4% +0.9% -17.2% +10.0% ✅ faster
81 duckdb:vortex-file-compressed -0.6% +0.9% -1.5% +10.0% ➖ noise
82 datafusion:vortex-compact -8.3% -4.2% -4.3% +12.3% ➖ noise
82 datafusion:vortex-file-compressed +1.1% -4.2% +5.6% +12.2% ➖ noise
82 duckdb:duckdb +1.3% -4.2% +5.8% +15.4% ➖ noise
82 duckdb:vortex-compact -5.3% -4.2% -1.1% +12.8% ➖ noise
82 duckdb:vortex-file-compressed -5.0% -4.2% -0.8% +14.5% ➖ noise
83 datafusion:vortex-compact -8.3% +6.4% -13.8% +10.3% ✅ faster
83 datafusion:vortex-file-compressed -1.8% +6.4% -7.7% +10.0% ➖ noise
83 duckdb:duckdb -4.4% +6.4% -10.2% +13.0% ➖ noise
83 duckdb:vortex-compact -9.0% +6.4% -14.5% +10.0% ✅ faster
83 duckdb:vortex-file-compressed +2.4% +6.4% -3.8% +10.0% ➖ noise
84 datafusion:vortex-compact -10.5% +1.3% -11.6% +10.0% ✅ faster
84 datafusion:vortex-file-compressed -3.1% +1.3% -4.3% +13.8% ➖ noise
84 duckdb:duckdb -14.7% +1.3% -15.8% +11.3% ✅ faster
84 duckdb:vortex-compact -5.6% +1.3% -6.8% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -1.6% +1.3% -2.9% +10.0% ➖ noise
85 datafusion:vortex-compact -3.4% -0.3% -3.1% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +0.7% -0.3% +0.9% +10.0% ➖ noise
85 duckdb:duckdb -11.2% -0.3% -11.0% +12.9% ➖ noise
85 duckdb:vortex-compact -11.1% -0.3% -10.9% +10.0% ✅ faster
85 duckdb:vortex-file-compressed -2.7% -0.3% -2.4% +10.0% ➖ noise
86 datafusion:vortex-compact -10.2% -1.2% -9.1% +11.0% ➖ noise
86 datafusion:vortex-file-compressed +3.8% -1.2% +5.1% +10.0% ➖ noise
86 duckdb:duckdb -16.2% -1.2% -15.1% +13.1% ✅ faster
86 duckdb:vortex-compact -11.1% -1.2% -10.0% +22.2% ➖ noise
86 duckdb:vortex-file-compressed -10.4% -1.2% -9.3% +12.7% ➖ noise
87 datafusion:vortex-compact -6.5% -7.8% +1.4% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +1.4% -7.8% +10.0% +10.0% ➖ noise
87 duckdb:duckdb -13.8% -7.8% -6.5% +11.6% ➖ noise
87 duckdb:vortex-compact -7.6% -7.8% +0.2% +14.0% ➖ noise
87 duckdb:vortex-file-compressed +0.4% -7.8% +8.9% +10.0% ➖ noise
88 datafusion:vortex-compact -8.8% -0.7% -8.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +2.5% -0.7% +3.3% +10.0% ➖ noise
88 duckdb:duckdb -6.5% -0.7% -5.8% +10.0% ➖ noise
88 duckdb:vortex-compact -9.0% -0.7% -8.4% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -4.4% -0.7% -3.6% +10.0% ➖ noise
89 datafusion:vortex-compact -7.2% +0.7% -7.8% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -2.2% +0.7% -2.8% +10.0% ➖ noise
89 duckdb:duckdb -7.0% +0.7% -7.7% +12.9% ➖ noise
89 duckdb:vortex-compact -7.6% +0.7% -8.3% +10.7% ➖ noise
89 duckdb:vortex-file-compressed -7.6% +0.7% -8.3% +12.0% ➖ noise
90 datafusion:vortex-compact -6.0% -0.7% -5.3% +10.6% ➖ noise
90 datafusion:vortex-file-compressed +1.3% -0.7% +2.0% +10.0% ➖ noise
90 duckdb:duckdb -10.2% -0.7% -9.6% +12.8% ➖ noise
90 duckdb:vortex-compact -5.2% -0.7% -4.5% +15.2% ➖ noise
90 duckdb:vortex-file-compressed +1.4% -0.7% +2.2% +10.0% ➖ noise
91 datafusion:vortex-compact -8.5% -1.8% -6.8% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +6.0% -1.8% +8.0% +10.0% ➖ noise
91 duckdb:duckdb -4.3% -1.8% -2.5% +12.6% ➖ noise
91 duckdb:vortex-compact -8.8% -1.8% -7.1% +12.2% ➖ noise
91 duckdb:vortex-file-compressed -4.5% -1.8% -2.7% +10.0% ➖ noise
92 datafusion:vortex-compact -8.8% -0.7% -8.1% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -0.1% -0.7% +0.7% +10.0% ➖ noise
92 duckdb:duckdb +0.0% -0.7% +0.7% +14.1% ➖ noise
92 duckdb:vortex-compact -7.0% -0.7% -6.4% +16.9% ➖ noise
92 duckdb:vortex-file-compressed -7.1% -0.7% -6.4% +11.5% ➖ noise
93 datafusion:vortex-compact -8.1% -1.9% -6.4% +11.6% ➖ noise
93 datafusion:vortex-file-compressed +3.2% -1.9% +5.1% +12.0% ➖ noise
93 duckdb:duckdb -6.0% -1.9% -4.2% +11.0% ➖ noise
93 duckdb:vortex-compact -9.2% -1.9% -7.5% +12.1% ➖ noise
93 duckdb:vortex-file-compressed +1.1% -1.9% +3.0% +12.5% ➖ noise
94 datafusion:vortex-compact -0.2% +3.2% -3.3% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +2.8% +3.2% -0.4% +10.0% ➖ noise
94 duckdb:duckdb -3.2% +3.2% -6.2% +10.0% ➖ noise
94 duckdb:vortex-compact -14.6% +3.2% -17.2% +14.9% ✅ faster
94 duckdb:vortex-file-compressed -2.1% +3.2% -5.2% +10.0% ➖ noise
95 datafusion:vortex-compact -4.0% -0.5% -3.5% +10.0% ➖ noise
95 datafusion:vortex-file-compressed +0.1% -0.5% +0.6% +10.0% ➖ noise
95 duckdb:duckdb +5.4% -0.5% +6.0% +15.8% ➖ noise
95 duckdb:vortex-compact -3.3% -0.5% -2.8% +13.2% ➖ noise
95 duckdb:vortex-file-compressed +5.9% -0.5% +6.4% +18.9% ➖ noise
96 datafusion:vortex-compact -10.8% -4.9% -6.2% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +1.1% -4.9% +6.4% +11.2% ➖ noise
96 duckdb:duckdb -13.9% -4.9% -9.4% +14.2% ➖ noise
96 duckdb:vortex-compact -10.6% -4.9% -6.0% +27.1% ➖ noise
96 duckdb:vortex-file-compressed -5.6% -4.9% -0.7% +21.1% ➖ noise
97 datafusion:vortex-compact -8.1% -1.9% -6.3% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -2.6% -1.9% -0.8% +10.0% ➖ noise
97 duckdb:duckdb -4.7% -1.9% -2.8% +11.0% ➖ noise
97 duckdb:vortex-compact -9.4% -1.9% -7.6% +17.6% ➖ noise
97 duckdb:vortex-file-compressed +3.8% -1.9% +5.9% +17.9% ➖ noise
98 datafusion:vortex-compact -8.8% -2.9% -6.1% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +2.0% -2.9% +5.1% +11.6% ➖ noise
98 duckdb:duckdb -6.8% -2.9% -4.0% +13.2% ➖ noise
98 duckdb:vortex-compact -5.1% -2.9% -2.3% +12.4% ➖ noise
98 duckdb:vortex-file-compressed +2.4% -2.9% +5.5% +10.0% ➖ noise
99 datafusion:vortex-compact -11.5% +0.3% -11.7% +10.0% ✅ faster
99 datafusion:vortex-file-compressed +5.5% +0.3% +5.2% +10.0% ➖ noise
99 duckdb:duckdb -1.2% +0.3% -1.5% +10.0% ➖ noise
99 duckdb:vortex-compact -15.5% +0.3% -15.7% +10.0% ✅ faster
99 duckdb:vortex-file-compressed -2.6% +0.3% -2.9% +20.1% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: FineWeb S3

Summary

  • Overall: 1.040x ➖
  • Vortex: 1.034x ➖
  • Parquet: 1.052x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -1.7%
  • Confidence: environment too noisy
  • Environment shift: +5.2%

Statistical Summary

  • Systemic shift (parquet controls): +5.2%
  • Control sigma: +5.9%
  • Residual noise: +4.8%
  • Median polish overall: +2.1%
datafusion / vortex-file-compressed (0.981x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 50266128 45893138 1.10
fineweb_q01/datafusion:vortex-file-compressed 481469061 519198149 0.93
fineweb_q02/datafusion:vortex-file-compressed 503167636 559246073 0.90
fineweb_q03/datafusion:vortex-file-compressed 1408189555 1376010684 1.02
fineweb_q04/datafusion:vortex-file-compressed 1383105819 1391516446 0.99
fineweb_q05/datafusion:vortex-file-compressed 1380825026 1387337544 1.00
fineweb_q06/datafusion:vortex-file-compressed 1474342418 1542046418 0.96
fineweb_q07/datafusion:vortex-file-compressed 1390259778 1432777630 0.97
fineweb_q08/datafusion:vortex-file-compressed 567429062 578807928 0.98
datafusion / vortex-compact (1.014x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 32161710 32682119 0.98
fineweb_q01/datafusion:vortex-compact 588746982 509961075 1.15
fineweb_q02/datafusion:vortex-compact 709554729 669060665 1.06
fineweb_q03/datafusion:vortex-compact 1847777692 1845794145 1.00
fineweb_q04/datafusion:vortex-compact 2237161242 2199675662 1.02
fineweb_q05/datafusion:vortex-compact 1709735961 1700214299 1.01
fineweb_q06/datafusion:vortex-compact 1450869503 1402302986 1.03
fineweb_q07/datafusion:vortex-compact 1244644993 1372519991 0.91
fineweb_q08/datafusion:vortex-compact 394258787 402528552 0.98
datafusion / parquet (1.066x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1131881442 1127078620 1.00
fineweb_q01/datafusion:parquet 1796479574 1790803230 1.00
fineweb_q02/datafusion:parquet 1878472822 1744640081 1.08
fineweb_q03/datafusion:parquet 2126459537 1829639301 1.16
fineweb_q04/datafusion:parquet 2122039439 1895426883 1.12
fineweb_q05/datafusion:parquet 2132559496 1725748611 1.24
fineweb_q06/datafusion:parquet 1754631620 1739640626 1.01
fineweb_q07/datafusion:parquet 1716360160 1877858916 0.91
fineweb_q08/datafusion:parquet 1882035965 1701798524 1.11
duckdb / vortex-file-compressed (1.124x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 109155528 95570143 1.14
fineweb_q01/duckdb:vortex-file-compressed 623865392 557248689 1.12
fineweb_q02/duckdb:vortex-file-compressed 528065244 416818790 1.27
fineweb_q03/duckdb:vortex-file-compressed 1556329357 1462318377 1.06
fineweb_q04/duckdb:vortex-file-compressed 1596626326 1509888549 1.06
fineweb_q05/duckdb:vortex-file-compressed 1490546150 1529709156 0.97
fineweb_q06/duckdb:vortex-file-compressed 2035342328 1671408718 1.22
fineweb_q07/duckdb:vortex-file-compressed 1802895858 1543812261 1.17
fineweb_q08/duckdb:vortex-file-compressed 736487030 650063573 1.13
duckdb / vortex-compact (1.024x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 84518752 82195790 1.03
fineweb_q01/duckdb:vortex-compact 588811253 533669108 1.10
fineweb_q02/duckdb:vortex-compact 598983599 603065551 0.99
fineweb_q03/duckdb:vortex-compact 1603080861 1691834592 0.95
fineweb_q04/duckdb:vortex-compact 1740670926 1757139049 0.99
fineweb_q05/duckdb:vortex-compact 1611747110 1589463577 1.01
fineweb_q06/duckdb:vortex-compact 1586201718 1455455116 1.09
fineweb_q07/duckdb:vortex-compact 1380220874 1349633319 1.02
fineweb_q08/duckdb:vortex-compact 497732230 482646287 1.03
duckdb / parquet (1.039x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1116465839 1055501310 1.06
fineweb_q01/duckdb:parquet 1722630310 1585567832 1.09
fineweb_q02/duckdb:parquet 1582061828 1619045705 0.98
fineweb_q03/duckdb:parquet 4570913111 3928111691 1.16
fineweb_q04/duckdb:parquet 1910024210 1900870547 1.00
fineweb_q05/duckdb:parquet 2717193722 2658829234 1.02
fineweb_q06/duckdb:parquet 3428414273 3314290748 1.03
fineweb_q07/duckdb:parquet 3829033331 3855168854 0.99
fineweb_q08/duckdb:parquet 1109712969 1086052827 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -1.6% +3.1% -4.5% +176.6% ➖ noise
0 datafusion:vortex-file-compressed +9.5% +3.1% +6.3% +187.6% ➖ noise
0 duckdb:vortex-compact +2.8% +3.1% -0.2% +127.3% ➖ noise
0 duckdb:vortex-file-compressed +14.2% +3.1% +10.8% +57.1% ➖ noise
1 datafusion:vortex-compact +15.4% +4.4% +10.6% +66.4% ➖ noise
1 datafusion:vortex-file-compressed -7.3% +4.4% -11.2% +68.9% ➖ noise
1 duckdb:vortex-compact +10.3% +4.4% +5.7% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +12.0% +4.4% +7.2% +30.0% ➖ noise
2 datafusion:vortex-compact +6.1% +2.6% +3.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -10.0% +2.6% -12.3% +30.1% ➖ noise
2 duckdb:vortex-compact -0.7% +2.6% -3.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +26.7% +2.6% +23.5% +50.3% ➖ noise
3 datafusion:vortex-compact +0.1% +16.3% -13.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +2.3% +16.3% -12.0% +30.0% ➖ noise
3 duckdb:vortex-compact -5.2% +16.3% -18.5% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +6.4% +16.3% -8.5% +30.0% ➖ noise
4 datafusion:vortex-compact +1.7% +6.1% -4.1% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.6% +6.1% -6.3% +30.0% ➖ noise
4 duckdb:vortex-compact -0.9% +6.1% -6.6% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +5.7% +6.1% -0.3% +30.0% ➖ noise
5 datafusion:vortex-compact +0.6% +12.4% -10.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.5% +12.4% -11.4% +30.0% ➖ noise
5 duckdb:vortex-compact +1.4% +12.4% -9.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -2.6% +12.4% -13.3% +30.0% ➖ noise
6 datafusion:vortex-compact +3.5% +2.1% +1.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -4.4% +2.1% -6.4% +30.0% ➖ noise
6 duckdb:vortex-compact +9.0% +2.1% +6.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +21.8% +2.1% +19.2% +30.0% ➖ noise
7 datafusion:vortex-compact -9.3% -4.7% -4.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -3.0% -4.7% +1.8% +30.0% ➖ noise
7 duckdb:vortex-compact +2.3% -4.7% +7.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +16.8% -4.7% +22.6% +30.0% ➖ noise
8 datafusion:vortex-compact -2.1% +6.3% -7.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -2.0% +6.3% -7.8% +30.0% ➖ noise
8 duckdb:vortex-compact +3.1% +6.3% -3.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +13.3% +6.3% +6.6% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-H SF=10 on NVME

Summary

  • Overall: 0.921x ➖
  • Vortex: 0.912x ➖
  • Parquet: 0.942x ➖

Verdict

No clear signal

  • Attributed Vortex impact: -3.0%
  • Confidence: low
  • Environment shift: -5.8%

Statistical Summary

  • Systemic shift (parquet controls): -5.8%
  • Control sigma: +2.6%
  • Residual noise: +2.1%
  • Median polish overall: -8.4%
datafusion / vortex-file-compressed (0.895x ✅, 11↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 427325723 488285500 0.88
tpch_q02/datafusion:vortex-file-compressed 158063616 175473460 0.90
tpch_q03/datafusion:vortex-file-compressed 🚀 244324640 281998528 0.87
tpch_q04/datafusion:vortex-file-compressed 108880465 116042878 0.94
tpch_q05/datafusion:vortex-file-compressed 🚀 454684423 513841339 0.88
tpch_q06/datafusion:vortex-file-compressed 40109217 44485486 0.90
tpch_q07/datafusion:vortex-file-compressed 🚀 635560527 757781463 0.84
tpch_q08/datafusion:vortex-file-compressed 🚀 467815830 526170356 0.89
tpch_q09/datafusion:vortex-file-compressed 🚀 797694713 903782106 0.88
tpch_q10/datafusion:vortex-file-compressed 🚀 285391287 328552457 0.87
tpch_q11/datafusion:vortex-file-compressed 117741972 129385002 0.91
tpch_q12/datafusion:vortex-file-compressed 124094511 137437387 0.90
tpch_q13/datafusion:vortex-file-compressed 226521476 246195819 0.92
tpch_q14/datafusion:vortex-file-compressed 71761214 78138628 0.92
tpch_q15/datafusion:vortex-file-compressed 109672579 118475752 0.93
tpch_q16/datafusion:vortex-file-compressed 91643441 100730627 0.91
tpch_q17/datafusion:vortex-file-compressed 🚀 735529582 828636212 0.89
tpch_q18/datafusion:vortex-file-compressed 🚀 964087734 1090943052 0.88
tpch_q19/datafusion:vortex-file-compressed 125618312 134800656 0.93
tpch_q20/datafusion:vortex-file-compressed 🚀 197825902 225142955 0.88
tpch_q21/datafusion:vortex-file-compressed 🚀 755940373 881154262 0.86
tpch_q22/datafusion:vortex-file-compressed 60733875 66116940 0.92
datafusion / vortex-compact (0.913x ➖, 9↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 473282035 505308312 0.94
tpch_q02/datafusion:vortex-compact 165429791 179052501 0.92
tpch_q03/datafusion:vortex-compact 🚀 261312784 295804468 0.88
tpch_q04/datafusion:vortex-compact 129073129 143136485 0.90
tpch_q05/datafusion:vortex-compact 🚀 466523488 532375362 0.88
tpch_q06/datafusion:vortex-compact 64569646 69414499 0.93
tpch_q07/datafusion:vortex-compact 🚀 671735190 752311806 0.89
tpch_q08/datafusion:vortex-compact 🚀 475214866 530276390 0.90
tpch_q09/datafusion:vortex-compact 🚀 807148267 920619356 0.88
tpch_q10/datafusion:vortex-compact 329238055 357349645 0.92
tpch_q11/datafusion:vortex-compact 122455110 133761326 0.92
tpch_q12/datafusion:vortex-compact 185611434 201753240 0.92
tpch_q13/datafusion:vortex-compact 274415179 296455319 0.93
tpch_q14/datafusion:vortex-compact 89342850 96152488 0.93
tpch_q15/datafusion:vortex-compact 🚀 165796439 185585587 0.89
tpch_q16/datafusion:vortex-compact 100851903 105058893 0.96
tpch_q17/datafusion:vortex-compact 🚀 736186609 825836062 0.89
tpch_q18/datafusion:vortex-compact 🚀 977298941 1107000406 0.88
tpch_q19/datafusion:vortex-compact 228969530 244662998 0.94
tpch_q20/datafusion:vortex-compact 229664747 248503458 0.92
tpch_q21/datafusion:vortex-compact 🚀 793345821 893588740 0.89
tpch_q22/datafusion:vortex-compact 74710628 76179859 0.98
datafusion / parquet (0.922x ➖, 7↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 454446628 496049299 0.92
tpch_q02/datafusion:parquet 262979182 273544939 0.96
tpch_q03/datafusion:parquet 387447680 424722183 0.91
tpch_q04/datafusion:parquet 150215502 155106114 0.97
tpch_q05/datafusion:parquet 🚀 567190898 633396261 0.90
tpch_q06/datafusion:parquet 127410549 132014908 0.97
tpch_q07/datafusion:parquet 788814789 868440918 0.91
tpch_q08/datafusion:parquet 637660600 697402841 0.91
tpch_q09/datafusion:parquet 🚀 953202156 1067351868 0.89
tpch_q10/datafusion:parquet 🚀 581652170 648308613 0.90
tpch_q11/datafusion:parquet 193074918 205293188 0.94
tpch_q12/datafusion:parquet 251626761 250519629 1.00
tpch_q13/datafusion:parquet 348339633 354165210 0.98
tpch_q14/datafusion:parquet 194180871 211652830 0.92
tpch_q15/datafusion:parquet 🚀 259967840 306743343 0.85
tpch_q16/datafusion:parquet 177268922 188932441 0.94
tpch_q17/datafusion:parquet 🚀 835538952 929998254 0.90
tpch_q18/datafusion:parquet 1026890417 1135025441 0.90
tpch_q19/datafusion:parquet 🚀 323396229 379536063 0.85
tpch_q20/datafusion:parquet 369729352 400463245 0.92
tpch_q21/datafusion:parquet 🚀 877452986 990716647 0.89
tpch_q22/datafusion:parquet 220850092 226128290 0.98
datafusion / arrow (0.877x ✅, 18↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 723828803 815031861 0.89
tpch_q02/datafusion:arrow 202137929 212158600 0.95
tpch_q03/datafusion:arrow 🚀 555071633 643680388 0.86
tpch_q04/datafusion:arrow 🚀 396119771 477750972 0.83
tpch_q05/datafusion:arrow 🚀 1042556793 1200549886 0.87
tpch_q06/datafusion:arrow 🚀 324190923 377490924 0.86
tpch_q07/datafusion:arrow 🚀 1359215253 1587353570 0.86
tpch_q08/datafusion:arrow 🚀 1264781751 1452381454 0.87
tpch_q09/datafusion:arrow 🚀 1526304102 1742180785 0.88
tpch_q10/datafusion:arrow 🚀 665934911 778056121 0.86
tpch_q11/datafusion:arrow 176192736 192980724 0.91
tpch_q12/datafusion:arrow 🚀 743778425 832646265 0.89
tpch_q13/datafusion:arrow 534041896 562298568 0.95
tpch_q14/datafusion:arrow 🚀 358176827 439236461 0.82
tpch_q15/datafusion:arrow 🚀 758632906 923179047 0.82
tpch_q16/datafusion:arrow 123474944 133840060 0.92
tpch_q17/datafusion:arrow 🚀 1554985056 1752383590 0.89
tpch_q18/datafusion:arrow 🚀 2147363540 2390053160 0.90
tpch_q19/datafusion:arrow 🚀 572187990 656268986 0.87
tpch_q20/datafusion:arrow 🚀 562904484 661098349 0.85
tpch_q21/datafusion:arrow 🚀 4041977897 4617867220 0.88
tpch_q22/datafusion:arrow 🚀 174344635 196524072 0.89
duckdb / vortex-file-compressed (0.914x ➖, 5↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176034926 186767634 0.94
tpch_q02/duckdb:vortex-file-compressed 🚀 51350850 59599609 0.86
tpch_q03/duckdb:vortex-file-compressed 129832490 140605706 0.92
tpch_q04/duckdb:vortex-file-compressed 150839289 166885415 0.90
tpch_q05/duckdb:vortex-file-compressed 131441109 144263256 0.91
tpch_q06/duckdb:vortex-file-compressed 🚀 49613185 55215065 0.90
tpch_q07/duckdb:vortex-file-compressed 146721270 159754656 0.92
tpch_q08/duckdb:vortex-file-compressed 🚀 171405850 206206826 0.83
tpch_q09/duckdb:vortex-file-compressed 336988193 361636746 0.93
tpch_q10/duckdb:vortex-file-compressed 154493936 166933369 0.93
tpch_q11/duckdb:vortex-file-compressed 36005242 38969116 0.92
tpch_q12/duckdb:vortex-file-compressed 93541683 103680460 0.90
tpch_q13/duckdb:vortex-file-compressed 244045343 260026051 0.94
tpch_q14/duckdb:vortex-file-compressed 73347226 73564536 1.00
tpch_q15/duckdb:vortex-file-compressed 97440973 108210359 0.90
tpch_q16/duckdb:vortex-file-compressed 78741384 84917117 0.93
tpch_q17/duckdb:vortex-file-compressed 🚀 101061771 113890470 0.89
tpch_q18/duckdb:vortex-file-compressed 280484688 310600918 0.90
tpch_q19/duckdb:vortex-file-compressed 90696997 95525438 0.95
tpch_q20/duckdb:vortex-file-compressed 🚀 165647117 184647741 0.90
tpch_q21/duckdb:vortex-file-compressed 549675231 609329325 0.90
tpch_q22/duckdb:vortex-file-compressed 77546556 81898148 0.95
duckdb / vortex-compact (0.928x ➖, 4↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230203827 236109871 0.97
tpch_q02/duckdb:vortex-compact 59542158 61668200 0.97
tpch_q03/duckdb:vortex-compact 142113167 151632342 0.94
tpch_q04/duckdb:vortex-compact 177165676 193906463 0.91
tpch_q05/duckdb:vortex-compact 🚀 145159518 165287220 0.88
tpch_q06/duckdb:vortex-compact 87578689 90703378 0.97
tpch_q07/duckdb:vortex-compact 206141305 220380063 0.94
tpch_q08/duckdb:vortex-compact 🚀 191785162 219464059 0.87
tpch_q09/duckdb:vortex-compact 362476669 390385777 0.93
tpch_q10/duckdb:vortex-compact 🚀 185255564 208476475 0.89
tpch_q11/duckdb:vortex-compact 🚀 41642733 46569198 0.89
tpch_q12/duckdb:vortex-compact 211093463 221597501 0.95
tpch_q13/duckdb:vortex-compact 291229187 312483563 0.93
tpch_q14/duckdb:vortex-compact 103348046 112673365 0.92
tpch_q15/duckdb:vortex-compact 121496220 129383288 0.94
tpch_q16/duckdb:vortex-compact 86508541 93114957 0.93
tpch_q17/duckdb:vortex-compact 117569816 129104146 0.91
tpch_q18/duckdb:vortex-compact 296903642 318585155 0.93
tpch_q19/duckdb:vortex-compact 115032520 118948743 0.97
tpch_q20/duckdb:vortex-compact 209524728 221535471 0.95
tpch_q21/duckdb:vortex-compact 630367134 688082228 0.92
tpch_q22/duckdb:vortex-compact 87624843 94566796 0.93
duckdb / parquet (0.962x ➖, 1↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 256491599 257488989 1.00
tpch_q02/duckdb:parquet 105052113 109684663 0.96
tpch_q03/duckdb:parquet 209544752 223048588 0.94
tpch_q04/duckdb:parquet 135044415 140485527 0.96
tpch_q05/duckdb:parquet 217446029 230734435 0.94
tpch_q06/duckdb:parquet 66348563 69191599 0.96
tpch_q07/duckdb:parquet 179139145 188310312 0.95
tpch_q08/duckdb:parquet 255955068 273425288 0.94
tpch_q09/duckdb:parquet 457603509 479138792 0.96
tpch_q10/duckdb:parquet 606679250 630229692 0.96
tpch_q11/duckdb:parquet 46101257 44574015 1.03
tpch_q12/duckdb:parquet 127234542 133333908 0.95
tpch_q13/duckdb:parquet 🚀 409795456 469031305 0.87
tpch_q14/duckdb:parquet 176737513 173289894 1.02
tpch_q15/duckdb:parquet 99377950 103713775 0.96
tpch_q16/duckdb:parquet 160030865 169248016 0.95
tpch_q17/duckdb:parquet 182170246 184432150 0.99
tpch_q18/duckdb:parquet 352779042 362083853 0.97
tpch_q19/duckdb:parquet 280098946 289462837 0.97
tpch_q20/duckdb:parquet 229797426 234049435 0.98
tpch_q21/duckdb:parquet 578073510 606681416 0.95
tpch_q22/duckdb:parquet 289207153 296909571 0.97
duckdb / duckdb (0.958x ➖, 1↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116902783 118431716 0.99
tpch_q02/duckdb:duckdb 44890798 47863105 0.94
tpch_q03/duckdb:duckdb 97841548 101250817 0.97
tpch_q04/duckdb:duckdb 131348980 141622705 0.93
tpch_q05/duckdb:duckdb 110646739 117104506 0.94
tpch_q06/duckdb:duckdb 39492398 38449925 1.03
tpch_q07/duckdb:duckdb 86606378 89049897 0.97
tpch_q08/duckdb:duckdb 111040185 117070496 0.95
tpch_q09/duckdb:duckdb 276444055 289436123 0.96
tpch_q10/duckdb:duckdb 204986409 215301736 0.95
tpch_q11/duckdb:duckdb 🚀 15704628 18254757 0.86
tpch_q12/duckdb:duckdb 85363931 87767534 0.97
tpch_q13/duckdb:duckdb 251406484 265617192 0.95
tpch_q14/duckdb:duckdb 71669929 73961005 0.97
tpch_q15/duckdb:duckdb 77906106 81591735 0.95
tpch_q16/duckdb:duckdb 72953903 77149154 0.95
tpch_q17/duckdb:duckdb 84044904 85977001 0.98
tpch_q18/duckdb:duckdb 213832999 225093688 0.95
tpch_q19/duckdb:duckdb 116462728 120566286 0.97
tpch_q20/duckdb:duckdb 110959779 114572711 0.97
tpch_q21/duckdb:duckdb 301281645 320275415 0.94
tpch_q22/duckdb:duckdb 69763840 68393051 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -11.2% -4.5% -7.0% +11.8% ➖ noise
1 datafusion:vortex-compact -6.3% -4.5% -2.0% +13.8% ➖ noise
1 datafusion:vortex-file-compressed -12.5% -4.5% -8.4% +13.4% ➖ noise
1 duckdb:duckdb -1.3% -4.5% +3.3% +11.9% ➖ noise
1 duckdb:vortex-compact -2.5% -4.5% +2.1% +12.0% ➖ noise
1 duckdb:vortex-file-compressed -5.7% -4.5% -1.3% +12.9% ➖ noise
2 datafusion:arrow -4.7% -4.0% -0.7% +10.0% ➖ noise
2 datafusion:vortex-compact -7.6% -4.0% -3.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -9.9% -4.0% -6.1% +10.0% ➖ noise
2 duckdb:duckdb -6.2% -4.0% -2.3% +10.3% ➖ noise
2 duckdb:vortex-compact -3.4% -4.0% +0.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -13.8% -4.0% -10.2% +10.0% ✅ faster
3 datafusion:arrow -13.8% -7.4% -6.8% +10.0% ➖ noise
3 datafusion:vortex-compact -11.7% -7.4% -4.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -13.4% -7.4% -6.4% +10.0% ➖ noise
3 duckdb:duckdb -3.4% -7.4% +4.4% +10.0% ➖ noise
3 duckdb:vortex-compact -6.3% -7.4% +1.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -7.7% -7.4% -0.3% +10.0% ➖ noise
4 datafusion:arrow -17.1% -3.5% -14.1% +10.0% ✅ faster
4 datafusion:vortex-compact -9.8% -3.5% -6.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -6.2% -3.5% -2.8% +10.0% ➖ noise
4 duckdb:duckdb -7.3% -3.5% -3.9% +10.0% ➖ noise
4 duckdb:vortex-compact -8.6% -3.5% -5.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -9.6% -3.5% -6.3% +10.0% ➖ noise
5 datafusion:arrow -13.2% -8.1% -5.5% +10.0% ➖ noise
5 datafusion:vortex-compact -12.4% -8.1% -4.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -11.5% -8.1% -3.7% +10.0% ➖ noise
5 duckdb:duckdb -5.5% -8.1% +2.9% +10.0% ➖ noise
5 duckdb:vortex-compact -12.2% -8.1% -4.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -8.9% -8.1% -0.8% +10.0% ➖ noise
6 datafusion:arrow -14.1% -3.8% -10.7% +10.0% ✅ faster
6 datafusion:vortex-compact -7.0% -3.8% -3.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -9.8% -3.8% -6.3% +10.0% ➖ noise
6 duckdb:duckdb +2.7% -3.8% +6.8% +14.6% ➖ noise
6 duckdb:vortex-compact -3.4% -3.8% +0.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -10.1% -3.8% -6.6% +10.3% ➖ noise
7 datafusion:arrow -14.4% -7.0% -7.9% +10.0% ➖ noise
7 datafusion:vortex-compact -10.7% -7.0% -3.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -16.1% -7.0% -9.8% +10.0% ✅ faster
7 duckdb:duckdb -2.7% -7.0% +4.6% +10.0% ➖ noise
7 duckdb:vortex-compact -6.5% -7.0% +0.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -8.2% -7.0% -1.2% +10.0% ➖ noise
8 datafusion:arrow -12.9% -7.5% -5.9% +10.0% ➖ noise
8 datafusion:vortex-compact -10.4% -7.5% -3.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -11.1% -7.5% -3.9% +10.0% ➖ noise
8 duckdb:duckdb -5.2% -7.5% +2.5% +10.0% ➖ noise
8 duckdb:vortex-compact -12.6% -7.5% -5.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -16.9% -7.5% -10.2% +10.0% ✅ faster
9 datafusion:arrow -12.4% -7.6% -5.1% +10.0% ➖ noise
9 datafusion:vortex-compact -12.3% -7.6% -5.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -11.7% -7.6% -4.4% +10.0% ➖ noise
9 duckdb:duckdb -4.5% -7.6% +3.4% +10.0% ➖ noise
9 duckdb:vortex-compact -7.1% -7.6% +0.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.8% -7.6% +0.9% +10.0% ➖ noise
10 datafusion:arrow -14.4% -7.1% -7.9% +10.0% ➖ noise
10 datafusion:vortex-compact -7.9% -7.1% -0.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -13.1% -7.1% -6.5% +10.0% ➖ noise
10 duckdb:duckdb -4.8% -7.1% +2.4% +10.0% ➖ noise
10 duckdb:vortex-compact -11.1% -7.1% -4.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -7.5% -7.1% -0.4% +10.0% ➖ noise
11 datafusion:arrow -8.7% -1.4% -7.4% +13.3% ➖ noise
11 datafusion:vortex-compact -8.5% -1.4% -7.2% +12.9% ➖ noise
11 datafusion:vortex-file-compressed -9.0% -1.4% -7.7% +13.0% ➖ noise
11 duckdb:duckdb -14.0% -1.4% -12.8% +21.5% ➖ noise
11 duckdb:vortex-compact -10.6% -1.4% -9.3% +17.1% ➖ noise
11 duckdb:vortex-file-compressed -7.6% -1.4% -6.3% +16.7% ➖ noise
12 datafusion:arrow -10.7% -2.1% -8.8% +40.2% ➖ noise
12 datafusion:vortex-compact -8.0% -2.1% -6.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -9.7% -2.1% -7.8% +10.0% ➖ noise
12 duckdb:duckdb -2.7% -2.1% -0.7% +10.0% ➖ noise
12 duckdb:vortex-compact -4.7% -2.1% -2.7% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -9.8% -2.1% -7.8% +10.0% ➖ noise
13 datafusion:arrow -5.0% -7.3% +2.5% +10.0% ➖ noise
13 datafusion:vortex-compact -7.4% -7.3% -0.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -8.0% -7.3% -0.7% +10.0% ➖ noise
13 duckdb:duckdb -5.4% -7.3% +2.1% +10.0% ➖ noise
13 duckdb:vortex-compact -6.8% -7.3% +0.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -6.1% -7.3% +1.2% +10.0% ➖ noise
14 datafusion:arrow -18.5% -3.3% -15.7% +10.0% ✅ faster
14 datafusion:vortex-compact -7.1% -3.3% -3.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -8.2% -3.3% -5.1% +10.0% ➖ noise
14 duckdb:duckdb -3.1% -3.3% +0.2% +10.0% ➖ noise
14 duckdb:vortex-compact -8.3% -3.3% -5.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.3% -3.3% +3.1% +10.0% ➖ noise
15 datafusion:arrow -17.8% -9.9% -8.8% +10.0% ➖ noise
15 datafusion:vortex-compact -10.7% -9.9% -0.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -7.4% -9.9% +2.7% +10.0% ➖ noise
15 duckdb:duckdb -4.5% -9.9% +6.0% +10.0% ➖ noise
15 duckdb:vortex-compact -6.1% -9.9% +4.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -10.0% -9.9% -0.1% +10.0% ➖ noise
16 datafusion:arrow -7.7% -5.8% -2.1% +10.0% ➖ noise
16 datafusion:vortex-compact -4.0% -5.8% +1.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -9.0% -5.8% -3.4% +10.0% ➖ noise
16 duckdb:duckdb -5.4% -5.8% +0.4% +10.0% ➖ noise
16 duckdb:vortex-compact -7.1% -5.8% -1.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -7.3% -5.8% -1.6% +10.0% ➖ noise
17 datafusion:arrow -11.3% -5.8% -5.8% +10.0% ➖ noise
17 datafusion:vortex-compact -10.9% -5.8% -5.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -11.2% -5.8% -5.8% +10.0% ➖ noise
17 duckdb:duckdb -2.2% -5.8% +3.8% +10.0% ➖ noise
17 duckdb:vortex-compact -8.9% -5.8% -3.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -11.3% -5.8% -5.8% +10.0% ➖ noise
18 datafusion:arrow -10.2% -6.1% -4.3% +12.2% ➖ noise
18 datafusion:vortex-compact -11.7% -6.1% -6.0% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -11.6% -6.1% -5.9% +10.0% ➖ noise
18 duckdb:duckdb -5.0% -6.1% +1.2% +10.0% ➖ noise
18 duckdb:vortex-compact -6.8% -6.1% -0.7% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -9.7% -6.1% -3.8% +10.0% ➖ noise
19 datafusion:arrow -12.8% -9.2% -4.0% +10.0% ➖ noise
19 datafusion:vortex-compact -6.4% -9.2% +3.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -6.8% -9.2% +2.6% +10.0% ➖ noise
19 duckdb:duckdb -3.4% -9.2% +6.4% +10.0% ➖ noise
19 duckdb:vortex-compact -3.3% -9.2% +6.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -5.1% -9.2% +4.6% +10.0% ➖ noise
20 datafusion:arrow -14.9% -4.8% -10.6% +10.0% ✅ faster
20 datafusion:vortex-compact -7.6% -4.8% -2.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -12.1% -4.8% -7.7% +10.0% ➖ noise
20 duckdb:duckdb -3.2% -4.8% +1.7% +10.0% ➖ noise
20 duckdb:vortex-compact -5.4% -4.8% -0.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -10.3% -4.8% -5.8% +10.0% ➖ noise
21 datafusion:arrow -12.5% -8.1% -4.7% +10.0% ➖ noise
21 datafusion:vortex-compact -11.2% -8.1% -3.4% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -14.2% -8.1% -6.6% +10.0% ➖ noise
21 duckdb:duckdb -5.9% -8.1% +2.4% +10.0% ➖ noise
21 duckdb:vortex-compact -8.4% -8.1% -0.3% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -9.8% -8.1% -1.8% +10.0% ➖ noise
22 datafusion:arrow -11.3% -2.5% -9.0% +10.0% ➖ noise
22 datafusion:vortex-compact -1.9% -2.5% +0.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -8.1% -2.5% -5.8% +10.0% ➖ noise
22 duckdb:duckdb +2.0% -2.5% +4.6% +10.0% ➖ noise
22 duckdb:vortex-compact -7.3% -2.5% -5.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -5.3% -2.5% -2.9% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: TPC-H SF=10 on S3

Summary

  • Overall: 1.106x ➖
  • Vortex: 1.122x ➖
  • Parquet: 1.073x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +4.7%
  • Confidence: environment too noisy
  • Environment shift: +7.3%

Statistical Summary

  • Systemic shift (parquet controls): +7.3%
  • Control sigma: +10.4%
  • Residual noise: +6.6%
  • Median polish overall: +10.5%
datafusion / vortex-file-compressed (1.172x ➖, 0↑ 5↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 776960894 767401722 1.01
tpch_q02/datafusion:vortex-file-compressed 834312547 799957368 1.04
tpch_q03/datafusion:vortex-file-compressed 882549525 797148740 1.11
tpch_q04/datafusion:vortex-file-compressed 631338380 628179876 1.01
tpch_q05/datafusion:vortex-file-compressed 1277466111 1109573823 1.15
tpch_q06/datafusion:vortex-file-compressed 804641510 620228424 1.30
tpch_q07/datafusion:vortex-file-compressed 🚨 1576800243 1140186680 1.38
tpch_q08/datafusion:vortex-file-compressed 🚨 2358476922 1201587652 1.96
tpch_q09/datafusion:vortex-file-compressed 🚨 2257206212 1478324879 1.53
tpch_q10/datafusion:vortex-file-compressed 1199302684 1030496001 1.16
tpch_q11/datafusion:vortex-file-compressed 🚨 634468372 475997894 1.33
tpch_q12/datafusion:vortex-file-compressed 1124990831 1059815791 1.06
tpch_q13/datafusion:vortex-file-compressed 474980135 539821999 0.88
tpch_q14/datafusion:vortex-file-compressed 613213932 607014576 1.01
tpch_q15/datafusion:vortex-file-compressed 1174852349 1128102964 1.04
tpch_q16/datafusion:vortex-file-compressed 327266747 279226710 1.17
tpch_q17/datafusion:vortex-file-compressed 1330608879 1244644378 1.07
tpch_q18/datafusion:vortex-file-compressed 1498379874 1317021495 1.14
tpch_q19/datafusion:vortex-file-compressed 793433402 730080520 1.09
tpch_q20/datafusion:vortex-file-compressed 1071864229 956498095 1.12
tpch_q21/datafusion:vortex-file-compressed 1822489537 1644035738 1.11
tpch_q22/datafusion:vortex-file-compressed 🚨 660069351 428038576 1.54
datafusion / vortex-compact (1.117x ➖, 1↑ 3↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 823510731 717395374 1.15
tpch_q02/datafusion:vortex-compact 🚨 1024237836 638558707 1.60
tpch_q03/datafusion:vortex-compact 🚨 881287009 674477155 1.31
tpch_q04/datafusion:vortex-compact 511964565 549436420 0.93
tpch_q05/datafusion:vortex-compact 1108265423 982053562 1.13
tpch_q06/datafusion:vortex-compact 619660431 593125704 1.04
tpch_q07/datafusion:vortex-compact 1223805673 1240024449 0.99
tpch_q08/datafusion:vortex-compact 1424533358 1167247531 1.22
tpch_q09/datafusion:vortex-compact 1524229007 1315860510 1.16
tpch_q10/datafusion:vortex-compact 1133758593 932137907 1.22
tpch_q11/datafusion:vortex-compact 494815591 442937415 1.12
tpch_q12/datafusion:vortex-compact 864570996 810946333 1.07
tpch_q13/datafusion:vortex-compact 429890519 393075670 1.09
tpch_q14/datafusion:vortex-compact 616367657 579366170 1.06
tpch_q15/datafusion:vortex-compact 1166078907 1052025298 1.11
tpch_q16/datafusion:vortex-compact 🚨 593364484 334211129 1.78
tpch_q17/datafusion:vortex-compact 1331076256 1181389672 1.13
tpch_q18/datafusion:vortex-compact 1352096204 1196320724 1.13
tpch_q19/datafusion:vortex-compact 762628398 719319451 1.06
tpch_q20/datafusion:vortex-compact 955791730 847768250 1.13
tpch_q21/datafusion:vortex-compact 1460219129 1569044502 0.93
tpch_q22/datafusion:vortex-compact 🚀 345038743 520931060 0.66
datafusion / parquet (1.021x ➖, 1↑ 1↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 944272928 875884329 1.08
tpch_q02/datafusion:parquet 🚨 995735517 683894374 1.46
tpch_q03/datafusion:parquet 1126945789 1193439829 0.94
tpch_q04/datafusion:parquet 576263651 716761239 0.80
tpch_q05/datafusion:parquet 1340770547 1302653704 1.03
tpch_q06/datafusion:parquet 520074848 595179631 0.87
tpch_q07/datafusion:parquet 1562363299 1395323327 1.12
tpch_q08/datafusion:parquet 1892032352 1783612990 1.06
tpch_q09/datafusion:parquet 2137075633 1991121223 1.07
tpch_q10/datafusion:parquet 2402991894 2315453755 1.04
tpch_q11/datafusion:parquet 594075226 781174271 0.76
tpch_q12/datafusion:parquet 835943242 794766042 1.05
tpch_q13/datafusion:parquet 715147488 687648974 1.04
tpch_q14/datafusion:parquet 886641579 800859080 1.11
tpch_q15/datafusion:parquet 1324927711 1185759475 1.12
tpch_q16/datafusion:parquet 545295713 478094647 1.14
tpch_q17/datafusion:parquet 1645504750 1498933871 1.10
tpch_q18/datafusion:parquet 1905404807 1592184805 1.20
tpch_q19/datafusion:parquet 996747047 947629579 1.05
tpch_q20/datafusion:parquet 1284655115 1185341918 1.08
tpch_q21/datafusion:parquet 1823739806 1789484493 1.02
tpch_q22/datafusion:parquet 🚀 673884347 1081492689 0.62
duckdb / vortex-file-compressed (1.125x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 682892602 602359691 1.13
tpch_q02/duckdb:vortex-file-compressed 1210067021 1073843756 1.13
tpch_q03/duckdb:vortex-file-compressed 1103360014 961648500 1.15
tpch_q04/duckdb:vortex-file-compressed 670123675 604883426 1.11
tpch_q05/duckdb:vortex-file-compressed 1239909744 1066713541 1.16
tpch_q06/duckdb:vortex-file-compressed 825588676 763642882 1.08
tpch_q07/duckdb:vortex-file-compressed 1221215975 1016253362 1.20
tpch_q08/duckdb:vortex-file-compressed 1475348935 1314353540 1.12
tpch_q09/duckdb:vortex-file-compressed 1509644798 1407605285 1.07
tpch_q10/duckdb:vortex-file-compressed 1275411783 1129439084 1.13
tpch_q11/duckdb:vortex-file-compressed 759619176 721901390 1.05
tpch_q12/duckdb:vortex-file-compressed 805083484 681286626 1.18
tpch_q13/duckdb:vortex-file-compressed 1142851955 995512255 1.15
tpch_q14/duckdb:vortex-file-compressed 1005226633 868304158 1.16
tpch_q15/duckdb:vortex-file-compressed 605316453 554974251 1.09
tpch_q16/duckdb:vortex-file-compressed 507493767 401865389 1.26
tpch_q17/duckdb:vortex-file-compressed 1089659099 980660750 1.11
tpch_q18/duckdb:vortex-file-compressed 925171899 900670329 1.03
tpch_q19/duckdb:vortex-file-compressed 817600907 804554384 1.02
tpch_q20/duckdb:vortex-file-compressed 1343572086 1150773040 1.17
tpch_q21/duckdb:vortex-file-compressed 2112222464 1875191317 1.13
tpch_q22/duckdb:vortex-file-compressed 655145836 566769449 1.16
duckdb / vortex-compact (1.077x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 625961828 625322971 1.00
tpch_q02/duckdb:vortex-compact 1089783034 1115916903 0.98
tpch_q03/duckdb:vortex-compact 802005520 825408218 0.97
tpch_q04/duckdb:vortex-compact 515427628 496821347 1.04
tpch_q05/duckdb:vortex-compact 1036489149 1046816244 0.99
tpch_q06/duckdb:vortex-compact 776281459 681792961 1.14
tpch_q07/duckdb:vortex-compact 1084827309 1152704388 0.94
tpch_q08/duckdb:vortex-compact 1496877217 1365924125 1.10
tpch_q09/duckdb:vortex-compact 1498054424 1290473280 1.16
tpch_q10/duckdb:vortex-compact 1114233103 905963959 1.23
tpch_q11/duckdb:vortex-compact 869772072 709123615 1.23
tpch_q12/duckdb:vortex-compact 660522306 648785113 1.02
tpch_q13/duckdb:vortex-compact 838562451 849261970 0.99
tpch_q14/duckdb:vortex-compact 911230714 864308225 1.05
tpch_q15/duckdb:vortex-compact 588892521 532548688 1.11
tpch_q16/duckdb:vortex-compact 406912092 432569620 0.94
tpch_q17/duckdb:vortex-compact 945544878 930642906 1.02
tpch_q18/duckdb:vortex-compact 734310755 656052640 1.12
tpch_q19/duckdb:vortex-compact 833743300 708010084 1.18
tpch_q20/duckdb:vortex-compact 1335425579 1165487890 1.15
tpch_q21/duckdb:vortex-compact 2095826827 1689573437 1.24
tpch_q22/duckdb:vortex-compact 769223085 629810140 1.22
duckdb / parquet (1.127x ➖, 0↑ 1↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 861388963 874751453 0.98
tpch_q02/duckdb:parquet 1708168558 1498957615 1.14
tpch_q03/duckdb:parquet 1909874079 1522257607 1.25
tpch_q04/duckdb:parquet 1142654733 945328691 1.21
tpch_q05/duckdb:parquet 2191128756 2035023606 1.08
tpch_q06/duckdb:parquet 700186025 739007933 0.95
tpch_q07/duckdb:parquet 1925315598 1564355995 1.23
tpch_q08/duckdb:parquet 2822323504 2307279209 1.22
tpch_q09/duckdb:parquet 2451190390 2256829063 1.09
tpch_q10/duckdb:parquet 3247387863 3032822451 1.07
tpch_q11/duckdb:parquet 1010931483 966942116 1.05
tpch_q12/duckdb:parquet 1086588854 1013976574 1.07
tpch_q13/duckdb:parquet 1187622027 1158348427 1.03
tpch_q14/duckdb:parquet 1407335046 1238656360 1.14
tpch_q15/duckdb:parquet 962457387 835264920 1.15
tpch_q16/duckdb:parquet 791945781 719401710 1.10
tpch_q17/duckdb:parquet 🚨 1531317754 1173488775 1.30
tpch_q18/duckdb:parquet 1652017684 1405069428 1.18
tpch_q19/duckdb:parquet 1690397751 1395808383 1.21
tpch_q20/duckdb:parquet 1797891102 1589500068 1.13
tpch_q21/duckdb:parquet 2131811652 1887047691 1.13
tpch_q22/duckdb:parquet 1183167608 1026690970 1.15
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +14.8% +3.0% +11.4% +57.2% ➖ noise
1 datafusion:vortex-file-compressed +1.2% +3.0% -1.7% +80.9% ➖ noise
1 duckdb:vortex-compact +0.1% +3.0% -2.8% +31.7% ➖ noise
1 duckdb:vortex-file-compressed +13.4% +3.0% +10.0% +33.4% ➖ noise
2 datafusion:vortex-compact +60.4% +28.8% +24.5% +44.2% ➖ noise
2 datafusion:vortex-file-compressed +4.3% +28.8% -19.0% +41.9% ➖ noise
2 duckdb:vortex-compact -2.3% +28.8% -24.2% +35.3% ➖ noise
2 duckdb:vortex-file-compressed +12.7% +28.8% -12.5% +34.3% ➖ noise
3 datafusion:vortex-compact +30.7% +8.8% +20.0% +82.2% ➖ noise
3 datafusion:vortex-file-compressed +10.7% +8.8% +1.7% +89.2% ➖ noise
3 duckdb:vortex-compact -2.8% +8.8% -10.7% +59.8% ➖ noise
3 duckdb:vortex-file-compressed +14.7% +8.8% +5.4% +44.4% ➖ noise
4 datafusion:vortex-compact -6.8% -1.4% -5.5% +33.4% ➖ noise
4 datafusion:vortex-file-compressed +0.5% -1.4% +2.0% +39.0% ➖ noise
4 duckdb:vortex-compact +3.7% -1.4% +5.2% +36.0% ➖ noise
4 duckdb:vortex-file-compressed +10.8% -1.4% +12.4% +30.7% ➖ noise
5 datafusion:vortex-compact +12.9% +5.3% +7.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +15.1% +5.3% +9.4% +30.0% ➖ noise
5 duckdb:vortex-compact -1.0% +5.3% -5.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +16.2% +5.3% +10.4% +30.0% ➖ noise
6 datafusion:vortex-compact +4.5% -9.0% +14.8% +31.1% ➖ noise
6 datafusion:vortex-file-compressed +29.7% -9.0% +42.6% +42.2% 🚨 regression
6 duckdb:vortex-compact +13.9% -9.0% +25.1% +30.1% ➖ noise
6 duckdb:vortex-file-compressed +8.1% -9.0% +18.8% +42.7% ➖ noise
7 datafusion:vortex-compact -1.3% +17.4% -15.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +38.3% +17.4% +17.8% +30.0% ➖ noise
7 duckdb:vortex-compact -5.9% +17.4% -19.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +20.2% +17.4% +2.4% +30.0% ➖ noise
8 datafusion:vortex-compact +22.0% +13.9% +7.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +96.3% +13.9% +72.3% +55.6% 🚨 regression
8 duckdb:vortex-compact +9.6% +13.9% -3.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +12.2% +13.9% -1.5% +30.0% ➖ noise
9 datafusion:vortex-compact +15.8% +8.0% +7.3% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +52.7% +8.0% +41.4% +30.0% 🚨 regression
9 duckdb:vortex-compact +16.1% +8.0% +7.5% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +7.2% +8.0% -0.7% +30.0% ➖ noise
10 datafusion:vortex-compact +21.6% +5.4% +15.4% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +16.4% +5.4% +10.4% +32.7% ➖ noise
10 duckdb:vortex-compact +23.0% +5.4% +16.7% +37.0% ➖ noise
10 duckdb:vortex-file-compressed +12.9% +5.4% +7.1% +33.9% ➖ noise
11 datafusion:vortex-compact +11.7% -10.8% +25.3% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +33.3% -10.8% +49.5% +34.7% 🚨 regression
11 duckdb:vortex-compact +22.7% -10.8% +37.6% +33.4% 🚨 regression
11 duckdb:vortex-file-compressed +5.2% -10.8% +18.0% +36.4% ➖ noise
12 datafusion:vortex-compact +6.6% +6.2% +0.4% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +6.1% +6.2% -0.0% +32.5% ➖ noise
12 duckdb:vortex-compact +1.8% +6.2% -4.1% +60.4% ➖ noise
12 duckdb:vortex-file-compressed +18.2% +6.2% +11.3% +35.6% ➖ noise
13 datafusion:vortex-compact +9.4% +3.3% +5.9% +37.7% ➖ noise
13 datafusion:vortex-file-compressed -12.0% +3.3% -14.8% +40.8% ➖ noise
13 duckdb:vortex-compact -1.3% +3.3% -4.4% +65.0% ➖ noise
13 duckdb:vortex-file-compressed +14.8% +3.3% +11.2% +39.7% ➖ noise
14 datafusion:vortex-compact +6.4% +12.2% -5.1% +30.0% ➖ noise
14 datafusion:vortex-file-compressed +1.0% +12.2% -9.9% +30.0% ➖ noise
14 duckdb:vortex-compact +5.4% +12.2% -6.0% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +15.8% +12.2% +3.2% +30.0% ➖ noise
15 datafusion:vortex-compact +10.8% +13.5% -2.3% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +4.1% +13.5% -8.2% +30.0% ➖ noise
15 duckdb:vortex-compact +10.6% +13.5% -2.5% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +9.1% +13.5% -3.9% +30.0% ➖ noise
16 datafusion:vortex-compact +77.5% +12.1% +58.4% +43.0% 🚨 regression
16 datafusion:vortex-file-compressed +17.2% +12.1% +4.6% +30.0% ➖ noise
16 duckdb:vortex-compact -5.9% +12.1% -16.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +26.3% +12.1% +12.7% +41.9% ➖ noise
17 datafusion:vortex-compact +12.7% +19.7% -5.9% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +6.9% +19.7% -10.7% +30.0% ➖ noise
17 duckdb:vortex-compact +1.6% +19.7% -15.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +11.1% +19.7% -7.2% +30.0% ➖ noise
18 datafusion:vortex-compact +13.0% +18.6% -4.7% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +13.8% +18.6% -4.1% +30.0% ➖ noise
18 duckdb:vortex-compact +11.9% +18.6% -5.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +2.7% +18.6% -13.4% +30.0% ➖ noise
19 datafusion:vortex-compact +6.0% +12.9% -6.1% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +8.7% +12.9% -3.7% +30.0% ➖ noise
19 duckdb:vortex-compact +17.8% +12.9% +4.3% +43.4% ➖ noise
19 duckdb:vortex-file-compressed +1.6% +12.9% -10.0% +30.0% ➖ noise
20 datafusion:vortex-compact +12.7% +10.7% +1.8% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +12.1% +10.7% +1.2% +30.0% ➖ noise
20 duckdb:vortex-compact +14.6% +10.7% +3.5% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +16.8% +10.7% +5.5% +30.0% ➖ noise
21 datafusion:vortex-compact -6.9% +7.3% -13.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +10.9% +7.3% +3.3% +30.0% ➖ noise
21 duckdb:vortex-compact +24.0% +7.3% +15.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +12.6% +7.3% +5.0% +30.0% ➖ noise
22 datafusion:vortex-compact -33.8% -15.3% -21.8% +38.1% ➖ noise
22 datafusion:vortex-file-compressed +54.2% -15.3% +82.0% +63.0% 🚨 regression
22 duckdb:vortex-compact +22.1% -15.3% +44.1% +30.0% 🚨 regression
22 duckdb:vortex-file-compressed +15.6% -15.3% +36.4% +30.0% 🚨 regression

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: Clickbench on NVME

Summary

  • Overall: 1.057x ➖
  • Vortex: 1.084x ➖
  • Parquet: 1.038x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +3.1%
  • Confidence: low
  • Environment shift: +3.8%

Statistical Summary

  • Systemic shift (parquet controls): +3.8%
  • Control sigma: +2.4%
  • Residual noise: +2.6%
  • Median polish overall: +4.4%
datafusion / vortex-file-compressed (1.068x ➖, 1↑ 9↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2457867 1721085 1.43
clickbench_q01/datafusion:vortex-file-compressed 🚨 14753483 13321860 1.11
clickbench_q02/datafusion:vortex-file-compressed 33454256 33302791 1.00
clickbench_q03/datafusion:vortex-file-compressed 38925035 35838964 1.09
clickbench_q04/datafusion:vortex-file-compressed 339607946 327913019 1.04
clickbench_q05/datafusion:vortex-file-compressed 332054644 316070566 1.05
clickbench_q06/datafusion:vortex-file-compressed 🚀 1678731 2346062 0.72
clickbench_q07/datafusion:vortex-file-compressed 19787861 19794170 1.00
clickbench_q08/datafusion:vortex-file-compressed 414599265 391210620 1.06
clickbench_q09/datafusion:vortex-file-compressed 599078853 583938734 1.03
clickbench_q10/datafusion:vortex-file-compressed 75999858 76448405 0.99
clickbench_q11/datafusion:vortex-file-compressed 84314502 83722522 1.01
clickbench_q12/datafusion:vortex-file-compressed 290719595 272370878 1.07
clickbench_q13/datafusion:vortex-file-compressed 443467352 415644879 1.07
clickbench_q14/datafusion:vortex-file-compressed 266891230 253231154 1.05
clickbench_q15/datafusion:vortex-file-compressed 405221429 379665958 1.07
clickbench_q16/datafusion:vortex-file-compressed 770328122 728491294 1.06
clickbench_q17/datafusion:vortex-file-compressed 793200792 732628199 1.08
clickbench_q18/datafusion:vortex-file-compressed 🚨 1618677240 1437218177 1.13
clickbench_q19/datafusion:vortex-file-compressed 24441024 25265899 0.97
clickbench_q20/datafusion:vortex-file-compressed 🚨 373728856 338934820 1.10
clickbench_q21/datafusion:vortex-file-compressed 🚨 439284749 395645021 1.11
clickbench_q22/datafusion:vortex-file-compressed 580407091 558190458 1.04
clickbench_q23/datafusion:vortex-file-compressed 🚨 923633407 635432983 1.45
clickbench_q24/datafusion:vortex-file-compressed 🚨 56212506 48032359 1.17
clickbench_q25/datafusion:vortex-file-compressed 🚨 79673184 69175874 1.15
clickbench_q26/datafusion:vortex-file-compressed 54621563 50525111 1.08
clickbench_q27/datafusion:vortex-file-compressed 854112166 796017890 1.07
clickbench_q28/datafusion:vortex-file-compressed 6832745688 6821241989 1.00
clickbench_q29/datafusion:vortex-file-compressed 244956387 245496686 1.00
clickbench_q30/datafusion:vortex-file-compressed 270989480 254567176 1.06
clickbench_q31/datafusion:vortex-file-compressed 310712453 292163071 1.06
clickbench_q32/datafusion:vortex-file-compressed 🚨 1535917462 1266288826 1.21
clickbench_q33/datafusion:vortex-file-compressed 1512624918 1433180193 1.06
clickbench_q34/datafusion:vortex-file-compressed 1508762857 1414755953 1.07
clickbench_q35/datafusion:vortex-file-compressed 575456671 532109030 1.08
clickbench_q36/datafusion:vortex-file-compressed 85161961 78996661 1.08
clickbench_q37/datafusion:vortex-file-compressed 40436275 38598754 1.05
clickbench_q38/datafusion:vortex-file-compressed 25850912 24294276 1.06
clickbench_q39/datafusion:vortex-file-compressed 163808095 153688343 1.07
clickbench_q40/datafusion:vortex-file-compressed 21822902 20644830 1.06
clickbench_q41/datafusion:vortex-file-compressed 19981390 18861964 1.06
clickbench_q42/datafusion:vortex-file-compressed 23404270 22389509 1.05
datafusion / parquet (1.042x ➖, 0↑ 2↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1777574 1930792 0.92
clickbench_q01/datafusion:parquet 21588207 21057243 1.03
clickbench_q02/datafusion:parquet 49603468 49933135 0.99
clickbench_q03/datafusion:parquet 41286519 43281315 0.95
clickbench_q04/datafusion:parquet 374103906 359383082 1.04
clickbench_q05/datafusion:parquet 398361528 378614000 1.05
clickbench_q06/datafusion:parquet 1619750 1601770 1.01
clickbench_q07/datafusion:parquet 28346403 27910768 1.02
clickbench_q08/datafusion:parquet 452582644 418949935 1.08
clickbench_q09/datafusion:parquet 719612795 666517656 1.08
clickbench_q10/datafusion:parquet 126248706 117668756 1.07
clickbench_q11/datafusion:parquet 153057449 145618707 1.05
clickbench_q12/datafusion:parquet 402701814 373322274 1.08
clickbench_q13/datafusion:parquet 564121559 528772571 1.07
clickbench_q14/datafusion:parquet 394903775 381392329 1.04
clickbench_q15/datafusion:parquet 428305356 402566687 1.06
clickbench_q16/datafusion:parquet 🚨 844387820 732189511 1.15
clickbench_q17/datafusion:parquet 🚨 843594110 727602679 1.16
clickbench_q18/datafusion:parquet 1684666738 1693478354 0.99
clickbench_q19/datafusion:parquet 35308728 35725939 0.99
clickbench_q20/datafusion:parquet 648753446 616125863 1.05
clickbench_q21/datafusion:parquet 722221217 676803723 1.07
clickbench_q22/datafusion:parquet 1064054928 980318715 1.09
clickbench_q23/datafusion:parquet 4147515776 3795432941 1.09
clickbench_q24/datafusion:parquet 102547234 95618630 1.07
clickbench_q25/datafusion:parquet 153431674 151526727 1.01
clickbench_q26/datafusion:parquet 100219084 94986590 1.06
clickbench_q27/datafusion:parquet 1095294167 1059707811 1.03
clickbench_q28/datafusion:parquet 6653944372 6623334451 1.00
clickbench_q29/datafusion:parquet 234785871 244129009 0.96
clickbench_q30/datafusion:parquet 395101827 384896783 1.03
clickbench_q31/datafusion:parquet 438895257 412394750 1.06
clickbench_q32/datafusion:parquet 1389778698 1277552026 1.09
clickbench_q33/datafusion:parquet 1651604267 1575658706 1.05
clickbench_q34/datafusion:parquet 1634964769 1551124301 1.05
clickbench_q35/datafusion:parquet 584351429 550395961 1.06
clickbench_q36/datafusion:parquet 154695169 146184997 1.06
clickbench_q37/datafusion:parquet 62130941 59672078 1.04
clickbench_q38/datafusion:parquet 102720716 99735353 1.03
clickbench_q39/datafusion:parquet 285265134 283396685 1.01
clickbench_q40/datafusion:parquet 36558266 35891007 1.02
clickbench_q41/datafusion:parquet 31944557 30667101 1.04
clickbench_q42/datafusion:parquet 33265420 32136473 1.04
duckdb / vortex-file-compressed (1.100x ❌, 0↑ 17↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 6794203 6056617 1.12
clickbench_q01/duckdb:vortex-file-compressed 🚨 16165476 13726193 1.18
clickbench_q02/duckdb:vortex-file-compressed 🚨 26316283 23844711 1.10
clickbench_q03/duckdb:vortex-file-compressed 🚨 33534219 29983975 1.12
clickbench_q04/duckdb:vortex-file-compressed 190158881 174748096 1.09
clickbench_q05/duckdb:vortex-file-compressed 218642612 200281453 1.09
clickbench_q06/duckdb:vortex-file-compressed 20753498 19154948 1.08
clickbench_q07/duckdb:vortex-file-compressed 16713909 15939751 1.05
clickbench_q08/duckdb:vortex-file-compressed 281713175 265945358 1.06
clickbench_q09/duckdb:vortex-file-compressed 393071728 376764569 1.04
clickbench_q10/duckdb:vortex-file-compressed 79056774 75103927 1.05
clickbench_q11/duckdb:vortex-file-compressed 84459133 82322719 1.03
clickbench_q12/duckdb:vortex-file-compressed 227553839 215262328 1.06
clickbench_q13/duckdb:vortex-file-compressed 🚨 494893199 438319742 1.13
clickbench_q14/duckdb:vortex-file-compressed 🚨 278950492 240689505 1.16
clickbench_q15/duckdb:vortex-file-compressed 237042965 215780006 1.10
clickbench_q16/duckdb:vortex-file-compressed 🚨 768164408 659440107 1.16
clickbench_q17/duckdb:vortex-file-compressed 🚨 646056502 522723017 1.24
clickbench_q18/duckdb:vortex-file-compressed 1228764172 1169368246 1.05
clickbench_q19/duckdb:vortex-file-compressed 22965891 20951599 1.10
clickbench_q20/duckdb:vortex-file-compressed 🚨 448555333 355233556 1.26
clickbench_q21/duckdb:vortex-file-compressed 🚨 449773283 380717175 1.18
clickbench_q22/duckdb:vortex-file-compressed 🚨 835814235 705487735 1.18
clickbench_q23/duckdb:vortex-file-compressed 🚨 940302750 671531817 1.40
clickbench_q24/duckdb:vortex-file-compressed 50221990 50530978 0.99
clickbench_q25/duckdb:vortex-file-compressed 🚨 80286633 67465710 1.19
clickbench_q26/duckdb:vortex-file-compressed 49961844 45685815 1.09
clickbench_q27/duckdb:vortex-file-compressed 🚨 581183435 519006640 1.12
clickbench_q28/duckdb:vortex-file-compressed 3176592835 2984033493 1.06
clickbench_q29/duckdb:vortex-file-compressed 28848281 28355637 1.02
clickbench_q30/duckdb:vortex-file-compressed 203588623 192809362 1.06
clickbench_q31/duckdb:vortex-file-compressed 292663220 271403886 1.08
clickbench_q32/duckdb:vortex-file-compressed 🚨 1403739026 1192210012 1.18
clickbench_q33/duckdb:vortex-file-compressed 🚨 1846196597 1405666088 1.31
clickbench_q34/duckdb:vortex-file-compressed 🚨 1891763140 1547296035 1.22
clickbench_q35/duckdb:vortex-file-compressed 380732417 371278273 1.03
clickbench_q36/duckdb:vortex-file-compressed 33482409 31672792 1.06
clickbench_q37/duckdb:vortex-file-compressed 23510312 23281327 1.01
clickbench_q38/duckdb:vortex-file-compressed 24459726 24485411 1.00
clickbench_q39/duckdb:vortex-file-compressed 45833988 44281804 1.04
clickbench_q40/duckdb:vortex-file-compressed 22759615 22087095 1.03
clickbench_q41/duckdb:vortex-file-compressed 21832852 21666184 1.01
clickbench_q42/duckdb:vortex-file-compressed 25192926 26858456 0.94
duckdb / parquet (1.033x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 237763983 223131015 1.07
clickbench_q01/duckdb:parquet 51634660 51328354 1.01
clickbench_q02/duckdb:parquet 66731226 66331152 1.01
clickbench_q03/duckdb:parquet 65052060 64617441 1.01
clickbench_q04/duckdb:parquet 208314691 204572511 1.02
clickbench_q05/duckdb:parquet 285055824 282949699 1.01
clickbench_q06/duckdb:parquet 62300802 60513441 1.03
clickbench_q07/duckdb:parquet 53176323 51179788 1.04
clickbench_q08/duckdb:parquet 277927247 270898369 1.03
clickbench_q09/duckdb:parquet 402131625 396338400 1.01
clickbench_q10/duckdb:parquet 98494681 95914308 1.03
clickbench_q11/duckdb:parquet 111538229 107687456 1.04
clickbench_q12/duckdb:parquet 299306978 297257198 1.01
clickbench_q13/duckdb:parquet 531424246 511294993 1.04
clickbench_q14/duckdb:parquet 339494400 332126829 1.02
clickbench_q15/duckdb:parquet 249069797 241648398 1.03
clickbench_q16/duckdb:parquet 641700767 613735083 1.05
clickbench_q17/duckdb:parquet 525794499 511336416 1.03
clickbench_q18/duckdb:parquet 1107360877 1060721656 1.04
clickbench_q19/duckdb:parquet 51110271 49864379 1.02
clickbench_q20/duckdb:parquet 448694490 441217267 1.02
clickbench_q21/duckdb:parquet 573319613 558322278 1.03
clickbench_q22/duckdb:parquet 944367159 928744462 1.02
clickbench_q23/duckdb:parquet 317146942 320728034 0.99
clickbench_q24/duckdb:parquet 81201314 78869315 1.03
clickbench_q25/duckdb:parquet 141756227 141970696 1.00
clickbench_q26/duckdb:parquet 54489477 52077872 1.05
clickbench_q27/duckdb:parquet 661167481 642160849 1.03
clickbench_q28/duckdb:parquet 4967015754 4829385673 1.03
clickbench_q29/duckdb:parquet 63941995 62009420 1.03
clickbench_q30/duckdb:parquet 320698298 306502338 1.05
clickbench_q31/duckdb:parquet 365090994 347517613 1.05
clickbench_q32/duckdb:parquet 1272714037 1181545230 1.08
clickbench_q33/duckdb:parquet 1376730299 1308878346 1.05
clickbench_q34/duckdb:parquet 1408763568 1311368449 1.07
clickbench_q35/duckdb:parquet 378577210 354613228 1.07
clickbench_q36/duckdb:parquet 68270224 63788330 1.07
clickbench_q37/duckdb:parquet 56947766 53892505 1.06
clickbench_q38/duckdb:parquet 61285969 58525338 1.05
clickbench_q39/duckdb:parquet 102080397 98178621 1.04
clickbench_q40/duckdb:parquet 57972466 56432880 1.03
clickbench_q41/duckdb:parquet 62036485 59110856 1.05
clickbench_q42/duckdb:parquet 55699481 53172618 1.05
duckdb / duckdb (1.043x ➖, 0↑ 4↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17803299 17654069 1.01
clickbench_q01/duckdb:duckdb 33985092 32989984 1.03
clickbench_q02/duckdb:duckdb 45449128 45364491 1.00
clickbench_q03/duckdb:duckdb 47647399 47009842 1.01
clickbench_q04/duckdb:duckdb 231816584 215379562 1.08
clickbench_q05/duckdb:duckdb 339556640 310684006 1.09
clickbench_q06/duckdb:duckdb 35959394 35457193 1.01
clickbench_q07/duckdb:duckdb 35990948 36024039 1.00
clickbench_q08/duckdb:duckdb 323984689 302242290 1.07
clickbench_q09/duckdb:duckdb 491261262 484304746 1.01
clickbench_q10/duckdb:duckdb 100895732 97054777 1.04
clickbench_q11/duckdb:duckdb 109542505 107442164 1.02
clickbench_q12/duckdb:duckdb 319797911 291078227 1.10
clickbench_q13/duckdb:duckdb 🚨 606899264 516136455 1.18
clickbench_q14/duckdb:duckdb 363246911 346967495 1.05
clickbench_q15/duckdb:duckdb 273139432 256508841 1.06
clickbench_q16/duckdb:duckdb 708613320 686264058 1.03
clickbench_q17/duckdb:duckdb 601770794 579654239 1.04
clickbench_q18/duckdb:duckdb 1320124445 1254415446 1.05
clickbench_q19/duckdb:duckdb 35589933 35315957 1.01
clickbench_q20/duckdb:duckdb 🚨 1047136797 827103769 1.27
clickbench_q21/duckdb:duckdb 🚨 1025183645 922796618 1.11
clickbench_q22/duckdb:duckdb 1146750985 1129489199 1.02
clickbench_q23/duckdb:duckdb 263125618 252556695 1.04
clickbench_q24/duckdb:duckdb 62782914 60796410 1.03
clickbench_q25/duckdb:duckdb 126642428 122623543 1.03
clickbench_q26/duckdb:duckdb 56973621 56442783 1.01
clickbench_q27/duckdb:duckdb 1000721523 1017936239 0.98
clickbench_q28/duckdb:duckdb 4744277863 4645688670 1.02
clickbench_q29/duckdb:duckdb 50122588 49139461 1.02
clickbench_q30/duckdb:duckdb 313108170 287210231 1.09
clickbench_q31/duckdb:duckdb 424373122 424668238 1.00
clickbench_q32/duckdb:duckdb 1497625606 1438366665 1.04
clickbench_q33/duckdb:duckdb 2032915975 1911631283 1.06
clickbench_q34/duckdb:duckdb 🚨 2262530430 2013783261 1.12
clickbench_q35/duckdb:duckdb 272330877 264349730 1.03
clickbench_q36/duckdb:duckdb 42806553 41522413 1.03
clickbench_q37/duckdb:duckdb 31812595 31349280 1.01
clickbench_q38/duckdb:duckdb 32270607 30898153 1.04
clickbench_q39/duckdb:duckdb 64541885 64978578 0.99
clickbench_q40/duckdb:duckdb 32761121 31493538 1.04
clickbench_q41/duckdb:duckdb 31033328 31027810 1.00
clickbench_q42/duckdb:duckdb 32123559 31596068 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +42.8% -1.0% +44.2% +681.9% ➖ noise
0 duckdb:duckdb +0.8% -1.0% +1.8% +298.0% ➖ noise
0 duckdb:vortex-file-compressed +12.2% -1.0% +13.3% +343.0% ➖ noise
1 datafusion:vortex-file-compressed +10.7% +1.6% +9.1% +40.7% ➖ noise
1 duckdb:duckdb +3.0% +1.6% +1.4% +57.9% ➖ noise
1 duckdb:vortex-file-compressed +17.8% +1.6% +16.0% +19.2% ➖ noise
2 datafusion:vortex-file-compressed +0.5% -0.0% +0.5% +33.7% ➖ noise
2 duckdb:duckdb +0.2% -0.0% +0.2% +24.6% ➖ noise
2 duckdb:vortex-file-compressed +10.4% -0.0% +10.4% +15.0% ➖ noise
3 datafusion:vortex-file-compressed +8.6% -2.0% +10.8% +179.2% ➖ noise
3 duckdb:duckdb +1.4% -2.0% +3.4% +51.6% ➖ noise
3 duckdb:vortex-file-compressed +11.8% -2.0% +14.1% +30.4% ➖ noise
4 datafusion:vortex-file-compressed +3.6% +3.0% +0.6% +10.0% ➖ noise
4 duckdb:duckdb +7.6% +3.0% +4.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +8.8% +3.0% +5.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.1% +3.0% +2.0% +10.0% ➖ noise
5 duckdb:duckdb +9.3% +3.0% +6.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +9.2% +3.0% +6.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -28.4% +2.0% -29.9% +38.3% ✅ faster
6 duckdb:duckdb +1.4% +2.0% -0.6% +28.9% ➖ noise
6 duckdb:vortex-file-compressed +8.3% +2.0% +6.2% +18.8% ➖ noise
7 datafusion:vortex-file-compressed -0.0% +2.7% -2.7% +12.6% ➖ noise
7 duckdb:duckdb -0.1% +2.7% -2.7% +12.1% ➖ noise
7 duckdb:vortex-file-compressed +4.9% +2.7% +2.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +6.0% +5.3% +0.7% +10.0% ➖ noise
8 duckdb:duckdb +7.2% +5.3% +1.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +5.9% +5.3% +0.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.6% +4.7% -2.0% +10.0% ➖ noise
9 duckdb:duckdb +1.4% +4.7% -3.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +4.3% +4.7% -0.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.6% +5.0% -5.3% +10.0% ➖ noise
10 duckdb:duckdb +4.0% +5.0% -1.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +5.3% +5.0% +0.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +0.7% +4.3% -3.5% +10.0% ➖ noise
11 duckdb:duckdb +2.0% +4.3% -2.3% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.6% +4.3% -1.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +6.7% +4.2% +2.4% +10.0% ➖ noise
12 duckdb:duckdb +9.9% +4.2% +5.4% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +5.7% +4.2% +1.4% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +6.7% +5.3% +1.3% +10.0% ➖ noise
13 duckdb:duckdb +17.6% +5.3% +11.7% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +12.9% +5.3% +7.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +5.4% +2.9% +2.4% +10.0% ➖ noise
14 duckdb:duckdb +4.7% +2.9% +1.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +15.9% +2.9% +12.7% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +6.7% +4.7% +1.9% +10.0% ➖ noise
15 duckdb:duckdb +6.5% +4.7% +1.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +9.9% +4.7% +4.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +5.7% +9.8% -3.7% +10.0% ➖ noise
16 duckdb:duckdb +3.3% +9.8% -6.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +16.5% +9.8% +6.1% +14.3% ➖ noise
17 datafusion:vortex-file-compressed +8.3% +9.2% -0.8% +10.0% ➖ noise
17 duckdb:duckdb +3.8% +9.2% -4.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +23.6% +9.2% +13.2% +10.6% 🚨 regression
18 datafusion:vortex-file-compressed +12.6% +1.9% +10.5% +10.0% 🚨 regression
18 duckdb:duckdb +5.2% +1.9% +3.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +5.1% +1.9% +3.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.3% +0.6% -3.9% +14.6% ➖ noise
19 duckdb:duckdb +0.8% +0.6% +0.1% +12.4% ➖ noise
19 duckdb:vortex-file-compressed +9.6% +0.6% +8.9% +37.5% ➖ noise
20 datafusion:vortex-file-compressed +10.3% +3.5% +6.6% +194.2% ➖ noise
20 duckdb:duckdb +26.6% +3.5% +22.3% +23.0% ➖ noise
20 duckdb:vortex-file-compressed +26.3% +3.5% +22.0% +10.0% 🚨 regression
21 datafusion:vortex-file-compressed +11.0% +4.7% +6.1% +10.0% ➖ noise
21 duckdb:duckdb +11.1% +4.7% +6.1% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +18.1% +4.7% +12.9% +10.0% 🚨 regression
22 datafusion:vortex-file-compressed +4.0% +5.1% -1.0% +10.0% ➖ noise
22 duckdb:duckdb +1.5% +5.1% -3.4% +11.1% ➖ noise
22 duckdb:vortex-file-compressed +18.5% +5.1% +12.8% +18.0% ➖ noise
23 datafusion:vortex-file-compressed +45.4% +4.0% +39.8% +47.4% ➖ noise
23 duckdb:duckdb +4.2% +4.0% +0.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +40.0% +4.0% +34.7% +27.1% 🚨 regression
24 datafusion:vortex-file-compressed +17.0% +5.1% +11.4% +11.0% 🚨 regression
24 duckdb:duckdb +3.3% +5.1% -1.7% +11.4% ➖ noise
24 duckdb:vortex-file-compressed -0.6% +5.1% -5.4% +22.5% ➖ noise
25 datafusion:vortex-file-compressed +15.2% +0.6% +14.5% +10.0% 🚨 regression
25 duckdb:duckdb +3.3% +0.6% +2.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +19.0% +0.6% +18.4% +13.3% 🚨 regression
26 datafusion:vortex-file-compressed +8.1% +5.1% +2.9% +19.5% ➖ noise
26 duckdb:duckdb +0.9% +5.1% -3.9% +15.4% ➖ noise
26 duckdb:vortex-file-compressed +9.4% +5.1% +4.1% +23.8% ➖ noise
27 datafusion:vortex-file-compressed +7.3% +3.2% +4.0% +10.0% ➖ noise
27 duckdb:duckdb -1.7% +3.2% -4.7% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +12.0% +3.2% +8.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +0.2% +1.6% -1.5% +10.0% ➖ noise
28 duckdb:duckdb +2.1% +1.6% +0.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +6.5% +1.6% +4.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.2% -0.4% +0.2% +10.5% ➖ noise
29 duckdb:duckdb +2.0% -0.4% +2.4% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.7% -0.4% +2.2% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +6.5% +3.6% +2.7% +10.0% ➖ noise
30 duckdb:duckdb +9.0% +3.6% +5.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +5.6% +3.6% +1.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +6.3% +5.7% +0.6% +10.0% ➖ noise
31 duckdb:duckdb -0.1% +5.7% -5.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +7.8% +5.7% +2.0% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +21.3% +8.2% +12.0% +10.0% 🚨 regression
32 duckdb:duckdb +4.1% +8.2% -3.8% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +17.7% +8.2% +8.8% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +5.5% +5.0% +0.5% +10.0% ➖ noise
33 duckdb:duckdb +6.3% +5.0% +1.3% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +31.3% +5.0% +25.1% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed +6.6% +6.4% +0.2% +10.0% ➖ noise
34 duckdb:duckdb +12.4% +6.4% +5.6% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +22.3% +6.4% +14.9% +10.0% 🚨 regression
35 datafusion:vortex-file-compressed +8.1% +6.5% +1.6% +10.0% ➖ noise
35 duckdb:duckdb +3.0% +6.5% -3.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +2.5% +6.5% -3.7% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +7.8% +6.4% +1.3% +10.0% ➖ noise
36 duckdb:duckdb +3.1% +6.4% -3.1% +13.4% ➖ noise
36 duckdb:vortex-file-compressed +5.7% +6.4% -0.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +4.8% +4.9% -0.1% +10.0% ➖ noise
37 duckdb:duckdb +1.5% +4.9% -3.3% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +1.0% +4.9% -3.7% +14.9% ➖ noise
38 datafusion:vortex-file-compressed +6.4% +3.9% +2.5% +10.0% ➖ noise
38 duckdb:duckdb +4.4% +3.9% +0.6% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -0.1% +3.9% -3.8% +12.5% ➖ noise
39 datafusion:vortex-file-compressed +6.6% +2.3% +4.2% +10.0% ➖ noise
39 duckdb:duckdb -0.7% +2.3% -2.9% +21.6% ➖ noise
39 duckdb:vortex-file-compressed +3.5% +2.3% +1.2% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +5.7% +2.3% +3.3% +10.0% ➖ noise
40 duckdb:duckdb +4.0% +2.3% +1.7% +18.7% ➖ noise
40 duckdb:vortex-file-compressed +3.0% +2.3% +0.7% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +5.9% +4.6% +1.3% +10.0% ➖ noise
41 duckdb:duckdb +0.0% +4.6% -4.3% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.8% +4.6% -3.6% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +4.5% +4.1% +0.4% +10.0% ➖ noise
42 duckdb:duckdb +1.7% +4.1% -2.4% +10.0% ➖ noise
42 duckdb:vortex-file-compressed -6.2% +4.1% -9.9% +14.2% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 11, 2026

Benchmarks: Statistical and Population Genetics

Summary

  • Overall: 0.990x ➖
  • Vortex: 0.993x ➖
  • Parquet: 0.985x ➖

Verdict

No clear signal

  • Attributed Vortex impact: +0.8%
  • Confidence: low
  • Environment shift: -1.5%

Statistical Summary

  • Systemic shift (parquet controls): -1.5%
  • Control sigma: +1.5%
  • Residual noise: +0.7%
  • Median polish overall: -0.8%
duckdb / vortex-file-compressed (0.988x ➖, 1↑ 1↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11263883 11374292 0.99
statpopgen_q01/duckdb:vortex-file-compressed 🚀 26089454 32542582 0.80
statpopgen_q02/duckdb:vortex-file-compressed 1317026691 1336274214 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3117892762 3110205347 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3094601878 3134096860 0.99
statpopgen_q05/duckdb:vortex-file-compressed 1384589505 1428536489 0.97
statpopgen_q06/duckdb:vortex-file-compressed 2069897367 2071336488 1.00
statpopgen_q07/duckdb:vortex-file-compressed 🚨 222353430 201934003 1.10
statpopgen_q08/duckdb:vortex-file-compressed 235268991 216986403 1.08
statpopgen_q09/duckdb:vortex-file-compressed 2923139452 2956096960 0.99
statpopgen_q10/duckdb:vortex-file-compressed 4674432363 4745124072 0.99
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11265124 11403520 0.99
statpopgen_q01/duckdb:vortex-compact 170356043 170906148 1.00
statpopgen_q02/duckdb:vortex-compact 1841881677 1860561279 0.99
statpopgen_q03/duckdb:vortex-compact 3568125806 3542046730 1.01
statpopgen_q04/duckdb:vortex-compact 3565467774 3590089656 0.99
statpopgen_q05/duckdb:vortex-compact 1838119358 1873415958 0.98
statpopgen_q06/duckdb:vortex-compact 2712408247 2731332169 0.99
statpopgen_q07/duckdb:vortex-compact 982225897 984747339 1.00
statpopgen_q08/duckdb:vortex-compact 1023058357 1018642549 1.00
statpopgen_q09/duckdb:vortex-compact 3466813413 3370621797 1.03
statpopgen_q10/duckdb:vortex-compact 5489301418 5488884648 1.00
duckdb / parquet (0.985x ➖, 0↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 320702450 323575495 0.99
statpopgen_q01/duckdb:parquet 409906300 411692198 1.00
statpopgen_q02/duckdb:parquet 1001957301 1023245572 0.98
statpopgen_q03/duckdb:parquet 1497683414 1551091331 0.97
statpopgen_q04/duckdb:parquet 1522673673 1534482876 0.99
statpopgen_q05/duckdb:parquet 1027191714 1034909103 0.99
statpopgen_q06/duckdb:parquet 1501817337 1531064905 0.98
statpopgen_q07/duckdb:parquet 1891631814 1919967798 0.99
statpopgen_q08/duckdb:parquet 1937705164 1906230951 1.02
statpopgen_q09/duckdb:parquet 1398531974 1439599122 0.97
statpopgen_q10/duckdb:parquet 2690369686 2772380066 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.2% -0.9% -0.3% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -1.0% -0.9% -0.1% +10.0% ➖ noise
1 duckdb:vortex-compact -0.3% -0.4% +0.1% +36.3% ➖ noise
1 duckdb:vortex-file-compressed -19.8% -0.4% -19.5% +264.5% ➖ noise
2 duckdb:vortex-compact -1.0% -2.1% +1.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.4% -2.1% +0.7% +10.0% ➖ noise
3 duckdb:vortex-compact +0.7% -3.4% +4.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.2% -3.4% +3.8% +10.0% ➖ noise
4 duckdb:vortex-compact -0.7% -0.8% +0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.3% -0.8% -0.5% +10.0% ➖ noise
5 duckdb:vortex-compact -1.9% -0.7% -1.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.1% -0.7% -2.3% +10.0% ➖ noise
6 duckdb:vortex-compact -0.7% -1.9% +1.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.1% -1.9% +1.9% +10.0% ➖ noise
7 duckdb:vortex-compact -0.3% -1.5% +1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +10.1% -1.5% +11.8% +10.0% 🚨 regression
8 duckdb:vortex-compact +0.4% +1.7% -1.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +8.4% +1.7% +6.7% +10.0% ➖ noise
9 duckdb:vortex-compact +2.9% -2.9% +5.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.1% -2.9% +1.8% +10.0% ➖ noise
10 duckdb:vortex-compact +0.0% -3.0% +3.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.5% -3.0% +1.5% +10.0% ➖ noise

joseph-isaacs and others added 2 commits March 11, 2026 15:49
…PI lock files

CI was failing because the VTable trait now requires `slots`, `slot_name`,
and `with_slots` methods, which were missing from PythonVTable.

Signed-off-by: Joe Isaacs <joe@spiraldb.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
# Conflicts:
#	vortex-array/src/vtable/mod.rs
@joseph-isaacs joseph-isaacs added action/benchmark Trigger full benchmarks to run on this PR labels Mar 11, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 11, 2026
joseph-isaacs and others added 4 commits March 11, 2026 18:57
RunsOn reads config from the default branch (develop) for public
repos. Add _extends to inherit runner config from .github-private
and pin arm64 AMI for prebuilt image testing.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added changelog/break A breaking API change action/benchmark Trigger full benchmarks to run on this PR labels Mar 12, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 12, 2026

Benchmarks: Random Access

Summary

  • Overall: 0.896x ✅
  • Vortex: 0.843x ✅
  • Parquet: 0.965x ➖
unknown / unknown (0.896x ✅, 17↑ 0↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 3002656 5285176 0.57
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚀 1276325 1496149 0.85
random-access/feature-vectors/correlated/parquet-tokio-local-disk 13903318469 13862083151 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13376047961 13717619543 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk 7584794 7955517 0.95
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 5708594 6574520 0.87
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚀 1449707 1715636 0.84
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚀 2390743 2776754 0.86
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13474726917 13780783637 0.98
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13460505726 13701318913 0.98
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12569101 14298781 0.88
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12787316 14230288 0.90
random-access/lance-tokio-local-disk 746684 783788 0.95
random-access/lance-tokio-local-disk-footer 1343973 1466246 0.92
random-access/nested-lists/correlated/lance-tokio-local-disk 268947 291673 0.92
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚀 725329 832310 0.87
random-access/nested-lists/correlated/parquet-tokio-local-disk 162504446 169118219 0.96
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 162038803 172998460 0.94
random-access/nested-lists/correlated/vortex-tokio-local-disk 717293 744352 0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 724374 744807 0.97
random-access/nested-lists/uniform/lance-tokio-local-disk 🚀 1155172 1284424 0.90
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1665831 1839590 0.91
random-access/nested-lists/uniform/parquet-tokio-local-disk 162291729 172409381 0.94
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 162320807 171837738 0.94
random-access/nested-lists/uniform/vortex-tokio-local-disk 2500786 2626697 0.95
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2542830 2863427 0.89
random-access/nested-structs/correlated/lance-tokio-local-disk 434497 478005 0.91
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 664838 727066 0.91
random-access/nested-structs/correlated/parquet-tokio-local-disk 28315858 29155786 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 28271226 28746324 0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk 887225 951104 0.93
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 923639 974809 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk 2914778 3129623 0.93
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3194630 3347786 0.95
random-access/nested-structs/uniform/parquet-tokio-local-disk 28589073 30028748 0.95
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 28464742 29544180 0.96
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1786619 1994376 0.90
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1796104 1959901 0.92
random-access/parquet-tokio-local-disk 185550909 193052192 0.96
random-access/parquet-tokio-local-disk-footer 187714665 194386169 0.97
random-access/taxi/correlated/lance-tokio-local-disk 962439 1032715 0.93
random-access/taxi/correlated/lance-tokio-local-disk-footer 1643602 1807275 0.91
random-access/taxi/correlated/parquet-tokio-local-disk 281767423 288497120 0.98
random-access/taxi/correlated/parquet-tokio-local-disk-footer 276714086 285111393 0.97
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1736781 2704935 0.64
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1752813 2651246 0.66
random-access/taxi/uniform/lance-tokio-local-disk 8528760 9132551 0.93
random-access/taxi/uniform/lance-tokio-local-disk-footer 9218162 9800523 0.94
random-access/taxi/uniform/parquet-tokio-local-disk 291134493 304002481 0.96
random-access/taxi/uniform/parquet-tokio-local-disk-footer 292513803 305630515 0.96
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4544862 5637993 0.81
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4575189 5665947 0.81
random-access/vortex-tokio-local-disk 🚀 1238770 1862968 0.66
random-access/vortex-tokio-local-disk-footer 🚀 1234882 1835928 0.67

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 12, 2026
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
# Conflicts:
#	.github/runs-on.yml
#	encodings/alp/public-api.lock
#	encodings/bytebool/public-api.lock
#	encodings/datetime-parts/public-api.lock
#	encodings/decimal-byte-parts/public-api.lock
#	encodings/fastlanes/public-api.lock
#	encodings/fsst/public-api.lock
#	encodings/fsst/src/array.rs
#	encodings/pco/public-api.lock
#	encodings/runend/public-api.lock
#	encodings/sequence/public-api.lock
#	encodings/sparse/public-api.lock
#	encodings/zigzag/public-api.lock
#	encodings/zstd/public-api.lock
#	vortex-array/public-api.lock
#	vortex-array/src/arrays/listview/array.rs
#	vortex-array/src/arrays/masked/execute.rs
#	vortex-array/src/arrays/scalar_fn/rules.rs
@joseph-isaacs joseph-isaacs added action/benchmark Trigger full benchmarks to run on this PR and removed action/benchmark Trigger full benchmarks to run on this PR labels Mar 13, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 13, 2026

Benchmarks: Compression

Summary

  • Overall: 1.036x ➖
  • Vortex: 1.082x ➖
  • Parquet: 1.027x ➖
unknown / unknown (1.036x ➖, 14↑ 9↓)
name PR a5632e2 (ns) base 0b981a8 (ns) ratio (PR/base)
compress time/Arade 1165565199 1225918161 0.95
compress time/Bimbo 7160695420 7533164757 0.95
compress time/CMSprovider 3008825649 3074356385 0.98
compress time/Euro2016 435579251 467944999 0.93
compress time/Food 388454998 423894020 0.92
compress time/HashTags 922401408 1002892329 0.92
compress time/TPC-H l_comment canonical 1357832060 1409612936 0.96
compress time/TPC-H l_comment chunked 1357547845 1420513993 0.96
compress time/taxi 736629367 766625125 0.96
compress time/wide table cols=100 chunks=1 rows=1000 16442159 17939335 0.92
compress time/wide table cols=100 chunks=50 rows=1000 🚀 16303134 18936864 0.86
compress time/wide table cols=1000 chunks=1 rows=1000 162026176 175727839 0.92
compress time/wide table cols=1000 chunks=50 rows=1000 161403256 176564674 0.91
compress time/wide table cols=10000 chunks=1 rows=1000 1607399052 1670205970 0.96
compress time/wide table cols=10000 chunks=50 rows=1000 1595117145 1678718049 0.95
decompress time/Arade 🚀 30166213 36557074 0.83
decompress time/Bimbo 104742844 113399751 0.92
decompress time/CMSprovider 🚀 83418596 95617578 0.87
decompress time/Euro2016 22921532 23646469 0.97
decompress time/Food 9088878 9348825 0.97
decompress time/HashTags 82172634 87380342 0.94
decompress time/TPC-H l_comment canonical 42907672 43538230 0.99
decompress time/TPC-H l_comment chunked 44905643 45359835 0.99
decompress time/taxi 🚀 20014188 22387120 0.89
decompress time/wide table cols=100 chunks=1 rows=1000 2651732 2945057 0.90
decompress time/wide table cols=100 chunks=50 rows=1000 2879253 3011284 0.96
decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 35620027 25163188 1.42
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 36612848 24665499 1.48
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 1520252447 274665832 5.53
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 1524870685 271228185 5.62
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 2489843728 2719370495 0.92
parquet_rs-zstd compress time/Bimbo 15941331098 17111069351 0.93
parquet_rs-zstd compress time/CMSprovider 🚀 7840091564 8761189518 0.89
parquet_rs-zstd compress time/Euro2016 1453491509 1545310166 0.94
parquet_rs-zstd compress time/Food 926357583 985987765 0.94
parquet_rs-zstd compress time/HashTags 🚀 2542866404 2876575745 0.88
parquet_rs-zstd compress time/TPC-H l_comment canonical 3191611337 3384582211 0.94
parquet_rs-zstd compress time/TPC-H l_comment chunked 3170561933 3427174707 0.93
parquet_rs-zstd compress time/taxi 1407128769 1462430954 0.96
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6418947 7689754 0.83
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6347896 7355708 0.86
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚀 83725646 100169700 0.84
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 🚀 85539252 100732365 0.85
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 910677789 944718973 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 890846264 942345412 0.95
parquet_rs-zstd decompress time/Arade 662251476 682972039 0.97
parquet_rs-zstd decompress time/Bimbo 2283775127 2367510059 0.96
parquet_rs-zstd decompress time/CMSprovider 2122976931 2265011661 0.94
parquet_rs-zstd decompress time/Euro2016 422408329 440369853 0.96
parquet_rs-zstd decompress time/Food 243016430 253319159 0.96
parquet_rs-zstd decompress time/HashTags 🚀 685867326 779012778 0.88
parquet_rs-zstd decompress time/TPC-H l_comment canonical 712639901 740317271 0.96
parquet_rs-zstd decompress time/TPC-H l_comment chunked 706225196 741861529 0.95
parquet_rs-zstd decompress time/taxi 293078483 299554711 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2605188 2718621 0.96
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2543166 2622130 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚀 29749678 33398022 0.89
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 29578676 33321332 0.89
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 334473912 362462388 0.92
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 339033692 358143291 0.95
vortex-file-compressed size/Arade 143320892 143320892 1.00
vortex-file-compressed size/Bimbo 526057964 526057964 1.00
vortex-file-compressed size/CMSprovider 448338524 448338524 1.00
vortex-file-compressed size/Euro2016 167858692 167863828 1.00
vortex-file-compressed size/Food 44162400 44162400 1.00
vortex-file-compressed size/HashTags 198700644 198700644 1.00
vortex-file-compressed size/TPC-H l_comment canonical 180408824 180408824 1.00
vortex-file-compressed size/TPC-H l_comment chunked 180408824 180408824 1.00
vortex-file-compressed size/taxi 51448740 51448740 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.04
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.09
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 0 0 0.98
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 1.10
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.00
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 🚨 1 1 1.10
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.01
vortex:parquet-zstd ratio decompress time/Arade 🚀 0 0 0.85
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.96
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.93
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio decompress time/Food 0 0 1.01
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.07
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 1 0 1.59
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 1 0 1.67
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 4 0 6.00
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 4 0 5.94
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 13, 2026
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
# Conflicts:
#	vortex-array/src/arrays/chunked/array.rs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/break A breaking API change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant