Skip to content

[WIP] TakeExecute for FilterArray#7393

Draft
robert3005 wants to merge 3 commits intodevelopfrom
rk/parentexecute
Draft

[WIP] TakeExecute for FilterArray#7393
robert3005 wants to merge 3 commits intodevelopfrom
rk/parentexecute

Conversation

@robert3005
Copy link
Copy Markdown
Contributor

@robert3005 robert3005 commented Apr 10, 2026

This seems to be an improvement if the take array is small. Falls over if we are taking too many indices. Needs more investigation before can be integrated

Signed-off-by: Robert Kruszewski github@robertk.io

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 changed the title TakeExecute for FilterArray [WIP] TakeExecute for FilterArray Apr 10, 2026
@robert3005 robert3005 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 10, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 10, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 2a6b29b 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 2ff0486 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.010x ➖


datafusion / vortex-file-compressed (1.010x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 123412752 128088345 0.96
polarsignals_q01/datafusion:vortex-file-compressed 362397370 374243794 0.97
polarsignals_q02/datafusion:vortex-file-compressed 22248082 21932668 1.01
polarsignals_q03/datafusion:vortex-file-compressed 374129628 368440922 1.02
polarsignals_q04/datafusion:vortex-file-compressed 11525692 11133095 1.04
polarsignals_q05/datafusion:vortex-file-compressed 15901107 14616114 1.09
polarsignals_q06/datafusion:vortex-file-compressed 19052721 18246289 1.04
polarsignals_q07/datafusion:vortex-file-compressed 14081144 13418504 1.05
polarsignals_q08/datafusion:vortex-file-compressed 452608352 462536697 0.98
polarsignals_q09/datafusion:vortex-file-compressed 10845229 11429641 0.95

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.0%
Vortex (geomean): 0.949x ➖
Parquet (geomean): 0.981x ➖
Shifts: Parquet (control) -1.9% · Median polish -5.0%


datafusion / vortex-file-compressed (0.956x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 48826156 52155350 0.94
tpch_q02/datafusion:vortex-file-compressed 32799211 35544942 0.92
tpch_q03/datafusion:vortex-file-compressed 26717407 29516240 0.91
tpch_q04/datafusion:vortex-file-compressed 18120876 18855517 0.96
tpch_q05/datafusion:vortex-file-compressed 53189481 56726704 0.94
tpch_q06/datafusion:vortex-file-compressed 10283700 10671605 0.96
tpch_q07/datafusion:vortex-file-compressed 63082411 68356736 0.92
tpch_q08/datafusion:vortex-file-compressed 47419511 49921119 0.95
tpch_q09/datafusion:vortex-file-compressed 58637937 59422193 0.99
tpch_q10/datafusion:vortex-file-compressed 44301532 45235362 0.98
tpch_q11/datafusion:vortex-file-compressed 17697055 18435701 0.96
tpch_q12/datafusion:vortex-file-compressed 22274703 22512698 0.99
tpch_q13/datafusion:vortex-file-compressed 27820847 28381854 0.98
tpch_q14/datafusion:vortex-file-compressed 17006367 16653083 1.02
tpch_q15/datafusion:vortex-file-compressed 24878249 25167355 0.99
tpch_q16/datafusion:vortex-file-compressed 25110750 25422671 0.99
tpch_q17/datafusion:vortex-file-compressed 65744257 71216090 0.92
tpch_q18/datafusion:vortex-file-compressed 79787241 86641170 0.92
tpch_q19/datafusion:vortex-file-compressed 21901013 23008909 0.95
tpch_q20/datafusion:vortex-file-compressed 33131119 34564311 0.96
tpch_q21/datafusion:vortex-file-compressed 73491318 80341007 0.91
tpch_q22/datafusion:vortex-file-compressed 16775398 17047601 0.98
datafusion / vortex-compact (0.939x ➖, 1↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58491640 61288237 0.95
tpch_q02/datafusion:vortex-compact 36388872 38402008 0.95
tpch_q03/datafusion:vortex-compact 30093353 32722936 0.92
tpch_q04/datafusion:vortex-compact 23375029 24905231 0.94
tpch_q05/datafusion:vortex-compact 58121263 59330092 0.98
tpch_q06/datafusion:vortex-compact 12763114 14050923 0.91
tpch_q07/datafusion:vortex-compact 70723839 73996621 0.96
tpch_q08/datafusion:vortex-compact 50619484 53634680 0.94
tpch_q09/datafusion:vortex-compact 61988586 66728944 0.93
tpch_q10/datafusion:vortex-compact 53639902 58126250 0.92
tpch_q11/datafusion:vortex-compact 18954159 20630971 0.92
tpch_q12/datafusion:vortex-compact 32694332 34824569 0.94
tpch_q13/datafusion:vortex-compact 36096089 37325834 0.97
tpch_q14/datafusion:vortex-compact 20822018 22676105 0.92
tpch_q15/datafusion:vortex-compact 34521090 35844007 0.96
tpch_q16/datafusion:vortex-compact 29671178 30054127 0.99
tpch_q17/datafusion:vortex-compact 69618747 74715207 0.93
tpch_q18/datafusion:vortex-compact 85277609 94082218 0.91
tpch_q19/datafusion:vortex-compact 33317135 34192118 0.97
tpch_q20/datafusion:vortex-compact 38934244 41314923 0.94
tpch_q21/datafusion:vortex-compact 🚀 88614057 98712844 0.90
tpch_q22/datafusion:vortex-compact 17070705 18758578 0.91
datafusion / parquet (0.961x ➖, 2↑ 1↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 136298034 138979190 0.98
tpch_q02/datafusion:parquet 69535616 74442194 0.93
tpch_q03/datafusion:parquet 🚀 71376613 84607537 0.84
tpch_q04/datafusion:parquet 48777981 50542395 0.97
tpch_q05/datafusion:parquet 102486594 109813028 0.93
tpch_q06/datafusion:parquet 🚨 42667448 34470517 1.24
tpch_q07/datafusion:parquet 116705899 117846944 0.99
tpch_q08/datafusion:parquet 105583401 111549336 0.95
tpch_q09/datafusion:parquet 132910631 142020578 0.94
tpch_q10/datafusion:parquet 122860973 125250381 0.98
tpch_q11/datafusion:parquet 48709186 51759742 0.94
tpch_q12/datafusion:parquet 80871255 82473151 0.98
tpch_q13/datafusion:parquet 204766895 222925679 0.92
tpch_q14/datafusion:parquet 51358777 48321769 1.06
tpch_q15/datafusion:parquet 70402483 73734777 0.95
tpch_q16/datafusion:parquet 50424074 53508548 0.94
tpch_q17/datafusion:parquet 🚀 142285448 168566567 0.84
tpch_q18/datafusion:parquet 171338639 170398271 1.01
tpch_q19/datafusion:parquet 74667581 81693980 0.91
tpch_q20/datafusion:parquet 77394246 80162766 0.97
tpch_q21/datafusion:parquet 147339710 150567036 0.98
tpch_q22/datafusion:parquet 34396400 36437971 0.94
datafusion / arrow (0.941x ➖, 5↑ 1↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 56999992 63605325 0.90
tpch_q02/datafusion:arrow 21435888 22896800 0.94
tpch_q03/datafusion:arrow 33411013 36527053 0.91
tpch_q04/datafusion:arrow 26943768 29609092 0.91
tpch_q05/datafusion:arrow 76642791 85036177 0.90
tpch_q06/datafusion:arrow 🚀 19956979 22514965 0.89
tpch_q07/datafusion:arrow 111249394 117706834 0.95
tpch_q08/datafusion:arrow 🚀 42721290 49322811 0.87
tpch_q09/datafusion:arrow 69328038 75224402 0.92
tpch_q10/datafusion:arrow 52786124 56771664 0.93
tpch_q11/datafusion:arrow 🚨 14229430 11882284 1.20
tpch_q12/datafusion:arrow 61313369 59161576 1.04
tpch_q13/datafusion:arrow 49656225 51275312 0.97
tpch_q14/datafusion:arrow 23091408 24578972 0.94
tpch_q15/datafusion:arrow 44470568 49034968 0.91
tpch_q16/datafusion:arrow 21444926 21588147 0.99
tpch_q17/datafusion:arrow 71980572 76389409 0.94
tpch_q18/datafusion:arrow 147261781 156471647 0.94
tpch_q19/datafusion:arrow 🚀 40286089 46126893 0.87
tpch_q20/datafusion:arrow 🚀 38478262 42874988 0.90
tpch_q21/datafusion:arrow 154102874 161652966 0.95
tpch_q22/datafusion:arrow 21157058 21462841 0.99
duckdb / vortex-file-compressed (0.950x ➖, 1↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33184677 33945815 0.98
tpch_q02/duckdb:vortex-file-compressed 🚀 27310404 30420900 0.90
tpch_q03/duckdb:vortex-file-compressed 28159293 31119258 0.90
tpch_q04/duckdb:vortex-file-compressed 32611577 30850763 1.06
tpch_q05/duckdb:vortex-file-compressed 34516333 34520554 1.00
tpch_q06/duckdb:vortex-file-compressed 11300809 11579928 0.98
tpch_q07/duckdb:vortex-file-compressed 36280225 37919217 0.96
tpch_q08/duckdb:vortex-file-compressed 40607977 42719246 0.95
tpch_q09/duckdb:vortex-file-compressed 82530557 85596756 0.96
tpch_q10/duckdb:vortex-file-compressed 36544302 39962671 0.91
tpch_q11/duckdb:vortex-file-compressed 15645178 17137731 0.91
tpch_q12/duckdb:vortex-file-compressed 22648064 23658615 0.96
tpch_q13/duckdb:vortex-file-compressed 37623857 39880167 0.94
tpch_q14/duckdb:vortex-file-compressed 22642494 23258008 0.97
tpch_q15/duckdb:vortex-file-compressed 16125171 17706138 0.91
tpch_q16/duckdb:vortex-file-compressed 29891394 30621149 0.98
tpch_q17/duckdb:vortex-file-compressed 25886653 27238867 0.95
tpch_q18/duckdb:vortex-file-compressed 49623837 51976924 0.95
tpch_q19/duckdb:vortex-file-compressed 32444998 35951304 0.90
tpch_q20/duckdb:vortex-file-compressed 34335596 36674028 0.94
tpch_q21/duckdb:vortex-file-compressed 104296832 111569686 0.93
tpch_q22/duckdb:vortex-file-compressed 18844594 19731849 0.96
duckdb / vortex-compact (0.951x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40140245 41448336 0.97
tpch_q02/duckdb:vortex-compact 38230621 39725669 0.96
tpch_q03/duckdb:vortex-compact 32440886 35380258 0.92
tpch_q04/duckdb:vortex-compact 35264527 37690078 0.94
tpch_q05/duckdb:vortex-compact 37705918 40378378 0.93
tpch_q06/duckdb:vortex-compact 14992269 14682117 1.02
tpch_q07/duckdb:vortex-compact 42658309 46203269 0.92
tpch_q08/duckdb:vortex-compact 46534799 46975532 0.99
tpch_q09/duckdb:vortex-compact 92680776 95966782 0.97
tpch_q10/duckdb:vortex-compact 40765845 43448208 0.94
tpch_q11/duckdb:vortex-compact 19715764 21858893 0.90
tpch_q12/duckdb:vortex-compact 35771554 37865537 0.94
tpch_q13/duckdb:vortex-compact 46993293 49469683 0.95
tpch_q14/duckdb:vortex-compact 29593668 31486809 0.94
tpch_q15/duckdb:vortex-compact 19101205 20415268 0.94
tpch_q16/duckdb:vortex-compact 38185728 37360512 1.02
tpch_q17/duckdb:vortex-compact 31719583 32518827 0.98
tpch_q18/duckdb:vortex-compact 50215754 53522416 0.94
tpch_q19/duckdb:vortex-compact 37550244 39851668 0.94
tpch_q20/duckdb:vortex-compact 44232304 46999817 0.94
tpch_q21/duckdb:vortex-compact 111718687 120856857 0.92
tpch_q22/duckdb:vortex-compact 20551620 21467383 0.96
duckdb / parquet (1.002x ➖, 0↑ 2↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 81899429 80953488 1.01
tpch_q02/duckdb:parquet 41225039 42189821 0.98
tpch_q03/duckdb:parquet 70139978 75566188 0.93
tpch_q04/duckdb:parquet 🚨 57229682 49425377 1.16
tpch_q05/duckdb:parquet 70156955 68317716 1.03
tpch_q06/duckdb:parquet 🚨 25743782 20560054 1.25
tpch_q07/duckdb:parquet 80676738 74427318 1.08
tpch_q08/duckdb:parquet 82506297 82911275 1.00
tpch_q09/duckdb:parquet 137847945 137930478 1.00
tpch_q10/duckdb:parquet 141141531 143594802 0.98
tpch_q11/duckdb:parquet 23033806 23655895 0.97
tpch_q12/duckdb:parquet 45478881 46865167 0.97
tpch_q13/duckdb:parquet 268690006 293587331 0.92
tpch_q14/duckdb:parquet 50239449 51602863 0.97
tpch_q15/duckdb:parquet 24468937 25145853 0.97
tpch_q16/duckdb:parquet 55426793 59964880 0.92
tpch_q17/duckdb:parquet 56032311 55612722 1.01
tpch_q18/duckdb:parquet 119966338 125851238 0.95
tpch_q19/duckdb:parquet 76244613 73936584 1.03
tpch_q20/duckdb:parquet 63886028 67457775 0.95
tpch_q21/duckdb:parquet 187314880 182273318 1.03
tpch_q22/duckdb:parquet 53091081 53517374 0.99
duckdb / duckdb (0.975x ➖, 2↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16166834 16495146 0.98
tpch_q02/duckdb:duckdb 🚀 12303414 13796515 0.89
tpch_q03/duckdb:duckdb 19915435 20416086 0.98
tpch_q04/duckdb:duckdb 19289234 19606894 0.98
tpch_q05/duckdb:duckdb 21633235 22035695 0.98
tpch_q06/duckdb:duckdb 🚀 5398548 6345018 0.85
tpch_q07/duckdb:duckdb 24464396 24063190 1.02
tpch_q08/duckdb:duckdb 21302280 22522998 0.95
tpch_q09/duckdb:duckdb 57031566 58456037 0.98
tpch_q10/duckdb:duckdb 48728114 44527596 1.09
tpch_q11/duckdb:duckdb 6513491 6053523 1.08
tpch_q12/duckdb:duckdb 14621211 14824370 0.99
tpch_q13/duckdb:duckdb 38712134 41300315 0.94
tpch_q14/duckdb:duckdb 18230158 18948414 0.96
tpch_q15/duckdb:duckdb 12362657 12445000 0.99
tpch_q16/duckdb:duckdb 24187160 24777688 0.98
tpch_q17/duckdb:duckdb 14138997 14624679 0.97
tpch_q18/duckdb:duckdb 38720552 39931567 0.97
tpch_q19/duckdb:duckdb 27489807 28186240 0.98
tpch_q20/duckdb:duckdb 23987833 23553543 1.02
tpch_q21/duckdb:duckdb 55496608 60243194 0.92
tpch_q22/duckdb:duckdb 24689288 24867437 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -10.4% -0.4% -10.0% +29.4% ➖ noise
1 datafusion:vortex-compact -4.6% -0.4% -4.2% +29.4% ➖ noise
1 datafusion:vortex-file-compressed -6.4% -0.4% -6.0% +29.8% ➖ noise
1 duckdb:duckdb -2.0% -0.4% -1.6% +28.9% ➖ noise
1 duckdb:vortex-compact -3.2% -0.4% -2.8% +28.3% ➖ noise
1 duckdb:vortex-file-compressed -2.2% -0.4% -1.9% +28.5% ➖ noise
2 datafusion:arrow -6.4% -4.5% -2.0% +18.6% ➖ noise
2 datafusion:vortex-compact -5.2% -4.5% -0.8% +18.6% ➖ noise
2 datafusion:vortex-file-compressed -7.7% -4.5% -3.4% +18.6% ➖ noise
2 duckdb:duckdb -10.8% -4.5% -6.7% +18.6% ➖ noise
2 duckdb:vortex-compact -3.8% -4.5% +0.7% +18.6% ➖ noise
2 duckdb:vortex-file-compressed -10.2% -4.5% -6.0% +18.6% ➖ noise
3 datafusion:arrow -8.5% -11.5% +3.4% +18.6% ➖ noise
3 datafusion:vortex-compact -8.0% -11.5% +3.9% +18.6% ➖ noise
3 datafusion:vortex-file-compressed -9.5% -11.5% +2.3% +18.6% ➖ noise
3 duckdb:duckdb -2.5% -11.5% +10.2% +18.6% ➖ noise
3 duckdb:vortex-compact -8.3% -11.5% +3.6% +18.6% ➖ noise
3 duckdb:vortex-file-compressed -9.5% -11.5% +2.3% +18.6% ➖ noise
4 datafusion:arrow -9.0% +5.7% -13.9% +18.6% ➖ noise
4 datafusion:vortex-compact -6.1% +5.7% -11.2% +18.6% ➖ noise
4 datafusion:vortex-file-compressed -3.9% +5.7% -9.1% +18.6% ➖ noise
4 duckdb:duckdb -1.6% +5.7% -6.9% +18.6% ➖ noise
4 duckdb:vortex-compact -6.4% +5.7% -11.5% +18.6% ➖ noise
4 duckdb:vortex-file-compressed +5.7% +5.7% -0.0% +18.6% ➖ noise
5 datafusion:arrow -9.9% -2.1% -7.9% +18.6% ➖ noise
5 datafusion:vortex-compact -2.0% -2.1% +0.1% +18.6% ➖ noise
5 datafusion:vortex-file-compressed -6.2% -2.1% -4.2% +18.6% ➖ noise
5 duckdb:duckdb -1.8% -2.1% +0.3% +18.6% ➖ noise
5 duckdb:vortex-compact -6.6% -2.1% -4.6% +18.6% ➖ noise
5 duckdb:vortex-file-compressed -0.0% -2.1% +2.1% +18.6% ➖ noise
6 datafusion:arrow -11.4% +24.5% -28.8% +23.2% ✅ faster
6 datafusion:vortex-compact -9.2% +24.5% -27.0% +24.2% ✅ faster
6 datafusion:vortex-file-compressed -3.6% +24.5% -22.6% +24.5% ✅ faster
6 duckdb:duckdb -14.9% +24.5% -31.7% +27.7% ✅ faster
6 duckdb:vortex-compact +2.1% +24.5% -18.0% +22.9% ➖ noise
6 duckdb:vortex-file-compressed -2.4% +24.5% -21.6% +25.8% ✅ faster
7 datafusion:arrow -5.5% +3.6% -8.8% +18.6% ➖ noise
7 datafusion:vortex-compact -4.4% +3.6% -7.8% +18.6% ➖ noise
7 datafusion:vortex-file-compressed -7.7% +3.6% -10.9% +18.6% ➖ noise
7 duckdb:duckdb +1.7% +3.6% -1.9% +18.6% ➖ noise
7 duckdb:vortex-compact -7.7% +3.6% -10.9% +18.6% ➖ noise
7 duckdb:vortex-file-compressed -4.3% +3.6% -7.7% +18.6% ➖ noise
8 datafusion:arrow -13.4% -2.9% -10.8% +18.6% ➖ noise
8 datafusion:vortex-compact -5.6% -2.9% -2.8% +18.6% ➖ noise
8 datafusion:vortex-file-compressed -5.0% -2.9% -2.1% +18.6% ➖ noise
8 duckdb:duckdb -5.4% -2.9% -2.5% +18.6% ➖ noise
8 duckdb:vortex-compact -0.9% -2.9% +2.1% +18.6% ➖ noise
8 duckdb:vortex-file-compressed -4.9% -2.9% -2.1% +18.6% ➖ noise
9 datafusion:arrow -7.8% -3.3% -4.7% +18.6% ➖ noise
9 datafusion:vortex-compact -7.1% -3.3% -3.9% +18.6% ➖ noise
9 datafusion:vortex-file-compressed -1.3% -3.3% +2.0% +18.6% ➖ noise
9 duckdb:duckdb -2.4% -3.3% +0.9% +18.6% ➖ noise
9 duckdb:vortex-compact -3.4% -3.3% -0.1% +18.6% ➖ noise
9 duckdb:vortex-file-compressed -3.6% -3.3% -0.3% +18.6% ➖ noise
10 datafusion:arrow -7.0% -1.8% -5.3% +21.2% ➖ noise
10 datafusion:vortex-compact -7.7% -1.8% -6.0% +18.6% ➖ noise
10 datafusion:vortex-file-compressed -2.1% -1.8% -0.3% +18.6% ➖ noise
10 duckdb:duckdb +9.4% -1.8% +11.4% +20.5% ➖ noise
10 duckdb:vortex-compact -6.2% -1.8% -4.4% +18.6% ➖ noise
10 duckdb:vortex-file-compressed -8.6% -1.8% -6.9% +18.6% ➖ noise
11 datafusion:arrow +19.8% -4.3% +25.1% +27.5% ➖ noise
11 datafusion:vortex-compact -8.1% -4.3% -4.0% +18.6% ➖ noise
11 datafusion:vortex-file-compressed -4.0% -4.3% +0.3% +18.6% ➖ noise
11 duckdb:duckdb +7.6% -4.3% +12.4% +18.6% ➖ noise
11 duckdb:vortex-compact -9.8% -4.3% -5.8% +18.6% ➖ noise
11 duckdb:vortex-file-compressed -8.7% -4.3% -4.6% +18.6% ➖ noise
12 datafusion:arrow +3.6% -2.5% +6.2% +26.2% ➖ noise
12 datafusion:vortex-compact -6.1% -2.5% -3.8% +18.6% ➖ noise
12 datafusion:vortex-file-compressed -1.1% -2.5% +1.4% +18.6% ➖ noise
12 duckdb:duckdb -1.4% -2.5% +1.1% +18.6% ➖ noise
12 duckdb:vortex-compact -5.5% -2.5% -3.2% +18.6% ➖ noise
12 duckdb:vortex-file-compressed -4.3% -2.5% -1.9% +18.6% ➖ noise
13 datafusion:arrow -3.2% -8.3% +5.6% +18.6% ➖ noise
13 datafusion:vortex-compact -3.3% -8.3% +5.5% +18.6% ➖ noise
13 datafusion:vortex-file-compressed -2.0% -8.3% +6.9% +18.6% ➖ noise
13 duckdb:duckdb -6.3% -8.3% +2.2% +18.6% ➖ noise
13 duckdb:vortex-compact -5.0% -8.3% +3.6% +18.6% ➖ noise
13 duckdb:vortex-file-compressed -5.7% -8.3% +2.9% +18.6% ➖ noise
14 datafusion:arrow -6.1% +1.7% -7.6% +18.6% ➖ noise
14 datafusion:vortex-compact -8.2% +1.7% -9.7% +18.6% ➖ noise
14 datafusion:vortex-file-compressed +2.1% +1.7% +0.4% +18.6% ➖ noise
14 duckdb:duckdb -3.8% +1.7% -5.4% +22.5% ➖ noise
14 duckdb:vortex-compact -6.0% +1.7% -7.6% +18.6% ➖ noise
14 duckdb:vortex-file-compressed -2.6% +1.7% -4.3% +18.6% ➖ noise
15 datafusion:arrow -9.3% -3.6% -5.9% +18.6% ➖ noise
15 datafusion:vortex-compact -3.7% -3.6% -0.1% +18.6% ➖ noise
15 datafusion:vortex-file-compressed -1.1% -3.6% +2.6% +18.6% ➖ noise
15 duckdb:duckdb -0.7% -3.6% +3.1% +18.6% ➖ noise
15 duckdb:vortex-compact -6.4% -3.6% -2.9% +18.6% ➖ noise
15 duckdb:vortex-file-compressed -8.9% -3.6% -5.5% +18.6% ➖ noise
16 datafusion:arrow -0.7% -6.7% +6.4% +18.6% ➖ noise
16 datafusion:vortex-compact -1.3% -6.7% +5.8% +18.6% ➖ noise
16 datafusion:vortex-file-compressed -1.2% -6.7% +5.8% +18.6% ➖ noise
16 duckdb:duckdb -2.4% -6.7% +4.6% +18.6% ➖ noise
16 duckdb:vortex-compact +2.2% -6.7% +9.5% +18.6% ➖ noise
16 duckdb:vortex-file-compressed -2.4% -6.7% +4.6% +18.6% ➖ noise
17 datafusion:arrow -5.8% -7.8% +2.2% +18.6% ➖ noise
17 datafusion:vortex-compact -6.8% -7.8% +1.0% +19.1% ➖ noise
17 datafusion:vortex-file-compressed -7.7% -7.8% +0.1% +18.6% ➖ noise
17 duckdb:duckdb -3.3% -7.8% +4.8% +18.6% ➖ noise
17 duckdb:vortex-compact -2.5% -7.8% +5.8% +18.6% ➖ noise
17 duckdb:vortex-file-compressed -5.0% -7.8% +3.1% +18.6% ➖ noise
18 datafusion:arrow -5.9% -2.1% -3.9% +18.6% ➖ noise
18 datafusion:vortex-compact -9.4% -2.1% -7.4% +18.6% ➖ noise
18 datafusion:vortex-file-compressed -7.9% -2.1% -5.9% +18.6% ➖ noise
18 duckdb:duckdb -3.0% -2.1% -1.0% +18.6% ➖ noise
18 duckdb:vortex-compact -6.2% -2.1% -4.2% +18.6% ➖ noise
18 duckdb:vortex-file-compressed -4.5% -2.1% -2.5% +18.6% ➖ noise
19 datafusion:arrow -12.7% -2.9% -10.0% +18.6% ➖ noise
19 datafusion:vortex-compact -2.6% -2.9% +0.4% +18.6% ➖ noise
19 datafusion:vortex-file-compressed -4.8% -2.9% -2.0% +18.6% ➖ noise
19 duckdb:duckdb -2.5% -2.9% +0.5% +18.6% ➖ noise
19 duckdb:vortex-compact -5.8% -2.9% -2.9% +18.6% ➖ noise
19 duckdb:vortex-file-compressed -9.8% -2.9% -7.0% +18.6% ➖ noise
20 datafusion:arrow -10.3% -4.4% -6.1% +18.6% ➖ noise
20 datafusion:vortex-compact -5.8% -4.4% -1.4% +18.6% ➖ noise
20 datafusion:vortex-file-compressed -4.1% -4.4% +0.2% +18.6% ➖ noise
20 duckdb:duckdb +1.8% -4.4% +6.5% +18.6% ➖ noise
20 duckdb:vortex-compact -5.9% -4.4% -1.6% +18.6% ➖ noise
20 duckdb:vortex-file-compressed -6.4% -4.4% -2.1% +22.4% ➖ noise
21 datafusion:arrow -4.7% +0.3% -4.9% +18.6% ➖ noise
21 datafusion:vortex-compact -10.2% +0.3% -10.5% +18.6% ➖ noise
21 datafusion:vortex-file-compressed -8.5% +0.3% -8.8% +18.6% ➖ noise
21 duckdb:duckdb -7.9% +0.3% -8.1% +18.6% ➖ noise
21 duckdb:vortex-compact -7.6% +0.3% -7.8% +18.6% ➖ noise
21 duckdb:vortex-file-compressed -6.5% +0.3% -6.8% +18.6% ➖ noise
22 datafusion:arrow -1.4% -3.2% +1.9% +18.6% ➖ noise
22 datafusion:vortex-compact -9.0% -3.2% -6.0% +18.6% ➖ noise
22 datafusion:vortex-file-compressed -1.6% -3.2% +1.7% +18.6% ➖ noise
22 duckdb:duckdb -0.7% -3.2% +2.6% +18.6% ➖ noise
22 duckdb:vortex-compact -4.3% -3.2% -1.1% +18.6% ➖ noise
22 duckdb:vortex-file-compressed -4.5% -3.2% -1.3% +18.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Vortex (geomean): 1.003x ➖
Parquet (geomean): 1.017x ➖
Shifts: Parquet (control) +1.7% · Median polish +1.6%


datafusion / vortex-file-compressed (0.954x ➖, 3↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4924348 5360843 0.92
fineweb_q01/datafusion:vortex-file-compressed 27177135 27269352 1.00
fineweb_q02/datafusion:vortex-file-compressed 32131068 30824843 1.04
fineweb_q03/datafusion:vortex-file-compressed 🚀 82665389 93590372 0.88
fineweb_q04/datafusion:vortex-file-compressed 250622265 263064101 0.95
fineweb_q05/datafusion:vortex-file-compressed 232144369 230803249 1.01
fineweb_q06/datafusion:vortex-file-compressed 74015361 69228792 1.07
fineweb_q07/datafusion:vortex-file-compressed 🚀 75494745 88904914 0.85
fineweb_q08/datafusion:vortex-file-compressed 🚀 25973418 28960706 0.90
datafusion / vortex-compact (1.015x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 4882485 4889324 1.00
fineweb_q01/datafusion:vortex-compact 162128046 167390030 0.97
fineweb_q02/datafusion:vortex-compact 165584759 166593388 0.99
fineweb_q03/datafusion:vortex-compact 1480394549 1433290895 1.03
fineweb_q04/datafusion:vortex-compact 1609583867 1565308119 1.03
fineweb_q05/datafusion:vortex-compact 1243010448 1233385735 1.01
fineweb_q06/datafusion:vortex-compact 740790609 694387461 1.07
fineweb_q07/datafusion:vortex-compact 752315654 724554509 1.04
fineweb_q08/datafusion:vortex-compact 21304630 21186882 1.01
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6634113 6419766 1.03
fineweb_q01/datafusion:parquet 268719555 267771115 1.00
fineweb_q02/datafusion:parquet 267269404 270872717 0.99
fineweb_q03/datafusion:parquet 271992523 263921839 1.03
fineweb_q04/datafusion:parquet 286328129 278817808 1.03
fineweb_q05/datafusion:parquet 276663212 273599700 1.01
fineweb_q06/datafusion:parquet 268160885 276447106 0.97
fineweb_q07/datafusion:parquet 263676430 265401937 0.99
fineweb_q08/datafusion:parquet 264878836 263032688 1.01
duckdb / vortex-file-compressed (1.022x ➖, 0↑ 1↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3360840 3223304 1.04
fineweb_q01/duckdb:vortex-file-compressed 🚨 30149225 27125475 1.11
fineweb_q02/duckdb:vortex-file-compressed 25555385 25351873 1.01
fineweb_q03/duckdb:vortex-file-compressed 141859506 138936781 1.02
fineweb_q04/duckdb:vortex-file-compressed 234250829 231879220 1.01
fineweb_q05/duckdb:vortex-file-compressed 218917996 215414230 1.02
fineweb_q06/duckdb:vortex-file-compressed 63228815 65470672 0.97
fineweb_q07/duckdb:vortex-file-compressed 64837529 62847730 1.03
fineweb_q08/duckdb:vortex-file-compressed 25137583 25288025 0.99
duckdb / vortex-compact (1.022x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3916489 3896876 1.01
fineweb_q01/duckdb:vortex-compact 111160868 104389456 1.06
fineweb_q02/duckdb:vortex-compact 111704949 115886740 0.96
fineweb_q03/duckdb:vortex-compact 856982113 849611467 1.01
fineweb_q04/duckdb:vortex-compact 906709630 898778993 1.01
fineweb_q05/duckdb:vortex-compact 821112250 812267674 1.01
fineweb_q06/duckdb:vortex-compact 491964646 462711268 1.06
fineweb_q07/duckdb:vortex-compact 505660645 476301063 1.06
fineweb_q08/duckdb:vortex-compact 23740724 23353912 1.02
duckdb / parquet (1.028x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 38090628 35606106 1.07
fineweb_q01/duckdb:parquet 96149198 92632802 1.04
fineweb_q02/duckdb:parquet 102463188 95771069 1.07
fineweb_q03/duckdb:parquet 318112866 304614309 1.04
fineweb_q04/duckdb:parquet 438123975 437365267 1.00
fineweb_q05/duckdb:parquet 409123447 407660526 1.00
fineweb_q06/duckdb:parquet 199539362 197137182 1.01
fineweb_q07/duckdb:parquet 209029553 208632029 1.00
fineweb_q08/duckdb:parquet 57136559 56205202 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -0.1% +5.1% -5.0% +37.4% ➖ noise
0 datafusion:vortex-file-compressed -8.1% +5.1% -12.6% +77.6% ➖ noise
0 duckdb:vortex-compact +0.5% +5.1% -4.4% +31.5% ➖ noise
0 duckdb:vortex-file-compressed +4.3% +5.1% -0.8% +47.3% ➖ noise
1 datafusion:vortex-compact -3.1% +2.1% -5.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -0.3% +2.1% -2.4% +14.4% ➖ noise
1 duckdb:vortex-compact +6.5% +2.1% +4.3% +15.3% ➖ noise
1 duckdb:vortex-file-compressed +11.1% +2.1% +8.9% +39.7% ➖ noise
2 datafusion:vortex-compact -0.6% +2.7% -3.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +4.2% +2.7% +1.5% +18.4% ➖ noise
2 duckdb:vortex-compact -3.6% +2.7% -6.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.8% +2.7% -1.9% +10.0% ➖ noise
3 datafusion:vortex-compact +3.3% +3.7% -0.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -11.7% +3.7% -14.9% +30.2% ➖ noise
3 duckdb:vortex-compact +0.9% +3.7% -2.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.1% +3.7% -1.6% +33.2% ➖ noise
4 datafusion:vortex-compact +2.8% +1.4% +1.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.7% +1.4% -6.1% +10.0% ➖ noise
4 duckdb:vortex-compact +0.9% +1.4% -0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.0% +1.4% -0.4% +10.0% ➖ noise
5 datafusion:vortex-compact +0.8% +0.7% +0.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.6% +0.7% -0.2% +10.0% ➖ noise
5 duckdb:vortex-compact +1.1% +0.7% +0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.6% +0.7% +0.9% +10.0% ➖ noise
6 datafusion:vortex-compact +6.7% -0.9% +7.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +6.9% -0.9% +7.9% +14.2% ➖ noise
6 duckdb:vortex-compact +6.3% -0.9% +7.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.4% -0.9% -2.5% +10.3% ➖ noise
7 datafusion:vortex-compact +3.8% -0.2% +4.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -15.1% -0.2% -14.9% +20.4% ➖ noise
7 duckdb:vortex-compact +6.2% -0.2% +6.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.2% -0.2% +3.4% +14.5% ➖ noise
8 datafusion:vortex-compact +0.6% +1.2% -0.6% +28.8% ➖ noise
8 datafusion:vortex-file-compressed -10.3% +1.2% -11.4% +43.0% ➖ noise
8 duckdb:vortex-compact +1.7% +1.2% +0.5% +16.1% ➖ noise
8 duckdb:vortex-file-compressed -0.6% +1.2% -1.8% +14.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.2%
Vortex (geomean): 0.979x ➖
Parquet (geomean): 0.954x ➖
Shifts: Parquet (control) -4.6% · Median polish -2.5%


datafusion / vortex-file-compressed (0.955x ➖, 14↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 27221767 31323731 0.87
tpcds_q02/datafusion:vortex-file-compressed 🚀 51723170 57936788 0.89
tpcds_q03/datafusion:vortex-file-compressed 20432868 22580932 0.90
tpcds_q04/datafusion:vortex-file-compressed 286776458 298840871 0.96
tpcds_q05/datafusion:vortex-file-compressed 🚀 51313701 59193398 0.87
tpcds_q06/datafusion:vortex-file-compressed 🚀 48827415 55145408 0.89
tpcds_q07/datafusion:vortex-file-compressed 48954098 53237207 0.92
tpcds_q08/datafusion:vortex-file-compressed 36998644 40685084 0.91
tpcds_q09/datafusion:vortex-file-compressed 48504744 51987989 0.93
tpcds_q10/datafusion:vortex-file-compressed 🚀 44035169 49557200 0.89
tpcds_q11/datafusion:vortex-file-compressed 160961923 171658617 0.94
tpcds_q12/datafusion:vortex-file-compressed 🚀 22807000 25562545 0.89
tpcds_q13/datafusion:vortex-file-compressed 52263814 57608839 0.91
tpcds_q14/datafusion:vortex-file-compressed 196979743 210573836 0.94
tpcds_q15/datafusion:vortex-file-compressed 🚀 33081707 36759592 0.90
tpcds_q16/datafusion:vortex-file-compressed 🚀 27059105 30656963 0.88
tpcds_q17/datafusion:vortex-file-compressed 🚀 64371525 71537328 0.90
tpcds_q18/datafusion:vortex-file-compressed 🚀 76281444 87052829 0.88
tpcds_q19/datafusion:vortex-file-compressed 31418473 33933727 0.93
tpcds_q20/datafusion:vortex-file-compressed 25976485 27764028 0.94
tpcds_q21/datafusion:vortex-file-compressed 135928032 150555048 0.90
tpcds_q22/datafusion:vortex-file-compressed 🚀 56121948 66611137 0.84
tpcds_q23/datafusion:vortex-file-compressed 145179167 150816040 0.96
tpcds_q24/datafusion:vortex-file-compressed 110456027 118979879 0.93
tpcds_q25/datafusion:vortex-file-compressed 66899121 66246035 1.01
tpcds_q26/datafusion:vortex-file-compressed 35186432 36129875 0.97
tpcds_q27/datafusion:vortex-file-compressed 116163591 118529870 0.98
tpcds_q28/datafusion:vortex-file-compressed 42488716 44907766 0.95
tpcds_q29/datafusion:vortex-file-compressed 66915479 66286650 1.01
tpcds_q30/datafusion:vortex-file-compressed 29907364 31862809 0.94
tpcds_q31/datafusion:vortex-file-compressed 91232351 91675301 1.00
tpcds_q32/datafusion:vortex-file-compressed 20687303 20939551 0.99
tpcds_q33/datafusion:vortex-file-compressed 37745647 37403487 1.01
tpcds_q34/datafusion:vortex-file-compressed 32115449 30663775 1.05
tpcds_q35/datafusion:vortex-file-compressed 51873647 54123929 0.96
tpcds_q36/datafusion:vortex-file-compressed 74280819 74979796 0.99
tpcds_q37/datafusion:vortex-file-compressed 33576678 33669262 1.00
tpcds_q38/datafusion:vortex-file-compressed 50316004 53474246 0.94
tpcds_q39/datafusion:vortex-file-compressed 148299048 138832608 1.07
tpcds_q40/datafusion:vortex-file-compressed 50416418 53597688 0.94
tpcds_q41/datafusion:vortex-file-compressed 17435580 17997846 0.97
tpcds_q42/datafusion:vortex-file-compressed 17759557 19239597 0.92
tpcds_q43/datafusion:vortex-file-compressed 32097544 32283320 0.99
tpcds_q44/datafusion:vortex-file-compressed 40804433 43066757 0.95
tpcds_q45/datafusion:vortex-file-compressed 33883193 34675407 0.98
tpcds_q46/datafusion:vortex-file-compressed 🚀 44326375 50471956 0.88
tpcds_q47/datafusion:vortex-file-compressed 200834932 211667197 0.95
tpcds_q48/datafusion:vortex-file-compressed 40063019 41440843 0.97
tpcds_q49/datafusion:vortex-file-compressed 65835517 68152889 0.97
tpcds_q50/datafusion:vortex-file-compressed 44091116 48378598 0.91
tpcds_q51/datafusion:vortex-file-compressed 88565642 91253236 0.97
tpcds_q52/datafusion:vortex-file-compressed 17792030 19748673 0.90
tpcds_q53/datafusion:vortex-file-compressed 24792076 26001998 0.95
tpcds_q54/datafusion:vortex-file-compressed 42609522 44686369 0.95
tpcds_q55/datafusion:vortex-file-compressed 18052067 18611672 0.97
tpcds_q56/datafusion:vortex-file-compressed 39998396 39700851 1.01
tpcds_q57/datafusion:vortex-file-compressed 125397993 133451862 0.94
tpcds_q58/datafusion:vortex-file-compressed 67639766 72763880 0.93
tpcds_q59/datafusion:vortex-file-compressed 69711521 76218561 0.91
tpcds_q60/datafusion:vortex-file-compressed 39745908 40603815 0.98
tpcds_q61/datafusion:vortex-file-compressed 49374377 53468075 0.92
tpcds_q62/datafusion:vortex-file-compressed 30839515 33971472 0.91
tpcds_q63/datafusion:vortex-file-compressed 🚀 24509396 27361590 0.90
tpcds_q64/datafusion:vortex-file-compressed 459578254 475698522 0.97
tpcds_q65/datafusion:vortex-file-compressed 46231498 46686661 0.99
tpcds_q66/datafusion:vortex-file-compressed 90032126 89385961 1.01
tpcds_q67/datafusion:vortex-file-compressed 113785810 123538256 0.92
tpcds_q68/datafusion:vortex-file-compressed 43583900 45506606 0.96
tpcds_q69/datafusion:vortex-file-compressed 40212826 41789719 0.96
tpcds_q70/datafusion:vortex-file-compressed 112250513 111522502 1.01
tpcds_q71/datafusion:vortex-file-compressed 29675916 31586212 0.94
tpcds_q72/datafusion:vortex-file-compressed 2550451320 2613864732 0.98
tpcds_q73/datafusion:vortex-file-compressed 34550904 33375428 1.04
tpcds_q74/datafusion:vortex-file-compressed 114386306 113701916 1.01
tpcds_q75/datafusion:vortex-file-compressed 117881539 118192567 1.00
tpcds_q76/datafusion:vortex-file-compressed 32033638 32602690 0.98
tpcds_q77/datafusion:vortex-file-compressed 50738184 51220528 0.99
tpcds_q78/datafusion:vortex-file-compressed 120991755 123562171 0.98
tpcds_q79/datafusion:vortex-file-compressed 36761997 38202778 0.96
tpcds_q80/datafusion:vortex-file-compressed 113499963 112785974 1.01
tpcds_q81/datafusion:vortex-file-compressed 🚀 35234673 39655104 0.89
tpcds_q82/datafusion:vortex-file-compressed 34414062 37388845 0.92
tpcds_q83/datafusion:vortex-file-compressed 48435715 50378439 0.96
tpcds_q84/datafusion:vortex-file-compressed 14821434 15030529 0.99
tpcds_q85/datafusion:vortex-file-compressed 98206630 99495088 0.99
tpcds_q86/datafusion:vortex-file-compressed 18628991 19717617 0.94
tpcds_q87/datafusion:vortex-file-compressed 52201432 51795539 1.01
tpcds_q88/datafusion:vortex-file-compressed 72837982 73226787 0.99
tpcds_q89/datafusion:vortex-file-compressed 35300270 35670145 0.99
tpcds_q90/datafusion:vortex-file-compressed 17554447 17703222 0.99
tpcds_q91/datafusion:vortex-file-compressed 25293584 24762346 1.02
tpcds_q92/datafusion:vortex-file-compressed 17810254 18086373 0.98
tpcds_q93/datafusion:vortex-file-compressed 33021668 32355768 1.02
tpcds_q94/datafusion:vortex-file-compressed 24954460 24196504 1.03
tpcds_q95/datafusion:vortex-file-compressed 60860403 59411420 1.02
tpcds_q96/datafusion:vortex-file-compressed 15091474 15592563 0.97
tpcds_q97/datafusion:vortex-file-compressed 29881284 30098744 0.99
tpcds_q98/datafusion:vortex-file-compressed 30599904 31712907 0.96
tpcds_q99/datafusion:vortex-file-compressed 45307431 46383977 0.98
datafusion / vortex-compact (0.973x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 34587225 34939793 0.99
tpcds_q02/datafusion:vortex-compact 58848652 60077882 0.98
tpcds_q03/datafusion:vortex-compact 26401733 25494699 1.04
tpcds_q04/datafusion:vortex-compact 323384270 322444714 1.00
tpcds_q05/datafusion:vortex-compact 63923013 64015394 1.00
tpcds_q06/datafusion:vortex-compact 56386917 56619972 1.00
tpcds_q07/datafusion:vortex-compact 65847170 66848416 0.99
tpcds_q08/datafusion:vortex-compact 44082984 45262967 0.97
tpcds_q09/datafusion:vortex-compact 71134726 69727054 1.02
tpcds_q10/datafusion:vortex-compact 64433306 64814484 0.99
tpcds_q11/datafusion:vortex-compact 185332047 194425627 0.95
tpcds_q12/datafusion:vortex-compact 27415562 28509953 0.96
tpcds_q13/datafusion:vortex-compact 116563699 114800855 1.02
tpcds_q14/datafusion:vortex-compact 250794461 268610554 0.93
tpcds_q15/datafusion:vortex-compact 37900962 42082310 0.90
tpcds_q16/datafusion:vortex-compact 39482798 41182139 0.96
tpcds_q17/datafusion:vortex-compact 91772151 96401254 0.95
tpcds_q18/datafusion:vortex-compact 85614274 92767234 0.92
tpcds_q19/datafusion:vortex-compact 45049885 46444527 0.97
tpcds_q20/datafusion:vortex-compact 29405200 30863825 0.95
tpcds_q21/datafusion:vortex-compact 139382799 147360380 0.95
tpcds_q22/datafusion:vortex-compact 64773775 66824901 0.97
tpcds_q23/datafusion:vortex-compact 180036943 186188419 0.97
tpcds_q24/datafusion:vortex-compact 139622785 143913592 0.97
tpcds_q25/datafusion:vortex-compact 95255499 95434088 1.00
tpcds_q26/datafusion:vortex-compact 46477937 46375709 1.00
tpcds_q27/datafusion:vortex-compact 154961394 157298031 0.99
tpcds_q28/datafusion:vortex-compact 82255843 87165691 0.94
tpcds_q29/datafusion:vortex-compact 93944766 92866381 1.01
tpcds_q30/datafusion:vortex-compact 36199723 35992360 1.01
tpcds_q31/datafusion:vortex-compact 129019813 136648507 0.94
tpcds_q32/datafusion:vortex-compact 26166016 28063050 0.93
tpcds_q33/datafusion:vortex-compact 53936819 56478007 0.96
tpcds_q34/datafusion:vortex-compact 51390825 54063238 0.95
tpcds_q35/datafusion:vortex-compact 69216630 71117711 0.97
tpcds_q36/datafusion:vortex-compact 99246552 100173903 0.99
tpcds_q37/datafusion:vortex-compact 46876549 47433417 0.99
tpcds_q38/datafusion:vortex-compact 68724404 70978631 0.97
tpcds_q39/datafusion:vortex-compact 143855779 150329550 0.96
tpcds_q40/datafusion:vortex-compact 56313701 60127010 0.94
tpcds_q41/datafusion:vortex-compact 20441516 21074586 0.97
tpcds_q42/datafusion:vortex-compact 24418278 25027378 0.98
tpcds_q43/datafusion:vortex-compact 37608606 38628036 0.97
tpcds_q44/datafusion:vortex-compact 73048988 74254693 0.98
tpcds_q45/datafusion:vortex-compact 38473488 40548474 0.95
tpcds_q46/datafusion:vortex-compact 72092621 75569666 0.95
tpcds_q47/datafusion:vortex-compact 227161076 237155783 0.96
tpcds_q48/datafusion:vortex-compact 85271950 81166698 1.05
tpcds_q49/datafusion:vortex-compact 88517651 94421129 0.94
tpcds_q50/datafusion:vortex-compact 66134687 67995394 0.97
tpcds_q51/datafusion:vortex-compact 98812534 100816612 0.98
tpcds_q52/datafusion:vortex-compact 23607002 24932394 0.95
tpcds_q53/datafusion:vortex-compact 35420102 35748534 0.99
tpcds_q54/datafusion:vortex-compact 59035166 61230147 0.96
tpcds_q55/datafusion:vortex-compact 24390503 23861885 1.02
tpcds_q56/datafusion:vortex-compact 57697693 56228221 1.03
tpcds_q57/datafusion:vortex-compact 135812466 139075606 0.98
tpcds_q58/datafusion:vortex-compact 80839689 79472022 1.02
tpcds_q59/datafusion:vortex-compact 84394870 87012986 0.97
tpcds_q60/datafusion:vortex-compact 56156503 59821871 0.94
tpcds_q61/datafusion:vortex-compact 77189866 77450417 1.00
tpcds_q62/datafusion:vortex-compact 33549901 35937834 0.93
tpcds_q63/datafusion:vortex-compact 35633896 37610559 0.95
tpcds_q64/datafusion:vortex-compact 542641270 561109395 0.97
tpcds_q65/datafusion:vortex-compact 67167220 72646596 0.92
tpcds_q66/datafusion:vortex-compact 97873614 102341870 0.96
tpcds_q67/datafusion:vortex-compact 121096346 127010061 0.95
tpcds_q68/datafusion:vortex-compact 70149679 71803243 0.98
tpcds_q69/datafusion:vortex-compact 59494989 61432148 0.97
tpcds_q70/datafusion:vortex-compact 123453334 124595154 0.99
tpcds_q71/datafusion:vortex-compact 47422029 46958316 1.01
tpcds_q72/datafusion:vortex-compact 2572104167 2643967274 0.97
tpcds_q73/datafusion:vortex-compact 52615911 53112250 0.99
tpcds_q74/datafusion:vortex-compact 135963406 138198310 0.98
tpcds_q75/datafusion:vortex-compact 163523672 165468763 0.99
tpcds_q76/datafusion:vortex-compact 50184795 51393148 0.98
tpcds_q77/datafusion:vortex-compact 66196704 73385361 0.90
tpcds_q78/datafusion:vortex-compact 148966610 152286998 0.98
tpcds_q79/datafusion:vortex-compact 64595714 61503101 1.05
tpcds_q80/datafusion:vortex-compact 130976667 132083018 0.99
tpcds_q81/datafusion:vortex-compact 42442944 44050448 0.96
tpcds_q82/datafusion:vortex-compact 49134358 47793645 1.03
tpcds_q83/datafusion:vortex-compact 58759234 56183217 1.05
tpcds_q84/datafusion:vortex-compact 18879285 19271547 0.98
tpcds_q85/datafusion:vortex-compact 123763770 124929009 0.99
tpcds_q86/datafusion:vortex-compact 21635718 22695065 0.95
tpcds_q87/datafusion:vortex-compact 70341677 69035807 1.02
tpcds_q88/datafusion:vortex-compact 121653644 123705980 0.98
tpcds_q89/datafusion:vortex-compact 44192457 46518764 0.95
tpcds_q90/datafusion:vortex-compact 23505322 24495283 0.96
tpcds_q91/datafusion:vortex-compact 39231269 42251637 0.93
tpcds_q92/datafusion:vortex-compact 25770038 26093363 0.99
tpcds_q93/datafusion:vortex-compact 45846426 47784099 0.96
tpcds_q94/datafusion:vortex-compact 29147489 31522052 0.92
tpcds_q95/datafusion:vortex-compact 68749719 72063607 0.95
tpcds_q96/datafusion:vortex-compact 24491099 25254614 0.97
tpcds_q97/datafusion:vortex-compact 42745051 44676885 0.96
tpcds_q98/datafusion:vortex-compact 39052806 39327286 0.99
tpcds_q99/datafusion:vortex-compact 49856599 51892268 0.96
datafusion / parquet (0.917x ➖, 36↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 35294612 36426322 0.97
tpcds_q02/datafusion:parquet 46233694 47437548 0.97
tpcds_q03/datafusion:parquet 🚀 14731028 16374185 0.90
tpcds_q04/datafusion:parquet 311531341 340172010 0.92
tpcds_q05/datafusion:parquet 53313923 54076816 0.99
tpcds_q06/datafusion:parquet 63858227 66045628 0.97
tpcds_q07/datafusion:parquet 87662060 90562668 0.97
tpcds_q08/datafusion:parquet 32522624 33042149 0.98
tpcds_q09/datafusion:parquet 59563657 56769216 1.05
tpcds_q10/datafusion:parquet 81017348 82668662 0.98
tpcds_q11/datafusion:parquet 174371546 187685288 0.93
tpcds_q12/datafusion:parquet 22710550 22859293 0.99
tpcds_q13/datafusion:parquet 85326122 91576860 0.93
tpcds_q14/datafusion:parquet 🚀 188273042 212219195 0.89
tpcds_q15/datafusion:parquet 26859328 28567905 0.94
tpcds_q16/datafusion:parquet 27293030 30113975 0.91
tpcds_q17/datafusion:parquet 68348483 73564344 0.93
tpcds_q18/datafusion:parquet 129628119 140232584 0.92
tpcds_q19/datafusion:parquet 27641240 30574239 0.90
tpcds_q20/datafusion:parquet 20698473 22973296 0.90
tpcds_q21/datafusion:parquet 🚀 21899816 25737489 0.85
tpcds_q22/datafusion:parquet 147585408 143981005 1.03
tpcds_q23/datafusion:parquet 158165420 166443034 0.95
tpcds_q24/datafusion:parquet 105306377 107541760 0.98
tpcds_q25/datafusion:parquet 68976438 72743022 0.95
tpcds_q26/datafusion:parquet 73574977 75344760 0.98
tpcds_q27/datafusion:parquet 162493739 171286133 0.95
tpcds_q28/datafusion:parquet 47249352 49268693 0.96
tpcds_q29/datafusion:parquet 71807741 75275012 0.95
tpcds_q30/datafusion:parquet 🚀 43383525 51068900 0.85
tpcds_q31/datafusion:parquet 74347338 78134312 0.95
tpcds_q32/datafusion:parquet 22659700 24025725 0.94
tpcds_q33/datafusion:parquet 35965625 36962518 0.97
tpcds_q34/datafusion:parquet 🚀 26356107 30032090 0.88
tpcds_q35/datafusion:parquet 🚀 83855755 95323497 0.88
tpcds_q36/datafusion:parquet 62484162 68059629 0.92
tpcds_q37/datafusion:parquet 🚀 22133696 27210323 0.81
tpcds_q38/datafusion:parquet 🚀 50510597 56311058 0.90
tpcds_q39/datafusion:parquet 🚀 81604994 97521924 0.84
tpcds_q40/datafusion:parquet 🚀 27091849 30484666 0.89
tpcds_q41/datafusion:parquet 🚀 15696940 18296218 0.86
tpcds_q42/datafusion:parquet 13928759 14977680 0.93
tpcds_q43/datafusion:parquet 18731827 20695716 0.91
tpcds_q44/datafusion:parquet 40867553 44707059 0.91
tpcds_q45/datafusion:parquet 31809503 34884363 0.91
tpcds_q46/datafusion:parquet 🚀 37812778 43120017 0.88
tpcds_q47/datafusion:parquet 🚀 132607073 148279277 0.89
tpcds_q48/datafusion:parquet 🚀 78309457 89968352 0.87
tpcds_q49/datafusion:parquet 🚀 64927041 72402958 0.90
tpcds_q50/datafusion:parquet 🚀 47986579 53530146 0.90
tpcds_q51/datafusion:parquet 🚀 87404755 100090827 0.87
tpcds_q52/datafusion:parquet 14861203 15690659 0.95
tpcds_q53/datafusion:parquet 🚀 21447604 23894699 0.90
tpcds_q54/datafusion:parquet 42011113 45051150 0.93
tpcds_q55/datafusion:parquet 🚀 13356127 15080962 0.89
tpcds_q56/datafusion:parquet 🚀 34544575 39340290 0.88
tpcds_q57/datafusion:parquet 106068754 114126629 0.93
tpcds_q58/datafusion:parquet 🚀 57797141 65627442 0.88
tpcds_q59/datafusion:parquet 58622136 63283354 0.93
tpcds_q60/datafusion:parquet 33970977 37350970 0.91
tpcds_q61/datafusion:parquet 50493341 53906722 0.94
tpcds_q62/datafusion:parquet 28712082 31307349 0.92
tpcds_q63/datafusion:parquet 21118390 23149303 0.91
tpcds_q64/datafusion:parquet 539686518 590851309 0.91
tpcds_q65/datafusion:parquet 42687709 47092832 0.91
tpcds_q66/datafusion:parquet 76796315 82304179 0.93
tpcds_q67/datafusion:parquet 🚀 148675188 165547157 0.90
tpcds_q68/datafusion:parquet 39032108 41648312 0.94
tpcds_q69/datafusion:parquet 🚀 77166316 88109742 0.88
tpcds_q70/datafusion:parquet 🚀 95003896 110641257 0.86
tpcds_q71/datafusion:parquet 26902987 28698617 0.94
tpcds_q72/datafusion:parquet 638778829 695106497 0.92
tpcds_q73/datafusion:parquet 27401143 29747884 0.92
tpcds_q74/datafusion:parquet 🚀 102176186 115243254 0.89
tpcds_q75/datafusion:parquet 115789017 122079744 0.95
tpcds_q76/datafusion:parquet 34337430 37625542 0.91
tpcds_q77/datafusion:parquet 48804934 52187170 0.94
tpcds_q78/datafusion:parquet 120107554 129382747 0.93
tpcds_q79/datafusion:parquet 31008726 33561887 0.92
tpcds_q80/datafusion:parquet 92907781 97005734 0.96
tpcds_q81/datafusion:parquet 🚀 40697862 45426492 0.90
tpcds_q82/datafusion:parquet 23645524 24646089 0.96
tpcds_q83/datafusion:parquet 49613980 52258606 0.95
tpcds_q84/datafusion:parquet 🚀 46562690 52435476 0.89
tpcds_q85/datafusion:parquet 🚀 167974361 191237205 0.88
tpcds_q86/datafusion:parquet 🚀 17084352 20056858 0.85
tpcds_q87/datafusion:parquet 🚀 49987912 57880719 0.86
tpcds_q88/datafusion:parquet 69482265 73445495 0.95
tpcds_q89/datafusion:parquet 🚀 23648175 26397561 0.90
tpcds_q90/datafusion:parquet 🚀 17849483 20127617 0.89
tpcds_q91/datafusion:parquet 🚀 69339452 77362583 0.90
tpcds_q92/datafusion:parquet 21895401 24102788 0.91
tpcds_q93/datafusion:parquet 34223745 36835024 0.93
tpcds_q94/datafusion:parquet 🚀 24148318 27901346 0.87
tpcds_q95/datafusion:parquet 🚀 66235227 73871154 0.90
tpcds_q96/datafusion:parquet 14040723 15598725 0.90
tpcds_q97/datafusion:parquet 🚀 32684110 37172603 0.88
tpcds_q98/datafusion:parquet 26093649 27693175 0.94
tpcds_q99/datafusion:parquet 28057642 29968515 0.94
duckdb / vortex-file-compressed (0.993x ➖, 1↑ 1↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24989886 26709437 0.94
tpcds_q02/duckdb:vortex-file-compressed 80139987 75598278 1.06
tpcds_q03/duckdb:vortex-file-compressed 24816261 24507719 1.01
tpcds_q04/duckdb:vortex-file-compressed 101990450 100525323 1.01
tpcds_q05/duckdb:vortex-file-compressed 91960543 94779204 0.97
tpcds_q06/duckdb:vortex-file-compressed 33627758 34320244 0.98
tpcds_q07/duckdb:vortex-file-compressed 22589382 22421369 1.01
tpcds_q08/duckdb:vortex-file-compressed 27309218 27333956 1.00
tpcds_q09/duckdb:vortex-file-compressed 33106909 33571121 0.99
tpcds_q10/duckdb:vortex-file-compressed 42796565 40356803 1.06
tpcds_q11/duckdb:vortex-file-compressed 58115066 58851348 0.99
tpcds_q12/duckdb:vortex-file-compressed 14398252 14681519 0.98
tpcds_q13/duckdb:vortex-file-compressed 41463404 41250493 1.01
tpcds_q14/duckdb:vortex-file-compressed 192930808 190337907 1.01
tpcds_q15/duckdb:vortex-file-compressed 40008864 40046466 1.00
tpcds_q16/duckdb:vortex-file-compressed 30484360 29779404 1.02
tpcds_q17/duckdb:vortex-file-compressed 36042362 35515987 1.01
tpcds_q18/duckdb:vortex-file-compressed 43185778 45685170 0.95
tpcds_q19/duckdb:vortex-file-compressed 31390325 31421187 1.00
tpcds_q20/duckdb:vortex-file-compressed 16004280 15073916 1.06
tpcds_q21/duckdb:vortex-file-compressed 19389631 20660251 0.94
tpcds_q22/duckdb:vortex-file-compressed 101395607 102084780 0.99
tpcds_q23/duckdb:vortex-file-compressed 147645166 145501419 1.01
tpcds_q24/duckdb:vortex-file-compressed 56530886 54462944 1.04
tpcds_q25/duckdb:vortex-file-compressed 36053779 34870694 1.03
tpcds_q26/duckdb:vortex-file-compressed 36766312 38695014 0.95
tpcds_q27/duckdb:vortex-file-compressed 84506814 87424799 0.97
tpcds_q28/duckdb:vortex-file-compressed 35119975 34242385 1.03
tpcds_q29/duckdb:vortex-file-compressed 36368874 34714266 1.05
tpcds_q30/duckdb:vortex-file-compressed 27249514 29640225 0.92
tpcds_q31/duckdb:vortex-file-compressed 27472958 28558053 0.96
tpcds_q32/duckdb:vortex-file-compressed 16608611 16384755 1.01
tpcds_q33/duckdb:vortex-file-compressed 61424939 62829619 0.98
tpcds_q34/duckdb:vortex-file-compressed 18619677 19415948 0.96
tpcds_q35/duckdb:vortex-file-compressed 68559267 68903575 1.00
tpcds_q36/duckdb:vortex-file-compressed 26538342 27572307 0.96
tpcds_q37/duckdb:vortex-file-compressed 21758369 20790577 1.05
tpcds_q38/duckdb:vortex-file-compressed 39827558 38916567 1.02
tpcds_q39/duckdb:vortex-file-compressed 44264243 44925675 0.99
tpcds_q40/duckdb:vortex-file-compressed 21844535 23706927 0.92
tpcds_q41/duckdb:vortex-file-compressed 12696042 13177070 0.96
tpcds_q42/duckdb:vortex-file-compressed 11143310 10935346 1.02
tpcds_q43/duckdb:vortex-file-compressed 30724429 29754154 1.03
tpcds_q44/duckdb:vortex-file-compressed 23518745 24223177 0.97
tpcds_q45/duckdb:vortex-file-compressed 26136044 27031485 0.97
tpcds_q46/duckdb:vortex-file-compressed 45780788 48179695 0.95
tpcds_q47/duckdb:vortex-file-compressed 49367986 49276707 1.00
tpcds_q48/duckdb:vortex-file-compressed 38482740 37607832 1.02
tpcds_q49/duckdb:vortex-file-compressed 27266924 28722596 0.95
tpcds_q50/duckdb:vortex-file-compressed 32653966 33531518 0.97
tpcds_q51/duckdb:vortex-file-compressed 98980638 102424770 0.97
tpcds_q52/duckdb:vortex-file-compressed 12323046 12306483 1.00
tpcds_q53/duckdb:vortex-file-compressed 16833363 16621910 1.01
tpcds_q54/duckdb:vortex-file-compressed 46131885 44862863 1.03
tpcds_q55/duckdb:vortex-file-compressed 🚨 12116894 10994919 1.10
tpcds_q56/duckdb:vortex-file-compressed 63103839 60351614 1.05
tpcds_q57/duckdb:vortex-file-compressed 🚀 43512052 53521763 0.81
tpcds_q58/duckdb:vortex-file-compressed 31592949 33187523 0.95
tpcds_q59/duckdb:vortex-file-compressed 78525995 81539640 0.96
tpcds_q60/duckdb:vortex-file-compressed 66024668 61934320 1.07
tpcds_q61/duckdb:vortex-file-compressed 36493578 36483784 1.00
tpcds_q62/duckdb:vortex-file-compressed 17497768 19435309 0.90
tpcds_q63/duckdb:vortex-file-compressed 16969840 16551044 1.03
tpcds_q64/duckdb:vortex-file-compressed 76890448 78116519 0.98
tpcds_q65/duckdb:vortex-file-compressed 22424764 23635936 0.95
tpcds_q66/duckdb:vortex-file-compressed 58215953 53935107 1.08
tpcds_q67/duckdb:vortex-file-compressed 141355791 139671125 1.01
tpcds_q68/duckdb:vortex-file-compressed 39308317 40129126 0.98
tpcds_q69/duckdb:vortex-file-compressed 42694807 43081963 0.99
tpcds_q70/duckdb:vortex-file-compressed 27417786 28353643 0.97
tpcds_q71/duckdb:vortex-file-compressed 21381947 20551585 1.04
tpcds_q72/duckdb:vortex-file-compressed 173986547 174843778 1.00
tpcds_q73/duckdb:vortex-file-compressed 19409956 19190715 1.01
tpcds_q74/duckdb:vortex-file-compressed 46832899 47174506 0.99
tpcds_q75/duckdb:vortex-file-compressed 56061084 56847539 0.99
tpcds_q76/duckdb:vortex-file-compressed 60872815 60303023 1.01
tpcds_q77/duckdb:vortex-file-compressed 60894540 61062875 1.00
tpcds_q78/duckdb:vortex-file-compressed 77323211 77371786 1.00
tpcds_q79/duckdb:vortex-file-compressed 36031465 35770092 1.01
tpcds_q80/duckdb:vortex-file-compressed 85990722 89545818 0.96
tpcds_q81/duckdb:vortex-file-compressed 33547950 33071895 1.01
tpcds_q82/duckdb:vortex-file-compressed 21359191 21453503 1.00
tpcds_q83/duckdb:vortex-file-compressed 27115770 26414191 1.03
tpcds_q84/duckdb:vortex-file-compressed 17669255 16968897 1.04
tpcds_q85/duckdb:vortex-file-compressed 46669793 45759155 1.02
tpcds_q86/duckdb:vortex-file-compressed 16531474 17233068 0.96
tpcds_q87/duckdb:vortex-file-compressed 45518320 45858756 0.99
tpcds_q88/duckdb:vortex-file-compressed 41496379 41430882 1.00
tpcds_q89/duckdb:vortex-file-compressed 18130783 17634885 1.03
tpcds_q90/duckdb:vortex-file-compressed 12947537 13701229 0.94
tpcds_q91/duckdb:vortex-file-compressed 28997660 27598927 1.05
tpcds_q92/duckdb:vortex-file-compressed 14206589 15178360 0.94
tpcds_q93/duckdb:vortex-file-compressed 28759629 28922174 0.99
tpcds_q94/duckdb:vortex-file-compressed 20829416 21201429 0.98
tpcds_q95/duckdb:vortex-file-compressed 150146261 146160381 1.03
tpcds_q96/duckdb:vortex-file-compressed 16837243 17157231 0.98
tpcds_q97/duckdb:vortex-file-compressed 37730913 39711281 0.95
tpcds_q98/duckdb:vortex-file-compressed 17363515 17925205 0.97
tpcds_q99/duckdb:vortex-file-compressed 30489647 30427971 1.00
duckdb / vortex-compact (0.993x ➖, 0↑ 2↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 31766504 33928861 0.94
tpcds_q02/duckdb:vortex-compact 118824039 120322587 0.99
tpcds_q03/duckdb:vortex-compact 50379773 50923973 0.99
tpcds_q04/duckdb:vortex-compact 117884001 117020085 1.01
tpcds_q05/duckdb:vortex-compact 162351040 162992751 1.00
tpcds_q06/duckdb:vortex-compact 41326534 41505746 1.00
tpcds_q07/duckdb:vortex-compact 37803094 37579584 1.01
tpcds_q08/duckdb:vortex-compact 34354341 34960153 0.98
tpcds_q09/duckdb:vortex-compact 57164720 57107315 1.00
tpcds_q10/duckdb:vortex-compact 55238244 52533902 1.05
tpcds_q11/duckdb:vortex-compact 75754807 75350391 1.01
tpcds_q12/duckdb:vortex-compact 18394451 18687553 0.98
tpcds_q13/duckdb:vortex-compact 68634238 67418454 1.02
tpcds_q14/duckdb:vortex-compact 286599573 294161713 0.97
tpcds_q15/duckdb:vortex-compact 43979407 45510033 0.97
tpcds_q16/duckdb:vortex-compact 33827937 32893548 1.03
tpcds_q17/duckdb:vortex-compact 49127697 48495345 1.01
tpcds_q18/duckdb:vortex-compact 56563317 57705692 0.98
tpcds_q19/duckdb:vortex-compact 42201311 41844276 1.01
tpcds_q20/duckdb:vortex-compact 20050171 19709598 1.02
tpcds_q21/duckdb:vortex-compact 26708389 28305558 0.94
tpcds_q22/duckdb:vortex-compact 109600946 110818080 0.99
tpcds_q23/duckdb:vortex-compact 166138595 165416775 1.00
tpcds_q24/duckdb:vortex-compact 74964660 75712130 0.99
tpcds_q25/duckdb:vortex-compact 51491483 51491566 1.00
tpcds_q26/duckdb:vortex-compact 48789101 49115531 0.99
tpcds_q27/duckdb:vortex-compact 138580377 143121878 0.97
tpcds_q28/duckdb:vortex-compact 85314203 83914539 1.02
tpcds_q29/duckdb:vortex-compact 49326647 48199649 1.02
tpcds_q30/duckdb:vortex-compact 34238071 34391274 1.00
tpcds_q31/duckdb:vortex-compact 36620127 35705819 1.03
tpcds_q32/duckdb:vortex-compact 23394404 22533466 1.04
tpcds_q33/duckdb:vortex-compact 135157190 142104115 0.95
tpcds_q34/duckdb:vortex-compact 31548746 30805078 1.02
tpcds_q35/duckdb:vortex-compact 75547670 79047279 0.96
tpcds_q36/duckdb:vortex-compact 35016059 35320162 0.99
tpcds_q37/duckdb:vortex-compact 30798843 32506917 0.95
tpcds_q38/duckdb:vortex-compact 44992365 48147974 0.93
tpcds_q39/duckdb:vortex-compact 54800639 54383246 1.01
tpcds_q40/duckdb:vortex-compact 28353228 28821412 0.98
tpcds_q41/duckdb:vortex-compact 15752880 15355548 1.03
tpcds_q42/duckdb:vortex-compact 16634113 15968389 1.04
tpcds_q43/duckdb:vortex-compact 37977485 38189312 0.99
tpcds_q44/duckdb:vortex-compact 36010490 35653131 1.01
tpcds_q45/duckdb:vortex-compact 30553817 30430100 1.00
tpcds_q46/duckdb:vortex-compact 63143570 63224733 1.00
tpcds_q47/duckdb:vortex-compact 55704456 56208915 0.99
tpcds_q48/duckdb:vortex-compact 55028311 56430578 0.98
tpcds_q49/duckdb:vortex-compact 41867168 41379861 1.01
tpcds_q50/duckdb:vortex-compact 55323154 56946120 0.97
tpcds_q51/duckdb:vortex-compact 101244543 103779954 0.98
tpcds_q52/duckdb:vortex-compact 16415052 16936255 0.97
tpcds_q53/duckdb:vortex-compact 23665780 24269341 0.98
tpcds_q54/duckdb:vortex-compact 79382770 78219832 1.01
tpcds_q55/duckdb:vortex-compact 16446020 17109796 0.96
tpcds_q56/duckdb:vortex-compact 130899724 134849642 0.97
tpcds_q57/duckdb:vortex-compact 46035159 47398576 0.97
tpcds_q58/duckdb:vortex-compact 🚨 47239214 42374550 1.11
tpcds_q59/duckdb:vortex-compact 100068108 98691907 1.01
tpcds_q60/duckdb:vortex-compact 135330545 138270160 0.98
tpcds_q61/duckdb:vortex-compact 54321295 54536120 1.00
tpcds_q62/duckdb:vortex-compact 🚨 26355766 20187680 1.31
tpcds_q63/duckdb:vortex-compact 24681122 23971989 1.03
tpcds_q64/duckdb:vortex-compact 105265063 105861744 0.99
tpcds_q65/duckdb:vortex-compact 30477547 29403495 1.04
tpcds_q66/duckdb:vortex-compact 91757514 93565388 0.98
tpcds_q67/duckdb:vortex-compact 149304084 149349631 1.00
tpcds_q68/duckdb:vortex-compact 55679062 56638720 0.98
tpcds_q69/duckdb:vortex-compact 53849620 54918503 0.98
tpcds_q70/duckdb:vortex-compact 34718878 34313389 1.01
tpcds_q71/duckdb:vortex-compact 27488174 28428034 0.97
tpcds_q72/duckdb:vortex-compact 191605433 195146462 0.98
tpcds_q73/duckdb:vortex-compact 29234721 28977993 1.01
tpcds_q74/duckdb:vortex-compact 56499313 57378515 0.98
tpcds_q75/duckdb:vortex-compact 66316469 67695480 0.98
tpcds_q76/duckdb:vortex-compact 135304999 131421241 1.03
tpcds_q77/duckdb:vortex-compact 136215396 127443119 1.07
tpcds_q78/duckdb:vortex-compact 84516272 86885499 0.97
tpcds_q79/duckdb:vortex-compact 63990617 64310804 1.00
tpcds_q80/duckdb:vortex-compact 158823281 164799987 0.96
tpcds_q81/duckdb:vortex-compact 38425392 40693237 0.94
tpcds_q82/duckdb:vortex-compact 31101800 33296779 0.93
tpcds_q83/duckdb:vortex-compact 45063174 48213531 0.93
tpcds_q84/duckdb:vortex-compact 22090927 23700644 0.93
tpcds_q85/duckdb:vortex-compact 57275441 63172548 0.91
tpcds_q86/duckdb:vortex-compact 19969698 21208095 0.94
tpcds_q87/duckdb:vortex-compact 51929705 49352027 1.05
tpcds_q88/duckdb:vortex-compact 42576585 44219335 0.96
tpcds_q89/duckdb:vortex-compact 25593830 26198535 0.98
tpcds_q90/duckdb:vortex-compact 15854550 15722235 1.01
tpcds_q91/duckdb:vortex-compact 44644281 46683409 0.96
tpcds_q92/duckdb:vortex-compact 20468382 21210479 0.97
tpcds_q93/duckdb:vortex-compact 34138005 35499760 0.96
tpcds_q94/duckdb:vortex-compact 26343796 26974718 0.98
tpcds_q95/duckdb:vortex-compact 158446421 160385500 0.99
tpcds_q96/duckdb:vortex-compact 17661343 17494468 1.01
tpcds_q97/duckdb:vortex-compact 44627892 41357707 1.08
tpcds_q98/duckdb:vortex-compact 24135781 24257678 0.99
tpcds_q99/duckdb:vortex-compact 32846183 34549985 0.95
duckdb / parquet (0.992x ➖, 4↑ 2↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 47225178 44470088 1.06
tpcds_q02/duckdb:parquet 61814402 61657373 1.00
tpcds_q03/duckdb:parquet 11813948 11779801 1.00
tpcds_q04/duckdb:parquet 124218212 124689013 1.00
tpcds_q05/duckdb:parquet 🚀 66769514 74678255 0.89
tpcds_q06/duckdb:parquet 28207658 28893153 0.98
tpcds_q07/duckdb:parquet 23038256 22784097 1.01
tpcds_q08/duckdb:parquet 28362791 28000285 1.01
tpcds_q09/duckdb:parquet 38997723 39967797 0.98
tpcds_q10/duckdb:parquet 33859788 35041372 0.97
tpcds_q11/duckdb:parquet 86329975 85302282 1.01
tpcds_q12/duckdb:parquet 14347241 13961550 1.03
tpcds_q13/duckdb:parquet 33638816 33458319 1.01
tpcds_q14/duckdb:parquet 159983408 159717980 1.00
tpcds_q15/duckdb:parquet 28954492 30150001 0.96
tpcds_q16/duckdb:parquet 21208475 21318429 0.99
tpcds_q17/duckdb:parquet 36758671 38007510 0.97
tpcds_q18/duckdb:parquet 46127181 46062254 1.00
tpcds_q19/duckdb:parquet 29025337 28741631 1.01
tpcds_q20/duckdb:parquet 15207989 15163528 1.00
tpcds_q21/duckdb:parquet 🚨 12480702 10763758 1.16
tpcds_q22/duckdb:parquet 70394583 65952337 1.07
tpcds_q23/duckdb:parquet 110858634 112628651 0.98
tpcds_q24/duckdb:parquet 46051944 45507577 1.01
tpcds_q25/duckdb:parquet 32904646 32792789 1.00
tpcds_q26/duckdb:parquet 34824626 37869025 0.92
tpcds_q27/duckdb:parquet 87588089 87518404 1.00
tpcds_q28/duckdb:parquet 36912661 36962063 1.00
tpcds_q29/duckdb:parquet 36219834 35811229 1.01
tpcds_q30/duckdb:parquet 39435601 40110411 0.98
tpcds_q31/duckdb:parquet 22669488 22446445 1.01
tpcds_q32/duckdb:parquet 10951873 10744182 1.02
tpcds_q33/duckdb:parquet 69284924 69962011 0.99
tpcds_q34/duckdb:parquet 20981916 20946530 1.00
tpcds_q35/duckdb:parquet 59149028 56709766 1.04
tpcds_q36/duckdb:parquet 20060199 19998132 1.00
tpcds_q37/duckdb:parquet 13107736 13173758 0.99
tpcds_q38/duckdb:parquet 33173404 32458602 1.02
tpcds_q39/duckdb:parquet 🚀 32097645 37895209 0.85
tpcds_q40/duckdb:parquet 17550867 17670244 0.99
tpcds_q41/duckdb:parquet 7520632 7491585 1.00
tpcds_q42/duckdb:parquet 10116499 10123190 1.00
tpcds_q43/duckdb:parquet 15257081 15508296 0.98
tpcds_q44/duckdb:parquet 21454674 22002326 0.98
tpcds_q45/duckdb:parquet 26063130 26772177 0.97
tpcds_q46/duckdb:parquet 45796011 44625788 1.03
tpcds_q47/duckdb:parquet 46059071 45683267 1.01
tpcds_q48/duckdb:parquet 30790999 30368287 1.01
tpcds_q49/duckdb:parquet 25012304 24543987 1.02
tpcds_q50/duckdb:parquet 24609877 24394121 1.01
tpcds_q51/duckdb:parquet 93576898 93654495 1.00
tpcds_q52/duckdb:parquet 11454380 10834578 1.06
tpcds_q53/duckdb:parquet 16090431 16118288 1.00
tpcds_q54/duckdb:parquet 40769396 41657305 0.98
tpcds_q55/duckdb:parquet 🚀 10279615 11720754 0.88
tpcds_q56/duckdb:parquet 66155060 69407641 0.95
tpcds_q57/duckdb:parquet 35070968 35484708 0.99
tpcds_q58/duckdb:parquet 21218956 21149030 1.00
tpcds_q59/duckdb:parquet 37002036 37003168 1.00
tpcds_q60/duckdb:parquet 72521936 72599599 1.00
tpcds_q61/duckdb:parquet 30514775 29911244 1.02
tpcds_q62/duckdb:parquet 12291770 12305479 1.00
tpcds_q63/duckdb:parquet 15153008 15334779 0.99
tpcds_q64/duckdb:parquet 72329870 73914736 0.98
tpcds_q65/duckdb:parquet 19971086 20326590 0.98
tpcds_q66/duckdb:parquet 🚨 59979630 53085089 1.13
tpcds_q67/duckdb:parquet 132246158 136907942 0.97
tpcds_q68/duckdb:parquet 37376034 38208335 0.98
tpcds_q69/duckdb:parquet 37231698 37150662 1.00
tpcds_q70/duckdb:parquet 19595108 19597161 1.00
tpcds_q71/duckdb:parquet 18139187 18021970 1.01
tpcds_q72/duckdb:parquet 160856340 160630790 1.00
tpcds_q73/duckdb:parquet 17610156 17989736 0.98
tpcds_q74/duckdb:parquet 48769196 49552814 0.98
tpcds_q75/duckdb:parquet 52520923 54241034 0.97
tpcds_q76/duckdb:parquet 69326746 71095059 0.98
tpcds_q77/duckdb:parquet 62103760 65268385 0.95
tpcds_q78/duckdb:parquet 71719266 75101707 0.95
tpcds_q79/duckdb:parquet 27222980 27407430 0.99
tpcds_q80/duckdb:parquet 81682257 84150080 0.97
tpcds_q81/duckdb:parquet 46232366 47126580 0.98
tpcds_q82/duckdb:parquet 15259605 15517674 0.98
tpcds_q83/duckdb:parquet 16265124 16338422 1.00
tpcds_q84/duckdb:parquet 19507065 20126729 0.97
tpcds_q85/duckdb:parquet 38565929 41641418 0.93
tpcds_q86/duckdb:parquet 12150849 12407977 0.98
tpcds_q87/duckdb:parquet 36398691 35864630 1.01
tpcds_q88/duckdb:parquet 29552148 28717410 1.03
tpcds_q89/duckdb:parquet 17121882 17550256 0.98
tpcds_q90/duckdb:parquet 7870683 7459629 1.06
tpcds_q91/duckdb:parquet 22851431 22852840 1.00
tpcds_q92/duckdb:parquet 11470048 11446992 1.00
tpcds_q93/duckdb:parquet 30261755 31324123 0.97
tpcds_q94/duckdb:parquet 16179930 16275659 0.99
tpcds_q95/duckdb:parquet 🚀 115856598 132867812 0.87
tpcds_q96/duckdb:parquet 9325461 9583069 0.97
tpcds_q97/duckdb:parquet 34793005 35010857 0.99
tpcds_q98/duckdb:parquet 18343945 18924529 0.97
tpcds_q99/duckdb:parquet 19263234 20517345 0.94
duckdb / duckdb (0.960x ➖, 8↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20154656 20393718 0.99
tpcds_q02/duckdb:duckdb 18323346 17756885 1.03
tpcds_q03/duckdb:duckdb 8079421 8317983 0.97
tpcds_q04/duckdb:duckdb 162077281 161010320 1.01
tpcds_q05/duckdb:duckdb 🚀 18206128 20307065 0.90
tpcds_q06/duckdb:duckdb 21476418 22115545 0.97
tpcds_q07/duckdb:duckdb 36782816 38053160 0.97
tpcds_q08/duckdb:duckdb 119989891 118997186 1.01
tpcds_q09/duckdb:duckdb 19699024 19805420 0.99
tpcds_q10/duckdb:duckdb 22596142 24223954 0.93
tpcds_q11/duckdb:duckdb 137458344 140689226 0.98
tpcds_q12/duckdb:duckdb 10882406 11510766 0.95
tpcds_q13/duckdb:duckdb 24352398 23783222 1.02
tpcds_q14/duckdb:duckdb 93370886 93763085 1.00
tpcds_q15/duckdb:duckdb 23225712 23947203 0.97
tpcds_q16/duckdb:duckdb 17513349 16726357 1.05
tpcds_q17/duckdb:duckdb 20720625 20479347 1.01
tpcds_q18/duckdb:duckdb 43689391 42972646 1.02
tpcds_q19/duckdb:duckdb 16785793 16175756 1.04
tpcds_q20/duckdb:duckdb 11623370 11908259 0.98
tpcds_q21/duckdb:duckdb 6293478 6702140 0.94
tpcds_q22/duckdb:duckdb 61075660 60350004 1.01
tpcds_q23/duckdb:duckdb 🚀 77354383 86871084 0.89
tpcds_q24/duckdb:duckdb 23486369 23843312 0.99
tpcds_q25/duckdb:duckdb 17139064 16414055 1.04
tpcds_q26/duckdb:duckdb 23082609 25359880 0.91
tpcds_q27/duckdb:duckdb 39069372 39725443 0.98
tpcds_q28/duckdb:duckdb 21564664 21254447 1.01
tpcds_q29/duckdb:duckdb 19528569 19958732 0.98
tpcds_q30/duckdb:duckdb 28398558 27883224 1.02
tpcds_q31/duckdb:duckdb 19675734 19597105 1.00
tpcds_q32/duckdb:duckdb 6881114 7009253 0.98
tpcds_q33/duckdb:duckdb 12074220 12972317 0.93
tpcds_q34/duckdb:duckdb 15510625 14398300 1.08
tpcds_q35/duckdb:duckdb 29661096 31733090 0.93
tpcds_q36/duckdb:duckdb 67413332 70677347 0.95
tpcds_q37/duckdb:duckdb 7074628 7678247 0.92
tpcds_q38/duckdb:duckdb 29870123 30082506 0.99
tpcds_q39/duckdb:duckdb 25667663 25520641 1.01
tpcds_q40/duckdb:duckdb 13833667 14383456 0.96
tpcds_q41/duckdb:duckdb 7827214 8225057 0.95
tpcds_q42/duckdb:duckdb 6269028 6127492 1.02
tpcds_q43/duckdb:duckdb 10759192 11484569 0.94
tpcds_q44/duckdb:duckdb 13382365 13792291 0.97
tpcds_q45/duckdb:duckdb 16910044 17556436 0.96
tpcds_q46/duckdb:duckdb 34329582 35947598 0.95
tpcds_q47/duckdb:duckdb 40244865 40996975 0.98
tpcds_q48/duckdb:duckdb 21345372 21122960 1.01
tpcds_q49/duckdb:duckdb 15935560 17431169 0.91
tpcds_q50/duckdb:duckdb 13816389 14152515 0.98
tpcds_q51/duckdb:duckdb 92816491 94718114 0.98
tpcds_q52/duckdb:duckdb 6995014 7250871 0.96
tpcds_q53/duckdb:duckdb 11268820 11966705 0.94
tpcds_q54/duckdb:duckdb 16243853 17270865 0.94
tpcds_q55/duckdb:duckdb 6846307 6786091 1.01
tpcds_q56/duckdb:duckdb 🚀 12814671 14375694 0.89
tpcds_q57/duckdb:duckdb 32116513 34096433 0.94
tpcds_q58/duckdb:duckdb 11943967 12366539 0.97
tpcds_q59/duckdb:duckdb 34664130 35507062 0.98
tpcds_q60/duckdb:duckdb 🚀 14066790 16620596 0.85
tpcds_q61/duckdb:duckdb 13722287 14964045 0.92
tpcds_q62/duckdb:duckdb 9151500 9413997 0.97
tpcds_q63/duckdb:duckdb 10722816 11172767 0.96
tpcds_q64/duckdb:duckdb 53822923 54490494 0.99
tpcds_q65/duckdb:duckdb 31598741 32824616 0.96
tpcds_q66/duckdb:duckdb 24096052 26390583 0.91
tpcds_q67/duckdb:duckdb 128681147 133576602 0.96
tpcds_q68/duckdb:duckdb 24040091 25781152 0.93
tpcds_q69/duckdb:duckdb 22430249 23332921 0.96
tpcds_q70/duckdb:duckdb 14039006 13936851 1.01
tpcds_q71/duckdb:duckdb 12413283 12808124 0.97
tpcds_q72/duckdb:duckdb 41316008 44926784 0.92
tpcds_q73/duckdb:duckdb 10241140 10693659 0.96
tpcds_q74/duckdb:duckdb 94419393 101114753 0.93
tpcds_q75/duckdb:duckdb 41328563 43383648 0.95
tpcds_q76/duckdb:duckdb 11874146 12850849 0.92
tpcds_q77/duckdb:duckdb 11430849 11993695 0.95
tpcds_q78/duckdb:duckdb 61590301 65383480 0.94
tpcds_q79/duckdb:duckdb 17143256 17910236 0.96
tpcds_q80/duckdb:duckdb 🚀 25825144 29381650 0.88
tpcds_q81/duckdb:duckdb 36540379 38371961 0.95
tpcds_q82/duckdb:duckdb 7957263 8792011 0.91
tpcds_q83/duckdb:duckdb 8961202 9205432 0.97
tpcds_q84/duckdb:duckdb 13315938 14629210 0.91
tpcds_q85/duckdb:duckdb 22294687 23560358 0.95
tpcds_q86/duckdb:duckdb 10060278 11140991 0.90
tpcds_q87/duckdb:duckdb 33415948 36932333 0.90
tpcds_q88/duckdb:duckdb 23801691 24500852 0.97
tpcds_q89/duckdb:duckdb 13093659 14200432 0.92
tpcds_q90/duckdb:duckdb 5309256 5792491 0.92
tpcds_q91/duckdb:duckdb 12729177 13662201 0.93
tpcds_q92/duckdb:duckdb 9600971 8995543 1.07
tpcds_q93/duckdb:duckdb 🚀 20692651 23718497 0.87
tpcds_q94/duckdb:duckdb 13204319 13505069 0.98
tpcds_q95/duckdb:duckdb 🚀 104168329 134166176 0.78
tpcds_q96/duckdb:duckdb 4520561 4692966 0.96
tpcds_q97/duckdb:duckdb 30113423 32208139 0.93
tpcds_q98/duckdb:duckdb 🚀 12837170 14431116 0.89
tpcds_q99/duckdb:duckdb 16040440 16391808 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.0% +1.4% -2.4% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -13.1% +1.4% -14.3% +10.0% ✅ faster
1 duckdb:duckdb -1.2% +1.4% -2.6% +15.8% ➖ noise
1 duckdb:vortex-compact -6.4% +1.4% -7.7% +12.3% ➖ noise
1 duckdb:vortex-file-compressed -6.4% +1.4% -7.8% +11.0% ➖ noise
2 datafusion:vortex-compact -2.0% -1.2% -0.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -10.7% -1.2% -9.7% +10.0% ✅ faster
2 duckdb:duckdb +3.2% -1.2% +4.4% +12.3% ➖ noise
2 duckdb:vortex-compact -1.2% -1.2% -0.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +6.0% -1.2% +7.2% +11.8% ➖ noise
3 datafusion:vortex-compact +3.6% -5.0% +9.0% +11.9% ➖ noise
3 datafusion:vortex-file-compressed -9.5% -5.0% -4.7% +11.0% ➖ noise
3 duckdb:duckdb -2.9% -5.0% +2.3% +19.4% ➖ noise
3 duckdb:vortex-compact -1.1% -5.0% +4.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.3% -5.0% +6.6% +15.5% ➖ noise
4 datafusion:vortex-compact +0.3% -4.5% +5.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.0% -4.5% +0.5% +10.0% ➖ noise
4 duckdb:duckdb +0.7% -4.5% +5.4% +10.0% ➖ noise
4 duckdb:vortex-compact +0.7% -4.5% +5.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.5% -4.5% +6.2% +12.1% ➖ noise
5 datafusion:vortex-compact -0.1% -6.1% +6.4% +11.4% ➖ noise
5 datafusion:vortex-file-compressed -13.3% -6.1% -7.7% +14.4% ➖ noise
5 duckdb:duckdb -10.3% -6.1% -4.5% +14.8% ➖ noise
5 duckdb:vortex-compact -0.4% -6.1% +6.1% +12.0% ➖ noise
5 duckdb:vortex-file-compressed -3.0% -6.1% +3.3% +10.3% ➖ noise
6 datafusion:vortex-compact -0.4% -2.8% +2.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -11.5% -2.8% -8.9% +10.0% ➖ noise
6 duckdb:duckdb -2.9% -2.8% -0.0% +13.3% ➖ noise
6 duckdb:vortex-compact -0.4% -2.8% +2.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.0% -2.8% +0.8% +10.0% ➖ noise
7 datafusion:vortex-compact -1.5% -1.1% -0.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -8.0% -1.1% -7.1% +10.0% ➖ noise
7 duckdb:duckdb -3.3% -1.1% -2.3% +15.9% ➖ noise
7 duckdb:vortex-compact +0.6% -1.1% +1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.7% -1.1% +1.8% +10.3% ➖ noise
8 datafusion:vortex-compact -2.6% -0.1% -2.5% +13.0% ➖ noise
8 datafusion:vortex-file-compressed -9.1% -0.1% -8.9% +13.5% ➖ noise
8 duckdb:duckdb +0.8% -0.1% +1.0% +12.2% ➖ noise
8 duckdb:vortex-compact -1.7% -0.1% -1.6% +13.1% ➖ noise
8 duckdb:vortex-file-compressed -0.1% -0.1% +0.1% +15.9% ➖ noise
9 datafusion:vortex-compact +2.0% +1.2% +0.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -6.7% +1.2% -7.8% +10.0% ➖ noise
9 duckdb:duckdb -0.5% +1.2% -1.7% +10.0% ➖ noise
9 duckdb:vortex-compact +0.1% +1.2% -1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -1.4% +1.2% -2.5% +10.0% ➖ noise
10 datafusion:vortex-compact -0.6% -2.7% +2.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -11.1% -2.7% -8.7% +10.0% ➖ noise
10 duckdb:duckdb -6.7% -2.7% -4.1% +10.3% ➖ noise
10 duckdb:vortex-compact +5.1% -2.7% +8.1% +12.3% ➖ noise
10 duckdb:vortex-file-compressed +6.0% -2.7% +9.0% +10.0% ➖ noise
11 datafusion:vortex-compact -4.7% -3.0% -1.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -6.2% -3.0% -3.3% +10.0% ➖ noise
11 duckdb:duckdb -2.3% -3.0% +0.8% +10.0% ➖ noise
11 duckdb:vortex-compact +0.5% -3.0% +3.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.3% -3.0% +1.8% +10.0% ➖ noise
12 datafusion:vortex-compact -3.8% +1.0% -4.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -10.8% +1.0% -11.7% +15.9% ➖ noise
12 duckdb:duckdb -5.5% +1.0% -6.4% +10.0% ➖ noise
12 duckdb:vortex-compact -1.6% +1.0% -2.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.9% +1.0% -2.9% +12.6% ➖ noise
13 datafusion:vortex-compact +1.5% -3.2% +4.9% +13.5% ➖ noise
13 datafusion:vortex-file-compressed -9.3% -3.2% -6.3% +10.0% ➖ noise
13 duckdb:duckdb +2.4% -3.2% +5.8% +10.7% ➖ noise
13 duckdb:vortex-compact +1.8% -3.2% +5.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.5% -3.2% +3.9% +10.0% ➖ noise
14 datafusion:vortex-compact -6.6% -5.7% -1.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -6.5% -5.7% -0.8% +10.0% ➖ noise
14 duckdb:duckdb -0.4% -5.7% +5.6% +10.0% ➖ noise
14 duckdb:vortex-compact -2.6% -5.7% +3.4% +11.9% ➖ noise
14 duckdb:vortex-file-compressed +1.4% -5.7% +7.5% +10.0% ➖ noise
15 datafusion:vortex-compact -9.9% -5.0% -5.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -10.0% -5.0% -5.3% +10.7% ➖ noise
15 duckdb:duckdb -3.0% -5.0% +2.1% +15.3% ➖ noise
15 duckdb:vortex-compact -3.4% -5.0% +1.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.1% -5.0% +5.1% +10.0% ➖ noise
16 datafusion:vortex-compact -4.1% -5.0% +1.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -11.7% -5.0% -7.0% +10.0% ➖ noise
16 duckdb:duckdb +4.7% -5.0% +10.3% +13.2% ➖ noise
16 duckdb:vortex-compact +2.8% -5.0% +8.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +2.4% -5.0% +7.8% +10.0% ➖ noise
17 datafusion:vortex-compact -4.8% -5.2% +0.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -10.0% -5.2% -5.1% +10.0% ➖ noise
17 duckdb:duckdb +1.2% -5.2% +6.7% +12.8% ➖ noise
17 duckdb:vortex-compact +1.3% -5.2% +6.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.5% -5.2% +7.1% +10.0% ➖ noise
18 datafusion:vortex-compact -7.7% -3.8% -4.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -12.4% -3.8% -8.9% +10.0% ➖ noise
18 duckdb:duckdb +1.7% -3.8% +5.7% +10.0% ➖ noise
18 duckdb:vortex-compact -2.0% -3.8% +1.9% +10.2% ➖ noise
18 duckdb:vortex-file-compressed -5.5% -3.8% -1.7% +10.0% ➖ noise
19 datafusion:vortex-compact -3.0% -4.4% +1.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -7.4% -4.4% -3.1% +11.2% ➖ noise
19 duckdb:duckdb +3.8% -4.4% +8.6% +10.0% ➖ noise
19 duckdb:vortex-compact +0.9% -4.4% +5.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.1% -4.4% +4.6% +12.8% ➖ noise
20 datafusion:vortex-compact -4.7% -4.9% +0.2% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -6.4% -4.9% -1.6% +10.0% ➖ noise
20 duckdb:duckdb -2.4% -4.9% +2.7% +10.0% ➖ noise
20 duckdb:vortex-compact +1.7% -4.9% +7.0% +11.5% ➖ noise
20 duckdb:vortex-file-compressed +6.2% -4.9% +11.7% +11.7% 🚨 regression
21 datafusion:vortex-compact -5.4% -0.7% -4.8% +15.2% ➖ noise
21 datafusion:vortex-file-compressed -9.7% -0.7% -9.1% +15.2% ➖ noise
21 duckdb:duckdb -6.1% -0.7% -5.5% +22.6% ➖ noise
21 duckdb:vortex-compact -5.6% -0.7% -5.0% +17.9% ➖ noise
21 duckdb:vortex-file-compressed -6.2% -0.7% -5.5% +22.0% ➖ noise
22 datafusion:vortex-compact -3.1% +4.6% -7.3% +10.9% ➖ noise
22 datafusion:vortex-file-compressed -15.7% +4.6% -19.5% +13.0% ✅ faster
22 duckdb:duckdb +1.2% +4.6% -3.2% +12.6% ➖ noise
22 duckdb:vortex-compact -1.1% +4.6% -5.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.7% +4.6% -5.0% +13.3% ➖ noise
23 datafusion:vortex-compact -3.3% -3.3% -0.0% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -3.7% -3.3% -0.5% +10.0% ➖ noise
23 duckdb:duckdb -11.0% -3.3% -7.9% +10.0% ➖ noise
23 duckdb:vortex-compact +0.4% -3.3% +3.9% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +1.5% -3.3% +4.9% +10.0% ➖ noise
24 datafusion:vortex-compact -3.0% -0.5% -2.5% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -7.2% -0.5% -6.7% +10.0% ➖ noise
24 duckdb:duckdb -1.5% -0.5% -1.0% +10.0% ➖ noise
24 duckdb:vortex-compact -1.0% -0.5% -0.5% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +3.8% -0.5% +4.3% +10.3% ➖ noise
25 datafusion:vortex-compact -0.2% -2.5% +2.3% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +1.0% -2.5% +3.5% +10.0% ➖ noise
25 duckdb:duckdb +4.4% -2.5% +7.0% +11.4% ➖ noise
25 duckdb:vortex-compact -0.0% -2.5% +2.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +3.4% -2.5% +6.0% +10.3% ➖ noise
26 datafusion:vortex-compact +0.2% -5.2% +5.8% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -2.6% -5.2% +2.8% +10.0% ➖ noise
26 duckdb:duckdb -9.0% -5.2% -3.9% +15.9% ➖ noise
26 duckdb:vortex-compact -0.7% -5.2% +4.8% +12.0% ➖ noise
26 duckdb:vortex-file-compressed -5.0% -5.2% +0.3% +10.0% ➖ noise
27 datafusion:vortex-compact -1.5% -2.6% +1.1% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -2.0% -2.6% +0.6% +10.0% ➖ noise
27 duckdb:duckdb -1.7% -2.6% +0.9% +16.1% ➖ noise
27 duckdb:vortex-compact -3.2% -2.6% -0.6% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -3.3% -2.6% -0.8% +10.0% ➖ noise
28 datafusion:vortex-compact -5.6% -2.1% -3.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -5.4% -2.1% -3.3% +10.0% ➖ noise
28 duckdb:duckdb +1.5% -2.1% +3.7% +10.0% ➖ noise
28 duckdb:vortex-compact +1.7% -2.1% +3.9% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +2.6% -2.1% +4.8% +10.0% ➖ noise
29 datafusion:vortex-compact +1.2% -1.8% +3.0% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.9% -1.8% +2.8% +10.0% ➖ noise
29 duckdb:duckdb -2.2% -1.8% -0.4% +10.1% ➖ noise
29 duckdb:vortex-compact +2.3% -1.8% +4.2% +10.9% ➖ noise
29 duckdb:vortex-file-compressed +4.8% -1.8% +6.7% +10.0% ➖ noise
30 datafusion:vortex-compact +0.6% -8.6% +10.1% +11.4% ➖ noise
30 datafusion:vortex-file-compressed -6.1% -8.6% +2.7% +10.0% ➖ noise
30 duckdb:duckdb +1.8% -8.6% +11.4% +11.3% 🚨 regression
30 duckdb:vortex-compact -0.4% -8.6% +8.9% +11.9% ➖ noise
30 duckdb:vortex-file-compressed -8.1% -8.6% +0.6% +12.8% ➖ noise
31 datafusion:vortex-compact -5.6% -2.0% -3.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.5% -2.0% +1.5% +10.0% ➖ noise
31 duckdb:duckdb +0.4% -2.0% +2.4% +12.8% ➖ noise
31 duckdb:vortex-compact +2.6% -2.0% +4.6% +10.7% ➖ noise
31 duckdb:vortex-file-compressed -3.8% -2.0% -1.9% +10.4% ➖ noise
32 datafusion:vortex-compact -6.8% -2.0% -4.9% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -1.2% -2.0% +0.8% +10.0% ➖ noise
32 duckdb:duckdb -1.8% -2.0% +0.1% +11.0% ➖ noise
32 duckdb:vortex-compact +3.8% -2.0% +5.9% +12.9% ➖ noise
32 duckdb:vortex-file-compressed +1.4% -2.0% +3.4% +10.0% ➖ noise
33 datafusion:vortex-compact -4.5% -1.8% -2.7% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.9% -1.8% +2.8% +10.0% ➖ noise
33 duckdb:duckdb -6.9% -1.8% -5.2% +10.0% ➖ noise
33 duckdb:vortex-compact -4.9% -1.8% -3.1% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -2.2% -1.8% -0.4% +11.5% ➖ noise
34 datafusion:vortex-compact -4.9% -6.2% +1.4% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +4.7% -6.2% +11.7% +10.0% 🚨 regression
34 duckdb:duckdb +7.7% -6.2% +14.9% +14.8% 🚨 regression
34 duckdb:vortex-compact +2.4% -6.2% +9.2% +11.4% ➖ noise
34 duckdb:vortex-file-compressed -4.1% -6.2% +2.3% +10.9% ➖ noise
35 datafusion:vortex-compact -2.7% -4.2% +1.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -4.2% -4.2% +0.1% +10.0% ➖ noise
35 duckdb:duckdb -6.5% -4.2% -2.4% +17.6% ➖ noise
35 duckdb:vortex-compact -4.4% -4.2% -0.2% +10.8% ➖ noise
35 duckdb:vortex-file-compressed -0.5% -4.2% +3.9% +10.0% ➖ noise
36 datafusion:vortex-compact -0.9% -4.0% +3.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -0.9% -4.0% +3.2% +10.0% ➖ noise
36 duckdb:duckdb -4.6% -4.0% -0.6% +10.9% ➖ noise
36 duckdb:vortex-compact -0.9% -4.0% +3.3% +10.2% ➖ noise
36 duckdb:vortex-file-compressed -3.8% -4.0% +0.3% +10.4% ➖ noise
37 datafusion:vortex-compact -1.2% -10.0% +9.9% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -0.3% -10.0% +10.8% +15.0% ➖ noise
37 duckdb:duckdb -7.9% -10.0% +2.4% +12.5% ➖ noise
37 duckdb:vortex-compact -5.3% -10.0% +5.3% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +4.7% -10.0% +16.3% +11.7% 🚨 regression
38 datafusion:vortex-compact -3.2% -4.3% +1.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -5.9% -4.3% -1.7% +10.0% ➖ noise
38 duckdb:duckdb -0.7% -4.3% +3.7% +12.7% ➖ noise
38 duckdb:vortex-compact -6.6% -4.3% -2.4% +14.0% ➖ noise
38 duckdb:vortex-file-compressed +2.3% -4.3% +6.9% +18.9% ➖ noise
39 datafusion:vortex-compact -4.3% -15.8% +13.7% +13.7% ➖ noise
39 datafusion:vortex-file-compressed +6.8% -15.8% +26.9% +15.9% 🚨 regression
39 duckdb:duckdb +0.6% -15.8% +19.5% +16.5% 🚨 regression
39 duckdb:vortex-compact +0.8% -15.8% +19.7% +17.9% 🚨 regression
39 duckdb:vortex-file-compressed -1.5% -15.8% +17.0% +11.5% 🚨 regression
40 datafusion:vortex-compact -6.3% -6.0% -0.3% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -5.9% -6.0% +0.1% +10.0% ➖ noise
40 duckdb:duckdb -3.8% -6.0% +2.4% +15.3% ➖ noise
40 duckdb:vortex-compact -1.6% -6.0% +4.7% +12.5% ➖ noise
40 duckdb:vortex-file-compressed -7.9% -6.0% -1.9% +14.8% ➖ noise
41 datafusion:vortex-compact -3.0% -7.2% +4.5% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -3.1% -7.2% +4.4% +12.2% ➖ noise
41 duckdb:duckdb -4.8% -7.2% +2.5% +12.2% ➖ noise
41 duckdb:vortex-compact +2.6% -7.2% +10.5% +12.8% ➖ noise
41 duckdb:vortex-file-compressed -3.7% -7.2% +3.8% +10.0% ➖ noise
42 datafusion:vortex-compact -2.4% -3.6% +1.2% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -7.7% -3.6% -4.2% +10.0% ➖ noise
42 duckdb:duckdb +2.3% -3.6% +6.1% +12.5% ➖ noise
42 duckdb:vortex-compact +4.2% -3.6% +8.1% +11.7% ➖ noise
42 duckdb:vortex-file-compressed +1.9% -3.6% +5.7% +19.7% ➖ noise
43 datafusion:vortex-compact -2.6% -5.6% +3.2% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -0.6% -5.6% +5.4% +10.0% ➖ noise
43 duckdb:duckdb -6.3% -5.6% -0.7% +10.0% ➖ noise
43 duckdb:vortex-compact -0.6% -5.6% +5.4% +10.0% ➖ noise
43 duckdb:vortex-file-compressed +3.3% -5.6% +9.4% +26.0% ➖ noise
44 datafusion:vortex-compact -1.6% -5.6% +4.2% +10.0% ➖ noise
44 datafusion:vortex-file-compressed -5.3% -5.6% +0.4% +10.0% ➖ noise
44 duckdb:duckdb -3.0% -5.6% +2.8% +12.7% ➖ noise
44 duckdb:vortex-compact +1.0% -5.6% +7.0% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -2.9% -5.6% +2.8% +12.1% ➖ noise
45 datafusion:vortex-compact -5.1% -5.8% +0.7% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -2.3% -5.8% +3.7% +10.0% ➖ noise
45 duckdb:duckdb -3.7% -5.8% +2.2% +10.0% ➖ noise
45 duckdb:vortex-compact +0.4% -5.8% +6.6% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -3.3% -5.8% +2.6% +10.0% ➖ noise
46 datafusion:vortex-compact -4.6% -5.1% +0.6% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -12.2% -5.1% -7.4% +10.0% ➖ noise
46 duckdb:duckdb -4.5% -5.1% +0.7% +10.0% ➖ noise
46 duckdb:vortex-compact -0.1% -5.1% +5.3% +10.0% ➖ noise
46 duckdb:vortex-file-compressed -5.0% -5.1% +0.2% +10.4% ➖ noise
47 datafusion:vortex-compact -4.2% -5.0% +0.9% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -5.1% -5.0% -0.1% +10.0% ➖ noise
47 duckdb:duckdb -1.8% -5.0% +3.4% +10.0% ➖ noise
47 duckdb:vortex-compact -0.9% -5.0% +4.4% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +0.2% -5.0% +5.5% +10.0% ➖ noise
48 datafusion:vortex-compact +5.1% -6.1% +11.8% +14.7% ➖ noise
48 datafusion:vortex-file-compressed -3.3% -6.1% +2.9% +15.4% ➖ noise
48 duckdb:duckdb +1.1% -6.1% +7.6% +13.6% ➖ noise
48 duckdb:vortex-compact -2.5% -6.1% +3.8% +18.2% ➖ noise
48 duckdb:vortex-file-compressed +2.3% -6.1% +8.9% +16.6% ➖ noise
49 datafusion:vortex-compact -6.3% -4.4% -1.9% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -3.4% -4.4% +1.1% +10.0% ➖ noise
49 duckdb:duckdb -8.6% -4.4% -4.4% +12.5% ➖ noise
49 duckdb:vortex-compact +1.2% -4.4% +5.8% +10.0% ➖ noise
49 duckdb:vortex-file-compressed -5.1% -4.4% -0.7% +11.0% ➖ noise
50 datafusion:vortex-compact -2.7% -4.9% +2.3% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -8.9% -4.9% -4.2% +10.0% ➖ noise
50 duckdb:duckdb -2.4% -4.9% +2.7% +10.0% ➖ noise
50 duckdb:vortex-compact -2.9% -4.9% +2.2% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -2.6% -4.9% +2.4% +10.0% ➖ noise
51 datafusion:vortex-compact -2.0% -6.6% +4.9% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -2.9% -6.6% +3.9% +10.0% ➖ noise
51 duckdb:duckdb -2.0% -6.6% +4.9% +14.0% ➖ noise
51 duckdb:vortex-compact -2.4% -6.6% +4.4% +17.1% ➖ noise
51 duckdb:vortex-file-compressed -3.4% -6.6% +3.5% +24.1% ➖ noise
52 datafusion:vortex-compact -5.3% +0.1% -5.4% +13.2% ➖ noise
52 datafusion:vortex-file-compressed -9.9% +0.1% -10.0% +11.7% ➖ noise
52 duckdb:duckdb -3.5% +0.1% -3.6% +14.9% ➖ noise
52 duckdb:vortex-compact -3.1% +0.1% -3.1% +12.0% ➖ noise
52 duckdb:vortex-file-compressed +0.1% +0.1% +0.1% +17.7% ➖ noise
53 datafusion:vortex-compact -0.9% -5.3% +4.7% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -4.7% -5.3% +0.7% +10.0% ➖ noise
53 duckdb:duckdb -5.8% -5.3% -0.5% +11.0% ➖ noise
53 duckdb:vortex-compact -2.5% -5.3% +3.0% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +1.3% -5.3% +7.0% +12.1% ➖ noise
54 datafusion:vortex-compact -3.6% -4.5% +0.9% +10.0% ➖ noise
54 datafusion:vortex-file-compressed -4.6% -4.5% -0.2% +10.0% ➖ noise
54 duckdb:duckdb -5.9% -4.5% -1.5% +14.5% ➖ noise
54 duckdb:vortex-compact +1.5% -4.5% +6.2% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +2.8% -4.5% +7.6% +10.4% ➖ noise
55 datafusion:vortex-compact +2.2% -11.9% +16.0% +10.1% 🚨 regression
55 datafusion:vortex-file-compressed -3.0% -11.9% +10.1% +11.0% ➖ noise
55 duckdb:duckdb +0.9% -11.9% +14.5% +15.6% ➖ noise
55 duckdb:vortex-compact -3.9% -11.9% +9.1% +12.3% ➖ noise
55 duckdb:vortex-file-compressed +10.2% -11.9% +25.0% +13.8% 🚨 regression
56 datafusion:vortex-compact +2.6% -8.5% +12.2% +10.0% 🚨 regression
56 datafusion:vortex-file-compressed +0.7% -8.5% +10.1% +10.0% 🚨 regression
56 duckdb:duckdb -10.9% -8.5% -2.6% +10.6% ➖ noise
56 duckdb:vortex-compact -2.9% -8.5% +6.1% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +4.6% -8.5% +14.3% +11.4% 🚨 regression
57 datafusion:vortex-compact -2.3% -4.2% +1.9% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -6.0% -4.2% -2.0% +10.0% ➖ noise
57 duckdb:duckdb -5.8% -4.2% -1.7% +17.6% ➖ noise
57 duckdb:vortex-compact -2.9% -4.2% +1.3% +10.0% ➖ noise
57 duckdb:vortex-file-compressed -18.7% -4.2% -15.2% +21.9% ➖ noise
58 datafusion:vortex-compact +1.7% -6.0% +8.2% +14.5% ➖ noise
58 datafusion:vortex-file-compressed -7.0% -6.0% -1.1% +13.3% ➖ noise
58 duckdb:duckdb -3.4% -6.0% +2.7% +19.0% ➖ noise
58 duckdb:vortex-compact +11.5% -6.0% +18.6% +21.0% ➖ noise
58 duckdb:vortex-file-compressed -4.8% -6.0% +1.3% +19.8% ➖ noise
59 datafusion:vortex-compact -3.0% -3.8% +0.8% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -8.5% -3.8% -5.0% +10.0% ➖ noise
59 duckdb:duckdb -2.4% -3.8% +1.4% +13.3% ➖ noise
59 duckdb:vortex-compact +1.4% -3.8% +5.4% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -3.7% -3.8% +0.1% +10.0% ➖ noise
60 datafusion:vortex-compact -6.1% -4.7% -1.5% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -2.1% -4.7% +2.7% +14.4% ➖ noise
60 duckdb:duckdb -15.4% -4.7% -11.2% +19.3% ➖ noise
60 duckdb:vortex-compact -2.1% -4.7% +2.7% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +6.6% -4.7% +11.8% +14.0% ➖ noise
61 datafusion:vortex-compact -0.3% -2.2% +2.0% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -7.7% -2.2% -5.5% +10.0% ➖ noise
61 duckdb:duckdb -8.3% -2.2% -6.2% +10.1% ➖ noise
61 duckdb:vortex-compact -0.4% -2.2% +1.9% +11.0% ➖ noise
61 duckdb:vortex-file-compressed +0.0% -2.2% +2.3% +13.1% ➖ noise
62 datafusion:vortex-compact -6.6% -4.3% -2.5% +10.1% ➖ noise
62 datafusion:vortex-file-compressed -9.2% -4.3% -5.2% +10.0% ➖ noise
62 duckdb:duckdb -2.8% -4.3% +1.6% +20.0% ➖ noise
62 duckdb:vortex-compact +30.6% -4.3% +36.4% +26.4% 🚨 regression
62 duckdb:vortex-file-compressed -10.0% -4.3% -5.9% +23.9% ➖ noise
63 datafusion:vortex-compact -5.3% -5.1% -0.2% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -10.4% -5.1% -5.7% +11.8% ➖ noise
63 duckdb:duckdb -4.0% -5.1% +1.1% +10.0% ➖ noise
63 duckdb:vortex-compact +3.0% -5.1% +8.4% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +2.5% -5.1% +8.0% +13.9% ➖ noise
64 datafusion:vortex-compact -3.3% -5.5% +2.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -3.4% -5.5% +2.2% +10.0% ➖ noise
64 duckdb:duckdb -1.2% -5.5% +4.5% +10.0% ➖ noise
64 duckdb:vortex-compact -0.6% -5.5% +5.2% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -1.6% -5.5% +4.1% +10.0% ➖ noise
65 datafusion:vortex-compact -7.5% -5.6% -2.0% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -1.0% -5.6% +4.9% +10.3% ➖ noise
65 duckdb:duckdb -3.7% -5.6% +2.0% +13.5% ➖ noise
65 duckdb:vortex-compact +3.7% -5.6% +9.8% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -5.1% -5.6% +0.5% +10.0% ➖ noise
66 datafusion:vortex-compact -4.4% +2.7% -6.9% +12.4% ➖ noise
66 datafusion:vortex-file-compressed +0.7% +2.7% -1.9% +12.4% ➖ noise
66 duckdb:duckdb -8.7% +2.7% -11.1% +11.6% ✅ faster
66 duckdb:vortex-compact -1.9% +2.7% -4.5% +17.2% ➖ noise
66 duckdb:vortex-file-compressed +7.9% +2.7% +5.1% +19.0% ➖ noise
67 datafusion:vortex-compact -4.7% -6.9% +2.4% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -7.9% -6.9% -1.1% +10.0% ➖ noise
67 duckdb:duckdb -3.7% -6.9% +3.4% +10.0% ➖ noise
67 duckdb:vortex-compact -0.0% -6.9% +7.3% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +1.2% -6.9% +8.7% +10.0% ➖ noise
68 datafusion:vortex-compact -2.3% -4.3% +2.0% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -4.2% -4.3% +0.0% +10.0% ➖ noise
68 duckdb:duckdb -6.8% -4.3% -2.6% +10.6% ➖ noise
68 duckdb:vortex-compact -1.7% -4.3% +2.7% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -2.0% -4.3% +2.3% +10.0% ➖ noise
69 datafusion:vortex-compact -3.2% -6.3% +3.4% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -3.8% -6.3% +2.7% +10.0% ➖ noise
69 duckdb:duckdb -3.9% -6.3% +2.6% +12.6% ➖ noise
69 duckdb:vortex-compact -1.9% -6.3% +4.7% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -0.9% -6.3% +5.8% +14.0% ➖ noise
70 datafusion:vortex-compact -0.9% -7.3% +6.9% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +0.7% -7.3% +8.6% +10.2% ➖ noise
70 duckdb:duckdb +0.7% -7.3% +8.7% +15.0% ➖ noise
70 duckdb:vortex-compact +1.2% -7.3% +9.2% +10.9% ➖ noise
70 duckdb:vortex-file-compressed -3.3% -7.3% +4.4% +10.0% ➖ noise
71 datafusion:vortex-compact +1.0% -2.9% +4.0% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -6.0% -2.9% -3.3% +10.9% ➖ noise
71 duckdb:duckdb -3.1% -2.9% -0.2% +14.8% ➖ noise
71 duckdb:vortex-compact -3.3% -2.9% -0.5% +12.9% ➖ noise
71 duckdb:vortex-file-compressed +4.0% -2.9% +7.1% +17.5% ➖ noise
72 datafusion:vortex-compact -2.7% -4.1% +1.4% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -2.4% -4.1% +1.7% +10.0% ➖ noise
72 duckdb:duckdb -8.0% -4.1% -4.1% +12.0% ➖ noise
72 duckdb:vortex-compact -1.8% -4.1% +2.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.5% -4.1% +3.7% +10.0% ➖ noise
73 datafusion:vortex-compact -0.9% -5.0% +4.3% +12.0% ➖ noise
73 datafusion:vortex-file-compressed +3.5% -5.0% +9.0% +13.0% ➖ noise
73 duckdb:duckdb -4.2% -5.0% +0.9% +13.1% ➖ noise
73 duckdb:vortex-compact +0.9% -5.0% +6.2% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +1.1% -5.0% +6.5% +10.0% ➖ noise
74 datafusion:vortex-compact -1.6% -6.6% +5.3% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +0.6% -6.6% +7.7% +10.0% ➖ noise
74 duckdb:duckdb -6.6% -6.6% -0.0% +10.0% ➖ noise
74 duckdb:vortex-compact -1.5% -6.6% +5.4% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -0.7% -6.6% +6.3% +10.0% ➖ noise
75 datafusion:vortex-compact -1.2% -4.2% +3.1% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -0.3% -4.2% +4.1% +10.0% ➖ noise
75 duckdb:duckdb -4.7% -4.2% -0.6% +10.0% ➖ noise
75 duckdb:vortex-compact -2.0% -4.2% +2.2% +10.0% ➖ noise
75 duckdb:vortex-file-compressed -1.4% -4.2% +2.9% +10.4% ➖ noise
76 datafusion:vortex-compact -2.4% -5.7% +3.5% +10.3% ➖ noise
76 datafusion:vortex-file-compressed -1.7% -5.7% +4.2% +10.0% ➖ noise
76 duckdb:duckdb -7.6% -5.7% -2.1% +18.9% ➖ noise
76 duckdb:vortex-compact +3.0% -5.7% +9.1% +10.0% ➖ noise
76 duckdb:vortex-file-compressed +0.9% -5.7% +7.0% +37.9% ➖ noise
77 datafusion:vortex-compact -9.8% -5.7% -4.4% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -0.9% -5.7% +5.0% +10.0% ➖ noise
77 duckdb:duckdb -4.7% -5.7% +1.0% +18.9% ➖ noise
77 duckdb:vortex-compact +6.9% -5.7% +13.3% +10.0% 🚨 regression
77 duckdb:vortex-file-compressed -0.3% -5.7% +5.7% +10.6% ➖ noise
78 datafusion:vortex-compact -2.2% -5.8% +3.9% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -2.1% -5.8% +4.0% +10.0% ➖ noise
78 duckdb:duckdb -5.8% -5.8% +0.0% +12.0% ➖ noise
78 duckdb:vortex-compact -2.7% -5.8% +3.3% +11.6% ➖ noise
78 duckdb:vortex-file-compressed -0.1% -5.8% +6.1% +10.0% ➖ noise
79 datafusion:vortex-compact +5.0% -4.2% +9.6% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -3.8% -4.2% +0.5% +13.1% ➖ noise
79 duckdb:duckdb -4.3% -4.2% -0.1% +10.5% ➖ noise
79 duckdb:vortex-compact -0.5% -4.2% +3.9% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +0.7% -4.2% +5.2% +10.0% ➖ noise
80 datafusion:vortex-compact -0.8% -3.6% +2.8% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +0.6% -3.6% +4.4% +10.0% ➖ noise
80 duckdb:duckdb -12.1% -3.6% -8.8% +13.0% ➖ noise
80 duckdb:vortex-compact -3.6% -3.6% -0.0% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -4.0% -3.6% -0.4% +10.0% ➖ noise
81 datafusion:vortex-compact -3.6% -6.2% +2.8% +12.5% ➖ noise
81 datafusion:vortex-file-compressed -11.1% -6.2% -5.2% +10.0% ➖ noise
81 duckdb:duckdb -4.8% -6.2% +1.6% +10.0% ➖ noise
81 duckdb:vortex-compact -5.6% -6.2% +0.7% +11.0% ➖ noise
81 duckdb:vortex-file-compressed +1.4% -6.2% +8.2% +10.0% ➖ noise
82 datafusion:vortex-compact +2.8% -2.9% +5.8% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -8.0% -2.9% -5.2% +10.0% ➖ noise
82 duckdb:duckdb -9.5% -2.9% -6.8% +13.8% ➖ noise
82 duckdb:vortex-compact -6.6% -2.9% -3.8% +12.8% ➖ noise
82 duckdb:vortex-file-compressed -0.4% -2.9% +2.5% +13.1% ➖ noise
83 datafusion:vortex-compact +4.6% -2.8% +7.6% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -3.9% -2.8% -1.1% +10.0% ➖ noise
83 duckdb:duckdb -2.7% -2.8% +0.1% +11.3% ➖ noise
83 duckdb:vortex-compact -6.5% -2.8% -3.9% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +2.7% -2.8% +5.6% +10.0% ➖ noise
84 datafusion:vortex-compact -2.0% -7.2% +5.6% +14.9% ➖ noise
84 datafusion:vortex-file-compressed -1.4% -7.2% +6.3% +11.1% ➖ noise
84 duckdb:duckdb -9.0% -7.2% -1.9% +10.0% ➖ noise
84 duckdb:vortex-compact -6.8% -7.2% +0.5% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +4.1% -7.2% +12.2% +26.7% ➖ noise
85 datafusion:vortex-compact -0.9% -9.8% +9.8% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -1.3% -9.8% +9.4% +10.0% ➖ noise
85 duckdb:duckdb -5.4% -9.8% +4.9% +10.0% ➖ noise
85 duckdb:vortex-compact -9.3% -9.8% +0.5% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +2.0% -9.8% +13.1% +10.0% 🚨 regression
86 datafusion:vortex-compact -4.7% -8.7% +4.4% +14.4% ➖ noise
86 datafusion:vortex-file-compressed -5.5% -8.7% +3.4% +15.7% ➖ noise
86 duckdb:duckdb -9.7% -8.7% -1.1% +17.5% ➖ noise
86 duckdb:vortex-compact -5.8% -8.7% +3.1% +16.8% ➖ noise
86 duckdb:vortex-file-compressed -4.1% -8.7% +5.0% +16.7% ➖ noise
87 datafusion:vortex-compact +1.9% -6.4% +8.8% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +0.8% -6.4% +7.7% +10.0% ➖ noise
87 duckdb:duckdb -9.5% -6.4% -3.4% +14.9% ➖ noise
87 duckdb:vortex-compact +5.2% -6.4% +12.4% +18.1% ➖ noise
87 duckdb:vortex-file-compressed -0.7% -6.4% +6.0% +14.2% ➖ noise
88 datafusion:vortex-compact -1.7% -1.3% -0.3% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -0.5% -1.3% +0.8% +10.0% ➖ noise
88 duckdb:duckdb -2.9% -1.3% -1.5% +14.9% ➖ noise
88 duckdb:vortex-compact -3.7% -1.3% -2.4% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +0.2% -1.3% +1.5% +10.0% ➖ noise
89 datafusion:vortex-compact -5.0% -6.5% +1.6% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -1.0% -6.5% +5.9% +10.0% ➖ noise
89 duckdb:duckdb -7.8% -6.5% -1.4% +13.1% ➖ noise
89 duckdb:vortex-compact -2.3% -6.5% +4.5% +17.6% ➖ noise
89 duckdb:vortex-file-compressed +2.8% -6.5% +10.0% +12.6% ➖ noise
90 datafusion:vortex-compact -4.0% -3.3% -0.8% +10.0% ➖ noise
90 datafusion:vortex-file-compressed -0.8% -3.3% +2.5% +10.0% ➖ noise
90 duckdb:duckdb -8.3% -3.3% -5.2% +10.7% ➖ noise
90 duckdb:vortex-compact +0.8% -3.3% +4.2% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -5.5% -3.3% -2.3% +11.4% ➖ noise
91 datafusion:vortex-compact -7.1% -5.3% -1.9% +11.2% ➖ noise
91 datafusion:vortex-file-compressed +2.1% -5.3% +7.9% +10.0% ➖ noise
91 duckdb:duckdb -6.8% -5.3% -1.6% +15.9% ➖ noise
91 duckdb:vortex-compact -4.4% -5.3% +1.0% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +5.1% -5.3% +11.0% +10.0% 🚨 regression
92 datafusion:vortex-compact -1.2% -4.6% +3.5% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -1.5% -4.6% +3.2% +10.9% ➖ noise
92 duckdb:duckdb +6.7% -4.6% +11.9% +13.8% ➖ noise
92 duckdb:vortex-compact -3.5% -4.6% +1.1% +14.7% ➖ noise
92 duckdb:vortex-file-compressed -6.4% -4.6% -1.9% +14.5% ➖ noise
93 datafusion:vortex-compact -4.1% -5.3% +1.3% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +2.1% -5.3% +7.7% +10.0% ➖ noise
93 duckdb:duckdb -12.8% -5.3% -7.9% +14.2% ➖ noise
93 duckdb:vortex-compact -3.8% -5.3% +1.5% +10.6% ➖ noise
93 duckdb:vortex-file-compressed -0.6% -5.3% +5.0% +13.2% ➖ noise
94 datafusion:vortex-compact -7.5% -7.2% -0.3% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +3.1% -7.2% +11.2% +10.0% 🚨 regression
94 duckdb:duckdb -2.2% -7.2% +5.4% +12.8% ➖ noise
94 duckdb:vortex-compact -2.3% -7.2% +5.3% +10.0% ➖ noise
94 duckdb:vortex-file-compressed -1.8% -7.2% +5.9% +14.1% ➖ noise
95 datafusion:vortex-compact -4.6% -11.6% +7.9% +11.3% ➖ noise
95 datafusion:vortex-file-compressed +2.4% -11.6% +15.9% +12.6% 🚨 regression
95 duckdb:duckdb -22.4% -11.6% -12.2% +20.0% ➖ noise
95 duckdb:vortex-compact -1.2% -11.6% +11.7% +17.3% ➖ noise
95 duckdb:vortex-file-compressed +2.7% -11.6% +16.2% +18.3% ➖ noise
96 datafusion:vortex-compact -3.0% -6.4% +3.6% +10.1% ➖ noise
96 datafusion:vortex-file-compressed -3.2% -6.4% +3.4% +11.6% ➖ noise
96 duckdb:duckdb -3.7% -6.4% +2.9% +14.4% ➖ noise
96 duckdb:vortex-compact +1.0% -6.4% +7.9% +23.0% ➖ noise
96 duckdb:vortex-file-compressed -1.9% -6.4% +4.9% +23.4% ➖ noise
97 datafusion:vortex-compact -4.3% -6.5% +2.4% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -0.7% -6.5% +6.2% +10.0% ➖ noise
97 duckdb:duckdb -6.5% -6.5% +0.0% +10.0% ➖ noise
97 duckdb:vortex-compact +7.9% -6.5% +15.4% +19.1% ➖ noise
97 duckdb:vortex-file-compressed -5.0% -6.5% +1.6% +10.0% ➖ noise
98 datafusion:vortex-compact -0.7% -4.4% +3.9% +10.0% ➖ noise
98 datafusion:vortex-file-compressed -3.5% -4.4% +1.0% +10.0% ➖ noise
98 duckdb:duckdb -11.0% -4.4% -6.9% +11.6% ➖ noise
98 duckdb:vortex-compact -0.5% -4.4% +4.1% +10.0% ➖ noise
98 duckdb:vortex-file-compressed -3.1% -4.4% +1.4% +10.3% ➖ noise
99 datafusion:vortex-compact -3.9% -6.2% +2.5% +10.0% ➖ noise
99 datafusion:vortex-file-compressed -2.3% -6.2% +4.2% +10.0% ➖ noise
99 duckdb:duckdb -2.1% -6.2% +4.4% +29.6% ➖ noise
99 duckdb:vortex-compact -4.9% -6.2% +1.4% +13.6% ➖ noise
99 duckdb:vortex-file-compressed +0.2% -6.2% +6.9% +28.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.6%
Vortex (geomean): 0.906x ➖
Parquet (geomean): 0.903x ➖
Shifts: Parquet (control) -9.7% · Median polish -7.3%


datafusion / vortex-file-compressed (0.855x ✅, 21↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 391924916 444764351 0.88
tpch_q02/datafusion:vortex-file-compressed 🚀 112521415 136085474 0.83
tpch_q03/datafusion:vortex-file-compressed 🚀 200379726 240233953 0.83
tpch_q04/datafusion:vortex-file-compressed 🚀 97631556 118162909 0.83
tpch_q05/datafusion:vortex-file-compressed 🚀 373474260 446006052 0.84
tpch_q06/datafusion:vortex-file-compressed 🚀 41139297 47099868 0.87
tpch_q07/datafusion:vortex-file-compressed 🚀 554125946 644970694 0.86
tpch_q08/datafusion:vortex-file-compressed 🚀 372635666 441776648 0.84
tpch_q09/datafusion:vortex-file-compressed 🚀 651051476 771308256 0.84
tpch_q10/datafusion:vortex-file-compressed 🚀 237662448 278731179 0.85
tpch_q11/datafusion:vortex-file-compressed 🚀 84285611 100504148 0.84
tpch_q12/datafusion:vortex-file-compressed 🚀 103640944 124970984 0.83
tpch_q13/datafusion:vortex-file-compressed 🚀 214006384 255312373 0.84
tpch_q14/datafusion:vortex-file-compressed 🚀 57366113 63752086 0.90
tpch_q15/datafusion:vortex-file-compressed 🚀 106466414 121808500 0.87
tpch_q16/datafusion:vortex-file-compressed 🚀 74766699 87166089 0.86
tpch_q17/datafusion:vortex-file-compressed 🚀 637489344 755406835 0.84
tpch_q18/datafusion:vortex-file-compressed 🚀 862446438 1030515388 0.84
tpch_q19/datafusion:vortex-file-compressed 91642692 99352746 0.92
tpch_q20/datafusion:vortex-file-compressed 🚀 168456124 193169591 0.87
tpch_q21/datafusion:vortex-file-compressed 🚀 652497563 760702543 0.86
tpch_q22/datafusion:vortex-file-compressed 🚀 59003372 67481317 0.87
datafusion / vortex-compact (0.923x ➖, 3↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 449854595 481405144 0.93
tpch_q02/datafusion:vortex-compact 118669175 130435489 0.91
tpch_q03/datafusion:vortex-compact 🚀 213771475 239826982 0.89
tpch_q04/datafusion:vortex-compact 🚀 116630340 131061868 0.89
tpch_q05/datafusion:vortex-compact 387242687 421972465 0.92
tpch_q06/datafusion:vortex-compact 61850261 67686902 0.91
tpch_q07/datafusion:vortex-compact 🚀 575497607 651355019 0.88
tpch_q08/datafusion:vortex-compact 379687376 417657624 0.91
tpch_q09/datafusion:vortex-compact 669524859 720758012 0.93
tpch_q10/datafusion:vortex-compact 265175755 290124864 0.91
tpch_q11/datafusion:vortex-compact 90575758 94817101 0.96
tpch_q12/datafusion:vortex-compact 163530662 172408015 0.95
tpch_q13/datafusion:vortex-compact 265662925 295062990 0.90
tpch_q14/datafusion:vortex-compact 72847083 77170847 0.94
tpch_q15/datafusion:vortex-compact 161408053 176836393 0.91
tpch_q16/datafusion:vortex-compact 80079322 85407643 0.94
tpch_q17/datafusion:vortex-compact 640438893 692845579 0.92
tpch_q18/datafusion:vortex-compact 870516440 935687190 0.93
tpch_q19/datafusion:vortex-compact 127620475 135590055 0.94
tpch_q20/datafusion:vortex-compact 195471579 203610963 0.96
tpch_q21/datafusion:vortex-compact 689649952 750541456 0.92
tpch_q22/datafusion:vortex-compact 71698563 75630277 0.95
datafusion / parquet (0.856x ✅, 20↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 420679535 474543895 0.89
tpch_q02/datafusion:parquet 🚀 184469151 208481141 0.88
tpch_q03/datafusion:parquet 🚀 291206494 361561608 0.81
tpch_q04/datafusion:parquet 🚀 130875582 162215847 0.81
tpch_q05/datafusion:parquet 🚀 437942827 544349483 0.80
tpch_q06/datafusion:parquet 🚀 125269605 143886861 0.87
tpch_q07/datafusion:parquet 🚀 618326585 741342759 0.83
tpch_q08/datafusion:parquet 🚀 478865649 569521178 0.84
tpch_q09/datafusion:parquet 🚀 743965382 878761593 0.85
tpch_q10/datafusion:parquet 🚀 495753081 565747416 0.88
tpch_q11/datafusion:parquet 🚀 129310641 150926417 0.86
tpch_q12/datafusion:parquet 212909729 230324901 0.92
tpch_q13/datafusion:parquet 🚀 332777108 373061439 0.89
tpch_q14/datafusion:parquet 🚀 159558711 180975479 0.88
tpch_q15/datafusion:parquet 🚀 238258725 292138376 0.82
tpch_q16/datafusion:parquet 🚀 134759349 153328289 0.88
tpch_q17/datafusion:parquet 🚀 671473959 821653905 0.82
tpch_q18/datafusion:parquet 🚀 865157259 1033591861 0.84
tpch_q19/datafusion:parquet 🚀 267823702 309131095 0.87
tpch_q20/datafusion:parquet 🚀 302401150 351443740 0.86
tpch_q21/datafusion:parquet 🚀 725073123 882637492 0.82
tpch_q22/datafusion:parquet 213698304 229252318 0.93
datafusion / arrow (0.949x ➖, 5↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 583895755 581336858 1.00
tpch_q02/datafusion:arrow 159272261 161024924 0.99
tpch_q03/datafusion:arrow 433068982 437767855 0.99
tpch_q04/datafusion:arrow 327069363 326509625 1.00
tpch_q05/datafusion:arrow 859031879 853308031 1.01
tpch_q06/datafusion:arrow 255571235 252753174 1.01
tpch_q07/datafusion:arrow 1073094847 1058749499 1.01
tpch_q08/datafusion:arrow 1070565150 1065338287 1.00
tpch_q09/datafusion:arrow 1274752466 1278844223 1.00
tpch_q10/datafusion:arrow 564372265 586133842 0.96
tpch_q11/datafusion:arrow 144457050 148480016 0.97
tpch_q12/datafusion:arrow 632342973 633306575 1.00
tpch_q13/datafusion:arrow 512272748 504981885 1.01
tpch_q14/datafusion:arrow 285741691 295950584 0.97
tpch_q15/datafusion:arrow 602332926 643339539 0.94
tpch_q16/datafusion:arrow 103065274 113027869 0.91
tpch_q17/datafusion:arrow 🚀 1265560684 1557091302 0.81
tpch_q18/datafusion:arrow 🚀 1766007043 2147213137 0.82
tpch_q19/datafusion:arrow 🚀 471364138 564459167 0.84
tpch_q20/datafusion:arrow 460853555 483354034 0.95
tpch_q21/datafusion:arrow 🚀 2681203384 3120463067 0.86
tpch_q22/datafusion:arrow 🚀 140751224 163845401 0.86
duckdb / vortex-file-compressed (0.932x ➖, 2↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176068678 186975203 0.94
tpch_q02/duckdb:vortex-file-compressed 51922367 56984560 0.91
tpch_q03/duckdb:vortex-file-compressed 🚀 124427547 138671421 0.90
tpch_q04/duckdb:vortex-file-compressed 144430528 160183807 0.90
tpch_q05/duckdb:vortex-file-compressed 130898344 141159991 0.93
tpch_q06/duckdb:vortex-file-compressed 🚀 47513866 54609965 0.87
tpch_q07/duckdb:vortex-file-compressed 142471375 155853724 0.91
tpch_q08/duckdb:vortex-file-compressed 174743771 186303142 0.94
tpch_q09/duckdb:vortex-file-compressed 334425877 346712123 0.96
tpch_q10/duckdb:vortex-file-compressed 149528708 160552950 0.93
tpch_q11/duckdb:vortex-file-compressed 35388860 37782560 0.94
tpch_q12/duckdb:vortex-file-compressed 88134857 90851368 0.97
tpch_q13/duckdb:vortex-file-compressed 245925224 256395314 0.96
tpch_q14/duckdb:vortex-file-compressed 67100801 71932532 0.93
tpch_q15/duckdb:vortex-file-compressed 95194177 101106481 0.94
tpch_q16/duckdb:vortex-file-compressed 78834731 81778347 0.96
tpch_q17/duckdb:vortex-file-compressed 101530853 105377451 0.96
tpch_q18/duckdb:vortex-file-compressed 278744022 306075696 0.91
tpch_q19/duckdb:vortex-file-compressed 91808095 95096325 0.97
tpch_q20/duckdb:vortex-file-compressed 161035092 175522041 0.92
tpch_q21/duckdb:vortex-file-compressed 549557924 596697792 0.92
tpch_q22/duckdb:vortex-file-compressed 75787987 80770979 0.94
duckdb / vortex-compact (0.917x ➖, 5↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 229128646 232359244 0.99
tpch_q02/duckdb:vortex-compact 58862674 62477101 0.94
tpch_q03/duckdb:vortex-compact 🚀 136335130 154608199 0.88
tpch_q04/duckdb:vortex-compact 170977381 189231934 0.90
tpch_q05/duckdb:vortex-compact 🚀 140657910 156934757 0.90
tpch_q06/duckdb:vortex-compact 81300547 87807183 0.93
tpch_q07/duckdb:vortex-compact 197179629 214305081 0.92
tpch_q08/duckdb:vortex-compact 187106987 204957515 0.91
tpch_q09/duckdb:vortex-compact 359678714 392448033 0.92
tpch_q10/duckdb:vortex-compact 🚀 181338851 206083756 0.88
tpch_q11/duckdb:vortex-compact 41641998 45296170 0.92
tpch_q12/duckdb:vortex-compact 200032758 218033324 0.92
tpch_q13/duckdb:vortex-compact 🚀 290550178 323148165 0.90
tpch_q14/duckdb:vortex-compact 101132293 111831803 0.90
tpch_q15/duckdb:vortex-compact 116287505 128622094 0.90
tpch_q16/duckdb:vortex-compact 83747784 89443266 0.94
tpch_q17/duckdb:vortex-compact 117917548 125914787 0.94
tpch_q18/duckdb:vortex-compact 🚀 290799378 330741304 0.88
tpch_q19/duckdb:vortex-compact 113312365 121648968 0.93
tpch_q20/duckdb:vortex-compact 203880159 225627848 0.90
tpch_q21/duckdb:vortex-compact 620623493 660972271 0.94
tpch_q22/duckdb:vortex-compact 88685298 93070873 0.95
duckdb / parquet (0.954x ➖, 1↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 258789128 271019514 0.95
tpch_q02/duckdb:parquet 🚀 96783181 109087386 0.89
tpch_q03/duckdb:parquet 209882681 219752807 0.96
tpch_q04/duckdb:parquet 136189982 142786301 0.95
tpch_q05/duckdb:parquet 216917890 230782502 0.94
tpch_q06/duckdb:parquet 68468410 71230021 0.96
tpch_q07/duckdb:parquet 179917300 192064996 0.94
tpch_q08/duckdb:parquet 253485875 268695072 0.94
tpch_q09/duckdb:parquet 457547180 487135974 0.94
tpch_q10/duckdb:parquet 605415495 628180174 0.96
tpch_q11/duckdb:parquet 44029174 46749951 0.94
tpch_q12/duckdb:parquet 126809627 129784354 0.98
tpch_q13/duckdb:parquet 453503832 478302467 0.95
tpch_q14/duckdb:parquet 178580163 177976063 1.00
tpch_q15/duckdb:parquet 97131414 103997671 0.93
tpch_q16/duckdb:parquet 141757174 145322925 0.98
tpch_q17/duckdb:parquet 180536060 182193117 0.99
tpch_q18/duckdb:parquet 344769070 358996156 0.96
tpch_q19/duckdb:parquet 281738173 301844789 0.93
tpch_q20/duckdb:parquet 229938829 235530593 0.98
tpch_q21/duckdb:parquet 572793229 604605922 0.95
tpch_q22/duckdb:parquet 290358724 299068121 0.97
duckdb / duckdb (0.991x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116714645 117118026 1.00
tpch_q02/duckdb:duckdb 48917785 48030888 1.02
tpch_q03/duckdb:duckdb 96429568 98134392 0.98
tpch_q04/duckdb:duckdb 130887612 134425425 0.97
tpch_q05/duckdb:duckdb 108328656 112556633 0.96
tpch_q06/duckdb:duckdb 39207405 36791404 1.07
tpch_q07/duckdb:duckdb 86051019 87116990 0.99
tpch_q08/duckdb:duckdb 109619621 114146275 0.96
tpch_q09/duckdb:duckdb 273416323 281696108 0.97
tpch_q10/duckdb:duckdb 204267409 205489331 0.99
tpch_q11/duckdb:duckdb 15589865 15844995 0.98
tpch_q12/duckdb:duckdb 82853419 85039456 0.97
tpch_q13/duckdb:duckdb 249757414 249450545 1.00
tpch_q14/duckdb:duckdb 69259765 70370068 0.98
tpch_q15/duckdb:duckdb 78507744 79408977 0.99
tpch_q16/duckdb:duckdb 73630461 74004198 0.99
tpch_q17/duckdb:duckdb 84312229 84812890 0.99
tpch_q18/duckdb:duckdb 213670713 215381309 0.99
tpch_q19/duckdb:duckdb 114798238 121301254 0.95
tpch_q20/duckdb:duckdb 111116034 110959436 1.00
tpch_q21/duckdb:duckdb 303746608 302672289 1.00
tpch_q22/duckdb:duckdb 70814053 68717288 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.4% -8.0% +9.2% +10.9% ➖ noise
1 datafusion:vortex-compact -6.6% -8.0% +1.6% +11.7% ➖ noise
1 datafusion:vortex-file-compressed -11.9% -8.0% -4.2% +11.4% ➖ noise
1 duckdb:duckdb -0.3% -8.0% +8.3% +10.9% ➖ noise
1 duckdb:vortex-compact -1.4% -8.0% +7.2% +10.8% ➖ noise
1 duckdb:vortex-file-compressed -5.8% -8.0% +2.4% +11.3% ➖ noise
2 datafusion:arrow -1.1% -11.4% +11.6% +10.0% 🚨 regression
2 datafusion:vortex-compact -9.0% -11.4% +2.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -17.3% -11.4% -6.7% +10.0% ➖ noise
2 duckdb:duckdb +1.8% -11.4% +14.9% +13.1% 🚨 regression
2 duckdb:vortex-compact -5.8% -11.4% +6.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -8.9% -11.4% +2.8% +10.4% ➖ noise
3 datafusion:arrow -1.1% -12.3% +12.8% +10.0% 🚨 regression
3 datafusion:vortex-compact -10.9% -12.3% +1.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -16.6% -12.3% -4.9% +10.0% ➖ noise
3 duckdb:duckdb -1.7% -12.3% +12.0% +10.0% 🚨 regression
3 duckdb:vortex-compact -11.8% -12.3% +0.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -10.3% -12.3% +2.3% +10.0% ➖ noise
4 datafusion:arrow +0.2% -12.3% +14.2% +10.0% 🚨 regression
4 datafusion:vortex-compact -11.0% -12.3% +1.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -17.4% -12.3% -5.8% +10.0% ➖ noise
4 duckdb:duckdb -2.6% -12.3% +11.0% +10.0% 🚨 regression
4 duckdb:vortex-compact -9.6% -12.3% +3.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -9.8% -12.3% +2.8% +10.0% ➖ noise
5 datafusion:arrow +0.7% -13.0% +15.8% +10.0% 🚨 regression
5 datafusion:vortex-compact -8.2% -13.0% +5.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -16.3% -13.0% -3.7% +10.0% ➖ noise
5 duckdb:duckdb -3.8% -13.0% +10.7% +10.0% 🚨 regression
5 duckdb:vortex-compact -10.4% -13.0% +3.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -7.3% -13.0% +6.6% +10.0% ➖ noise
6 datafusion:arrow +1.1% -8.5% +10.5% +10.0% 🚨 regression
6 datafusion:vortex-compact -8.6% -8.5% -0.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -12.7% -8.5% -4.5% +10.0% ➖ noise
6 duckdb:duckdb +6.6% -8.5% +16.5% +13.9% 🚨 regression
6 duckdb:vortex-compact -7.4% -8.5% +1.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -13.0% -8.5% -4.9% +10.0% ➖ noise
7 datafusion:arrow +1.4% -11.6% +14.7% +10.0% 🚨 regression
7 datafusion:vortex-compact -11.6% -11.6% -0.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -14.1% -11.6% -2.8% +10.0% ➖ noise
7 duckdb:duckdb -1.2% -11.6% +11.7% +10.0% 🚨 regression
7 duckdb:vortex-compact -8.0% -11.6% +4.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -8.6% -11.6% +3.4% +10.0% ➖ noise
8 datafusion:arrow +0.5% -10.9% +12.8% +10.0% 🚨 regression
8 datafusion:vortex-compact -9.1% -10.9% +2.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -15.7% -10.9% -5.3% +10.0% ➖ noise
8 duckdb:duckdb -4.0% -10.9% +7.8% +10.0% ➖ noise
8 duckdb:vortex-compact -8.7% -10.9% +2.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -6.2% -10.9% +5.3% +10.0% ➖ noise
9 datafusion:arrow -0.3% -10.8% +11.8% +10.0% 🚨 regression
9 datafusion:vortex-compact -7.1% -10.8% +4.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -15.6% -10.8% -5.3% +10.0% ➖ noise
9 duckdb:duckdb -2.9% -10.8% +8.8% +10.0% ➖ noise
9 duckdb:vortex-compact -8.3% -10.8% +2.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.5% -10.8% +8.2% +10.0% ➖ noise
10 datafusion:arrow -3.7% -8.1% +4.8% +10.0% ➖ noise
10 datafusion:vortex-compact -8.6% -8.1% -0.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -14.7% -8.1% -7.2% +10.0% ➖ noise
10 duckdb:duckdb -0.6% -8.1% +8.2% +10.0% ➖ noise
10 duckdb:vortex-compact -12.0% -8.1% -4.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.9% -8.1% +1.3% +10.0% ➖ noise
11 datafusion:arrow -2.7% -10.2% +8.3% +10.0% ➖ noise
11 datafusion:vortex-compact -4.5% -10.2% +6.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -16.1% -10.2% -6.6% +10.0% ➖ noise
11 duckdb:duckdb -1.6% -10.2% +9.5% +15.5% ➖ noise
11 duckdb:vortex-compact -8.1% -10.2% +2.3% +15.8% ➖ noise
11 duckdb:vortex-file-compressed -6.3% -10.2% +4.3% +11.7% ➖ noise
12 datafusion:arrow -0.2% -5.0% +5.1% +47.2% ➖ noise
12 datafusion:vortex-compact -5.1% -5.0% -0.2% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -17.1% -5.0% -12.7% +10.0% ✅ faster
12 duckdb:duckdb -2.6% -5.0% +2.5% +10.0% ➖ noise
12 duckdb:vortex-compact -8.3% -5.0% -3.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -3.0% -5.0% +2.1% +10.0% ➖ noise
13 datafusion:arrow +1.4% -8.0% +10.3% +10.2% 🚨 regression
13 datafusion:vortex-compact -10.0% -8.0% -2.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -16.2% -8.0% -8.9% +10.0% ➖ noise
13 duckdb:duckdb +0.1% -8.0% +8.9% +10.0% ➖ noise
13 duckdb:vortex-compact -10.1% -8.0% -2.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -4.1% -8.0% +4.3% +10.0% ➖ noise
14 datafusion:arrow -3.4% -5.9% +2.7% +10.0% ➖ noise
14 datafusion:vortex-compact -5.6% -5.9% +0.4% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -10.0% -5.9% -4.3% +14.4% ➖ noise
14 duckdb:duckdb -1.6% -5.9% +4.6% +10.0% ➖ noise
14 duckdb:vortex-compact -9.6% -5.9% -3.9% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -6.7% -5.9% -0.8% +11.5% ➖ noise
15 datafusion:arrow -6.4% -12.7% +7.3% +10.0% ➖ noise
15 datafusion:vortex-compact -8.7% -12.7% +4.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -12.6% -12.7% +0.1% +10.0% ➖ noise
15 duckdb:duckdb -1.1% -12.7% +13.3% +10.0% 🚨 regression
15 duckdb:vortex-compact -9.6% -12.7% +3.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -5.8% -12.7% +7.9% +11.6% ➖ noise
16 datafusion:arrow -8.8% -7.4% -1.5% +11.3% ➖ noise
16 datafusion:vortex-compact -6.2% -7.4% +1.3% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -14.2% -7.4% -7.4% +10.1% ➖ noise
16 duckdb:duckdb -0.5% -7.4% +7.5% +10.0% ➖ noise
16 duckdb:vortex-compact -6.4% -7.4% +1.1% +10.4% ➖ noise
16 duckdb:vortex-file-compressed -3.6% -7.4% +4.1% +10.0% ➖ noise
17 datafusion:arrow -18.7% -10.0% -9.7% +10.0% ✅ faster
17 datafusion:vortex-compact -7.6% -10.0% +2.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -15.6% -10.0% -6.2% +11.5% ➖ noise
17 duckdb:duckdb -0.6% -10.0% +10.5% +10.0% 🚨 regression
17 duckdb:vortex-compact -6.4% -10.0% +4.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -3.7% -10.0% +7.1% +10.0% ➖ noise
18 datafusion:arrow -17.8% -10.3% -8.3% +10.0% ➖ noise
18 datafusion:vortex-compact -7.0% -10.3% +3.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -16.3% -10.3% -6.7% +10.0% ➖ noise
18 duckdb:duckdb -0.8% -10.3% +10.6% +10.0% 🚨 regression
18 duckdb:vortex-compact -12.1% -10.3% -1.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -8.9% -10.3% +1.6% +10.0% ➖ noise
19 datafusion:arrow -16.5% -10.1% -7.1% +10.0% ➖ noise
19 datafusion:vortex-compact -5.9% -10.1% +4.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -7.8% -10.1% +2.6% +10.0% ➖ noise
19 duckdb:duckdb -5.4% -10.1% +5.2% +10.0% ➖ noise
19 duckdb:vortex-compact -6.9% -10.1% +3.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -3.5% -10.1% +7.4% +10.0% ➖ noise
20 datafusion:arrow -4.7% -8.3% +4.0% +10.0% ➖ noise
20 datafusion:vortex-compact -4.0% -8.3% +4.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -12.8% -8.3% -4.9% +10.0% ➖ noise
20 duckdb:duckdb +0.1% -8.3% +9.3% +10.0% ➖ noise
20 duckdb:vortex-compact -9.6% -8.3% -1.4% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -8.3% -8.3% +0.1% +10.0% ➖ noise
21 datafusion:arrow -14.1% -11.8% -2.6% +10.0% ➖ noise
21 datafusion:vortex-compact -8.1% -11.8% +4.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -14.2% -11.8% -2.8% +10.0% ➖ noise
21 duckdb:duckdb +0.4% -11.8% +13.8% +10.0% 🚨 regression
21 duckdb:vortex-compact -6.1% -11.8% +6.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -7.9% -11.8% +4.4% +10.0% ➖ noise
22 datafusion:arrow -14.1% -4.9% -9.7% +10.0% ✅ faster
22 datafusion:vortex-compact -5.2% -4.9% -0.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -12.6% -4.9% -8.1% +10.0% ➖ noise
22 duckdb:duckdb +3.1% -4.9% +8.3% +14.2% ➖ noise
22 duckdb:vortex-compact -4.7% -4.9% +0.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -6.2% -4.9% -1.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +11.1%
Vortex (geomean): 0.985x ➖
Parquet (geomean): 0.886x ➖
Shifts: Parquet (control) -11.4% · Median polish +0.4%


datafusion / vortex-file-compressed (0.892x ➖, 1↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 32110156 49658141 0.65
fineweb_q01/datafusion:vortex-file-compressed 581299666 546885219 1.06
fineweb_q02/datafusion:vortex-file-compressed 699031015 953528778 0.73
fineweb_q03/datafusion:vortex-file-compressed 1369947448 1401109230 0.98
fineweb_q04/datafusion:vortex-file-compressed 1381743945 1414789642 0.98
fineweb_q05/datafusion:vortex-file-compressed 1356184008 1375554467 0.99
fineweb_q06/datafusion:vortex-file-compressed 1505141003 1635918688 0.92
fineweb_q07/datafusion:vortex-file-compressed 1321799048 1478085145 0.89
fineweb_q08/datafusion:vortex-file-compressed 531048943 580869407 0.91
datafusion / vortex-compact (0.963x ➖, 2↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 36589156 32062105 1.14
fineweb_q01/datafusion:vortex-compact 🚀 533162267 782640117 0.68
fineweb_q02/datafusion:vortex-compact 🚀 648302209 1032458980 0.63
fineweb_q03/datafusion:vortex-compact 1986767018 1827460675 1.09
fineweb_q04/datafusion:vortex-compact 2432927580 2191061199 1.11
fineweb_q05/datafusion:vortex-compact 1839712111 1686725471 1.09
fineweb_q06/datafusion:vortex-compact 1504950241 1447792917 1.04
fineweb_q07/datafusion:vortex-compact 1403783684 1284882819 1.09
fineweb_q08/datafusion:vortex-compact 382773602 390457682 0.98
datafusion / parquet (0.805x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 964554371 1340467935 0.72
fineweb_q01/datafusion:parquet 1774377142 1973071349 0.90
fineweb_q02/datafusion:parquet 1888247983 2367054343 0.80
fineweb_q03/datafusion:parquet 1742774406 2377524317 0.73
fineweb_q04/datafusion:parquet 1737601781 2319803370 0.75
fineweb_q05/datafusion:parquet 2100911262 2267971987 0.93
fineweb_q06/datafusion:parquet 1825998520 2362144718 0.77
fineweb_q07/datafusion:parquet 1716113930 1842208155 0.93
fineweb_q08/datafusion:parquet 1736355018 2319228763 0.75
duckdb / vortex-file-compressed (1.034x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 104826707 101009020 1.04
fineweb_q01/duckdb:vortex-file-compressed 559158966 729028289 0.77
fineweb_q02/duckdb:vortex-file-compressed 485094539 446537395 1.09
fineweb_q03/duckdb:vortex-file-compressed 1615864393 1511928048 1.07
fineweb_q04/duckdb:vortex-file-compressed 1827243641 1479194191 1.24
fineweb_q05/duckdb:vortex-file-compressed 1655046710 1504763343 1.10
fineweb_q06/duckdb:vortex-file-compressed 1800570102 1687792693 1.07
fineweb_q07/duckdb:vortex-file-compressed 1567798686 1482321471 1.06
fineweb_q08/duckdb:vortex-file-compressed 637232291 667183750 0.96
duckdb / vortex-compact (1.059x ➖, 1↑ 1↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 82922955 59729892 1.39
fineweb_q01/duckdb:vortex-compact 555558275 533329799 1.04
fineweb_q02/duckdb:vortex-compact 🚀 562934391 923643182 0.61
fineweb_q03/duckdb:vortex-compact 1875400904 1671532390 1.12
fineweb_q04/duckdb:vortex-compact 1963060077 1657899268 1.18
fineweb_q05/duckdb:vortex-compact 1732401202 1508080503 1.15
fineweb_q06/duckdb:vortex-compact 1707308540 1481200426 1.15
fineweb_q07/duckdb:vortex-compact 1411515839 1325075293 1.07
fineweb_q08/duckdb:vortex-compact 471924613 464425594 1.02
duckdb / parquet (0.976x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1067850818 1098864168 0.97
fineweb_q01/duckdb:parquet 1588031166 1668392378 0.95
fineweb_q02/duckdb:parquet 1613792893 1637626719 0.99
fineweb_q03/duckdb:parquet 4116795092 4147683824 0.99
fineweb_q04/duckdb:parquet 1928115848 2106164967 0.92
fineweb_q05/duckdb:parquet 2836367764 2635760304 1.08
fineweb_q06/duckdb:parquet 3289501530 3435170114 0.96
fineweb_q07/duckdb:parquet 3942789858 4272896046 0.92
fineweb_q08/duckdb:parquet 1104413780 1080916761 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +14.1% -16.4% +36.5% +218.7% ➖ noise
0 datafusion:vortex-file-compressed -35.3% -16.4% -22.7% +216.7% ➖ noise
0 duckdb:vortex-compact +38.8% -16.4% +66.0% +58.4% 🚨 regression
0 duckdb:vortex-file-compressed +3.8% -16.4% +24.1% +50.1% ➖ noise
1 datafusion:vortex-compact -31.9% -7.5% -26.4% +81.7% ➖ noise
1 datafusion:vortex-file-compressed +6.3% -7.5% +14.9% +90.3% ➖ noise
1 duckdb:vortex-compact +4.2% -7.5% +12.6% +53.3% ➖ noise
1 duckdb:vortex-file-compressed -23.3% -7.5% -17.1% +53.6% ➖ noise
2 datafusion:vortex-compact -37.2% -11.3% -29.2% +30.0% ✅ faster
2 datafusion:vortex-file-compressed -26.7% -11.3% -17.3% +78.5% ➖ noise
2 duckdb:vortex-compact -39.1% -11.3% -31.3% +58.8% ➖ noise
2 duckdb:vortex-file-compressed +8.6% -11.3% +22.5% +30.0% ➖ noise
3 datafusion:vortex-compact +8.7% -14.7% +27.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -2.2% -14.7% +14.6% +30.0% ➖ noise
3 duckdb:vortex-compact +12.2% -14.7% +31.5% +67.6% ➖ noise
3 duckdb:vortex-file-compressed +6.9% -14.7% +25.3% +30.0% ➖ noise
4 datafusion:vortex-compact +11.0% -17.2% +34.1% +30.0% 🚨 regression
4 datafusion:vortex-file-compressed -2.3% -17.2% +17.9% +30.0% ➖ noise
4 duckdb:vortex-compact +18.4% -17.2% +43.0% +30.0% 🚨 regression
4 duckdb:vortex-file-compressed +23.5% -17.2% +49.2% +30.0% 🚨 regression
5 datafusion:vortex-compact +9.1% -0.2% +9.2% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.4% -0.2% -1.3% +30.0% ➖ noise
5 duckdb:vortex-compact +14.9% -0.2% +15.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +10.0% -0.2% +10.2% +30.0% ➖ noise
6 datafusion:vortex-compact +3.9% -14.0% +20.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -8.0% -14.0% +6.9% +30.0% ➖ noise
6 duckdb:vortex-compact +15.3% -14.0% +34.0% +30.0% 🚨 regression
6 duckdb:vortex-file-compressed +6.7% -14.0% +24.0% +30.0% ➖ noise
7 datafusion:vortex-compact +9.3% -7.3% +17.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -10.6% -7.3% -3.5% +30.0% ➖ noise
7 duckdb:vortex-compact +6.5% -7.3% +14.9% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +5.8% -7.3% +14.1% +30.0% ➖ noise
8 datafusion:vortex-compact -2.0% -12.5% +12.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -8.6% -12.5% +4.5% +32.4% ➖ noise
8 duckdb:vortex-compact +1.6% -12.5% +16.2% +31.8% ➖ noise
8 duckdb:vortex-file-compressed -4.5% -12.5% +9.2% +38.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 0.860x ➖
Parquet (geomean): 0.859x ➖
Shifts: Parquet (control) -14.1% · Median polish -9.3%


datafusion / vortex-file-compressed (0.677x ✅, 13↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 212686407 329243960 0.65
tpch_q02/datafusion:vortex-file-compressed 424840015 581951099 0.73
tpch_q03/datafusion:vortex-file-compressed 394969700 516264720 0.77
tpch_q04/datafusion:vortex-file-compressed 227608915 309043988 0.74
tpch_q05/datafusion:vortex-file-compressed 🚀 438064110 781110904 0.56
tpch_q06/datafusion:vortex-file-compressed 276814174 393801257 0.70
tpch_q07/datafusion:vortex-file-compressed 🚀 374002697 622999301 0.60
tpch_q08/datafusion:vortex-file-compressed 🚀 524095826 925925847 0.57
tpch_q09/datafusion:vortex-file-compressed 🚀 333189537 796589836 0.42
tpch_q10/datafusion:vortex-file-compressed 🚀 465249875 680540747 0.68
tpch_q11/datafusion:vortex-file-compressed 🚀 299946610 443862981 0.68
tpch_q12/datafusion:vortex-file-compressed 🚀 346642082 549259075 0.63
tpch_q13/datafusion:vortex-file-compressed 218288946 273904388 0.80
tpch_q14/datafusion:vortex-file-compressed 198128462 263919046 0.75
tpch_q15/datafusion:vortex-file-compressed 🚀 344276180 520602218 0.66
tpch_q16/datafusion:vortex-file-compressed 281703135 291648919 0.97
tpch_q17/datafusion:vortex-file-compressed 🚀 380225818 566347918 0.67
tpch_q18/datafusion:vortex-file-compressed 🚀 285838857 457599556 0.62
tpch_q19/datafusion:vortex-file-compressed 🚀 340107883 551120285 0.62
tpch_q20/datafusion:vortex-file-compressed 330347954 445849718 0.74
tpch_q21/datafusion:vortex-file-compressed 453253205 494126903 0.92
tpch_q22/datafusion:vortex-file-compressed 🚀 145376431 229449161 0.63
datafusion / vortex-compact (0.871x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 244380305 279786387 0.87
tpch_q02/datafusion:vortex-compact 443597747 465959782 0.95
tpch_q03/datafusion:vortex-compact 392690458 402871446 0.97
tpch_q04/datafusion:vortex-compact 261671624 225739091 1.16
tpch_q05/datafusion:vortex-compact 431299103 404949683 1.07
tpch_q06/datafusion:vortex-compact 299949803 349464931 0.86
tpch_q07/datafusion:vortex-compact 374043282 417192091 0.90
tpch_q08/datafusion:vortex-compact 492516577 591508188 0.83
tpch_q09/datafusion:vortex-compact 405260414 506597006 0.80
tpch_q10/datafusion:vortex-compact 428955543 517956001 0.83
tpch_q11/datafusion:vortex-compact 256771596 311876044 0.82
tpch_q12/datafusion:vortex-compact 382645696 472979506 0.81
tpch_q13/datafusion:vortex-compact 205832287 277148624 0.74
tpch_q14/datafusion:vortex-compact 237572235 324457721 0.73
tpch_q15/datafusion:vortex-compact 435051503 513907071 0.85
tpch_q16/datafusion:vortex-compact 181658677 204571739 0.89
tpch_q17/datafusion:vortex-compact 313861294 381579141 0.82
tpch_q18/datafusion:vortex-compact 263925684 309032996 0.85
tpch_q19/datafusion:vortex-compact 447785816 496375214 0.90
tpch_q20/datafusion:vortex-compact 444858920 480226365 0.93
tpch_q21/datafusion:vortex-compact 493554257 522824372 0.94
tpch_q22/datafusion:vortex-compact 135958037 181828569 0.75
datafusion / parquet (0.776x ➖, 7↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 232050968 222072402 1.04
tpch_q02/datafusion:parquet 498270229 480821768 1.04
tpch_q03/datafusion:parquet 314450204 342803369 0.92
tpch_q04/datafusion:parquet 181885780 171420560 1.06
tpch_q05/datafusion:parquet 497893423 520259680 0.96
tpch_q06/datafusion:parquet 131994454 174078155 0.76
tpch_q07/datafusion:parquet 489164982 566593710 0.86
tpch_q08/datafusion:parquet 651972325 640696242 1.02
tpch_q09/datafusion:parquet 496953985 494599874 1.00
tpch_q10/datafusion:parquet 553183969 660539992 0.84
tpch_q11/datafusion:parquet 358055043 332348411 1.08
tpch_q12/datafusion:parquet 🚀 266581735 427021149 0.62
tpch_q13/datafusion:parquet 433659802 578453665 0.75
tpch_q14/datafusion:parquet 187615859 222455641 0.84
tpch_q15/datafusion:parquet 339617805 459691966 0.74
tpch_q16/datafusion:parquet 🚀 197011404 281536543 0.70
tpch_q17/datafusion:parquet 🚀 376829476 719323230 0.52
tpch_q18/datafusion:parquet 🚀 459919204 687259083 0.67
tpch_q19/datafusion:parquet 🚀 326100150 806662920 0.40
tpch_q20/datafusion:parquet 🚀 312823138 846509830 0.37
tpch_q21/datafusion:parquet 556446023 657251368 0.85
tpch_q22/datafusion:parquet 🚀 115310741 166546371 0.69
duckdb / vortex-file-compressed (0.963x ➖, 1↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 272103167 287786717 0.95
tpch_q02/duckdb:vortex-file-compressed 873656456 922595059 0.95
tpch_q03/duckdb:vortex-file-compressed 613551457 712801983 0.86
tpch_q04/duckdb:vortex-file-compressed 410670104 408348674 1.01
tpch_q05/duckdb:vortex-file-compressed 916115589 962834237 0.95
tpch_q06/duckdb:vortex-file-compressed 423084711 371553692 1.14
tpch_q07/duckdb:vortex-file-compressed 670776030 709395538 0.95
tpch_q08/duckdb:vortex-file-compressed 998403946 996495387 1.00
tpch_q09/duckdb:vortex-file-compressed 905322253 941252655 0.96
tpch_q10/duckdb:vortex-file-compressed 735095835 798299410 0.92
tpch_q11/duckdb:vortex-file-compressed 462623229 506942078 0.91
tpch_q12/duckdb:vortex-file-compressed 504115199 468928505 1.08
tpch_q13/duckdb:vortex-file-compressed 471452382 482479845 0.98
tpch_q14/duckdb:vortex-file-compressed 453550773 539738219 0.84
tpch_q15/duckdb:vortex-file-compressed 279977772 255769727 1.09
tpch_q16/duckdb:vortex-file-compressed 419711533 362142205 1.16
tpch_q17/duckdb:vortex-file-compressed 🚀 628154767 930491886 0.68
tpch_q18/duckdb:vortex-file-compressed 666856147 570089665 1.17
tpch_q19/duckdb:vortex-file-compressed 543701861 520051828 1.05
tpch_q20/duckdb:vortex-file-compressed 769901656 919287668 0.84
tpch_q21/duckdb:vortex-file-compressed 1158924654 1201262024 0.96
tpch_q22/duckdb:vortex-file-compressed 353942798 387278441 0.91
duckdb / vortex-compact (0.965x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 300897302 272720237 1.10
tpch_q02/duckdb:vortex-compact 876366989 890287567 0.98
tpch_q03/duckdb:vortex-compact 650785089 725981469 0.90
tpch_q04/duckdb:vortex-compact 378673052 414434735 0.91
tpch_q05/duckdb:vortex-compact 846931627 850410098 1.00
tpch_q06/duckdb:vortex-compact 354833468 443651064 0.80
tpch_q07/duckdb:vortex-compact 778572517 711118323 1.09
tpch_q08/duckdb:vortex-compact 868343913 937915217 0.93
tpch_q09/duckdb:vortex-compact 913633419 1146962279 0.80
tpch_q10/duckdb:vortex-compact 691588384 710171165 0.97
tpch_q11/duckdb:vortex-compact 486246848 458881332 1.06
tpch_q12/duckdb:vortex-compact 471884435 463826911 1.02
tpch_q13/duckdb:vortex-compact 453356722 609673484 0.74
tpch_q14/duckdb:vortex-compact 492796735 563694046 0.87
tpch_q15/duckdb:vortex-compact 317679525 312992415 1.01
tpch_q16/duckdb:vortex-compact 330789038 347088570 0.95
tpch_q17/duckdb:vortex-compact 678266735 633548754 1.07
tpch_q18/duckdb:vortex-compact 490649300 483854856 1.01
tpch_q19/duckdb:vortex-compact 454588083 416504771 1.09
tpch_q20/duckdb:vortex-compact 805979385 913300143 0.88
tpch_q21/duckdb:vortex-compact 1131274287 1017077480 1.11
tpch_q22/duckdb:vortex-compact 366274095 351113948 1.04
duckdb / parquet (0.950x ➖, 1↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚀 532801457 868253528 0.61
tpch_q02/duckdb:parquet 1359984070 1424969233 0.95
tpch_q03/duckdb:parquet 1004103743 1033824985 0.97
tpch_q04/duckdb:parquet 628734735 688499670 0.91
tpch_q05/duckdb:parquet 1725349359 1570053293 1.10
tpch_q06/duckdb:parquet 471610342 463598132 1.02
tpch_q07/duckdb:parquet 1325503750 1353555283 0.98
tpch_q08/duckdb:parquet 1657574152 1757827791 0.94
tpch_q09/duckdb:parquet 1491528128 1699277807 0.88
tpch_q10/duckdb:parquet 1329801547 1631729584 0.81
tpch_q11/duckdb:parquet 896851753 835882868 1.07
tpch_q12/duckdb:parquet 681026411 789289687 0.86
tpch_q13/duckdb:parquet 970530906 930467749 1.04
tpch_q14/duckdb:parquet 655265967 693753202 0.94
tpch_q15/duckdb:parquet 560618964 542826393 1.03
tpch_q16/duckdb:parquet 581506999 576105007 1.01
tpch_q17/duckdb:parquet 799430373 754185945 1.06
tpch_q18/duckdb:parquet 870911646 941685739 0.92
tpch_q19/duckdb:parquet 826059649 737655953 1.12
tpch_q20/duckdb:parquet 1121530909 1093558860 1.03
tpch_q21/duckdb:parquet 1295135911 1231940018 1.05
tpch_q22/duckdb:parquet 584996597 782891192 0.75
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -12.7% -19.9% +9.1% +149.8% ➖ noise
1 datafusion:vortex-file-compressed -35.4% -19.9% -19.3% +141.4% ➖ noise
1 duckdb:vortex-compact +10.3% -19.9% +37.8% +54.3% ➖ noise
1 duckdb:vortex-file-compressed -5.4% -19.9% +18.1% +62.0% ➖ noise
2 datafusion:vortex-compact -4.8% -0.6% -4.3% +49.3% ➖ noise
2 datafusion:vortex-file-compressed -27.0% -0.6% -26.6% +56.1% ➖ noise
2 duckdb:vortex-compact -1.6% -0.6% -1.0% +44.8% ➖ noise
2 duckdb:vortex-file-compressed -5.3% -0.6% -4.8% +44.8% ➖ noise
3 datafusion:vortex-compact -2.5% -5.6% +3.3% +73.0% ➖ noise
3 datafusion:vortex-file-compressed -23.5% -5.6% -18.9% +105.0% ➖ noise
3 duckdb:vortex-compact -10.4% -5.6% -5.0% +63.7% ➖ noise
3 duckdb:vortex-file-compressed -13.9% -5.6% -8.8% +44.8% ➖ noise
4 datafusion:vortex-compact +15.9% -1.6% +17.8% +44.8% ➖ noise
4 datafusion:vortex-file-compressed -26.4% -1.6% -25.2% +44.8% ➖ noise
4 duckdb:vortex-compact -8.6% -1.6% -7.2% +44.8% ➖ noise
4 duckdb:vortex-file-compressed +0.6% -1.6% +2.2% +44.8% ➖ noise
5 datafusion:vortex-compact +6.5% +2.6% +3.9% +55.1% ➖ noise
5 datafusion:vortex-file-compressed -43.9% +2.6% -45.3% +44.8% ✅ faster
5 duckdb:vortex-compact -0.4% +2.6% -2.9% +44.8% ➖ noise
5 duckdb:vortex-file-compressed -4.9% +2.6% -7.2% +44.8% ➖ noise
6 datafusion:vortex-compact -14.2% -12.2% -2.3% +44.8% ➖ noise
6 datafusion:vortex-file-compressed -29.7% -12.2% -20.0% +44.8% ➖ noise
6 duckdb:vortex-compact -20.0% -12.2% -8.9% +95.5% ➖ noise
6 duckdb:vortex-file-compressed +13.9% -12.2% +29.7% +44.8% ➖ noise
7 datafusion:vortex-compact -10.3% -8.1% -2.5% +44.8% ➖ noise
7 datafusion:vortex-file-compressed -40.0% -8.1% -34.7% +44.8% ✅ faster
7 duckdb:vortex-compact +9.5% -8.1% +19.1% +44.8% ➖ noise
7 duckdb:vortex-file-compressed -5.4% -8.1% +2.8% +44.8% ➖ noise
8 datafusion:vortex-compact -16.7% -2.0% -15.0% +54.7% ➖ noise
8 datafusion:vortex-file-compressed -43.4% -2.0% -42.2% +44.8% ✅ faster
8 duckdb:vortex-compact -7.4% -2.0% -5.5% +44.8% ➖ noise
8 duckdb:vortex-file-compressed +0.2% -2.0% +2.3% +44.8% ➖ noise
9 datafusion:vortex-compact -20.0% -6.1% -14.8% +61.1% ➖ noise
9 datafusion:vortex-file-compressed -58.2% -6.1% -55.5% +44.8% ✅ faster
9 duckdb:vortex-compact -20.3% -6.1% -15.2% +44.8% ➖ noise
9 duckdb:vortex-file-compressed -3.8% -6.1% +2.4% +44.8% ➖ noise
10 datafusion:vortex-compact -17.2% -17.4% +0.2% +44.8% ➖ noise
10 datafusion:vortex-file-compressed -31.6% -17.4% -17.2% +44.8% ➖ noise
10 duckdb:vortex-compact -2.6% -17.4% +17.9% +44.8% ➖ noise
10 duckdb:vortex-file-compressed -7.9% -17.4% +11.5% +44.8% ➖ noise
11 datafusion:vortex-compact -17.7% +7.5% -23.4% +44.8% ➖ noise
11 datafusion:vortex-file-compressed -32.4% +7.5% -37.1% +44.8% ✅ faster
11 duckdb:vortex-compact +6.0% +7.5% -1.4% +44.8% ➖ noise
11 duckdb:vortex-file-compressed -8.7% +7.5% -15.1% +44.8% ➖ noise
12 datafusion:vortex-compact -19.1% -26.6% +10.2% +44.8% ➖ noise
12 datafusion:vortex-file-compressed -36.9% -26.6% -14.0% +44.8% ➖ noise
12 duckdb:vortex-compact +1.7% -26.6% +38.6% +44.8% ➖ noise
12 duckdb:vortex-file-compressed +7.5% -26.6% +46.5% +44.8% 🚨 regression
13 datafusion:vortex-compact -25.7% -11.6% -16.0% +61.2% ➖ noise
13 datafusion:vortex-file-compressed -20.3% -11.6% -9.9% +68.9% ➖ noise
13 duckdb:vortex-compact -25.6% -11.6% -15.9% +44.8% ➖ noise
13 duckdb:vortex-file-compressed -2.3% -11.6% +10.5% +44.8% ➖ noise
14 datafusion:vortex-compact -26.8% -10.7% -18.0% +44.8% ➖ noise
14 datafusion:vortex-file-compressed -24.9% -10.7% -15.9% +44.8% ➖ noise
14 duckdb:vortex-compact -12.6% -10.7% -2.0% +44.8% ➖ noise
14 duckdb:vortex-file-compressed -16.0% -10.7% -5.8% +44.8% ➖ noise
15 datafusion:vortex-compact -15.3% -12.6% -3.1% +44.8% ➖ noise
15 datafusion:vortex-file-compressed -33.9% -12.6% -24.3% +44.8% ➖ noise
15 duckdb:vortex-compact +1.5% -12.6% +16.2% +44.8% ➖ noise
15 duckdb:vortex-file-compressed +9.5% -12.6% +25.3% +44.8% ➖ noise
16 datafusion:vortex-compact -11.2% -16.0% +5.7% +44.8% ➖ noise
16 datafusion:vortex-file-compressed -3.4% -16.0% +14.9% +44.8% ➖ noise
16 duckdb:vortex-compact -4.7% -16.0% +13.4% +44.8% ➖ noise
16 duckdb:vortex-file-compressed +15.9% -16.0% +37.9% +44.8% ➖ noise
17 datafusion:vortex-compact -17.7% -25.5% +10.4% +44.8% ➖ noise
17 datafusion:vortex-file-compressed -32.9% -25.5% -9.9% +52.7% ➖ noise
17 duckdb:vortex-compact +7.1% -25.5% +43.7% +44.8% ➖ noise
17 duckdb:vortex-file-compressed -32.5% -25.5% -9.4% +44.8% ➖ noise
18 datafusion:vortex-compact -14.6% -21.3% +8.6% +44.8% ➖ noise
18 datafusion:vortex-file-compressed -37.5% -21.3% -20.6% +84.3% ➖ noise
18 duckdb:vortex-compact +1.4% -21.3% +28.9% +44.8% ➖ noise
18 duckdb:vortex-file-compressed +17.0% -21.3% +48.7% +44.8% 🚨 regression
19 datafusion:vortex-compact -9.8% -32.7% +34.1% +44.8% ➖ noise
19 datafusion:vortex-file-compressed -38.3% -32.7% -8.3% +44.8% ➖ noise
19 duckdb:vortex-compact +9.1% -32.7% +62.2% +44.8% 🚨 regression
19 duckdb:vortex-file-compressed +4.5% -32.7% +55.4% +48.1% 🚨 regression
20 datafusion:vortex-compact -7.4% -38.4% +50.5% +44.8% 🚨 regression
20 datafusion:vortex-file-compressed -25.9% -38.4% +20.4% +44.8% ➖ noise
20 duckdb:vortex-compact -11.8% -38.4% +43.3% +44.8% ➖ noise
20 duckdb:vortex-file-compressed -16.3% -38.4% +36.0% +44.8% ➖ noise
21 datafusion:vortex-compact -5.6% -5.7% +0.1% +44.8% ➖ noise
21 datafusion:vortex-file-compressed -8.3% -5.7% -2.8% +46.9% ➖ noise
21 duckdb:vortex-compact +11.2% -5.7% +17.9% +44.8% ➖ noise
21 duckdb:vortex-file-compressed -3.5% -5.7% +2.3% +52.0% ➖ noise
22 datafusion:vortex-compact -25.2% -28.1% +4.0% +44.8% ➖ noise
22 datafusion:vortex-file-compressed -36.6% -28.1% -11.9% +44.8% ➖ noise
22 duckdb:vortex-compact +4.3% -28.1% +45.0% +44.8% 🚨 regression
22 duckdb:vortex-file-compressed -8.6% -28.1% +27.1% +46.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: Random Access

Vortex (geomean): 0.771x ✅
Parquet (geomean): 0.917x ➖


unknown / unknown (0.850x ✅, 36↑ 1↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 3261382 2657227 1.23
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 🚀 1290022 1510457 0.85
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11621621444 12476307881 0.93
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11155420028 11949672648 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8167327 8809384 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 6204158 7456502 0.83
random-access/feature-vectors/uniform/lance-tokio-local-disk 🚀 1463229 1862138 0.79
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 🚀 2347310 2917725 0.80
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11153577745 11910274653 0.94
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11114373645 11885741952 0.94
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12848928 15681429 0.82
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12705779 15950348 0.80
random-access/lance-tokio-local-disk 763013 826082 0.92
random-access/lance-tokio-local-disk-footer 🚀 1352826 1562432 0.87
random-access/nested-lists/correlated/lance-tokio-local-disk 🚀 268514 305804 0.88
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 🚀 700754 852594 0.82
random-access/nested-lists/correlated/parquet-tokio-local-disk 136844823 146897184 0.93
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 135812455 148404555 0.92
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 700412 996718 0.70
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 699304 898320 0.78
random-access/nested-lists/uniform/lance-tokio-local-disk 🚀 1154153 1354023 0.85
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 🚀 1613257 1935711 0.83
random-access/nested-lists/uniform/parquet-tokio-local-disk 136075285 145525873 0.94
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 135937503 145243247 0.94
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 2348112 2609131 0.90
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2455424 2729302 0.90
random-access/nested-structs/correlated/lance-tokio-local-disk 🚀 429209 507742 0.85
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚀 639140 762348 0.84
random-access/nested-structs/correlated/parquet-tokio-local-disk 30006029 32733044 0.92
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 29269339 32347255 0.90
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 911759 1014931 0.90
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 900545 1041534 0.86
random-access/nested-structs/uniform/lance-tokio-local-disk 🚀 2769843 3399645 0.81
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 🚀 3066067 3671759 0.84
random-access/nested-structs/uniform/parquet-tokio-local-disk 29011457 31987289 0.91
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 29945605 31960122 0.94
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1806440 2151848 0.84
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1780626 2138472 0.83
random-access/parquet-tokio-local-disk 184977024 202516401 0.91
random-access/parquet-tokio-local-disk-footer 🚀 181228687 201619010 0.90
random-access/taxi/correlated/lance-tokio-local-disk 993537 1072579 0.93
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚀 1668934 1903675 0.88
random-access/taxi/correlated/parquet-tokio-local-disk 271605530 300839055 0.90
random-access/taxi/correlated/parquet-tokio-local-disk-footer 🚀 270591314 300709249 0.90
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1823834 3011173 0.61
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1692337 2781972 0.61
random-access/taxi/uniform/lance-tokio-local-disk 🚀 8486129 9993931 0.85
random-access/taxi/uniform/lance-tokio-local-disk-footer 🚀 9155099 10665523 0.86
random-access/taxi/uniform/parquet-tokio-local-disk 🚀 285194852 320598412 0.89
random-access/taxi/uniform/parquet-tokio-local-disk-footer 🚀 283840924 320760644 0.88
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4646956 6072820 0.77
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4470294 6081974 0.74
random-access/vortex-tokio-local-disk 🚀 1252609 2078439 0.60
random-access/vortex-tokio-local-disk-footer 🚀 1258910 2034900 0.62

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.8%
Vortex (geomean): 0.985x ➖
Parquet (geomean): 0.949x ➖
Shifts: Parquet (control) -5.1% · Median polish -1.4%


duckdb / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10635025 11510658 0.92
statpopgen_q01/duckdb:vortex-file-compressed 18863305 20509704 0.92
statpopgen_q02/duckdb:vortex-file-compressed 1315282993 1308067099 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3041896565 3100548989 0.98
statpopgen_q04/duckdb:vortex-file-compressed 3106932011 3047652945 1.02
statpopgen_q05/duckdb:vortex-file-compressed 1411700021 1398489240 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2086391904 2108085551 0.99
statpopgen_q07/duckdb:vortex-file-compressed 215371918 222505716 0.97
statpopgen_q08/duckdb:vortex-file-compressed 233162108 237393527 0.98
statpopgen_q09/duckdb:vortex-file-compressed 2838832462 2900895675 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4599443082 4612267192 1.00
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10732508 10647164 1.01
statpopgen_q01/duckdb:vortex-compact 169607841 164500719 1.03
statpopgen_q02/duckdb:vortex-compact 1809634879 1779025575 1.02
statpopgen_q03/duckdb:vortex-compact 3439424059 3508407929 0.98
statpopgen_q04/duckdb:vortex-compact 3515315477 3590051162 0.98
statpopgen_q05/duckdb:vortex-compact 1876090570 1837143583 1.02
statpopgen_q06/duckdb:vortex-compact 2663683818 2701941064 0.99
statpopgen_q07/duckdb:vortex-compact 923291313 934630513 0.99
statpopgen_q08/duckdb:vortex-compact 956717768 974448232 0.98
statpopgen_q09/duckdb:vortex-compact 3374493947 3474240257 0.97
statpopgen_q10/duckdb:vortex-compact 5387715345 5680524495 0.95
duckdb / parquet (0.949x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 313902143 324203392 0.97
statpopgen_q01/duckdb:parquet 397482771 408233160 0.97
statpopgen_q02/duckdb:parquet 979832296 1036563524 0.95
statpopgen_q03/duckdb:parquet 1479315479 1568281198 0.94
statpopgen_q04/duckdb:parquet 1508102402 1572379335 0.96
statpopgen_q05/duckdb:parquet 1006992948 1069574121 0.94
statpopgen_q06/duckdb:parquet 1477579171 1586682824 0.93
statpopgen_q07/duckdb:parquet 1878692805 1976142070 0.95
statpopgen_q08/duckdb:parquet 1879140833 1991412151 0.94
statpopgen_q09/duckdb:parquet 1364891271 1446775180 0.94
statpopgen_q10/duckdb:parquet 2656877431 2824110494 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +0.8% -3.2% +4.1% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -7.6% -3.2% -4.6% +10.0% ➖ noise
1 duckdb:vortex-compact +3.1% -2.6% +5.9% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -8.0% -2.6% -5.5% +218.4% ➖ noise
2 duckdb:vortex-compact +1.7% -5.5% +7.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.6% -5.5% +6.4% +10.0% ➖ noise
3 duckdb:vortex-compact -2.0% -5.7% +3.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.9% -5.7% +4.0% +10.0% ➖ noise
4 duckdb:vortex-compact -2.1% -4.1% +2.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.9% -4.1% +6.3% +10.0% ➖ noise
5 duckdb:vortex-compact +2.1% -5.9% +8.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.9% -5.9% +7.2% +10.0% ➖ noise
6 duckdb:vortex-compact -1.4% -6.9% +5.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.0% -6.9% +6.3% +10.0% ➖ noise
7 duckdb:vortex-compact -1.2% -4.9% +3.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.2% -4.9% +1.8% +10.0% ➖ noise
8 duckdb:vortex-compact -1.8% -5.6% +4.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.8% -5.6% +4.1% +10.0% ➖ noise
9 duckdb:vortex-compact -2.9% -5.7% +3.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.1% -5.7% +3.7% +10.0% ➖ noise
10 duckdb:vortex-compact -5.2% -5.9% +0.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.3% -5.9% +6.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +1.0%


datafusion / vortex-file-compressed (1.009x ➖, 0↑ 1↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1953564 1948683 1.00
clickbench_q01/datafusion:vortex-file-compressed 🚨 15290467 13814288 1.11
clickbench_q02/datafusion:vortex-file-compressed 34748506 33910643 1.02
clickbench_q03/datafusion:vortex-file-compressed 39714170 38143893 1.04
clickbench_q04/datafusion:vortex-file-compressed 317577825 306462994 1.04
clickbench_q05/datafusion:vortex-file-compressed 324036473 314847057 1.03
clickbench_q06/datafusion:vortex-file-compressed 2781872 2919778 0.95
clickbench_q07/datafusion:vortex-file-compressed 18265354 17854193 1.02
clickbench_q08/datafusion:vortex-file-compressed 388987991 381376696 1.02
clickbench_q09/datafusion:vortex-file-compressed 576568066 555310416 1.04
clickbench_q10/datafusion:vortex-file-compressed 73267293 76413927 0.96
clickbench_q11/datafusion:vortex-file-compressed 82566249 86162345 0.96
clickbench_q12/datafusion:vortex-file-compressed 274702445 273576639 1.00
clickbench_q13/datafusion:vortex-file-compressed 418707424 411049591 1.02
clickbench_q14/datafusion:vortex-file-compressed 259902614 254557917 1.02
clickbench_q15/datafusion:vortex-file-compressed 367091095 356751284 1.03
clickbench_q16/datafusion:vortex-file-compressed 739746100 701510185 1.05
clickbench_q17/datafusion:vortex-file-compressed 716322055 709026176 1.01
clickbench_q18/datafusion:vortex-file-compressed 1351374478 1346066388 1.00
clickbench_q19/datafusion:vortex-file-compressed 22379094 23817753 0.94
clickbench_q20/datafusion:vortex-file-compressed 358198368 363088930 0.99
clickbench_q21/datafusion:vortex-file-compressed 402578546 399409431 1.01
clickbench_q22/datafusion:vortex-file-compressed 488246915 490915889 0.99
clickbench_q23/datafusion:vortex-file-compressed 684718737 725669072 0.94
clickbench_q24/datafusion:vortex-file-compressed 48434060 48352050 1.00
clickbench_q25/datafusion:vortex-file-compressed 68089938 70484507 0.97
clickbench_q26/datafusion:vortex-file-compressed 46032399 45362921 1.01
clickbench_q27/datafusion:vortex-file-compressed 784867768 778714576 1.01
clickbench_q28/datafusion:vortex-file-compressed 6927182853 6858012227 1.01
clickbench_q29/datafusion:vortex-file-compressed 238064838 247598975 0.96
clickbench_q30/datafusion:vortex-file-compressed 232073313 225168789 1.03
clickbench_q31/datafusion:vortex-file-compressed 267293879 267014829 1.00
clickbench_q32/datafusion:vortex-file-compressed 1223658541 1286609727 0.95
clickbench_q33/datafusion:vortex-file-compressed 1393638252 1377665034 1.01
clickbench_q34/datafusion:vortex-file-compressed 1430121147 1373152901 1.04
clickbench_q35/datafusion:vortex-file-compressed 524413156 513364136 1.02
clickbench_q36/datafusion:vortex-file-compressed 83474107 78683507 1.06
clickbench_q37/datafusion:vortex-file-compressed 39735915 40084164 0.99
clickbench_q38/datafusion:vortex-file-compressed 23244375 22542017 1.03
clickbench_q39/datafusion:vortex-file-compressed 144712710 148023031 0.98
clickbench_q40/datafusion:vortex-file-compressed 18572088 17959174 1.03
clickbench_q41/datafusion:vortex-file-compressed 17549620 16586270 1.06
clickbench_q42/datafusion:vortex-file-compressed 19043718 18462149 1.03
datafusion / parquet (1.002x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1830597 1783898 1.03
clickbench_q01/datafusion:parquet 21532652 20165913 1.07
clickbench_q02/datafusion:parquet 55610185 56375719 0.99
clickbench_q03/datafusion:parquet 43522095 44170455 0.99
clickbench_q04/datafusion:parquet 331998321 332381038 1.00
clickbench_q05/datafusion:parquet 370199005 369014173 1.00
clickbench_q06/datafusion:parquet 1758967 1802098 0.98
clickbench_q07/datafusion:parquet 25880780 26819931 0.96
clickbench_q08/datafusion:parquet 406075779 421260346 0.96
clickbench_q09/datafusion:parquet 648150953 646623594 1.00
clickbench_q10/datafusion:parquet 110130693 111788046 0.99
clickbench_q11/datafusion:parquet 137435286 138496520 0.99
clickbench_q12/datafusion:parquet 371938462 356951310 1.04
clickbench_q13/datafusion:parquet 529092852 526264595 1.01
clickbench_q14/datafusion:parquet 361319683 357468713 1.01
clickbench_q15/datafusion:parquet 384467308 379403376 1.01
clickbench_q16/datafusion:parquet 701411379 707985579 0.99
clickbench_q17/datafusion:parquet 681620787 685050251 0.99
clickbench_q18/datafusion:parquet 1377089754 1375123727 1.00
clickbench_q19/datafusion:parquet 32245813 33570415 0.96
clickbench_q20/datafusion:parquet 583032725 588293915 0.99
clickbench_q21/datafusion:parquet 648389148 670613656 0.97
clickbench_q22/datafusion:parquet 966344326 950763272 1.02
clickbench_q23/datafusion:parquet 3630973587 3639793994 1.00
clickbench_q24/datafusion:parquet 85928498 89656565 0.96
clickbench_q25/datafusion:parquet 137866950 138741707 0.99
clickbench_q26/datafusion:parquet 85634848 84173062 1.02
clickbench_q27/datafusion:parquet 1038720056 1062426664 0.98
clickbench_q28/datafusion:parquet 6741838094 6557229603 1.03
clickbench_q29/datafusion:parquet 247965013 254765160 0.97
clickbench_q30/datafusion:parquet 361708732 357835208 1.01
clickbench_q31/datafusion:parquet 395993192 384866493 1.03
clickbench_q32/datafusion:parquet 1331236551 1248498592 1.07
clickbench_q33/datafusion:parquet 1583040139 1523292216 1.04
clickbench_q34/datafusion:parquet 1579592398 1522490705 1.04
clickbench_q35/datafusion:parquet 554781276 543121376 1.02
clickbench_q36/datafusion:parquet 152096172 147957959 1.03
clickbench_q37/datafusion:parquet 61571271 61646440 1.00
clickbench_q38/datafusion:parquet 89288471 89735997 1.00
clickbench_q39/datafusion:parquet 291404968 273398979 1.07
clickbench_q40/datafusion:parquet 34536869 33655771 1.03
clickbench_q41/datafusion:parquet 29701690 31456639 0.94
clickbench_q42/datafusion:parquet 31982335 33302818 0.96
duckdb / vortex-file-compressed (1.022x ➖, 0↑ 2↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5967387 6056247 0.99
clickbench_q01/duckdb:vortex-file-compressed 13600645 14374155 0.95
clickbench_q02/duckdb:vortex-file-compressed 26981630 26141915 1.03
clickbench_q03/duckdb:vortex-file-compressed 30136523 29977836 1.01
clickbench_q04/duckdb:vortex-file-compressed 182152018 180002734 1.01
clickbench_q05/duckdb:vortex-file-compressed 199072082 196847750 1.01
clickbench_q06/duckdb:vortex-file-compressed 18309063 17511408 1.05
clickbench_q07/duckdb:vortex-file-compressed 15492041 16029392 0.97
clickbench_q08/duckdb:vortex-file-compressed 267481346 267077179 1.00
clickbench_q09/duckdb:vortex-file-compressed 347669890 345901456 1.01
clickbench_q10/duckdb:vortex-file-compressed 73622653 73914749 1.00
clickbench_q11/duckdb:vortex-file-compressed 83787519 81029089 1.03
clickbench_q12/duckdb:vortex-file-compressed 219691744 217255693 1.01
clickbench_q13/duckdb:vortex-file-compressed 437487137 431515557 1.01
clickbench_q14/duckdb:vortex-file-compressed 249889178 238675940 1.05
clickbench_q15/duckdb:vortex-file-compressed 227782328 219607604 1.04
clickbench_q16/duckdb:vortex-file-compressed 727582088 690277967 1.05
clickbench_q17/duckdb:vortex-file-compressed 576643756 545195690 1.06
clickbench_q18/duckdb:vortex-file-compressed 1256452430 1215623576 1.03
clickbench_q19/duckdb:vortex-file-compressed 21029366 20852023 1.01
clickbench_q20/duckdb:vortex-file-compressed 396316270 383752395 1.03
clickbench_q21/duckdb:vortex-file-compressed 420750357 405827293 1.04
clickbench_q22/duckdb:vortex-file-compressed 709257249 648284698 1.09
clickbench_q23/duckdb:vortex-file-compressed 🚨 1523449239 1230576640 1.24
clickbench_q24/duckdb:vortex-file-compressed 53410546 50319783 1.06
clickbench_q25/duckdb:vortex-file-compressed 76626017 74666828 1.03
clickbench_q26/duckdb:vortex-file-compressed 45853951 47036924 0.97
clickbench_q27/duckdb:vortex-file-compressed 502594679 495724811 1.01
clickbench_q28/duckdb:vortex-file-compressed 3031763099 2989182174 1.01
clickbench_q29/duckdb:vortex-file-compressed 30036101 29419924 1.02
clickbench_q30/duckdb:vortex-file-compressed 184644371 181596894 1.02
clickbench_q31/duckdb:vortex-file-compressed 260628413 260049046 1.00
clickbench_q32/duckdb:vortex-file-compressed 1493362193 1413161837 1.06
clickbench_q33/duckdb:vortex-file-compressed 🚨 1765683111 1573398288 1.12
clickbench_q34/duckdb:vortex-file-compressed 1776662552 1615952464 1.10
clickbench_q35/duckdb:vortex-file-compressed 377902263 377549340 1.00
clickbench_q36/duckdb:vortex-file-compressed 33296160 33629118 0.99
clickbench_q37/duckdb:vortex-file-compressed 23991804 24739009 0.97
clickbench_q38/duckdb:vortex-file-compressed 25742346 26847194 0.96
clickbench_q39/duckdb:vortex-file-compressed 46171968 44382951 1.04
clickbench_q40/duckdb:vortex-file-compressed 23591150 25605739 0.92
clickbench_q41/duckdb:vortex-file-compressed 24431437 25316899 0.97
clickbench_q42/duckdb:vortex-file-compressed 25066531 24232398 1.03
duckdb / parquet (1.011x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 225404308 224555981 1.00
clickbench_q01/duckdb:parquet 50992151 50334254 1.01
clickbench_q02/duckdb:parquet 66748208 65848942 1.01
clickbench_q03/duckdb:parquet 64841545 63780504 1.02
clickbench_q04/duckdb:parquet 205700133 207396113 0.99
clickbench_q05/duckdb:parquet 279554505 281011424 0.99
clickbench_q06/duckdb:parquet 61335119 60456034 1.01
clickbench_q07/duckdb:parquet 51944284 51772758 1.00
clickbench_q08/duckdb:parquet 270199413 270302218 1.00
clickbench_q09/duckdb:parquet 400340052 397226781 1.01
clickbench_q10/duckdb:parquet 99469168 95064420 1.05
clickbench_q11/duckdb:parquet 110629131 108913409 1.02
clickbench_q12/duckdb:parquet 304955793 296993521 1.03
clickbench_q13/duckdb:parquet 525969069 513302364 1.02
clickbench_q14/duckdb:parquet 332539656 328715977 1.01
clickbench_q15/duckdb:parquet 244636262 246040711 0.99
clickbench_q16/duckdb:parquet 623528105 613847212 1.02
clickbench_q17/duckdb:parquet 518194964 528408573 0.98
clickbench_q18/duckdb:parquet 1059285530 1058234861 1.00
clickbench_q19/duckdb:parquet 51535620 49238741 1.05
clickbench_q20/duckdb:parquet 432831245 437230513 0.99
clickbench_q21/duckdb:parquet 559245887 551722867 1.01
clickbench_q22/duckdb:parquet 923611647 929393505 0.99
clickbench_q23/duckdb:parquet 318979505 316926352 1.01
clickbench_q24/duckdb:parquet 78036514 78779349 0.99
clickbench_q25/duckdb:parquet 141363113 143268555 0.99
clickbench_q26/duckdb:parquet 53858307 52507041 1.03
clickbench_q27/duckdb:parquet 652496917 640413375 1.02
clickbench_q28/duckdb:parquet 4893732674 4834880626 1.01
clickbench_q29/duckdb:parquet 62466255 61558992 1.01
clickbench_q30/duckdb:parquet 307847823 304918652 1.01
clickbench_q31/duckdb:parquet 354881098 347710631 1.02
clickbench_q32/duckdb:parquet 1221401511 1173208176 1.04
clickbench_q33/duckdb:parquet 1265025062 1290184089 0.98
clickbench_q34/duckdb:parquet 1315941976 1284589026 1.02
clickbench_q35/duckdb:parquet 356491366 352979730 1.01
clickbench_q36/duckdb:parquet 65687089 64754583 1.01
clickbench_q37/duckdb:parquet 54085276 54332092 1.00
clickbench_q38/duckdb:parquet 58998477 58234207 1.01
clickbench_q39/duckdb:parquet 98516791 96223043 1.02
clickbench_q40/duckdb:parquet 56143326 55620100 1.01
clickbench_q41/duckdb:parquet 59691710 60701546 0.98
clickbench_q42/duckdb:parquet 52854065 49753871 1.06
duckdb / duckdb (1.039x ➖, 0↑ 5↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18735376 17783530 1.05
clickbench_q01/duckdb:duckdb 33484851 34314369 0.98
clickbench_q02/duckdb:duckdb 45769307 46094201 0.99
clickbench_q03/duckdb:duckdb 47889500 46743425 1.02
clickbench_q04/duckdb:duckdb 219420130 216807128 1.01
clickbench_q05/duckdb:duckdb 331412576 314425241 1.05
clickbench_q06/duckdb:duckdb 36477558 35976259 1.01
clickbench_q07/duckdb:duckdb 36873462 36832266 1.00
clickbench_q08/duckdb:duckdb 330153703 311485329 1.06
clickbench_q09/duckdb:duckdb 489660794 474383675 1.03
clickbench_q10/duckdb:duckdb 100219167 97450463 1.03
clickbench_q11/duckdb:duckdb 109084471 106124814 1.03
clickbench_q12/duckdb:duckdb 319818430 300788753 1.06
clickbench_q13/duckdb:duckdb 561307026 537981506 1.04
clickbench_q14/duckdb:duckdb 385595561 360934715 1.07
clickbench_q15/duckdb:duckdb 273393120 260844565 1.05
clickbench_q16/duckdb:duckdb 713353023 689558011 1.03
clickbench_q17/duckdb:duckdb 601687062 587563645 1.02
clickbench_q18/duckdb:duckdb 1303511222 1290713276 1.01
clickbench_q19/duckdb:duckdb 35381310 34146802 1.04
clickbench_q20/duckdb:duckdb 1025560141 949747005 1.08
clickbench_q21/duckdb:duckdb 🚨 1105878832 999922986 1.11
clickbench_q22/duckdb:duckdb 1134369704 1048622742 1.08
clickbench_q23/duckdb:duckdb 266313420 251799963 1.06
clickbench_q24/duckdb:duckdb 62396577 61762924 1.01
clickbench_q25/duckdb:duckdb 124424306 123628990 1.01
clickbench_q26/duckdb:duckdb 59156951 54589969 1.08
clickbench_q27/duckdb:duckdb 🚨 1100303683 994433408 1.11
clickbench_q28/duckdb:duckdb 4720723968 4631877421 1.02
clickbench_q29/duckdb:duckdb 49021124 49013150 1.00
clickbench_q30/duckdb:duckdb 302384537 284175105 1.06
clickbench_q31/duckdb:duckdb 434784717 421023386 1.03
clickbench_q32/duckdb:duckdb 🚨 1531569809 1379041812 1.11
clickbench_q33/duckdb:duckdb 🚨 2001246724 1808388054 1.11
clickbench_q34/duckdb:duckdb 🚨 2204327877 1949252165 1.13
clickbench_q35/duckdb:duckdb 272258553 264760691 1.03
clickbench_q36/duckdb:duckdb 44093703 41985998 1.05
clickbench_q37/duckdb:duckdb 32015791 32227714 0.99
clickbench_q38/duckdb:duckdb 31565648 31666698 1.00
clickbench_q39/duckdb:duckdb 70102636 67502103 1.04
clickbench_q40/duckdb:duckdb 32178703 32697238 0.98
clickbench_q41/duckdb:duckdb 31651471 31379973 1.01
clickbench_q42/duckdb:duckdb 32356478 32168668 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +0.3% +1.5% -1.2% +524.5% ➖ noise
0 duckdb:duckdb +5.4% +1.5% +3.8% +260.7% ➖ noise
0 duckdb:vortex-file-compressed -1.5% +1.5% -2.9% +308.4% ➖ noise
1 datafusion:vortex-file-compressed +10.7% +4.0% +6.4% +56.6% ➖ noise
1 duckdb:duckdb -2.4% +4.0% -6.2% +53.4% ➖ noise
1 duckdb:vortex-file-compressed -5.4% +4.0% -9.0% +18.8% ➖ noise
2 datafusion:vortex-file-compressed +2.5% -0.0% +2.5% +22.4% ➖ noise
2 duckdb:duckdb -0.7% -0.0% -0.7% +18.8% ➖ noise
2 duckdb:vortex-file-compressed +3.2% -0.0% +3.2% +13.3% ➖ noise
3 datafusion:vortex-file-compressed +4.1% +0.1% +4.0% +142.8% ➖ noise
3 duckdb:duckdb +2.5% +0.1% +2.4% +41.7% ➖ noise
3 duckdb:vortex-file-compressed +0.5% +0.1% +0.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +3.6% -0.5% +4.1% +10.0% ➖ noise
4 duckdb:duckdb +1.2% -0.5% +1.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.2% -0.5% +1.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.9% -0.1% +3.0% +10.0% ➖ noise
5 duckdb:duckdb +5.4% -0.1% +5.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.1% -0.1% +1.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -4.7% -0.5% -4.3% +38.9% ➖ noise
6 duckdb:duckdb +1.4% -0.5% +1.9% +28.2% ➖ noise
6 duckdb:vortex-file-compressed +4.6% -0.5% +5.1% +18.7% ➖ noise
7 datafusion:vortex-file-compressed +2.3% -1.6% +4.0% +31.7% ➖ noise
7 duckdb:duckdb +0.1% -1.6% +1.7% +31.9% ➖ noise
7 duckdb:vortex-file-compressed -3.4% -1.6% -1.8% +31.2% ➖ noise
8 datafusion:vortex-file-compressed +2.0% -1.8% +3.9% +10.0% ➖ noise
8 duckdb:duckdb +6.0% -1.8% +8.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.2% -1.8% +2.0% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.8% +0.5% +3.3% +10.0% ➖ noise
9 duckdb:duckdb +3.2% +0.5% +2.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.5% +0.5% +0.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -4.1% +1.5% -5.6% +10.6% ➖ noise
10 duckdb:duckdb +2.8% +1.5% +1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.4% +1.5% -1.9% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -4.2% +0.4% -4.6% +10.0% ➖ noise
11 duckdb:duckdb +2.8% +0.4% +2.4% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.4% +0.4% +3.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.4% +3.4% -2.9% +10.0% ➖ noise
12 duckdb:duckdb +6.3% +3.4% +2.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.1% +3.4% -2.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.9% +1.5% +0.4% +10.0% ➖ noise
13 duckdb:duckdb +4.3% +1.5% +2.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.4% +1.5% -0.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +2.1% +1.1% +1.0% +10.0% ➖ noise
14 duckdb:duckdb +6.8% +1.1% +5.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +4.7% +1.1% +3.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.9% +0.4% +2.5% +10.0% ➖ noise
15 duckdb:duckdb +4.8% +0.4% +4.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.7% +0.4% +3.3% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +5.5% +0.3% +5.1% +10.0% ➖ noise
16 duckdb:duckdb +3.5% +0.3% +3.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +5.4% +0.3% +5.1% +16.7% ➖ noise
17 datafusion:vortex-file-compressed +1.0% -1.2% +2.3% +10.0% ➖ noise
17 duckdb:duckdb +2.4% -1.2% +3.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +5.8% -1.2% +7.1% +10.4% ➖ noise
18 datafusion:vortex-file-compressed +0.4% +0.1% +0.3% +10.0% ➖ noise
18 duckdb:duckdb +1.0% +0.1% +0.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +3.4% +0.1% +3.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -6.0% +0.3% -6.3% +15.8% ➖ noise
19 duckdb:duckdb +3.6% +0.3% +3.3% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.9% +0.3% +0.6% +30.9% ➖ noise
20 datafusion:vortex-file-compressed -1.3% -1.0% -0.4% +184.3% ➖ noise
20 duckdb:duckdb +8.0% -1.0% +9.0% +19.9% ➖ noise
20 duckdb:vortex-file-compressed +3.3% -1.0% +4.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +0.8% -1.0% +1.8% +10.0% ➖ noise
21 duckdb:duckdb +10.6% -1.0% +11.7% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed +3.7% -1.0% +4.7% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.5% +0.5% -1.0% +10.0% ➖ noise
22 duckdb:duckdb +8.2% +0.5% +7.6% +15.5% ➖ noise
22 duckdb:vortex-file-compressed +9.4% +0.5% +8.9% +23.0% ➖ noise
23 datafusion:vortex-file-compressed -5.6% +0.2% -5.8% +43.7% ➖ noise
23 duckdb:duckdb +5.8% +0.2% +5.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +23.8% +0.2% +23.6% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +0.2% -2.6% +2.8% +27.2% ➖ noise
24 duckdb:duckdb +1.0% -2.6% +3.7% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +6.1% -2.6% +8.9% +26.0% ➖ noise
25 datafusion:vortex-file-compressed -3.4% -1.0% -2.4% +10.0% ➖ noise
25 duckdb:duckdb +0.6% -1.0% +1.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.6% -1.0% +3.6% +10.7% ➖ noise
26 datafusion:vortex-file-compressed +1.5% +2.2% -0.7% +13.9% ➖ noise
26 duckdb:duckdb +8.4% +2.2% +6.1% +10.0% ➖ noise
26 duckdb:vortex-file-compressed -2.5% +2.2% -4.6% +24.0% ➖ noise
27 datafusion:vortex-file-compressed +0.8% -0.2% +1.0% +10.0% ➖ noise
27 duckdb:duckdb +10.6% -0.2% +10.9% +10.3% 🚨 regression
27 duckdb:vortex-file-compressed +1.4% -0.2% +1.6% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.0% +2.0% -1.0% +10.0% ➖ noise
28 duckdb:duckdb +1.9% +2.0% -0.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.4% +2.0% -0.6% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -3.9% -0.6% -3.3% +12.4% ➖ noise
29 duckdb:duckdb +0.0% -0.6% +0.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +2.1% -0.6% +2.7% +10.5% ➖ noise
30 datafusion:vortex-file-compressed +3.1% +1.0% +2.0% +10.0% ➖ noise
30 duckdb:duckdb +6.4% +1.0% +5.3% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +1.7% +1.0% +0.6% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.1% +2.5% -2.3% +10.0% ➖ noise
31 duckdb:duckdb +3.3% +2.5% +0.8% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.2% +2.5% -2.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -4.9% +5.4% -9.7% +13.1% ➖ noise
32 duckdb:duckdb +11.1% +5.4% +5.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +5.7% +5.4% +0.3% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.2% +0.9% +0.2% +10.0% ➖ noise
33 duckdb:duckdb +10.7% +0.9% +9.6% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +12.2% +0.9% +11.2% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed +4.1% +3.1% +1.0% +10.0% ➖ noise
34 duckdb:duckdb +13.1% +3.1% +9.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +9.9% +3.1% +6.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.2% +1.6% +0.6% +10.0% ➖ noise
35 duckdb:duckdb +2.8% +1.6% +1.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.1% +1.6% -1.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +6.1% +2.1% +3.9% +10.0% ➖ noise
36 duckdb:duckdb +5.0% +2.1% +2.8% +14.8% ➖ noise
36 duckdb:vortex-file-compressed -1.0% +2.1% -3.0% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -0.9% -0.3% -0.6% +10.0% ➖ noise
37 duckdb:duckdb -0.7% -0.3% -0.4% +10.0% ➖ noise
37 duckdb:vortex-file-compressed -3.0% -0.3% -2.7% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +3.1% +0.4% +2.7% +10.0% ➖ noise
38 duckdb:duckdb -0.3% +0.4% -0.7% +10.0% ➖ noise
38 duckdb:vortex-file-compressed -4.1% +0.4% -4.5% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -2.2% +4.5% -6.4% +10.0% ➖ noise
39 duckdb:duckdb +3.9% +4.5% -0.6% +13.0% ➖ noise
39 duckdb:vortex-file-compressed +4.0% +4.5% -0.4% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +3.4% +1.8% +1.6% +11.2% ➖ noise
40 duckdb:duckdb -1.6% +1.8% -3.3% +19.1% ➖ noise
40 duckdb:vortex-file-compressed -7.9% +1.8% -9.5% +10.7% ➖ noise
41 datafusion:vortex-file-compressed +5.8% -3.6% +9.8% +10.8% ➖ noise
41 duckdb:duckdb +0.9% -3.6% +4.7% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -3.5% -3.6% +0.1% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +3.2% +1.0% +2.1% +10.0% ➖ noise
42 duckdb:duckdb +0.6% +1.0% -0.4% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +3.4% +1.0% +2.4% +15.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.03 GB → 7.03 GB (-0.0%)
  • vortex-file-compressed: 14.08 GB → 14.08 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.7%
Vortex (geomean): 0.895x ➖
Parquet (geomean): 0.880x ➖
Shifts: Parquet (control) -12.0% · Median polish -9.3%


datafusion / vortex-file-compressed (0.933x ➖, 1↑ 1↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 645552863 731211309 0.88
tpch_q02/datafusion:vortex-file-compressed 610666117 843609803 0.72
tpch_q03/datafusion:vortex-file-compressed 762361176 818898949 0.93
tpch_q04/datafusion:vortex-file-compressed 586019162 727775815 0.81
tpch_q05/datafusion:vortex-file-compressed 941194007 1009730478 0.93
tpch_q06/datafusion:vortex-file-compressed 604053481 628580376 0.96
tpch_q07/datafusion:vortex-file-compressed 1077647359 1062767178 1.01
tpch_q08/datafusion:vortex-file-compressed 1239399527 1197241621 1.04
tpch_q09/datafusion:vortex-file-compressed 1452413531 1607425835 0.90
tpch_q10/datafusion:vortex-file-compressed 🚀 1024623050 1666631597 0.61
tpch_q11/datafusion:vortex-file-compressed 718058113 671878595 1.07
tpch_q12/datafusion:vortex-file-compressed 897614508 1075849575 0.83
tpch_q13/datafusion:vortex-file-compressed 394740964 463412704 0.85
tpch_q14/datafusion:vortex-file-compressed 599066137 603920935 0.99
tpch_q15/datafusion:vortex-file-compressed 1115132898 1221198766 0.91
tpch_q16/datafusion:vortex-file-compressed 🚨 439314398 292263192 1.50
tpch_q17/datafusion:vortex-file-compressed 1225359880 1185418594 1.03
tpch_q18/datafusion:vortex-file-compressed 1575910722 1391400519 1.13
tpch_q19/datafusion:vortex-file-compressed 894613569 887709921 1.01
tpch_q20/datafusion:vortex-file-compressed 1089288538 1166338093 0.93
tpch_q21/datafusion:vortex-file-compressed 1602375261 1876100213 0.85
tpch_q22/datafusion:vortex-file-compressed 422288149 471138716 0.90
datafusion / vortex-compact (0.918x ➖, 1↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 656017584 715649372 0.92
tpch_q02/datafusion:vortex-compact 603722250 669604681 0.90
tpch_q03/datafusion:vortex-compact 691542653 684535239 1.01
tpch_q04/datafusion:vortex-compact 517564712 502160234 1.03
tpch_q05/datafusion:vortex-compact 972318291 957898423 1.02
tpch_q06/datafusion:vortex-compact 570651985 544709514 1.05
tpch_q07/datafusion:vortex-compact 1031230414 1074401200 0.96
tpch_q08/datafusion:vortex-compact 1086503502 1133966289 0.96
tpch_q09/datafusion:vortex-compact 1161489310 1464422653 0.79
tpch_q10/datafusion:vortex-compact 848843268 1138789007 0.75
tpch_q11/datafusion:vortex-compact 🚀 424469333 801175484 0.53
tpch_q12/datafusion:vortex-compact 721165605 814320074 0.89
tpch_q13/datafusion:vortex-compact 385808537 431176958 0.89
tpch_q14/datafusion:vortex-compact 545259186 554610438 0.98
tpch_q15/datafusion:vortex-compact 979824579 997719043 0.98
tpch_q16/datafusion:vortex-compact 322596546 328584754 0.98
tpch_q17/datafusion:vortex-compact 1114193348 1174838940 0.95
tpch_q18/datafusion:vortex-compact 1079514776 1191531159 0.91
tpch_q19/datafusion:vortex-compact 740259518 785954131 0.94
tpch_q20/datafusion:vortex-compact 827521588 967603991 0.86
tpch_q21/datafusion:vortex-compact 1399318627 1500842949 0.93
tpch_q22/datafusion:vortex-compact 479553455 406358738 1.18
datafusion / parquet (0.839x ➖, 4↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 838944954 830151274 1.01
tpch_q02/datafusion:parquet 828236387 754749003 1.10
tpch_q03/datafusion:parquet 999667441 1240364301 0.81
tpch_q04/datafusion:parquet 573659440 474979903 1.21
tpch_q05/datafusion:parquet 1086364022 1263008516 0.86
tpch_q06/datafusion:parquet 541701196 653117904 0.83
tpch_q07/datafusion:parquet 🚀 1185002566 1783374767 0.66
tpch_q08/datafusion:parquet 1615327785 1672940576 0.97
tpch_q09/datafusion:parquet 1684377764 1956487953 0.86
tpch_q10/datafusion:parquet 1910765114 2280394201 0.84
tpch_q11/datafusion:parquet 🚀 479139780 713001421 0.67
tpch_q12/datafusion:parquet 640995509 707836130 0.91
tpch_q13/datafusion:parquet 669986544 716266122 0.94
tpch_q14/datafusion:parquet 738862959 818141545 0.90
tpch_q15/datafusion:parquet 1207761578 1263038073 0.96
tpch_q16/datafusion:parquet 363159641 431819820 0.84
tpch_q17/datafusion:parquet 1403146879 1402179967 1.00
tpch_q18/datafusion:parquet 1482686469 1651259232 0.90
tpch_q19/datafusion:parquet 956164726 1116982163 0.86
tpch_q20/datafusion:parquet 1115441149 1464408897 0.76
tpch_q21/datafusion:parquet 🚀 1628340875 2396010556 0.68
tpch_q22/datafusion:parquet 🚀 675793486 1883517436 0.36
duckdb / vortex-file-compressed (0.854x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 623735613 706953476 0.88
tpch_q02/duckdb:vortex-file-compressed 1064796848 1152155745 0.92
tpch_q03/duckdb:vortex-file-compressed 865249546 983994005 0.88
tpch_q04/duckdb:vortex-file-compressed 594992154 739666690 0.80
tpch_q05/duckdb:vortex-file-compressed 1038709049 1220525591 0.85
tpch_q06/duckdb:vortex-file-compressed 870899741 858277897 1.01
tpch_q07/duckdb:vortex-file-compressed 1196565654 1271282263 0.94
tpch_q08/duckdb:vortex-file-compressed 1391946875 1630792614 0.85
tpch_q09/duckdb:vortex-file-compressed 1434439899 1618164636 0.89
tpch_q10/duckdb:vortex-file-compressed 1070065214 1425243221 0.75
tpch_q11/duckdb:vortex-file-compressed 637539556 887898095 0.72
tpch_q12/duckdb:vortex-file-compressed 709535630 852997454 0.83
tpch_q13/duckdb:vortex-file-compressed 876563344 1101658086 0.80
tpch_q14/duckdb:vortex-file-compressed 841431888 913524069 0.92
tpch_q15/duckdb:vortex-file-compressed 554060759 621799942 0.89
tpch_q16/duckdb:vortex-file-compressed 513269425 504466577 1.02
tpch_q17/duckdb:vortex-file-compressed 967451870 1141155230 0.85
tpch_q18/duckdb:vortex-file-compressed 893304930 1046795608 0.85
tpch_q19/duckdb:vortex-file-compressed 722645196 872509790 0.83
tpch_q20/duckdb:vortex-file-compressed 1198039408 1500429976 0.80
tpch_q21/duckdb:vortex-file-compressed 1917574599 2443457397 0.78
tpch_q22/duckdb:vortex-file-compressed 503748945 638839162 0.79
duckdb / vortex-compact (0.875x ➖, 0↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 588630955 674927348 0.87
tpch_q02/duckdb:vortex-compact 1021222168 1097758885 0.93
tpch_q03/duckdb:vortex-compact 875129215 940634187 0.93
tpch_q04/duckdb:vortex-compact 604893512 575223197 1.05
tpch_q05/duckdb:vortex-compact 938805409 1215151340 0.77
tpch_q06/duckdb:vortex-compact 669541039 879632773 0.76
tpch_q07/duckdb:vortex-compact 1030405807 1134808032 0.91
tpch_q08/duckdb:vortex-compact 1246365249 1634863251 0.76
tpch_q09/duckdb:vortex-compact 1309494281 1559777996 0.84
tpch_q10/duckdb:vortex-compact 986773604 1012767468 0.97
tpch_q11/duckdb:vortex-compact 604752872 748861292 0.81
tpch_q12/duckdb:vortex-compact 635044794 736673183 0.86
tpch_q13/duckdb:vortex-compact 868709979 877489828 0.99
tpch_q14/duckdb:vortex-compact 881541263 958919509 0.92
tpch_q15/duckdb:vortex-compact 542701867 587202001 0.92
tpch_q16/duckdb:vortex-compact 405706223 421876625 0.96
tpch_q17/duckdb:vortex-compact 864353274 1014258339 0.85
tpch_q18/duckdb:vortex-compact 663479764 775531181 0.86
tpch_q19/duckdb:vortex-compact 744966846 840720174 0.89
tpch_q20/duckdb:vortex-compact 1338137701 1454245791 0.92
tpch_q21/duckdb:vortex-compact 1591099856 1954215225 0.81
tpch_q22/duckdb:vortex-compact 621149398 834428092 0.74
duckdb / parquet (0.922x ➖, 1↑ 0↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 928251110 1079030764 0.86
tpch_q02/duckdb:parquet 1526633030 1792937351 0.85
tpch_q03/duckdb:parquet 1596599476 1609063311 0.99
tpch_q04/duckdb:parquet 1044196166 981796966 1.06
tpch_q05/duckdb:parquet 2063015190 2376376562 0.87
tpch_q06/duckdb:parquet 786583633 932738618 0.84
tpch_q07/duckdb:parquet 1679948700 1737634040 0.97
tpch_q08/duckdb:parquet 🚀 2456672413 3638575511 0.68
tpch_q09/duckdb:parquet 2453046718 2634432997 0.93
tpch_q10/duckdb:parquet 3014536447 3537752031 0.85
tpch_q11/duckdb:parquet 1133738379 951014923 1.19
tpch_q12/duckdb:parquet 1138605853 1078680215 1.06
tpch_q13/duckdb:parquet 1254247612 1226197476 1.02
tpch_q14/duckdb:parquet 1195720983 1434019327 0.83
tpch_q15/duckdb:parquet 802858758 964631174 0.83
tpch_q16/duckdb:parquet 852983869 882058550 0.97
tpch_q17/duckdb:parquet 1346460606 1466231552 0.92
tpch_q18/duckdb:parquet 1402716221 1593856958 0.88
tpch_q19/duckdb:parquet 1717835899 1650573566 1.04
tpch_q20/duckdb:parquet 1881263712 1881277524 1.00
tpch_q21/duckdb:parquet 1805526474 2160527835 0.84
tpch_q22/duckdb:parquet 1001318699 1063628179 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -8.3% -6.8% -1.7% +81.0% ➖ noise
1 datafusion:vortex-file-compressed -11.7% -6.8% -5.3% +86.6% ➖ noise
1 duckdb:vortex-compact -12.8% -6.8% -6.5% +38.1% ➖ noise
1 duckdb:vortex-file-compressed -11.8% -6.8% -5.4% +38.1% ➖ noise
2 datafusion:vortex-compact -9.8% -3.3% -6.7% +86.5% ➖ noise
2 datafusion:vortex-file-compressed -27.6% -3.3% -25.1% +75.0% ➖ noise
2 duckdb:vortex-compact -7.0% -3.3% -3.8% +38.1% ➖ noise
2 duckdb:vortex-file-compressed -7.6% -3.3% -4.4% +45.4% ➖ noise
3 datafusion:vortex-compact +1.0% -10.6% +13.0% +79.4% ➖ noise
3 datafusion:vortex-file-compressed -6.9% -10.6% +4.1% +111.6% ➖ noise
3 duckdb:vortex-compact -7.0% -10.6% +4.0% +46.8% ➖ noise
3 duckdb:vortex-file-compressed -12.1% -10.6% -1.7% +58.4% ➖ noise
4 datafusion:vortex-compact +3.1% +13.3% -9.1% +38.1% ➖ noise
4 datafusion:vortex-file-compressed -19.5% +13.3% -29.0% +38.1% ✅ faster
4 duckdb:vortex-compact +5.2% +13.3% -7.2% +38.1% ➖ noise
4 duckdb:vortex-file-compressed -19.6% +13.3% -29.0% +38.1% ✅ faster
5 datafusion:vortex-compact +1.5% -13.6% +17.5% +38.1% ➖ noise
5 datafusion:vortex-file-compressed -6.8% -13.6% +7.9% +38.1% ➖ noise
5 duckdb:vortex-compact -22.7% -13.6% -10.6% +38.1% ➖ noise
5 duckdb:vortex-file-compressed -14.9% -13.6% -1.5% +38.1% ➖ noise
6 datafusion:vortex-compact +4.8% -16.4% +25.3% +38.1% ➖ noise
6 datafusion:vortex-file-compressed -3.9% -16.4% +14.9% +38.1% ➖ noise
6 duckdb:vortex-compact -23.9% -16.4% -9.0% +38.1% ➖ noise
6 duckdb:vortex-file-compressed +1.5% -16.4% +21.3% +38.1% ➖ noise
7 datafusion:vortex-compact -4.0% -19.8% +19.8% +38.1% ➖ noise
7 datafusion:vortex-file-compressed +1.4% -19.8% +26.5% +38.1% ➖ noise
7 duckdb:vortex-compact -9.2% -19.8% +13.3% +38.1% ➖ noise
7 duckdb:vortex-file-compressed -5.9% -19.8% +17.4% +38.1% ➖ noise
8 datafusion:vortex-compact -4.2% -19.3% +18.7% +38.1% ➖ noise
8 datafusion:vortex-file-compressed +3.5% -19.3% +28.2% +38.1% ➖ noise
8 duckdb:vortex-compact -23.8% -19.3% -5.6% +38.1% ➖ noise
8 duckdb:vortex-file-compressed -14.6% -19.3% +5.7% +38.1% ➖ noise
9 datafusion:vortex-compact -20.7% -10.5% -11.4% +61.0% ➖ noise
9 datafusion:vortex-file-compressed -9.6% -10.5% +0.9% +65.9% ➖ noise
9 duckdb:vortex-compact -16.0% -10.5% -6.2% +63.3% ➖ noise
9 duckdb:vortex-file-compressed -11.4% -10.5% -1.0% +63.6% ➖ noise
10 datafusion:vortex-compact -25.5% -15.5% -11.8% +55.0% ➖ noise
10 datafusion:vortex-file-compressed -38.5% -15.5% -27.2% +60.3% ➖ noise
10 duckdb:vortex-compact -2.6% -15.5% +15.3% +54.7% ➖ noise
10 duckdb:vortex-file-compressed -24.9% -15.5% -11.1% +50.0% ➖ noise
11 datafusion:vortex-compact -47.0% -10.5% -40.8% +47.4% ✅ faster
11 datafusion:vortex-file-compressed +6.9% -10.5% +19.4% +50.1% ➖ noise
11 duckdb:vortex-compact -19.2% -10.5% -9.8% +38.1% ➖ noise
11 duckdb:vortex-file-compressed -28.2% -10.5% -19.8% +40.0% ➖ noise
12 datafusion:vortex-compact -11.4% -2.2% -9.4% +38.1% ➖ noise
12 datafusion:vortex-file-compressed -16.6% -2.2% -14.7% +45.8% ➖ noise
12 duckdb:vortex-compact -13.8% -2.2% -11.8% +38.1% ➖ noise
12 duckdb:vortex-file-compressed -16.8% -2.2% -14.9% +38.1% ➖ noise
13 datafusion:vortex-compact -10.5% -2.2% -8.5% +53.5% ➖ noise
13 datafusion:vortex-file-compressed -14.8% -2.2% -12.9% +66.5% ➖ noise
13 duckdb:vortex-compact -1.0% -2.2% +1.2% +70.7% ➖ noise
13 duckdb:vortex-file-compressed -20.4% -2.2% -18.7% +89.7% ➖ noise
14 datafusion:vortex-compact -1.7% -13.2% +13.3% +38.1% ➖ noise
14 datafusion:vortex-file-compressed -0.8% -13.2% +14.3% +38.1% ➖ noise
14 duckdb:vortex-compact -8.1% -13.2% +5.9% +38.1% ➖ noise
14 duckdb:vortex-file-compressed -7.9% -13.2% +6.1% +38.1% ➖ noise
15 datafusion:vortex-compact -1.8% -10.8% +10.1% +38.1% ➖ noise
15 datafusion:vortex-file-compressed -8.7% -10.8% +2.4% +38.5% ➖ noise
15 duckdb:vortex-compact -7.6% -10.8% +3.6% +38.1% ➖ noise
15 duckdb:vortex-file-compressed -10.9% -10.8% -0.1% +38.1% ➖ noise
16 datafusion:vortex-compact -1.8% -9.8% +8.9% +38.1% ➖ noise
16 datafusion:vortex-file-compressed +50.3% -9.8% +66.7% +38.1% 🚨 regression
16 duckdb:vortex-compact -3.8% -9.8% +6.6% +38.1% ➖ noise
16 duckdb:vortex-file-compressed +1.7% -9.8% +12.8% +38.1% ➖ noise
17 datafusion:vortex-compact -5.2% -4.1% -1.1% +38.1% ➖ noise
17 datafusion:vortex-file-compressed +3.4% -4.1% +7.8% +38.1% ➖ noise
17 duckdb:vortex-compact -14.8% -4.1% -11.1% +38.1% ➖ noise
17 duckdb:vortex-file-compressed -15.2% -4.1% -11.6% +38.1% ➖ noise
18 datafusion:vortex-compact -9.4% -11.1% +1.9% +38.1% ➖ noise
18 datafusion:vortex-file-compressed +13.3% -11.1% +27.4% +38.1% ➖ noise
18 duckdb:vortex-compact -14.4% -11.1% -3.8% +38.1% ➖ noise
18 duckdb:vortex-file-compressed -14.7% -11.1% -4.0% +38.1% ➖ noise
19 datafusion:vortex-compact -5.8% -5.6% -0.2% +38.1% ➖ noise
19 datafusion:vortex-file-compressed +0.8% -5.6% +6.8% +38.1% ➖ noise
19 duckdb:vortex-compact -11.4% -5.6% -6.1% +38.1% ➖ noise
19 duckdb:vortex-file-compressed -17.2% -5.6% -12.3% +38.1% ➖ noise
20 datafusion:vortex-compact -14.5% -12.7% -2.0% +38.1% ➖ noise
20 datafusion:vortex-file-compressed -6.6% -12.7% +7.0% +38.1% ➖ noise
20 duckdb:vortex-compact -8.0% -12.7% +5.4% +38.1% ➖ noise
20 duckdb:vortex-file-compressed -20.2% -12.7% -8.5% +38.1% ➖ noise
21 datafusion:vortex-compact -6.8% -24.6% +23.7% +38.1% ➖ noise
21 datafusion:vortex-file-compressed -14.6% -24.6% +13.3% +38.1% ➖ noise
21 duckdb:vortex-compact -18.6% -24.6% +8.0% +38.1% ➖ noise
21 duckdb:vortex-file-compressed -21.5% -24.6% +4.1% +38.1% ➖ noise
22 datafusion:vortex-compact +18.0% -41.9% +103.1% +46.1% 🚨 regression
22 datafusion:vortex-file-compressed -10.4% -41.9% +54.2% +53.8% 🚨 regression
22 duckdb:vortex-compact -25.6% -41.9% +28.1% +38.1% ➖ noise
22 duckdb:vortex-file-compressed -21.1% -41.9% +35.7% +45.3% ➖ noise

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added changelog/performance A performance improvement action/benchmark Trigger full benchmarks to run on this PR labels Apr 10, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 10, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

Benchmarks: Compression

Vortex (geomean): 1.013x ➖
Parquet (geomean): 1.022x ➖


unknown / unknown (1.029x ➖, 0↑ 18↓)
name PR 2a6b29b (ns) base 3bdb376 (ns) ratio (PR/base)
compress time/Arade 1215507348 1154068735 1.05
compress time/Bimbo 7509365329 7063740571 1.06
compress time/CMSprovider 3076567138 2882908408 1.07
compress time/Euro2016 460879248 471712702 0.98
compress time/Food 439177905 430287305 1.02
compress time/HashTags 836505930 804756113 1.04
compress time/TPC-H l_comment canonical 1367123121 1283924425 1.06
compress time/TPC-H l_comment chunked 1372872267 1292887914 1.06
compress time/taxi 747253810 718581128 1.04
compress time/wide table cols=100 chunks=1 rows=1000 14301917 13153000 1.09
compress time/wide table cols=100 chunks=50 rows=1000 🚨 13854911 12375424 1.12
compress time/wide table cols=1000 chunks=1 rows=1000 144431386 134643297 1.07
compress time/wide table cols=1000 chunks=50 rows=1000 147333696 134057339 1.10
compress time/wide table cols=10000 chunks=1 rows=1000 1477294333 1503364913 0.98
compress time/wide table cols=10000 chunks=50 rows=1000 1463045877 1412329411 1.04
decompress time/Arade 🚨 32921755 29609942 1.11
decompress time/Bimbo 125055617 130681838 0.96
decompress time/CMSprovider 92014612 83901814 1.10
decompress time/Euro2016 22914582 23756125 0.96
decompress time/Food 9843313 10298510 0.96
decompress time/HashTags 84465185 79922903 1.06
decompress time/TPC-H l_comment canonical 🚨 48195243 40982562 1.18
decompress time/TPC-H l_comment chunked 🚨 46042924 40424068 1.14
decompress time/taxi 22668993 21888467 1.04
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 2964113 2483844 1.19
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3142258 2510794 1.25
decompress time/wide table cols=1000 chunks=1 rows=1000 24422527 23331641 1.05
decompress time/wide table cols=1000 chunks=50 rows=1000 23804017 23133979 1.03
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 258676136 229368942 1.13
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 261415686 229529611 1.14
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3158852283 3015132213 1.05
parquet_rs-zstd compress time/Bimbo 17931317973 17120448987 1.05
parquet_rs-zstd compress time/CMSprovider 8447449486 8947987518 0.94
parquet_rs-zstd compress time/Euro2016 1423886387 1348567701 1.06
parquet_rs-zstd compress time/Food 959137788 1005925585 0.95
parquet_rs-zstd compress time/HashTags 2698307637 2805427086 0.96
parquet_rs-zstd compress time/TPC-H l_comment canonical 3297367159 3120955854 1.06
parquet_rs-zstd compress time/TPC-H l_comment chunked 3274575412 3114334087 1.05
parquet_rs-zstd compress time/taxi 1586924354 1503485118 1.06
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 8004137 6737055 1.19
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 8286812 6717650 1.23
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 88609866 85308968 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 87987276 86950713 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 917832418 869418667 1.06
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 911585153 912098589 1.00
parquet_rs-zstd decompress time/Arade 668154858 652410818 1.02
parquet_rs-zstd decompress time/Bimbo 1770533714 1756669265 1.01
parquet_rs-zstd decompress time/CMSprovider 2061194635 1950883062 1.06
parquet_rs-zstd decompress time/Euro2016 401994101 417278633 0.96
parquet_rs-zstd decompress time/Food 228960491 249422691 0.92
parquet_rs-zstd decompress time/HashTags 🚨 724692858 635906178 1.14
parquet_rs-zstd decompress time/TPC-H l_comment canonical 581063868 561702257 1.03
parquet_rs-zstd decompress time/TPC-H l_comment chunked 578975744 567207348 1.02
parquet_rs-zstd decompress time/taxi 249974141 247853971 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3102940 2680625 1.16
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2871641 2681189 1.07
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 35022350 32373308 1.08
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33756039 32030532 1.05
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 376521543 371315201 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 375291105 371853636 1.01
vortex-file-compressed size/Arade 143387364 143387364 1.00
vortex-file-compressed size/Bimbo 457703724 457703724 1.00
vortex-file-compressed size/CMSprovider 422230580 422230580 1.00
vortex-file-compressed size/Euro2016 164453084 164454348 1.00
vortex-file-compressed size/Food 42374576 42374576 1.00
vortex-file-compressed size/HashTags 195767892 195767892 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179471576 179471576 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179471576 179471576 1.00
vortex-file-compressed size/taxi 50083652 50083652 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 876416 876416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 876416 876416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8749616 8749616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8749616 8749616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 87517616 87517616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 87517616 87517616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.01
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.02
vortex:parquet-zstd ratio compress time/CMSprovider 🚨 0 0 1.13
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.93
vortex:parquet-zstd ratio compress time/Food 0 0 1.07
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.08
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.92
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.91
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.09
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.93
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.09
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.95
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.04
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.00
vortex:parquet-zstd ratio decompress time/Food 0 0 1.04
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.93
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨 1 0 1.17
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.13
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@robert3005
Copy link
Copy Markdown
Contributor Author

Random access benchmark changes seem real. I think take on a bitbuffer would always be faster than take on the filtered array that needs to copy values. I will do some refactoring here before this is ready for review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant