Skip to content

Unify benchmark dispatch into a workflow#7178

Merged
AdamGS merged 2 commits intodevelopfrom
adamg/pr-benchmarks-label-fix
Mar 27, 2026
Merged

Unify benchmark dispatch into a workflow#7178
AdamGS merged 2 commits intodevelopfrom
adamg/pr-benchmarks-label-fix

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Mar 26, 2026 •
edited
Loading

This PR started as something else, but I still think its nicer to split the flows into another workflow to handle triggering the benchmarks themselves.

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026
@AdamGS AdamGS changed the title Adamg/pr benchmarks label fix Fix PR benchmarks concurrency group to keep progress visible Mar 26, 2026
@AdamGS AdamGS added the changelog/chore A trivial change label Mar 26, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9334719 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done 5bddb05 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.975x ➖

datafusion / vortex-file-compressed (0.975x ➖, 1↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 125953922 128576235 0.98
polarsignals_q01/datafusion:vortex-file-compressed 378018097 384977484 0.98
polarsignals_q02/datafusion:vortex-file-compressed 🚀 21425273 24677722 0.87
polarsignals_q03/datafusion:vortex-file-compressed 385594014 389784909 0.99
polarsignals_q04/datafusion:vortex-file-compressed 11966455 11446750 1.05
polarsignals_q05/datafusion:vortex-file-compressed 15460825 15731904 0.98
polarsignals_q06/datafusion:vortex-file-compressed 19108570 19264340 0.99
polarsignals_q07/datafusion:vortex-file-compressed 13583722 13539983 1.00
polarsignals_q08/datafusion:vortex-file-compressed 458476112 463972137 0.99
polarsignals_q09/datafusion:vortex-file-compressed 10668100 11411420 0.93

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.7%
Vortex (geomean): 0.950x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -2.7%

datafusion / vortex-file-compressed (0.940x ➖, 3↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 53005280 51628396 1.03
tpch_q02/datafusion:vortex-file-compressed 34894033 34222547 1.02
tpch_q03/datafusion:vortex-file-compressed 28784213 27657341 1.04
tpch_q04/datafusion:vortex-file-compressed 19037562 19117615 1.00
tpch_q05/datafusion:vortex-file-compressed 54609284 58050361 0.94
tpch_q06/datafusion:vortex-file-compressed 9855363 10886829 0.91
tpch_q07/datafusion:vortex-file-compressed 🚀 61629393 69365574 0.89
tpch_q08/datafusion:vortex-file-compressed 45080040 48998863 0.92
tpch_q09/datafusion:vortex-file-compressed 54843791 57813049 0.95
tpch_q10/datafusion:vortex-file-compressed 44562800 47674893 0.93
tpch_q11/datafusion:vortex-file-compressed 18277409 19147217 0.95
tpch_q12/datafusion:vortex-file-compressed 22613504 25031777 0.90
tpch_q13/datafusion:vortex-file-compressed 27239203 29539845 0.92
tpch_q14/datafusion:vortex-file-compressed 🚀 16172728 17970320 0.90
tpch_q15/datafusion:vortex-file-compressed 25625206 27182839 0.94
tpch_q16/datafusion:vortex-file-compressed 🚀 24084637 27126444 0.89
tpch_q17/datafusion:vortex-file-compressed 64377795 70961288 0.91
tpch_q18/datafusion:vortex-file-compressed 78717599 85731753 0.92
tpch_q19/datafusion:vortex-file-compressed 26924322 28879863 0.93
tpch_q20/datafusion:vortex-file-compressed 32548122 35395864 0.92
tpch_q21/datafusion:vortex-file-compressed 72741409 79279500 0.92
tpch_q22/datafusion:vortex-file-compressed 16692771 17197444 0.97
datafusion / vortex-compact (0.928x ➖, 3↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 56617818 63182294 0.90
tpch_q02/datafusion:vortex-compact 36333924 39287988 0.92
tpch_q03/datafusion:vortex-compact 31181790 34098431 0.91
tpch_q04/datafusion:vortex-compact 🚀 22911640 25721010 0.89
tpch_q05/datafusion:vortex-compact 56253769 60189884 0.93
tpch_q06/datafusion:vortex-compact 13555046 14143255 0.96
tpch_q07/datafusion:vortex-compact 69973937 72074021 0.97
tpch_q08/datafusion:vortex-compact 49131083 53809969 0.91
tpch_q09/datafusion:vortex-compact 60614251 65726443 0.92
tpch_q10/datafusion:vortex-compact 52567431 56433110 0.93
tpch_q11/datafusion:vortex-compact 19709883 21881723 0.90
tpch_q12/datafusion:vortex-compact 33471414 35039977 0.96
tpch_q13/datafusion:vortex-compact 36554612 37956078 0.96
tpch_q14/datafusion:vortex-compact 🚀 20118822 22585087 0.89
tpch_q15/datafusion:vortex-compact 33505702 35385263 0.95
tpch_q16/datafusion:vortex-compact 31555172 33119364 0.95
tpch_q17/datafusion:vortex-compact 68921979 75717632 0.91
tpch_q18/datafusion:vortex-compact 84824618 90805881 0.93
tpch_q19/datafusion:vortex-compact 38975063 42167906 0.92
tpch_q20/datafusion:vortex-compact 37319968 39234886 0.95
tpch_q21/datafusion:vortex-compact 88372242 94181189 0.94
tpch_q22/datafusion:vortex-compact 17375674 19188076 0.91
datafusion / parquet (1.018x ➖, 2↑ 2↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 137880020 97371232 1.42
tpch_q02/datafusion:parquet 75519380 73448593 1.03
tpch_q03/datafusion:parquet 82261706 82380146 1.00
tpch_q04/datafusion:parquet 51241616 51491332 1.00
tpch_q05/datafusion:parquet 113991229 106930849 1.07
tpch_q06/datafusion:parquet 🚀 36437331 46414234 0.79
tpch_q07/datafusion:parquet 123769470 116940263 1.06
tpch_q08/datafusion:parquet 110804039 109431980 1.01
tpch_q09/datafusion:parquet 145581499 144241624 1.01
tpch_q10/datafusion:parquet 129620457 128760530 1.01
tpch_q11/datafusion:parquet 51792365 52870136 0.98
tpch_q12/datafusion:parquet 🚀 89171554 99928734 0.89
tpch_q13/datafusion:parquet 216525152 228323690 0.95
tpch_q14/datafusion:parquet 56369031 53127774 1.06
tpch_q15/datafusion:parquet 70216909 65081174 1.08
tpch_q16/datafusion:parquet 56585104 57009732 0.99
tpch_q17/datafusion:parquet 🚨 162399739 144250886 1.13
tpch_q18/datafusion:parquet 185034051 185392236 1.00
tpch_q19/datafusion:parquet 77448884 83243635 0.93
tpch_q20/datafusion:parquet 85358378 79952955 1.07
tpch_q21/datafusion:parquet 153139695 145861176 1.05
tpch_q22/datafusion:parquet 37468764 36698625 1.02
datafusion / arrow (1.079x ➖, 0↑ 7↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 62121458 63646294 0.98
tpch_q02/datafusion:arrow 24066245 22877470 1.05
tpch_q03/datafusion:arrow 39551135 36821616 1.07
tpch_q04/datafusion:arrow 32390756 31225614 1.04
tpch_q05/datafusion:arrow 88799313 88792268 1.00
tpch_q06/datafusion:arrow 24021990 22177437 1.08
tpch_q07/datafusion:arrow 128844531 117479565 1.10
tpch_q08/datafusion:arrow 52427168 49664661 1.06
tpch_q09/datafusion:arrow 84866537 78078141 1.09
tpch_q10/datafusion:arrow 🚨 62035986 55681693 1.11
tpch_q11/datafusion:arrow 🚨 13700795 11868938 1.15
tpch_q12/datafusion:arrow 🚨 69344762 59056870 1.17
tpch_q13/datafusion:arrow 🚨 58044318 50762021 1.14
tpch_q14/datafusion:arrow 🚨 28194618 24308414 1.16
tpch_q15/datafusion:arrow 🚨 56372668 50207844 1.12
tpch_q16/datafusion:arrow 23254317 22097239 1.05
tpch_q17/datafusion:arrow 🚨 83492127 75849236 1.10
tpch_q18/datafusion:arrow 169617470 162506984 1.04
tpch_q19/datafusion:arrow 47055024 43163995 1.09
tpch_q20/datafusion:arrow 45660325 42511306 1.07
tpch_q21/datafusion:arrow 171414067 167163831 1.03
tpch_q22/datafusion:arrow 21935104 21014906 1.04
duckdb / vortex-file-compressed (0.963x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33242291 33734329 0.99
tpch_q02/duckdb:vortex-file-compressed 28250177 27909384 1.01
tpch_q03/duckdb:vortex-file-compressed 30310317 30830199 0.98
tpch_q04/duckdb:vortex-file-compressed 30211340 30658255 0.99
tpch_q05/duckdb:vortex-file-compressed 33275290 35192232 0.95
tpch_q06/duckdb:vortex-file-compressed 10644002 10936284 0.97
tpch_q07/duckdb:vortex-file-compressed 36689517 39675371 0.92
tpch_q08/duckdb:vortex-file-compressed 38633926 40838139 0.95
tpch_q09/duckdb:vortex-file-compressed 80375205 79636813 1.01
tpch_q10/duckdb:vortex-file-compressed 38102612 38780708 0.98
tpch_q11/duckdb:vortex-file-compressed 16346618 17380175 0.94
tpch_q12/duckdb:vortex-file-compressed 23852799 25684818 0.93
tpch_q13/duckdb:vortex-file-compressed 36673613 39190476 0.94
tpch_q14/duckdb:vortex-file-compressed 22335644 22614143 0.99
tpch_q15/duckdb:vortex-file-compressed 16180121 16941231 0.96
tpch_q16/duckdb:vortex-file-compressed 30356418 32002454 0.95
tpch_q17/duckdb:vortex-file-compressed 25489437 27663189 0.92
tpch_q18/duckdb:vortex-file-compressed 50093656 51782475 0.97
tpch_q19/duckdb:vortex-file-compressed 33762817 34500833 0.98
tpch_q20/duckdb:vortex-file-compressed 34984363 35970795 0.97
tpch_q21/duckdb:vortex-file-compressed 104149703 111820553 0.93
tpch_q22/duckdb:vortex-file-compressed 19106562 19390455 0.99
duckdb / vortex-compact (0.968x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40721653 41638506 0.98
tpch_q02/duckdb:vortex-compact 39036350 40239413 0.97
tpch_q03/duckdb:vortex-compact 32499910 35164148 0.92
tpch_q04/duckdb:vortex-compact 35025269 36935996 0.95
tpch_q05/duckdb:vortex-compact 37257579 40637748 0.92
tpch_q06/duckdb:vortex-compact 16689010 15862386 1.05
tpch_q07/duckdb:vortex-compact 43080198 44889849 0.96
tpch_q08/duckdb:vortex-compact 46448804 46520488 1.00
tpch_q09/duckdb:vortex-compact 89965945 97710909 0.92
tpch_q10/duckdb:vortex-compact 41889345 43235607 0.97
tpch_q11/duckdb:vortex-compact 20938126 19928073 1.05
tpch_q12/duckdb:vortex-compact 39672600 38171152 1.04
tpch_q13/duckdb:vortex-compact 47118554 50284458 0.94
tpch_q14/duckdb:vortex-compact 30443787 32394812 0.94
tpch_q15/duckdb:vortex-compact 19741459 19949673 0.99
tpch_q16/duckdb:vortex-compact 37560123 37225607 1.01
tpch_q17/duckdb:vortex-compact 32075589 33195446 0.97
tpch_q18/duckdb:vortex-compact 52142364 53077027 0.98
tpch_q19/duckdb:vortex-compact 39473709 41718834 0.95
tpch_q20/duckdb:vortex-compact 44529918 47342392 0.94
tpch_q21/duckdb:vortex-compact 112579826 119571998 0.94
tpch_q22/duckdb:vortex-compact 20736241 22010759 0.94
duckdb / parquet (0.975x ➖, 4↑ 2↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 91964305 90119702 1.02
tpch_q02/duckdb:parquet 40546573 41813115 0.97
tpch_q03/duckdb:parquet 70612689 71497547 0.99
tpch_q04/duckdb:parquet 🚨 55726717 49502187 1.13
tpch_q05/duckdb:parquet 68202584 68899313 0.99
tpch_q06/duckdb:parquet 20441014 20732742 0.99
tpch_q07/duckdb:parquet 70678409 71032679 1.00
tpch_q08/duckdb:parquet 82395302 83817509 0.98
tpch_q09/duckdb:parquet 158092865 164020068 0.96
tpch_q10/duckdb:parquet 141846425 130154829 1.09
tpch_q11/duckdb:parquet 22511855 22926469 0.98
tpch_q12/duckdb:parquet 45212125 45665608 0.99
tpch_q13/duckdb:parquet 274100471 281484107 0.97
tpch_q14/duckdb:parquet 🚨 62897828 51475425 1.22
tpch_q15/duckdb:parquet 🚀 24272717 30300359 0.80
tpch_q16/duckdb:parquet 55419052 58221942 0.95
tpch_q17/duckdb:parquet 🚀 49275953 57409904 0.86
tpch_q18/duckdb:parquet 🚀 120540447 136902565 0.88
tpch_q19/duckdb:parquet 🚀 70500133 92869410 0.76
tpch_q20/duckdb:parquet 64904323 65220429 1.00
tpch_q21/duckdb:parquet 182441696 171921286 1.06
tpch_q22/duckdb:parquet 52238299 53683327 0.97
duckdb / duckdb (1.005x ➖, 0↑ 1↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16177600 16891474 0.96
tpch_q02/duckdb:duckdb 13287607 12926751 1.03
tpch_q03/duckdb:duckdb 19588400 18359991 1.07
tpch_q04/duckdb:duckdb 19716794 19911673 0.99
tpch_q05/duckdb:duckdb 21216973 19400127 1.09
tpch_q06/duckdb:duckdb 5519863 5438532 1.01
tpch_q07/duckdb:duckdb 22790587 22305409 1.02
tpch_q08/duckdb:duckdb 22174798 21843448 1.02
tpch_q09/duckdb:duckdb 54897050 56426284 0.97
tpch_q10/duckdb:duckdb 48111255 48326494 1.00
tpch_q11/duckdb:duckdb 6143715 6276527 0.98
tpch_q12/duckdb:duckdb 14268351 14430636 0.99
tpch_q13/duckdb:duckdb 37461103 38745931 0.97
tpch_q14/duckdb:duckdb 🚨 19553989 16273848 1.20
tpch_q15/duckdb:duckdb 12091694 12029606 1.01
tpch_q16/duckdb:duckdb 24370049 23096698 1.06
tpch_q17/duckdb:duckdb 13845172 14618180 0.95
tpch_q18/duckdb:duckdb 38326785 39034171 0.98
tpch_q19/duckdb:duckdb 28290620 28563325 0.99
tpch_q20/duckdb:duckdb 23151068 23759956 0.97
tpch_q21/duckdb:duckdb 54546761 58211543 0.94
tpch_q22/duckdb:duckdb 24389664 25177931 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -2.4% +20.2% -18.8% +30.7% ➖ noise
1 datafusion:vortex-compact -10.4% +20.2% -25.5% +29.2% ✅ faster
1 datafusion:vortex-file-compressed +2.7% +20.2% -14.6% +30.3% ➖ noise
1 duckdb:duckdb -4.2% +20.2% -20.3% +29.8% ➖ noise
1 duckdb:vortex-compact -2.2% +20.2% -18.6% +28.7% ➖ noise
1 duckdb:vortex-file-compressed -1.5% +20.2% -18.0% +29.5% ➖ noise
2 datafusion:arrow +5.2% -0.1% +5.4% +21.9% ➖ noise
2 datafusion:vortex-compact -7.5% -0.1% -7.4% +21.9% ➖ noise
2 datafusion:vortex-file-compressed +2.0% -0.1% +2.1% +21.9% ➖ noise
2 duckdb:duckdb +2.8% -0.1% +2.9% +21.9% ➖ noise
2 duckdb:vortex-compact -3.0% -0.1% -2.8% +21.9% ➖ noise
2 duckdb:vortex-file-compressed +1.2% -0.1% +1.4% +21.9% ➖ noise
3 datafusion:arrow +7.4% -0.7% +8.2% +21.9% ➖ noise
3 datafusion:vortex-compact -8.6% -0.7% -7.9% +21.9% ➖ noise
3 datafusion:vortex-file-compressed +4.1% -0.7% +4.8% +21.9% ➖ noise
3 duckdb:duckdb +6.7% -0.7% +7.4% +21.9% ➖ noise
3 duckdb:vortex-compact -7.6% -0.7% -6.9% +21.9% ➖ noise
3 duckdb:vortex-file-compressed -1.7% -0.7% -1.0% +21.9% ➖ noise
4 datafusion:arrow +3.7% +5.8% -2.0% +21.9% ➖ noise
4 datafusion:vortex-compact -10.9% +5.8% -15.8% +21.9% ➖ noise
4 datafusion:vortex-file-compressed -0.4% +5.8% -5.9% +21.9% ➖ noise
4 duckdb:duckdb -1.0% +5.8% -6.4% +21.9% ➖ noise
4 duckdb:vortex-compact -5.2% +5.8% -10.4% +21.9% ➖ noise
4 duckdb:vortex-file-compressed -1.5% +5.8% -6.9% +21.9% ➖ noise
5 datafusion:arrow +0.0% +2.7% -2.6% +21.9% ➖ noise
5 datafusion:vortex-compact -6.5% +2.7% -9.0% +21.9% ➖ noise
5 datafusion:vortex-file-compressed -5.9% +2.7% -8.4% +21.9% ➖ noise
5 duckdb:duckdb +9.4% +2.7% +6.5% +21.9% ➖ noise
5 duckdb:vortex-compact -8.3% +2.7% -10.8% +21.9% ➖ noise
5 duckdb:vortex-file-compressed -5.4% +2.7% -8.0% +21.9% ➖ noise
6 datafusion:arrow +8.3% -12.0% +23.1% +21.9% 🚨 regression
6 datafusion:vortex-compact -4.2% -12.0% +8.9% +21.9% ➖ noise
6 datafusion:vortex-file-compressed -9.5% -12.0% +2.9% +21.9% ➖ noise
6 duckdb:duckdb +1.5% -12.0% +15.4% +22.1% ➖ noise
6 duckdb:vortex-compact +5.2% -12.0% +19.6% +21.9% ➖ noise
6 duckdb:vortex-file-compressed -2.7% -12.0% +10.6% +21.9% ➖ noise
7 datafusion:arrow +9.7% +2.6% +6.9% +21.9% ➖ noise
7 datafusion:vortex-compact -2.9% +2.6% -5.4% +21.9% ➖ noise
7 datafusion:vortex-file-compressed -11.2% +2.6% -13.4% +21.9% ➖ noise
7 duckdb:duckdb +2.2% +2.6% -0.4% +21.9% ➖ noise
7 duckdb:vortex-compact -4.0% +2.6% -6.5% +21.9% ➖ noise
7 duckdb:vortex-file-compressed -7.5% +2.6% -9.9% +21.9% ➖ noise
8 datafusion:arrow +5.6% -0.2% +5.8% +21.9% ➖ noise
8 datafusion:vortex-compact -8.7% -0.2% -8.5% +21.9% ➖ noise
8 datafusion:vortex-file-compressed -8.0% -0.2% -7.8% +21.9% ➖ noise
8 duckdb:duckdb +1.5% -0.2% +1.8% +21.9% ➖ noise
8 duckdb:vortex-compact -0.2% -0.2% +0.1% +21.9% ➖ noise
8 duckdb:vortex-file-compressed -5.4% -0.2% -5.2% +21.9% ➖ noise
9 datafusion:arrow +8.7% -1.4% +10.2% +21.9% ➖ noise
9 datafusion:vortex-compact -7.8% -1.4% -6.5% +21.9% ➖ noise
9 datafusion:vortex-file-compressed -5.1% -1.4% -3.8% +21.9% ➖ noise
9 duckdb:duckdb -2.7% -1.4% -1.4% +21.9% ➖ noise
9 duckdb:vortex-compact -7.9% -1.4% -6.6% +21.9% ➖ noise
9 duckdb:vortex-file-compressed +0.9% -1.4% +2.3% +21.9% ➖ noise
10 datafusion:arrow +11.4% +4.7% +6.4% +21.9% ➖ noise
10 datafusion:vortex-compact -6.9% +4.7% -11.1% +21.9% ➖ noise
10 datafusion:vortex-file-compressed -6.5% +4.7% -10.8% +21.9% ➖ noise
10 duckdb:duckdb -0.4% +4.7% -5.0% +21.9% ➖ noise
10 duckdb:vortex-compact -3.1% +4.7% -7.5% +21.9% ➖ noise
10 duckdb:vortex-file-compressed -1.7% +4.7% -6.2% +21.9% ➖ noise
11 datafusion:arrow +15.4% -1.9% +17.7% +21.9% ➖ noise
11 datafusion:vortex-compact -9.9% -1.9% -8.2% +21.9% ➖ noise
11 datafusion:vortex-file-compressed -4.5% -1.9% -2.7% +21.9% ➖ noise
11 duckdb:duckdb -2.1% -1.9% -0.2% +21.9% ➖ noise
11 duckdb:vortex-compact +5.1% -1.9% +7.1% +21.9% ➖ noise
11 duckdb:vortex-file-compressed -5.9% -1.9% -4.1% +21.9% ➖ noise
12 datafusion:arrow +17.4% -6.0% +24.9% +21.9% 🚨 regression
12 datafusion:vortex-compact -4.5% -6.0% +1.6% +21.9% ➖ noise
12 datafusion:vortex-file-compressed -9.7% -6.0% -3.9% +21.9% ➖ noise
12 duckdb:duckdb -1.1% -6.0% +5.2% +21.9% ➖ noise
12 duckdb:vortex-compact +3.9% -6.0% +10.6% +21.9% ➖ noise
12 duckdb:vortex-file-compressed -7.1% -6.0% -1.2% +21.9% ➖ noise
13 datafusion:arrow +14.3% -3.9% +19.0% +21.9% ➖ noise
13 datafusion:vortex-compact -3.7% -3.9% +0.2% +21.9% ➖ noise
13 datafusion:vortex-file-compressed -7.8% -3.9% -4.0% +21.9% ➖ noise
13 duckdb:duckdb -3.3% -3.9% +0.6% +21.9% ➖ noise
13 duckdb:vortex-compact -6.3% -3.9% -2.5% +21.9% ➖ noise
13 duckdb:vortex-file-compressed -6.4% -3.9% -2.6% +21.9% ➖ noise
14 datafusion:arrow +16.0% +13.9% +1.9% +21.9% ➖ noise
14 datafusion:vortex-compact -10.9% +13.9% -21.8% +21.9% ✅ faster
14 datafusion:vortex-file-compressed -10.0% +13.9% -21.0% +21.9% ✅ faster
14 duckdb:duckdb +20.2% +13.9% +5.5% +21.9% ➖ noise
14 duckdb:vortex-compact -6.0% +13.9% -17.5% +21.9% ➖ noise
14 duckdb:vortex-file-compressed -1.2% +13.9% -13.3% +21.9% ➖ noise
15 datafusion:arrow +12.3% -7.0% +20.8% +21.9% ➖ noise
15 datafusion:vortex-compact -5.3% -7.0% +1.9% +21.9% ➖ noise
15 datafusion:vortex-file-compressed -5.7% -7.0% +1.4% +21.9% ➖ noise
15 duckdb:duckdb +0.5% -7.0% +8.1% +21.9% ➖ noise
15 duckdb:vortex-compact -1.0% -7.0% +6.4% +21.9% ➖ noise
15 duckdb:vortex-file-compressed -4.5% -7.0% +2.7% +21.9% ➖ noise
16 datafusion:arrow +5.2% -2.8% +8.3% +21.9% ➖ noise
16 datafusion:vortex-compact -4.7% -2.8% -2.0% +21.9% ➖ noise
16 datafusion:vortex-file-compressed -11.2% -2.8% -8.7% +21.9% ➖ noise
16 duckdb:duckdb +5.5% -2.8% +8.6% +21.9% ➖ noise
16 duckdb:vortex-compact +0.9% -2.8% +3.8% +21.9% ➖ noise
16 duckdb:vortex-file-compressed -5.1% -2.8% -2.4% +21.9% ➖ noise
17 datafusion:arrow +10.1% -1.7% +12.0% +21.9% ➖ noise
17 datafusion:vortex-compact -9.0% -1.7% -7.4% +21.9% ➖ noise
17 datafusion:vortex-file-compressed -9.3% -1.7% -7.7% +21.9% ➖ noise
17 duckdb:duckdb -5.3% -1.7% -3.7% +21.9% ➖ noise
17 duckdb:vortex-compact -3.4% -1.7% -1.7% +21.9% ➖ noise
17 duckdb:vortex-file-compressed -7.9% -1.7% -6.3% +21.9% ➖ noise
18 datafusion:arrow +4.4% -6.3% +11.3% +21.9% ➖ noise
18 datafusion:vortex-compact -6.6% -6.3% -0.4% +21.9% ➖ noise
18 datafusion:vortex-file-compressed -8.2% -6.3% -2.1% +21.9% ➖ noise
18 duckdb:duckdb -1.8% -6.3% +4.7% +21.9% ➖ noise
18 duckdb:vortex-compact -1.8% -6.3% +4.8% +21.9% ➖ noise
18 duckdb:vortex-file-compressed -3.3% -6.3% +3.2% +21.9% ➖ noise
19 datafusion:arrow +9.0% -16.0% +29.7% +21.9% 🚨 regression
19 datafusion:vortex-compact -7.6% -16.0% +10.0% +21.9% ➖ noise
19 datafusion:vortex-file-compressed -6.8% -16.0% +10.9% +21.9% ➖ noise
19 duckdb:duckdb -1.0% -16.0% +17.9% +21.9% ➖ noise
19 duckdb:vortex-compact -5.4% -16.0% +12.6% +21.9% ➖ noise
19 duckdb:vortex-file-compressed -2.1% -16.0% +16.4% +21.9% ➖ noise
20 datafusion:arrow +7.4% +3.1% +4.2% +21.9% ➖ noise
20 datafusion:vortex-compact -4.9% +3.1% -7.7% +21.9% ➖ noise
20 datafusion:vortex-file-compressed -8.0% +3.1% -10.8% +21.9% ➖ noise
20 duckdb:duckdb -2.6% +3.1% -5.5% +21.9% ➖ noise
20 duckdb:vortex-compact -5.9% +3.1% -8.7% +21.9% ➖ noise
20 duckdb:vortex-file-compressed -2.7% +3.1% -5.6% +21.9% ➖ noise
21 datafusion:arrow +2.5% +5.6% -2.9% +21.9% ➖ noise
21 datafusion:vortex-compact -6.2% +5.6% -11.1% +21.9% ➖ noise
21 datafusion:vortex-file-compressed -8.2% +5.6% -13.1% +21.9% ➖ noise
21 duckdb:duckdb -6.3% +5.6% -11.2% +21.9% ➖ noise
21 duckdb:vortex-compact -5.8% +5.6% -10.8% +21.9% ➖ noise
21 duckdb:vortex-file-compressed -6.9% +5.6% -11.8% +21.9% ➖ noise
22 datafusion:arrow +4.4% -0.3% +4.7% +21.9% ➖ noise
22 datafusion:vortex-compact -9.4% -0.3% -9.1% +21.9% ➖ noise
22 datafusion:vortex-file-compressed -2.9% -0.3% -2.6% +21.9% ➖ noise
22 duckdb:duckdb -3.1% -0.3% -2.8% +21.9% ➖ noise
22 duckdb:vortex-compact -5.8% -0.3% -5.5% +21.9% ➖ noise
22 duckdb:vortex-file-compressed -1.5% -0.3% -1.1% +21.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Vortex (geomean): 0.987x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish -0.5%

datafusion / vortex-file-compressed (0.976x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5125227 5454875 0.94
fineweb_q01/datafusion:vortex-file-compressed 27026626 27947966 0.97
fineweb_q02/datafusion:vortex-file-compressed 27104114 28795857 0.94
fineweb_q03/datafusion:vortex-file-compressed 77834167 74959985 1.04
fineweb_q04/datafusion:vortex-file-compressed 259790923 255539958 1.02
fineweb_q05/datafusion:vortex-file-compressed 225739089 230556992 0.98
fineweb_q06/datafusion:vortex-file-compressed 67447681 68638502 0.98
fineweb_q07/datafusion:vortex-file-compressed 68741575 67521000 1.02
fineweb_q08/datafusion:vortex-file-compressed 23529791 25879086 0.91
datafusion / vortex-compact (0.983x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5214449 5272704 0.99
fineweb_q01/datafusion:vortex-compact 163230517 164328051 0.99
fineweb_q02/datafusion:vortex-compact 162704392 165617346 0.98
fineweb_q03/datafusion:vortex-compact 1442771257 1448877384 1.00
fineweb_q04/datafusion:vortex-compact 1567899124 1577229002 0.99
fineweb_q05/datafusion:vortex-compact 1224835269 1237633665 0.99
fineweb_q06/datafusion:vortex-compact 696221717 692631248 1.01
fineweb_q07/datafusion:vortex-compact 729109631 729345642 1.00
fineweb_q08/datafusion:vortex-compact 22116590 24502384 0.90
datafusion / parquet (0.992x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6353131 6182246 1.03
fineweb_q01/datafusion:parquet 265758939 274146840 0.97
fineweb_q02/datafusion:parquet 266055462 272735585 0.98
fineweb_q03/datafusion:parquet 273879675 269551189 1.02
fineweb_q04/datafusion:parquet 283302742 281185563 1.01
fineweb_q05/datafusion:parquet 281124387 281508552 1.00
fineweb_q06/datafusion:parquet 269900176 283897108 0.95
fineweb_q07/datafusion:parquet 265318515 267374823 0.99
fineweb_q08/datafusion:parquet 262417860 264029938 0.99
duckdb / vortex-file-compressed (1.003x ➖, 1↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3512219 3432948 1.02
fineweb_q01/duckdb:vortex-file-compressed 29308308 27177649 1.08
fineweb_q02/duckdb:vortex-file-compressed 27683620 27581475 1.00
fineweb_q03/duckdb:vortex-file-compressed 🚀 135878899 161452766 0.84
fineweb_q04/duckdb:vortex-file-compressed 230754811 227712826 1.01
fineweb_q05/duckdb:vortex-file-compressed 218438462 215738602 1.01
fineweb_q06/duckdb:vortex-file-compressed 70466554 69938982 1.01
fineweb_q07/duckdb:vortex-file-compressed 62513667 63173720 0.99
fineweb_q08/duckdb:vortex-file-compressed 25849514 23972771 1.08
duckdb / vortex-compact (0.987x ➖, 1↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4097415 3865126 1.06
fineweb_q01/duckdb:vortex-compact 95838014 95905922 1.00
fineweb_q02/duckdb:vortex-compact 110281224 114147435 0.97
fineweb_q03/duckdb:vortex-compact 853183922 869315746 0.98
fineweb_q04/duckdb:vortex-compact 908471712 904244883 1.00
fineweb_q05/duckdb:vortex-compact 808915528 811116702 1.00
fineweb_q06/duckdb:vortex-compact 464624853 467395606 0.99
fineweb_q07/duckdb:vortex-compact 475312589 478686940 0.99
fineweb_q08/duckdb:vortex-compact 🚀 20783328 23305700 0.89
duckdb / parquet (0.980x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 35082550 35675531 0.98
fineweb_q01/duckdb:parquet 91888683 93094853 0.99
fineweb_q02/duckdb:parquet 94694147 96495479 0.98
fineweb_q03/duckdb:parquet 305502555 308609287 0.99
fineweb_q04/duckdb:parquet 436960975 443143165 0.99
fineweb_q05/duckdb:parquet 408196772 414957975 0.98
fineweb_q06/duckdb:parquet 197092026 202185601 0.97
fineweb_q07/duckdb:parquet 210050890 212006359 0.99
fineweb_q08/duckdb:parquet 55938856 59291304 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -1.1% +0.5% -1.6% +46.2% ➖ noise
0 datafusion:vortex-file-compressed -6.0% +0.5% -6.5% +73.5% ➖ noise
0 duckdb:vortex-compact +6.0% +0.5% +5.5% +40.0% ➖ noise
0 duckdb:vortex-file-compressed +2.3% +0.5% +1.8% +51.9% ➖ noise
1 datafusion:vortex-compact -0.7% -2.2% +1.5% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -3.3% -2.2% -1.1% +15.3% ➖ noise
1 duckdb:vortex-compact -0.1% -2.2% +2.2% +17.7% ➖ noise
1 duckdb:vortex-file-compressed +7.8% -2.2% +10.2% +40.9% ➖ noise
2 datafusion:vortex-compact -1.8% -2.2% +0.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -5.9% -2.2% -3.8% +10.0% ➖ noise
2 duckdb:vortex-compact -3.4% -2.2% -1.3% +11.2% ➖ noise
2 duckdb:vortex-file-compressed +0.4% -2.2% +2.6% +10.0% ➖ noise
3 datafusion:vortex-compact -0.4% +0.3% -0.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.8% +0.3% +3.5% +15.6% ➖ noise
3 duckdb:vortex-compact -1.9% +0.3% -2.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -15.8% +0.3% -16.1% +30.7% ➖ noise
4 datafusion:vortex-compact -0.6% -0.3% -0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.7% -0.3% +2.0% +10.0% ➖ noise
4 duckdb:vortex-compact +0.5% -0.3% +0.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.3% -0.3% +1.7% +10.0% ➖ noise
5 datafusion:vortex-compact -1.0% -0.9% -0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.1% -0.9% -1.2% +10.0% ➖ noise
5 duckdb:vortex-compact -0.3% -0.9% +0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.3% -0.9% +2.2% +10.0% ➖ noise
6 datafusion:vortex-compact +0.5% -3.7% +4.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -1.7% -3.7% +2.1% +11.4% ➖ noise
6 duckdb:vortex-compact -0.6% -3.7% +3.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.8% -3.7% +4.7% +19.8% ➖ noise
7 datafusion:vortex-compact -0.0% -0.8% +0.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +1.8% -0.8% +2.7% +10.0% ➖ noise
7 duckdb:vortex-compact -0.7% -0.8% +0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.0% -0.8% -0.2% +11.9% ➖ noise
8 datafusion:vortex-compact -9.7% -3.2% -6.8% +24.4% ➖ noise
8 datafusion:vortex-file-compressed -9.1% -3.2% -6.1% +15.1% ➖ noise
8 duckdb:vortex-compact -10.8% -3.2% -7.9% +17.7% ➖ noise
8 duckdb:vortex-file-compressed +7.8% -3.2% +11.4% +12.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.4%
Vortex (geomean): 1.059x ➖
Parquet (geomean): 1.040x ➖
Shifts: Parquet (control) +4.0% · Median polish +5.3%

datafusion / vortex-file-compressed (1.061x ➖, 0↑ 29↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 29020420 28261953 1.03
tpcds_q02/datafusion:vortex-file-compressed 54020777 51774777 1.04
tpcds_q03/datafusion:vortex-file-compressed 21169143 20451676 1.04
tpcds_q04/datafusion:vortex-file-compressed 299728020 291995171 1.03
tpcds_q05/datafusion:vortex-file-compressed 55448741 53127010 1.04
tpcds_q06/datafusion:vortex-file-compressed 53514177 51527326 1.04
tpcds_q07/datafusion:vortex-file-compressed 52898528 50069542 1.06
tpcds_q08/datafusion:vortex-file-compressed 37640534 37468228 1.00
tpcds_q09/datafusion:vortex-file-compressed 56769917 54393919 1.04
tpcds_q10/datafusion:vortex-file-compressed 47751385 45099210 1.06
tpcds_q11/datafusion:vortex-file-compressed 168859952 165161414 1.02
tpcds_q12/datafusion:vortex-file-compressed 22070257 22351069 0.99
tpcds_q13/datafusion:vortex-file-compressed 61729650 59732690 1.03
tpcds_q14/datafusion:vortex-file-compressed 203956368 202468521 1.01
tpcds_q15/datafusion:vortex-file-compressed 35710845 34399445 1.04
tpcds_q16/datafusion:vortex-file-compressed 29308311 28847945 1.02
tpcds_q17/datafusion:vortex-file-compressed 67445305 65871479 1.02
tpcds_q18/datafusion:vortex-file-compressed 80831964 77750265 1.04
tpcds_q19/datafusion:vortex-file-compressed 31243099 30746614 1.02
tpcds_q20/datafusion:vortex-file-compressed 25516621 26241269 0.97
tpcds_q21/datafusion:vortex-file-compressed 141261544 140445697 1.01
tpcds_q22/datafusion:vortex-file-compressed 58033901 58328299 0.99
tpcds_q23/datafusion:vortex-file-compressed 152383123 147584710 1.03
tpcds_q24/datafusion:vortex-file-compressed 116219255 109925199 1.06
tpcds_q25/datafusion:vortex-file-compressed 68653501 66820821 1.03
tpcds_q26/datafusion:vortex-file-compressed 37634684 36379202 1.03
tpcds_q27/datafusion:vortex-file-compressed 119883682 118661673 1.01
tpcds_q28/datafusion:vortex-file-compressed 50674868 49420231 1.03
tpcds_q29/datafusion:vortex-file-compressed 69454869 66235352 1.05
tpcds_q30/datafusion:vortex-file-compressed 32340175 30076088 1.08
tpcds_q31/datafusion:vortex-file-compressed 95896873 94900846 1.01
tpcds_q32/datafusion:vortex-file-compressed 21242068 19860527 1.07
tpcds_q33/datafusion:vortex-file-compressed 38756790 38491698 1.01
tpcds_q34/datafusion:vortex-file-compressed 33169317 33463654 0.99
tpcds_q35/datafusion:vortex-file-compressed 57034858 55759243 1.02
tpcds_q36/datafusion:vortex-file-compressed 79788367 73901240 1.08
tpcds_q37/datafusion:vortex-file-compressed 35731231 33381500 1.07
tpcds_q38/datafusion:vortex-file-compressed 🚨 57053071 50819345 1.12
tpcds_q39/datafusion:vortex-file-compressed 149078284 150213996 0.99
tpcds_q40/datafusion:vortex-file-compressed 57412958 52459467 1.09
tpcds_q41/datafusion:vortex-file-compressed 🚨 20118396 17905538 1.12
tpcds_q42/datafusion:vortex-file-compressed 🚨 21161411 18874459 1.12
tpcds_q43/datafusion:vortex-file-compressed 34948632 32856937 1.06
tpcds_q44/datafusion:vortex-file-compressed 46802547 45165111 1.04
tpcds_q45/datafusion:vortex-file-compressed 35715823 35089383 1.02
tpcds_q46/datafusion:vortex-file-compressed 52223403 50007997 1.04
tpcds_q47/datafusion:vortex-file-compressed 223121524 213489374 1.05
tpcds_q48/datafusion:vortex-file-compressed 48973540 50621897 0.97
tpcds_q49/datafusion:vortex-file-compressed 72869313 69940668 1.04
tpcds_q50/datafusion:vortex-file-compressed 48854419 47793613 1.02
tpcds_q51/datafusion:vortex-file-compressed 92256809 92063609 1.00
tpcds_q52/datafusion:vortex-file-compressed 19268479 20040799 0.96
tpcds_q53/datafusion:vortex-file-compressed 26921489 28111914 0.96
tpcds_q54/datafusion:vortex-file-compressed 45859464 46123568 0.99
tpcds_q55/datafusion:vortex-file-compressed 18991802 18646009 1.02
tpcds_q56/datafusion:vortex-file-compressed 40994033 40954489 1.00
tpcds_q57/datafusion:vortex-file-compressed 128942033 132482550 0.97
tpcds_q58/datafusion:vortex-file-compressed 73840566 71972783 1.03
tpcds_q59/datafusion:vortex-file-compressed 73347394 73638987 1.00
tpcds_q60/datafusion:vortex-file-compressed 42792625 41502870 1.03
tpcds_q61/datafusion:vortex-file-compressed 51795681 52900598 0.98
tpcds_q62/datafusion:vortex-file-compressed 32051906 31886158 1.01
tpcds_q63/datafusion:vortex-file-compressed 26319186 26050034 1.01
tpcds_q64/datafusion:vortex-file-compressed 485856147 472466299 1.03
tpcds_q65/datafusion:vortex-file-compressed 52016469 47865828 1.09
tpcds_q66/datafusion:vortex-file-compressed 98491054 92262895 1.07
tpcds_q67/datafusion:vortex-file-compressed 123014984 124186133 0.99
tpcds_q68/datafusion:vortex-file-compressed 47469449 46401918 1.02
tpcds_q69/datafusion:vortex-file-compressed 44011048 43538962 1.01
tpcds_q70/datafusion:vortex-file-compressed 118543249 108797352 1.09
tpcds_q71/datafusion:vortex-file-compressed 31858431 30497614 1.04
tpcds_q72/datafusion:vortex-file-compressed 🚨 3195566647 2576213726 1.24
tpcds_q73/datafusion:vortex-file-compressed 🚨 38241563 33841687 1.13
tpcds_q74/datafusion:vortex-file-compressed 🚨 136688509 116045900 1.18
tpcds_q75/datafusion:vortex-file-compressed 🚨 134628150 115445964 1.17
tpcds_q76/datafusion:vortex-file-compressed 🚨 40320549 34365147 1.17
tpcds_q77/datafusion:vortex-file-compressed 🚨 61023307 50666232 1.20
tpcds_q78/datafusion:vortex-file-compressed 🚨 143771637 123826225 1.16
tpcds_q79/datafusion:vortex-file-compressed 🚨 43343114 38981327 1.11
tpcds_q80/datafusion:vortex-file-compressed 🚨 129774234 114077573 1.14
tpcds_q81/datafusion:vortex-file-compressed 🚨 40769953 36606560 1.11
tpcds_q82/datafusion:vortex-file-compressed 🚨 42163389 34219302 1.23
tpcds_q83/datafusion:vortex-file-compressed 🚨 56476123 50877028 1.11
tpcds_q84/datafusion:vortex-file-compressed 🚨 17566455 15209552 1.15
tpcds_q85/datafusion:vortex-file-compressed 🚨 112965611 101604298 1.11
tpcds_q86/datafusion:vortex-file-compressed 🚨 21610938 18803099 1.15
tpcds_q87/datafusion:vortex-file-compressed 🚨 59268089 52927376 1.12
tpcds_q88/datafusion:vortex-file-compressed 83941520 76553345 1.10
tpcds_q89/datafusion:vortex-file-compressed 🚨 41469944 37100770 1.12
tpcds_q90/datafusion:vortex-file-compressed 🚨 19862879 18023749 1.10
tpcds_q91/datafusion:vortex-file-compressed 🚨 29237359 25972854 1.13
tpcds_q92/datafusion:vortex-file-compressed 🚨 21205490 18102577 1.17
tpcds_q93/datafusion:vortex-file-compressed 🚨 40210758 34172286 1.18
tpcds_q94/datafusion:vortex-file-compressed 🚨 27514938 23373091 1.18
tpcds_q95/datafusion:vortex-file-compressed 65831609 60250188 1.09
tpcds_q96/datafusion:vortex-file-compressed 🚨 19935251 16894778 1.18
tpcds_q97/datafusion:vortex-file-compressed 🚨 34784998 31168081 1.12
tpcds_q98/datafusion:vortex-file-compressed 🚨 36811303 31907111 1.15
tpcds_q99/datafusion:vortex-file-compressed 🚨 53489184 47265876 1.13
datafusion / vortex-compact (1.122x ❌, 0↑ 70↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 🚨 40705655 35469089 1.15
tpcds_q02/datafusion:vortex-compact 🚨 65490537 57666325 1.14
tpcds_q03/datafusion:vortex-compact 🚨 29384404 25250451 1.16
tpcds_q04/datafusion:vortex-compact 🚨 378001386 327755810 1.15
tpcds_q05/datafusion:vortex-compact 71476847 65675200 1.09
tpcds_q06/datafusion:vortex-compact 🚨 65468270 57230892 1.14
tpcds_q07/datafusion:vortex-compact 72387062 66677706 1.09
tpcds_q08/datafusion:vortex-compact 50755504 46595151 1.09
tpcds_q09/datafusion:vortex-compact 🚨 112353842 101900756 1.10
tpcds_q10/datafusion:vortex-compact 🚨 68611736 61912545 1.11
tpcds_q11/datafusion:vortex-compact 🚨 211128635 186403029 1.13
tpcds_q12/datafusion:vortex-compact 🚨 28354150 24778303 1.14
tpcds_q13/datafusion:vortex-compact 137413003 126895813 1.08
tpcds_q14/datafusion:vortex-compact 🚨 282869352 251584236 1.12
tpcds_q15/datafusion:vortex-compact 🚨 44259821 37509957 1.18
tpcds_q16/datafusion:vortex-compact 43172681 39841979 1.08
tpcds_q17/datafusion:vortex-compact 🚨 105995674 94462487 1.12
tpcds_q18/datafusion:vortex-compact 🚨 102088167 91561468 1.11
tpcds_q19/datafusion:vortex-compact 47890975 44098871 1.09
tpcds_q20/datafusion:vortex-compact 🚨 33816312 30322177 1.12
tpcds_q21/datafusion:vortex-compact 🚨 160102540 140671278 1.14
tpcds_q22/datafusion:vortex-compact 🚨 74255630 65022038 1.14
tpcds_q23/datafusion:vortex-compact 🚨 208711495 185615784 1.12
tpcds_q24/datafusion:vortex-compact 🚨 160281890 144294721 1.11
tpcds_q25/datafusion:vortex-compact 🚨 104811930 91522339 1.15
tpcds_q26/datafusion:vortex-compact 51794418 47413763 1.09
tpcds_q27/datafusion:vortex-compact 🚨 178534507 157301126 1.13
tpcds_q28/datafusion:vortex-compact 107570097 100118923 1.07
tpcds_q29/datafusion:vortex-compact 🚨 106555294 95739152 1.11
tpcds_q30/datafusion:vortex-compact 🚨 41278356 35184841 1.17
tpcds_q31/datafusion:vortex-compact 🚨 137526999 123784644 1.11
tpcds_q32/datafusion:vortex-compact 28874823 26475531 1.09
tpcds_q33/datafusion:vortex-compact 🚨 57299672 51450670 1.11
tpcds_q34/datafusion:vortex-compact 51736314 48972179 1.06
tpcds_q35/datafusion:vortex-compact 🚨 75774881 68692696 1.10
tpcds_q36/datafusion:vortex-compact 108753400 99287751 1.10
tpcds_q37/datafusion:vortex-compact 🚨 51884867 46972500 1.10
tpcds_q38/datafusion:vortex-compact 70882113 64605702 1.10
tpcds_q39/datafusion:vortex-compact 161475153 148531631 1.09
tpcds_q40/datafusion:vortex-compact 🚨 66853152 58535636 1.14
tpcds_q41/datafusion:vortex-compact 🚨 23452301 19642538 1.19
tpcds_q42/datafusion:vortex-compact 🚨 27398379 24060070 1.14
tpcds_q43/datafusion:vortex-compact 🚨 43952676 39185129 1.12
tpcds_q44/datafusion:vortex-compact 81363295 74629822 1.09
tpcds_q45/datafusion:vortex-compact 🚨 41639500 35976291 1.16
tpcds_q46/datafusion:vortex-compact 🚨 77373548 67918108 1.14
tpcds_q47/datafusion:vortex-compact 🚨 267237024 227631475 1.17
tpcds_q48/datafusion:vortex-compact 104440004 95277114 1.10
tpcds_q49/datafusion:vortex-compact 107012761 97452239 1.10
tpcds_q50/datafusion:vortex-compact 69322968 64328992 1.08
tpcds_q51/datafusion:vortex-compact 105449844 98093799 1.07
tpcds_q52/datafusion:vortex-compact 🚨 27989162 23869000 1.17
tpcds_q53/datafusion:vortex-compact 🚨 39890688 35271474 1.13
tpcds_q54/datafusion:vortex-compact 61825904 57851594 1.07
tpcds_q55/datafusion:vortex-compact 🚨 27251428 24093103 1.13
tpcds_q56/datafusion:vortex-compact 🚨 60014672 53588744 1.12
tpcds_q57/datafusion:vortex-compact 🚨 156516980 140645131 1.11
tpcds_q58/datafusion:vortex-compact 🚨 88264001 74667460 1.18
tpcds_q59/datafusion:vortex-compact 🚨 97734626 86526864 1.13
tpcds_q60/datafusion:vortex-compact 🚨 67165327 53339503 1.26
tpcds_q61/datafusion:vortex-compact 79776619 73329519 1.09
tpcds_q62/datafusion:vortex-compact 🚨 36960192 32617998 1.13
tpcds_q63/datafusion:vortex-compact 38441284 35478143 1.08
tpcds_q64/datafusion:vortex-compact 🚨 603638865 532447209 1.13
tpcds_q65/datafusion:vortex-compact 73148393 68007119 1.08
tpcds_q66/datafusion:vortex-compact 108254354 98799863 1.10
tpcds_q67/datafusion:vortex-compact 🚨 144828252 125846258 1.15
tpcds_q68/datafusion:vortex-compact 🚨 76609177 67998243 1.13
tpcds_q69/datafusion:vortex-compact 66225303 60422217 1.10
tpcds_q70/datafusion:vortex-compact 🚨 139838539 124682139 1.12
tpcds_q71/datafusion:vortex-compact 🚨 49278335 44055237 1.12
tpcds_q72/datafusion:vortex-compact 🚨 3174504913 2615854952 1.21
tpcds_q73/datafusion:vortex-compact 🚨 57445117 49761905 1.15
tpcds_q74/datafusion:vortex-compact 🚨 149432113 132940209 1.12
tpcds_q75/datafusion:vortex-compact 🚨 182729538 164605094 1.11
tpcds_q76/datafusion:vortex-compact 57145886 52351283 1.09
tpcds_q77/datafusion:vortex-compact 🚨 74661702 66194615 1.13
tpcds_q78/datafusion:vortex-compact 🚨 169819867 148250518 1.15
tpcds_q79/datafusion:vortex-compact 64646920 59163774 1.09
tpcds_q80/datafusion:vortex-compact 🚨 147641450 131968169 1.12
tpcds_q81/datafusion:vortex-compact 🚨 47136283 42040707 1.12
tpcds_q82/datafusion:vortex-compact 🚨 54643780 47116306 1.16
tpcds_q83/datafusion:vortex-compact 🚨 66316288 58409703 1.14
tpcds_q84/datafusion:vortex-compact 🚨 21804645 19082373 1.14
tpcds_q85/datafusion:vortex-compact 🚨 139479690 125091272 1.12
tpcds_q86/datafusion:vortex-compact 🚨 23189510 19220754 1.21
tpcds_q87/datafusion:vortex-compact 🚨 71619073 64625806 1.11
tpcds_q88/datafusion:vortex-compact 147992907 141010481 1.05
tpcds_q89/datafusion:vortex-compact 🚨 50779806 44332567 1.15
tpcds_q90/datafusion:vortex-compact 🚨 26313242 23827042 1.10
tpcds_q91/datafusion:vortex-compact 🚨 44467065 40252671 1.10
tpcds_q92/datafusion:vortex-compact 🚨 23109736 20245922 1.14
tpcds_q93/datafusion:vortex-compact 🚨 54167076 47593431 1.14
tpcds_q94/datafusion:vortex-compact 🚨 34614495 30733988 1.13
tpcds_q95/datafusion:vortex-compact 76008688 70728823 1.07
tpcds_q96/datafusion:vortex-compact 28173666 27239275 1.03
tpcds_q97/datafusion:vortex-compact 🚨 46740903 41193215 1.13
tpcds_q98/datafusion:vortex-compact 🚨 44331020 38088633 1.16
tpcds_q99/datafusion:vortex-compact 🚨 58555671 49300884 1.19
datafusion / parquet (1.007x ➖, 1↑ 3↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚨 39582817 35706832 1.11
tpcds_q02/datafusion:parquet 49496530 45416019 1.09
tpcds_q03/datafusion:parquet 16178016 14771549 1.10
tpcds_q04/datafusion:parquet 🚨 366655733 327014545 1.12
tpcds_q05/datafusion:parquet 55855667 53796651 1.04
tpcds_q06/datafusion:parquet 67021068 65979639 1.02
tpcds_q07/datafusion:parquet 95548147 88708412 1.08
tpcds_q08/datafusion:parquet 32252856 32882047 0.98
tpcds_q09/datafusion:parquet 56589686 55078198 1.03
tpcds_q10/datafusion:parquet 85050110 82060267 1.04
tpcds_q11/datafusion:parquet 189442798 183149272 1.03
tpcds_q12/datafusion:parquet 24272588 23764462 1.02
tpcds_q13/datafusion:parquet 87465580 86850624 1.01
tpcds_q14/datafusion:parquet 193681718 199228872 0.97
tpcds_q15/datafusion:parquet 24940035 26191018 0.95
tpcds_q16/datafusion:parquet 28371985 28664395 0.99
tpcds_q17/datafusion:parquet 71455714 69942971 1.02
tpcds_q18/datafusion:parquet 132325261 131565758 1.01
tpcds_q19/datafusion:parquet 28374485 27818915 1.02
tpcds_q20/datafusion:parquet 20602465 20968253 0.98
tpcds_q21/datafusion:parquet 22155732 21887018 1.01
tpcds_q22/datafusion:parquet 129948021 134635431 0.97
tpcds_q23/datafusion:parquet 159914358 164079727 0.97
tpcds_q24/datafusion:parquet 106327503 107292416 0.99
tpcds_q25/datafusion:parquet 70672678 71244152 0.99
tpcds_q26/datafusion:parquet 75510632 75772881 1.00
tpcds_q27/datafusion:parquet 161728339 161298526 1.00
tpcds_q28/datafusion:parquet 49251479 48716734 1.01
tpcds_q29/datafusion:parquet 73775810 76131674 0.97
tpcds_q30/datafusion:parquet 44074991 43538989 1.01
tpcds_q31/datafusion:parquet 76366701 75789105 1.01
tpcds_q32/datafusion:parquet 22305520 24570488 0.91
tpcds_q33/datafusion:parquet 34823931 36228597 0.96
tpcds_q34/datafusion:parquet 28505927 27857030 1.02
tpcds_q35/datafusion:parquet 84635115 87041272 0.97
tpcds_q36/datafusion:parquet 65104431 67083496 0.97
tpcds_q37/datafusion:parquet 24241687 25165491 0.96
tpcds_q38/datafusion:parquet 50930557 50756268 1.00
tpcds_q39/datafusion:parquet 82919681 83551113 0.99
tpcds_q40/datafusion:parquet 28762091 27969153 1.03
tpcds_q41/datafusion:parquet 15891976 15632765 1.02
tpcds_q42/datafusion:parquet 14014925 13925466 1.01
tpcds_q43/datafusion:parquet 19296918 19321364 1.00
tpcds_q44/datafusion:parquet 42368476 41974951 1.01
tpcds_q45/datafusion:parquet 32323360 32813538 0.99
tpcds_q46/datafusion:parquet 39618382 39495541 1.00
tpcds_q47/datafusion:parquet 136069393 135519819 1.00
tpcds_q48/datafusion:parquet 80585527 80822044 1.00
tpcds_q49/datafusion:parquet 66096446 64986255 1.02
tpcds_q50/datafusion:parquet 48196884 51972363 0.93
tpcds_q51/datafusion:parquet 90925705 91589439 0.99
tpcds_q52/datafusion:parquet 14645859 14827691 0.99
tpcds_q53/datafusion:parquet 22342927 22163744 1.01
tpcds_q54/datafusion:parquet 43508705 42229866 1.03
tpcds_q55/datafusion:parquet 14040454 13846706 1.01
tpcds_q56/datafusion:parquet 35278839 34594698 1.02
tpcds_q57/datafusion:parquet 107703860 110041242 0.98
tpcds_q58/datafusion:parquet 59211815 61996901 0.96
tpcds_q59/datafusion:parquet 57578441 58889824 0.98
tpcds_q60/datafusion:parquet 35611707 36033544 0.99
tpcds_q61/datafusion:parquet 50698406 52068663 0.97
tpcds_q62/datafusion:parquet 🚨 28569489 24871231 1.15
tpcds_q63/datafusion:parquet 22029445 21125480 1.04
tpcds_q64/datafusion:parquet 554554658 553554479 1.00
tpcds_q65/datafusion:parquet 43833286 43335370 1.01
tpcds_q66/datafusion:parquet 77098892 79328051 0.97
tpcds_q67/datafusion:parquet 152540539 152667108 1.00
tpcds_q68/datafusion:parquet 39171513 39771988 0.98
tpcds_q69/datafusion:parquet 78947690 78848357 1.00
tpcds_q70/datafusion:parquet 97540963 94354578 1.03
tpcds_q71/datafusion:parquet 26067172 26425186 0.99
tpcds_q72/datafusion:parquet 635885377 651968802 0.98
tpcds_q73/datafusion:parquet 27012462 28313270 0.95
tpcds_q74/datafusion:parquet 111575177 105846624 1.05
tpcds_q75/datafusion:parquet 122673038 121736068 1.01
tpcds_q76/datafusion:parquet 37771259 35512331 1.06
tpcds_q77/datafusion:parquet 51183995 49876889 1.03
tpcds_q78/datafusion:parquet 127698396 132389662 0.96
tpcds_q79/datafusion:parquet 34685292 33215256 1.04
tpcds_q80/datafusion:parquet 91110867 95495394 0.95
tpcds_q81/datafusion:parquet 43664092 42514323 1.03
tpcds_q82/datafusion:parquet 24031545 24608766 0.98
tpcds_q83/datafusion:parquet 51373081 48871817 1.05
tpcds_q84/datafusion:parquet 49442879 47969350 1.03
tpcds_q85/datafusion:parquet 177406873 172253254 1.03
tpcds_q86/datafusion:parquet 17141968 18274840 0.94
tpcds_q87/datafusion:parquet 52124452 52413221 0.99
tpcds_q88/datafusion:parquet 72944896 70156020 1.04
tpcds_q89/datafusion:parquet 24835515 24625090 1.01
tpcds_q90/datafusion:parquet 19978852 18761113 1.06
tpcds_q91/datafusion:parquet 72387897 69232407 1.05
tpcds_q92/datafusion:parquet 22881514 22257165 1.03
tpcds_q93/datafusion:parquet 36521542 35060726 1.04
tpcds_q94/datafusion:parquet 24960622 26141187 0.95
tpcds_q95/datafusion:parquet 70080358 68148475 1.03
tpcds_q96/datafusion:parquet 15401526 14327349 1.07
tpcds_q97/datafusion:parquet 36087711 34015028 1.06
tpcds_q98/datafusion:parquet 26279256 26036320 1.01
tpcds_q99/datafusion:parquet 🚀 29173634 33316807 0.88
duckdb / vortex-file-compressed (1.020x ➖, 1↑ 6↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 27903225 25455628 1.10
tpcds_q02/duckdb:vortex-file-compressed 83647904 85416308 0.98
tpcds_q03/duckdb:vortex-file-compressed 23841566 24055757 0.99
tpcds_q04/duckdb:vortex-file-compressed 112185560 110076360 1.02
tpcds_q05/duckdb:vortex-file-compressed 107696938 98446961 1.09
tpcds_q06/duckdb:vortex-file-compressed 37002375 36239001 1.02
tpcds_q07/duckdb:vortex-file-compressed 🚨 26580542 23972539 1.11
tpcds_q08/duckdb:vortex-file-compressed 24583179 24329571 1.01
tpcds_q09/duckdb:vortex-file-compressed 40551552 39830787 1.02
tpcds_q10/duckdb:vortex-file-compressed 38886718 36133336 1.08
tpcds_q11/duckdb:vortex-file-compressed 64078211 61989652 1.03
tpcds_q12/duckdb:vortex-file-compressed 14369665 13507303 1.06
tpcds_q13/duckdb:vortex-file-compressed 34552830 33890766 1.02
tpcds_q14/duckdb:vortex-file-compressed 194573230 199541246 0.98
tpcds_q15/duckdb:vortex-file-compressed 42036726 40655057 1.03
tpcds_q16/duckdb:vortex-file-compressed 30882977 30365247 1.02
tpcds_q17/duckdb:vortex-file-compressed 39784330 37566120 1.06
tpcds_q18/duckdb:vortex-file-compressed 🚨 48592347 43569432 1.12
tpcds_q19/duckdb:vortex-file-compressed 34830639 34174028 1.02
tpcds_q20/duckdb:vortex-file-compressed 17215610 15849472 1.09
tpcds_q21/duckdb:vortex-file-compressed 19938418 20208694 0.99
tpcds_q22/duckdb:vortex-file-compressed 114937842 111282309 1.03
tpcds_q23/duckdb:vortex-file-compressed 131293775 129273194 1.02
tpcds_q24/duckdb:vortex-file-compressed 57998907 59455070 0.98
tpcds_q25/duckdb:vortex-file-compressed 38281562 38195055 1.00
tpcds_q26/duckdb:vortex-file-compressed 40258269 41210919 0.98
tpcds_q27/duckdb:vortex-file-compressed 92143322 88044216 1.05
tpcds_q28/duckdb:vortex-file-compressed 38124566 36517693 1.04
tpcds_q29/duckdb:vortex-file-compressed 38482418 38027535 1.01
tpcds_q30/duckdb:vortex-file-compressed 29306649 29800710 0.98
tpcds_q31/duckdb:vortex-file-compressed 25916414 27065845 0.96
tpcds_q32/duckdb:vortex-file-compressed 17148034 16812505 1.02
tpcds_q33/duckdb:vortex-file-compressed 68676381 66663253 1.03
tpcds_q34/duckdb:vortex-file-compressed 20425710 19760329 1.03
tpcds_q35/duckdb:vortex-file-compressed 67291594 64377981 1.05
tpcds_q36/duckdb:vortex-file-compressed 28822016 28046177 1.03
tpcds_q37/duckdb:vortex-file-compressed 21929395 20930621 1.05
tpcds_q38/duckdb:vortex-file-compressed 40080913 37411723 1.07
tpcds_q39/duckdb:vortex-file-compressed 48645296 45759549 1.06
tpcds_q40/duckdb:vortex-file-compressed 25594643 24547203 1.04
tpcds_q41/duckdb:vortex-file-compressed 13564612 12771630 1.06
tpcds_q42/duckdb:vortex-file-compressed 12318462 11666687 1.06
tpcds_q43/duckdb:vortex-file-compressed 20675207 20151843 1.03
tpcds_q44/duckdb:vortex-file-compressed 24343302 22993282 1.06
tpcds_q45/duckdb:vortex-file-compressed 28074287 27250308 1.03
tpcds_q46/duckdb:vortex-file-compressed 49966478 48405994 1.03
tpcds_q47/duckdb:vortex-file-compressed 51293466 51480404 1.00
tpcds_q48/duckdb:vortex-file-compressed 32022515 31199604 1.03
tpcds_q49/duckdb:vortex-file-compressed 30278324 30040409 1.01
tpcds_q50/duckdb:vortex-file-compressed 37126022 37224562 1.00
tpcds_q51/duckdb:vortex-file-compressed 103058854 101240392 1.02
tpcds_q52/duckdb:vortex-file-compressed 12890125 11827398 1.09
tpcds_q53/duckdb:vortex-file-compressed 🚨 18094756 16358788 1.11
tpcds_q54/duckdb:vortex-file-compressed 51361431 49193345 1.04
tpcds_q55/duckdb:vortex-file-compressed 11987020 12257856 0.98
tpcds_q56/duckdb:vortex-file-compressed 70586485 67632828 1.04
tpcds_q57/duckdb:vortex-file-compressed 45874192 45018311 1.02
tpcds_q58/duckdb:vortex-file-compressed 34442684 33413715 1.03
tpcds_q59/duckdb:vortex-file-compressed 57474665 58018861 0.99
tpcds_q60/duckdb:vortex-file-compressed 🚨 73248740 66177975 1.11
tpcds_q61/duckdb:vortex-file-compressed 39232459 42286009 0.93
tpcds_q62/duckdb:vortex-file-compressed 🚨 20459664 18465897 1.11
tpcds_q63/duckdb:vortex-file-compressed 17735616 17838575 0.99
tpcds_q64/duckdb:vortex-file-compressed 81043378 77819286 1.04
tpcds_q65/duckdb:vortex-file-compressed 23602337 23876690 0.99
tpcds_q66/duckdb:vortex-file-compressed 59184174 57015257 1.04
tpcds_q67/duckdb:vortex-file-compressed 146467075 145711121 1.01
tpcds_q68/duckdb:vortex-file-compressed 41169096 42194683 0.98
tpcds_q69/duckdb:vortex-file-compressed 38421893 38750087 0.99
tpcds_q70/duckdb:vortex-file-compressed 25763801 24405933 1.06
tpcds_q71/duckdb:vortex-file-compressed 20813211 21486324 0.97
tpcds_q72/duckdb:vortex-file-compressed 177276300 179595374 0.99
tpcds_q73/duckdb:vortex-file-compressed 19450937 20069305 0.97
tpcds_q74/duckdb:vortex-file-compressed 51709761 52793523 0.98
tpcds_q75/duckdb:vortex-file-compressed 59058289 57831665 1.02
tpcds_q76/duckdb:vortex-file-compressed 71406259 66093187 1.08
tpcds_q77/duckdb:vortex-file-compressed 66075825 68172076 0.97
tpcds_q78/duckdb:vortex-file-compressed 75579094 81980834 0.92
tpcds_q79/duckdb:vortex-file-compressed 36024638 36802430 0.98
tpcds_q80/duckdb:vortex-file-compressed 99731634 98338402 1.01
tpcds_q81/duckdb:vortex-file-compressed 32332271 33906220 0.95
tpcds_q82/duckdb:vortex-file-compressed 23431643 21798778 1.07
tpcds_q83/duckdb:vortex-file-compressed 29033454 28387093 1.02
tpcds_q84/duckdb:vortex-file-compressed 17395987 17349763 1.00
tpcds_q85/duckdb:vortex-file-compressed 45551938 44974372 1.01
tpcds_q86/duckdb:vortex-file-compressed 🚀 16350195 18690386 0.87
tpcds_q87/duckdb:vortex-file-compressed 41604753 41912489 0.99
tpcds_q88/duckdb:vortex-file-compressed 35357088 36410589 0.97
tpcds_q89/duckdb:vortex-file-compressed 18328373 17711145 1.03
tpcds_q90/duckdb:vortex-file-compressed 14991440 14837444 1.01
tpcds_q91/duckdb:vortex-file-compressed 27512712 27970461 0.98
tpcds_q92/duckdb:vortex-file-compressed 14422335 14459471 1.00
tpcds_q93/duckdb:vortex-file-compressed 31748017 31001376 1.02
tpcds_q94/duckdb:vortex-file-compressed 22790195 21467637 1.06
tpcds_q95/duckdb:vortex-file-compressed 🚨 154659687 138742082 1.11
tpcds_q96/duckdb:vortex-file-compressed 12109148 12623433 0.96
tpcds_q97/duckdb:vortex-file-compressed 39619912 40998643 0.97
tpcds_q98/duckdb:vortex-file-compressed 18224142 17682555 1.03
tpcds_q99/duckdb:vortex-file-compressed 32998697 33895355 0.97
duckdb / vortex-compact (1.037x ➖, 0↑ 15↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 32836344 35939987 0.91
tpcds_q02/duckdb:vortex-compact 124074201 123489487 1.00
tpcds_q03/duckdb:vortex-compact 51307346 50571453 1.01
tpcds_q04/duckdb:vortex-compact 122873668 123941186 0.99
tpcds_q05/duckdb:vortex-compact 160533903 155866447 1.03
tpcds_q06/duckdb:vortex-compact 37454376 36933797 1.01
tpcds_q07/duckdb:vortex-compact 36310785 36838188 0.99
tpcds_q08/duckdb:vortex-compact 29890772 29337600 1.02
tpcds_q09/duckdb:vortex-compact 110391449 109771022 1.01
tpcds_q10/duckdb:vortex-compact 45518137 45216294 1.01
tpcds_q11/duckdb:vortex-compact 78283383 73914896 1.06
tpcds_q12/duckdb:vortex-compact 18371017 18270623 1.01
tpcds_q13/duckdb:vortex-compact 48932670 47817441 1.02
tpcds_q14/duckdb:vortex-compact 282559434 265585722 1.06
tpcds_q15/duckdb:vortex-compact 46043008 44657942 1.03
tpcds_q16/duckdb:vortex-compact 39534225 37343890 1.06
tpcds_q17/duckdb:vortex-compact 49655931 49004910 1.01
tpcds_q18/duckdb:vortex-compact 66720766 66860521 1.00
tpcds_q19/duckdb:vortex-compact 39522083 38554547 1.03
tpcds_q20/duckdb:vortex-compact 20158166 21175300 0.95
tpcds_q21/duckdb:vortex-compact 27210559 27323668 1.00
tpcds_q22/duckdb:vortex-compact 117367802 115210005 1.02
tpcds_q23/duckdb:vortex-compact 166287781 157117988 1.06
tpcds_q24/duckdb:vortex-compact 70827097 65889006 1.07
tpcds_q25/duckdb:vortex-compact 50016180 48114972 1.04
tpcds_q26/duckdb:vortex-compact 54294196 49479313 1.10
tpcds_q27/duckdb:vortex-compact 134252823 135665682 0.99
tpcds_q28/duckdb:vortex-compact 108239373 108302033 1.00
tpcds_q29/duckdb:vortex-compact 49390330 50151761 0.98
tpcds_q30/duckdb:vortex-compact 33618368 33896929 0.99
tpcds_q31/duckdb:vortex-compact 27967788 30941134 0.90
tpcds_q32/duckdb:vortex-compact 22911746 23540215 0.97
tpcds_q33/duckdb:vortex-compact 140151216 129689584 1.08
tpcds_q34/duckdb:vortex-compact 24321657 24624657 0.99
tpcds_q35/duckdb:vortex-compact 66635509 65990961 1.01
tpcds_q36/duckdb:vortex-compact 35361395 35282971 1.00
tpcds_q37/duckdb:vortex-compact 31651961 31933224 0.99
tpcds_q38/duckdb:vortex-compact 40931045 40431931 1.01
tpcds_q39/duckdb:vortex-compact 55706942 52313178 1.06
tpcds_q40/duckdb:vortex-compact 30406729 30799580 0.99
tpcds_q41/duckdb:vortex-compact 16926139 16742122 1.01
tpcds_q42/duckdb:vortex-compact 14825400 15009866 0.99
tpcds_q43/duckdb:vortex-compact 24689915 24627513 1.00
tpcds_q44/duckdb:vortex-compact 31198202 30756778 1.01
tpcds_q45/duckdb:vortex-compact 31021221 31648289 0.98
tpcds_q46/duckdb:vortex-compact 55659090 57644875 0.97
tpcds_q47/duckdb:vortex-compact 56140923 53551057 1.05
tpcds_q48/duckdb:vortex-compact 41174364 41577282 0.99
tpcds_q49/duckdb:vortex-compact 46982091 50676868 0.93
tpcds_q50/duckdb:vortex-compact 40944595 41580773 0.98
tpcds_q51/duckdb:vortex-compact 103313221 103265073 1.00
tpcds_q52/duckdb:vortex-compact 15165285 15452359 0.98
tpcds_q53/duckdb:vortex-compact 22211241 22831105 0.97
tpcds_q54/duckdb:vortex-compact 86005785 85488207 1.01
tpcds_q55/duckdb:vortex-compact 14854683 15150306 0.98
tpcds_q56/duckdb:vortex-compact 133683455 132217699 1.01
tpcds_q57/duckdb:vortex-compact 49183063 47961059 1.03
tpcds_q58/duckdb:vortex-compact 40651825 41023759 0.99
tpcds_q59/duckdb:vortex-compact 69313697 68067044 1.02
tpcds_q60/duckdb:vortex-compact 141472120 138007349 1.03
tpcds_q61/duckdb:vortex-compact 52823505 50044525 1.06
tpcds_q62/duckdb:vortex-compact 23518705 21948697 1.07
tpcds_q63/duckdb:vortex-compact 24884406 22629204 1.10
tpcds_q64/duckdb:vortex-compact 🚨 109936744 96832508 1.14
tpcds_q65/duckdb:vortex-compact 🚨 31966626 28064190 1.14
tpcds_q66/duckdb:vortex-compact 104659410 105189411 0.99
tpcds_q67/duckdb:vortex-compact 168825733 153910897 1.10
tpcds_q68/duckdb:vortex-compact 54723005 51270514 1.07
tpcds_q69/duckdb:vortex-compact 50239903 46874826 1.07
tpcds_q70/duckdb:vortex-compact 30060617 28717466 1.05
tpcds_q71/duckdb:vortex-compact 29381029 27152123 1.08
tpcds_q72/duckdb:vortex-compact 207033974 198007102 1.05
tpcds_q73/duckdb:vortex-compact 🚨 26005778 23629557 1.10
tpcds_q74/duckdb:vortex-compact 60917153 56938420 1.07
tpcds_q75/duckdb:vortex-compact 76562137 72207003 1.06
tpcds_q76/duckdb:vortex-compact 🚨 134756193 121085228 1.11
tpcds_q77/duckdb:vortex-compact 136668502 131684450 1.04
tpcds_q78/duckdb:vortex-compact 92564167 86688500 1.07
tpcds_q79/duckdb:vortex-compact 59124254 57482080 1.03
tpcds_q80/duckdb:vortex-compact 🚨 178669727 158490510 1.13
tpcds_q81/duckdb:vortex-compact 🚨 47079671 39860757 1.18
tpcds_q82/duckdb:vortex-compact 🚨 35263968 30861937 1.14
tpcds_q83/duckdb:vortex-compact 48703243 44796669 1.09
tpcds_q84/duckdb:vortex-compact 🚨 23469696 20836105 1.13
tpcds_q85/duckdb:vortex-compact 🚨 69283914 60217272 1.15
tpcds_q86/duckdb:vortex-compact 🚨 21460542 18617541 1.15
tpcds_q87/duckdb:vortex-compact 🚨 47949326 41309130 1.16
tpcds_q88/duckdb:vortex-compact 40288120 37714173 1.07
tpcds_q89/duckdb:vortex-compact 🚨 25201878 22566657 1.12
tpcds_q90/duckdb:vortex-compact 🚨 18016014 15890320 1.13
tpcds_q91/duckdb:vortex-compact 47697752 44104440 1.08
tpcds_q92/duckdb:vortex-compact 🚨 23681838 18923783 1.25
tpcds_q93/duckdb:vortex-compact 38751092 35967193 1.08
tpcds_q94/duckdb:vortex-compact 29607208 29824708 0.99
tpcds_q95/duckdb:vortex-compact 155958574 165751042 0.94
tpcds_q96/duckdb:vortex-compact 14702520 13971467 1.05
tpcds_q97/duckdb:vortex-compact 🚨 44323152 40057696 1.11
tpcds_q98/duckdb:vortex-compact 25402516 23937231 1.06
tpcds_q99/duckdb:vortex-compact 37873180 35358723 1.07
duckdb / parquet (1.074x ➖, 0↑ 28↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 47713476 44825124 1.06
tpcds_q02/duckdb:parquet 61730073 56763063 1.09
tpcds_q03/duckdb:parquet 🚨 12998673 11668822 1.11
tpcds_q04/duckdb:parquet 135477369 125201819 1.08
tpcds_q05/duckdb:parquet 🚨 82097679 72202533 1.14
tpcds_q06/duckdb:parquet 🚨 32696542 28508538 1.15
tpcds_q07/duckdb:parquet 24693689 23336834 1.06
tpcds_q08/duckdb:parquet 29352543 28499551 1.03
tpcds_q09/duckdb:parquet 41946312 39756777 1.06
tpcds_q10/duckdb:parquet 🚨 37359170 33488701 1.12
tpcds_q11/duckdb:parquet 91964581 85150868 1.08
tpcds_q12/duckdb:parquet 🚨 16728662 14614146 1.14
tpcds_q13/duckdb:parquet 36480479 33919567 1.08
tpcds_q14/duckdb:parquet 171750427 161065075 1.07
tpcds_q15/duckdb:parquet 33306734 30713213 1.08
tpcds_q16/duckdb:parquet 22688692 21562519 1.05
tpcds_q17/duckdb:parquet 🚨 41478911 37592704 1.10
tpcds_q18/duckdb:parquet 49679439 45816585 1.08
tpcds_q19/duckdb:parquet 🚨 32411154 28925531 1.12
tpcds_q20/duckdb:parquet 🚨 17705074 15272321 1.16
tpcds_q21/duckdb:parquet 🚨 13388427 11428333 1.17
tpcds_q22/duckdb:parquet 🚨 75010776 67183327 1.12
tpcds_q23/duckdb:parquet 122143754 113128846 1.08
tpcds_q24/duckdb:parquet 48350028 45893610 1.05
tpcds_q25/duckdb:parquet 34977863 33716082 1.04
tpcds_q26/duckdb:parquet 🚨 40533442 35985683 1.13
tpcds_q27/duckdb:parquet 95231989 87166598 1.09
tpcds_q28/duckdb:parquet 39677149 36759850 1.08
tpcds_q29/duckdb:parquet 37626818 35256313 1.07
tpcds_q30/duckdb:parquet 🚨 42826589 37223831 1.15
tpcds_q31/duckdb:parquet 24319281 23682850 1.03
tpcds_q32/duckdb:parquet 12121118 11554048 1.05
tpcds_q33/duckdb:parquet 75289835 69705913 1.08
tpcds_q34/duckdb:parquet 22264734 20330953 1.10
tpcds_q35/duckdb:parquet 🚨 64437253 57500200 1.12
tpcds_q36/duckdb:parquet 21802920 21319805 1.02
tpcds_q37/duckdb:parquet 🚨 14620725 12648454 1.16
tpcds_q38/duckdb:parquet 🚨 38807690 33156911 1.17
tpcds_q39/duckdb:parquet 🚨 35216864 31797632 1.11
tpcds_q40/duckdb:parquet 🚨 20283217 17974153 1.13
tpcds_q41/duckdb:parquet 8147839 7545987 1.08
tpcds_q42/duckdb:parquet 🚨 11157037 9823351 1.14
tpcds_q43/duckdb:parquet 16431382 15834979 1.04
tpcds_q44/duckdb:parquet 23065007 21903520 1.05
tpcds_q45/duckdb:parquet 29389486 26957840 1.09
tpcds_q46/duckdb:parquet 🚨 50757129 45644261 1.11
tpcds_q47/duckdb:parquet 48808553 46076299 1.06
tpcds_q48/duckdb:parquet 🚨 33775098 30470991 1.11
tpcds_q49/duckdb:parquet 26446525 24056941 1.10
tpcds_q50/duckdb:parquet 26054712 24937059 1.04
tpcds_q51/duckdb:parquet 100658132 94348899 1.07
tpcds_q52/duckdb:parquet 12026865 12036237 1.00
tpcds_q53/duckdb:parquet 17166893 15991454 1.07
tpcds_q54/duckdb:parquet 44342971 41560647 1.07
tpcds_q55/duckdb:parquet 🚨 11914182 10778340 1.11
tpcds_q56/duckdb:parquet 73847989 68848449 1.07
tpcds_q57/duckdb:parquet 37474764 34894561 1.07
tpcds_q58/duckdb:parquet 22992593 21406439 1.07
tpcds_q59/duckdb:parquet 37174199 36671549 1.01
tpcds_q60/duckdb:parquet 🚨 78834352 71094837 1.11
tpcds_q61/duckdb:parquet 33757889 31127572 1.08
tpcds_q62/duckdb:parquet 12758030 11726908 1.09
tpcds_q63/duckdb:parquet 15848546 15336203 1.03
tpcds_q64/duckdb:parquet 78107306 75396944 1.04
tpcds_q65/duckdb:parquet 20932125 20025080 1.05
tpcds_q66/duckdb:parquet 58417585 63627342 0.92
tpcds_q67/duckdb:parquet 🚨 151139371 135047761 1.12
tpcds_q68/duckdb:parquet 40332402 37122387 1.09
tpcds_q69/duckdb:parquet 39404873 37683215 1.05
tpcds_q70/duckdb:parquet 🚨 21449497 19368733 1.11
tpcds_q71/duckdb:parquet 🚨 19113749 17135832 1.12
tpcds_q72/duckdb:parquet 170482377 165620813 1.03
tpcds_q73/duckdb:parquet 19269761 18181392 1.06
tpcds_q74/duckdb:parquet 52800899 49764685 1.06
tpcds_q75/duckdb:parquet 56842462 53165457 1.07
tpcds_q76/duckdb:parquet 75246072 74049889 1.02
tpcds_q77/duckdb:parquet 66690892 61216398 1.09
tpcds_q78/duckdb:parquet 80492289 73179962 1.10
tpcds_q79/duckdb:parquet 30154338 27797999 1.08
tpcds_q80/duckdb:parquet 🚨 88279950 77150570 1.14
tpcds_q81/duckdb:parquet 51673900 47340281 1.09
tpcds_q82/duckdb:parquet 🚨 16893514 14843669 1.14
tpcds_q83/duckdb:parquet 16789137 15870556 1.06
tpcds_q84/duckdb:parquet 20057842 19389131 1.03
tpcds_q85/duckdb:parquet 40659771 39837355 1.02
tpcds_q86/duckdb:parquet 12275117 11933886 1.03
tpcds_q87/duckdb:parquet 37974119 37220449 1.02
tpcds_q88/duckdb:parquet 29614943 29302188 1.01
tpcds_q89/duckdb:parquet 17579120 16840138 1.04
tpcds_q90/duckdb:parquet 7341036 7468125 0.98
tpcds_q91/duckdb:parquet 21555275 21679085 0.99
tpcds_q92/duckdb:parquet 🚨 12196034 10715901 1.14
tpcds_q93/duckdb:parquet 31867336 29941276 1.06
tpcds_q94/duckdb:parquet 16960441 17233275 0.98
tpcds_q95/duckdb:parquet 155108941 145124502 1.07
tpcds_q96/duckdb:parquet 9474283 9191489 1.03
tpcds_q97/duckdb:parquet 37127081 36678317 1.01
tpcds_q98/duckdb:parquet 18327559 17797031 1.03
tpcds_q99/duckdb:parquet 21016213 20061818 1.05
duckdb / duckdb (1.085x ➖, 0↑ 37↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20446345 19805869 1.03
tpcds_q02/duckdb:duckdb 20006077 19155806 1.04
tpcds_q03/duckdb:duckdb 🚨 8995136 8151924 1.10
tpcds_q04/duckdb:duckdb 166763349 160422747 1.04
tpcds_q05/duckdb:duckdb 🚨 20840927 17462795 1.19
tpcds_q06/duckdb:duckdb 23684100 22102991 1.07
tpcds_q07/duckdb:duckdb 41066618 38193058 1.08
tpcds_q08/duckdb:duckdb 123328454 121409517 1.02
tpcds_q09/duckdb:duckdb 20364073 19698505 1.03
tpcds_q10/duckdb:duckdb 24616179 23004386 1.07
tpcds_q11/duckdb:duckdb 141653612 138314146 1.02
tpcds_q12/duckdb:duckdb 12135214 11130922 1.09
tpcds_q13/duckdb:duckdb 25086907 24160623 1.04
tpcds_q14/duckdb:duckdb 98172119 93653801 1.05
tpcds_q15/duckdb:duckdb 25395200 24427486 1.04
tpcds_q16/duckdb:duckdb 18796068 17128745 1.10
tpcds_q17/duckdb:duckdb 🚨 23791137 21416689 1.11
tpcds_q18/duckdb:duckdb 🚨 48541662 42788567 1.13
tpcds_q19/duckdb:duckdb 18201625 16764647 1.09
tpcds_q20/duckdb:duckdb 12478054 11604876 1.08
tpcds_q21/duckdb:duckdb 🚨 7181284 6497168 1.11
tpcds_q22/duckdb:duckdb 🚨 69825659 59317679 1.18
tpcds_q23/duckdb:duckdb 79054505 76493379 1.03
tpcds_q24/duckdb:duckdb 🚨 25386377 22333609 1.14
tpcds_q25/duckdb:duckdb 18119867 17166108 1.06
tpcds_q26/duckdb:duckdb 🚨 29177640 25531971 1.14
tpcds_q27/duckdb:duckdb 40921694 39519947 1.04
tpcds_q28/duckdb:duckdb 21901614 20944082 1.05
tpcds_q29/duckdb:duckdb 21290492 20031925 1.06
tpcds_q30/duckdb:duckdb 27977916 29536284 0.95
tpcds_q31/duckdb:duckdb 21592455 19805030 1.09
tpcds_q32/duckdb:duckdb 7583828 7306122 1.04
tpcds_q33/duckdb:duckdb 13341610 12436106 1.07
tpcds_q34/duckdb:duckdb 🚨 16046050 14461913 1.11
tpcds_q35/duckdb:duckdb 🚨 36574203 30996990 1.18
tpcds_q36/duckdb:duckdb 🚨 75225056 65882702 1.14
tpcds_q37/duckdb:duckdb 8106325 7730229 1.05
tpcds_q38/duckdb:duckdb 31722438 33337539 0.95
tpcds_q39/duckdb:duckdb 🚨 34574004 25601783 1.35
tpcds_q40/duckdb:duckdb 14900345 13988959 1.07
tpcds_q41/duckdb:duckdb 🚨 9962011 8845531 1.13
tpcds_q42/duckdb:duckdb 🚨 7015160 6115702 1.15
tpcds_q43/duckdb:duckdb 11880464 11344413 1.05
tpcds_q44/duckdb:duckdb 14261481 13303936 1.07
tpcds_q45/duckdb:duckdb 18198330 17327376 1.05
tpcds_q46/duckdb:duckdb 🚨 40325082 34726871 1.16
tpcds_q47/duckdb:duckdb 🚨 45385574 40433818 1.12
tpcds_q48/duckdb:duckdb 22611064 21122108 1.07
tpcds_q49/duckdb:duckdb 🚨 18121938 16463831 1.10
tpcds_q50/duckdb:duckdb 14819715 13616458 1.09
tpcds_q51/duckdb:duckdb 97644036 92544116 1.06
tpcds_q52/duckdb:duckdb 🚨 7909993 7138547 1.11
tpcds_q53/duckdb:duckdb 12530436 11680657 1.07
tpcds_q54/duckdb:duckdb 17439404 16427810 1.06
tpcds_q55/duckdb:duckdb 🚨 7899636 6822211 1.16
tpcds_q56/duckdb:duckdb 14208304 13437391 1.06
tpcds_q57/duckdb:duckdb 🚨 33541982 30153858 1.11
tpcds_q58/duckdb:duckdb 13004106 12016160 1.08
tpcds_q59/duckdb:duckdb 35761251 33850453 1.06
tpcds_q60/duckdb:duckdb 15949844 14615016 1.09
tpcds_q61/duckdb:duckdb 14834433 13882318 1.07
tpcds_q62/duckdb:duckdb 9972565 9090666 1.10
tpcds_q63/duckdb:duckdb 🚨 12371918 10882035 1.14
tpcds_q64/duckdb:duckdb 🚨 56823087 51523551 1.10
tpcds_q65/duckdb:duckdb 36337236 34498537 1.05
tpcds_q66/duckdb:duckdb 25294302 24594870 1.03
tpcds_q67/duckdb:duckdb 142607037 130185684 1.10
tpcds_q68/duckdb:duckdb 🚨 26658376 24228553 1.10
tpcds_q69/duckdb:duckdb 🚨 26578665 23870947 1.11
tpcds_q70/duckdb:duckdb 14682866 15219635 0.96
tpcds_q71/duckdb:duckdb 13184466 12838216 1.03
tpcds_q72/duckdb:duckdb 45056252 42217100 1.07
tpcds_q73/duckdb:duckdb 🚨 11405262 10220547 1.12
tpcds_q74/duckdb:duckdb 103548745 96553172 1.07
tpcds_q75/duckdb:duckdb 🚨 46470262 41826140 1.11
tpcds_q76/duckdb:duckdb 🚨 13094972 11623837 1.13
tpcds_q77/duckdb:duckdb 12320124 11360130 1.08
tpcds_q78/duckdb:duckdb 🚨 69375233 62268354 1.11
tpcds_q79/duckdb:duckdb 🚨 19719944 17033744 1.16
tpcds_q80/duckdb:duckdb 🚨 31554535 28076596 1.12
tpcds_q81/duckdb:duckdb 🚨 40339083 35658718 1.13
tpcds_q82/duckdb:duckdb 8905251 8320073 1.07
tpcds_q83/duckdb:duckdb 9980138 9113413 1.10
tpcds_q84/duckdb:duckdb 14230831 13358221 1.07
tpcds_q85/duckdb:duckdb 25724393 24106426 1.07
tpcds_q86/duckdb:duckdb 11367045 10562213 1.08
tpcds_q87/duckdb:duckdb 35025109 33611382 1.04
tpcds_q88/duckdb:duckdb 25059220 23689563 1.06
tpcds_q89/duckdb:duckdb 🚨 14470654 12846244 1.13
tpcds_q90/duckdb:duckdb 🚨 6315346 5413687 1.17
tpcds_q91/duckdb:duckdb 13478462 12418211 1.09
tpcds_q92/duckdb:duckdb 9701801 9477115 1.02
tpcds_q93/duckdb:duckdb 🚨 24224963 21503602 1.13
tpcds_q94/duckdb:duckdb 🚨 14102968 12776612 1.10
tpcds_q95/duckdb:duckdb 135940488 125198424 1.09
tpcds_q96/duckdb:duckdb 4986206 4542058 1.10
tpcds_q97/duckdb:duckdb 🚨 34254011 29698617 1.15
tpcds_q98/duckdb:duckdb 🚨 14222596 12922101 1.10
tpcds_q99/duckdb:duckdb 16786208 16650224 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +14.8% +8.6% +5.6% +11.8% ➖ noise
1 datafusion:vortex-file-compressed +2.7% +8.6% -5.5% +14.1% ➖ noise
1 duckdb:duckdb +3.2% +8.6% -5.0% +12.7% ➖ noise
1 duckdb:vortex-compact -8.6% +8.6% -15.9% +11.8% ✅ faster
1 duckdb:vortex-file-compressed +9.6% +8.6% +0.9% +20.9% ➖ noise
2 datafusion:vortex-compact +13.6% +8.9% +4.3% +11.3% ➖ noise
2 datafusion:vortex-file-compressed +4.3% +8.9% -4.2% +10.0% ➖ noise
2 duckdb:duckdb +4.4% +8.9% -4.1% +10.0% ➖ noise
2 duckdb:vortex-compact +0.5% +8.9% -7.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.1% +8.9% -10.0% +12.8% ➖ noise
3 datafusion:vortex-compact +16.4% +10.5% +5.4% +11.1% ➖ noise
3 datafusion:vortex-file-compressed +3.5% +10.5% -6.3% +10.0% ➖ noise
3 duckdb:duckdb +10.3% +10.5% -0.1% +18.1% ➖ noise
3 duckdb:vortex-compact +1.5% +10.5% -8.1% +12.7% ➖ noise
3 duckdb:vortex-file-compressed -0.9% +10.5% -10.3% +14.2% ➖ noise
4 datafusion:vortex-compact +15.3% +10.1% +4.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.6% +10.1% -6.8% +10.0% ➖ noise
4 duckdb:duckdb +4.0% +10.1% -5.6% +10.0% ➖ noise
4 duckdb:vortex-compact -0.9% +10.1% -10.0% +10.0% ✅ faster
4 duckdb:vortex-file-compressed +1.9% +10.1% -7.5% +10.0% ➖ noise
5 datafusion:vortex-compact +8.8% +8.7% +0.2% +11.9% ➖ noise
5 datafusion:vortex-file-compressed +4.4% +8.7% -3.9% +11.1% ➖ noise
5 duckdb:duckdb +19.3% +8.7% +9.8% +14.8% ➖ noise
5 duckdb:vortex-compact +3.0% +8.7% -5.2% +10.6% ➖ noise
5 duckdb:vortex-file-compressed +9.4% +8.7% +0.7% +16.9% ➖ noise
6 datafusion:vortex-compact +14.4% +7.9% +6.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.9% +7.9% -3.8% +10.0% ➖ noise
6 duckdb:duckdb +7.2% +7.9% -0.7% +13.3% ➖ noise
6 duckdb:vortex-compact +1.4% +7.9% -6.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +2.1% +7.9% -5.4% +10.0% ➖ noise
7 datafusion:vortex-compact +8.6% +6.8% +1.7% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.7% +6.8% -1.0% +10.0% ➖ noise
7 duckdb:duckdb +7.5% +6.8% +0.7% +14.8% ➖ noise
7 duckdb:vortex-compact -1.4% +6.8% -7.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +10.9% +6.8% +3.9% +10.0% ➖ noise
8 datafusion:vortex-compact +8.9% +0.5% +8.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.5% +0.5% -0.0% +10.0% ➖ noise
8 duckdb:duckdb +1.6% +0.5% +1.1% +10.0% ➖ noise
8 duckdb:vortex-compact +1.9% +0.5% +1.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.0% +0.5% +0.5% +10.0% ➖ noise
9 datafusion:vortex-compact +10.3% +4.1% +5.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +4.4% +4.1% +0.2% +10.0% ➖ noise
9 duckdb:duckdb +3.4% +4.1% -0.7% +10.0% ➖ noise
9 duckdb:vortex-compact +0.6% +4.1% -3.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.8% +4.1% -2.2% +10.0% ➖ noise
10 datafusion:vortex-compact +10.8% +7.5% +3.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +5.9% +7.5% -1.5% +10.0% ➖ noise
10 duckdb:duckdb +7.0% +7.5% -0.5% +10.0% ➖ noise
10 duckdb:vortex-compact +0.7% +7.5% -6.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +7.6% +7.5% +0.1% +10.0% ➖ noise
11 datafusion:vortex-compact +13.3% +5.7% +7.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.2% +5.7% -3.3% +10.0% ➖ noise
11 duckdb:duckdb +2.4% +5.7% -3.1% +10.0% ➖ noise
11 duckdb:vortex-compact +5.9% +5.7% +0.2% +10.1% ➖ noise
11 duckdb:vortex-file-compressed +3.4% +5.7% -2.2% +10.0% ➖ noise
12 datafusion:vortex-compact +14.4% +8.1% +5.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.3% +8.1% -8.7% +11.6% ➖ noise
12 duckdb:duckdb +9.0% +8.1% +0.8% +12.0% ➖ noise
12 duckdb:vortex-compact +0.5% +8.1% -7.0% +13.0% ➖ noise
12 duckdb:vortex-file-compressed +6.4% +8.1% -1.6% +11.8% ➖ noise
13 datafusion:vortex-compact +8.3% +4.1% +4.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +3.3% +4.1% -0.7% +10.0% ➖ noise
13 duckdb:duckdb +3.8% +4.1% -0.2% +10.0% ➖ noise
13 duckdb:vortex-compact +2.3% +4.1% -1.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.0% +4.1% -2.0% +11.5% ➖ noise
14 datafusion:vortex-compact +12.4% +1.8% +10.4% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +0.7% +1.8% -1.1% +10.0% ➖ noise
14 duckdb:duckdb +4.8% +1.8% +3.0% +10.0% ➖ noise
14 duckdb:vortex-compact +6.4% +1.8% +4.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.5% +1.8% -4.2% +10.0% ➖ noise
15 datafusion:vortex-compact +18.0% +1.6% +16.1% +10.6% 🚨 regression
15 datafusion:vortex-file-compressed +3.8% +1.6% +2.2% +16.0% ➖ noise
15 duckdb:duckdb +4.0% +1.6% +2.3% +16.7% ➖ noise
15 duckdb:vortex-compact +3.1% +1.6% +1.5% +17.5% ➖ noise
15 duckdb:vortex-file-compressed +3.4% +1.6% +1.8% +12.7% ➖ noise
16 datafusion:vortex-compact +8.4% +2.1% +6.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.6% +2.1% -0.4% +10.0% ➖ noise
16 duckdb:duckdb +9.7% +2.1% +7.5% +14.4% ➖ noise
16 duckdb:vortex-compact +5.9% +2.1% +3.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.7% +2.1% -0.3% +10.4% ➖ noise
17 datafusion:vortex-compact +12.2% +6.2% +5.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.4% +6.2% -3.6% +10.0% ➖ noise
17 duckdb:duckdb +11.1% +6.2% +4.6% +10.2% ➖ noise
17 duckdb:vortex-compact +1.3% +6.2% -4.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +5.9% +6.2% -0.3% +10.0% ➖ noise
18 datafusion:vortex-compact +11.5% +4.4% +6.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +4.0% +4.4% -0.4% +10.0% ➖ noise
18 duckdb:duckdb +13.4% +4.4% +8.6% +10.0% ➖ noise
18 duckdb:vortex-compact -0.2% +4.4% -4.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +11.5% +4.4% +6.8% +11.5% ➖ noise
19 datafusion:vortex-compact +8.6% +6.9% +1.6% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +1.6% +6.9% -4.9% +10.0% ➖ noise
19 duckdb:duckdb +8.6% +6.9% +1.6% +11.1% ➖ noise
19 duckdb:vortex-compact +2.5% +6.9% -4.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.9% +6.9% -4.7% +10.0% ➖ noise
20 datafusion:vortex-compact +11.5% +6.7% +4.5% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -2.8% +6.7% -8.9% +10.0% ➖ noise
20 duckdb:duckdb +7.5% +6.7% +0.7% +16.0% ➖ noise
20 duckdb:vortex-compact -4.8% +6.7% -10.8% +10.9% ✅ faster
20 duckdb:vortex-file-compressed +8.6% +6.7% +1.8% +13.0% ➖ noise
21 datafusion:vortex-compact +13.8% +8.9% +4.5% +10.5% ➖ noise
21 datafusion:vortex-file-compressed +0.6% +8.9% -7.6% +11.8% ➖ noise
21 duckdb:duckdb +10.5% +8.9% +1.5% +22.9% ➖ noise
21 duckdb:vortex-compact -0.4% +8.9% -8.6% +12.5% ➖ noise
21 duckdb:vortex-file-compressed -1.3% +8.9% -9.4% +13.7% ➖ noise
22 datafusion:vortex-compact +14.2% +3.8% +10.0% +16.3% ➖ noise
22 datafusion:vortex-file-compressed -0.5% +3.8% -4.2% +17.1% ➖ noise
22 duckdb:duckdb +17.7% +3.8% +13.4% +16.6% ➖ noise
22 duckdb:vortex-compact +1.9% +3.8% -1.9% +16.3% ➖ noise
22 duckdb:vortex-file-compressed +3.3% +3.8% -0.5% +16.6% ➖ noise
23 datafusion:vortex-compact +12.4% +2.6% +9.6% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +3.3% +2.6% +0.7% +10.0% ➖ noise
23 duckdb:duckdb +3.3% +2.6% +0.7% +10.0% ➖ noise
23 duckdb:vortex-compact +5.8% +2.6% +3.2% +12.4% ➖ noise
23 duckdb:vortex-file-compressed +1.6% +2.6% -1.0% +10.0% ➖ noise
24 datafusion:vortex-compact +11.1% +2.2% +8.7% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +5.7% +2.2% +3.5% +10.0% ➖ noise
24 duckdb:duckdb +13.7% +2.2% +11.2% +10.5% 🚨 regression
24 duckdb:vortex-compact +7.5% +2.2% +5.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -2.4% +2.2% -4.5% +10.0% ➖ noise
25 datafusion:vortex-compact +14.5% +1.4% +12.9% +10.0% 🚨 regression
25 datafusion:vortex-file-compressed +2.7% +1.4% +1.3% +10.0% ➖ noise
25 duckdb:duckdb +5.6% +1.4% +4.1% +10.0% ➖ noise
25 duckdb:vortex-compact +4.0% +1.4% +2.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +0.2% +1.4% -1.2% +10.0% ➖ noise
26 datafusion:vortex-compact +9.2% +5.9% +3.1% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +3.5% +5.9% -2.4% +12.6% ➖ noise
26 duckdb:duckdb +14.3% +5.9% +7.9% +13.0% ➖ noise
26 duckdb:vortex-compact +9.7% +5.9% +3.6% +17.0% ➖ noise
26 duckdb:vortex-file-compressed -2.3% +5.9% -7.8% +10.0% ➖ noise
27 datafusion:vortex-compact +13.5% +4.7% +8.4% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +1.0% +4.7% -3.5% +10.0% ➖ noise
27 duckdb:duckdb +3.5% +4.7% -1.1% +18.3% ➖ noise
27 duckdb:vortex-compact -1.0% +4.7% -5.5% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +4.7% +4.7% -0.0% +10.0% ➖ noise
28 datafusion:vortex-compact +7.4% +4.5% +2.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.5% +4.5% -1.8% +10.0% ➖ noise
28 duckdb:duckdb +4.6% +4.5% +0.1% +10.0% ➖ noise
28 duckdb:vortex-compact -0.1% +4.5% -4.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +4.4% +4.5% -0.1% +10.0% ➖ noise
29 datafusion:vortex-compact +11.3% +1.7% +9.4% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +4.9% +1.7% +3.1% +10.4% ➖ noise
29 duckdb:duckdb +6.3% +1.7% +4.5% +14.9% ➖ noise
29 duckdb:vortex-compact -1.5% +1.7% -3.2% +10.7% ➖ noise
29 duckdb:vortex-file-compressed +1.2% +1.7% -0.5% +15.0% ➖ noise
30 datafusion:vortex-compact +17.3% +7.9% +8.7% +10.6% ➖ noise
30 datafusion:vortex-file-compressed +7.5% +7.9% -0.4% +10.0% ➖ noise
30 duckdb:duckdb -5.3% +7.9% -12.2% +18.6% ➖ noise
30 duckdb:vortex-compact -0.8% +7.9% -8.1% +13.7% ➖ noise
30 duckdb:vortex-file-compressed -1.7% +7.9% -8.9% +15.2% ➖ noise
31 datafusion:vortex-compact +11.1% +1.7% +9.2% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +1.0% +1.7% -0.7% +10.0% ➖ noise
31 duckdb:duckdb +9.0% +1.7% +7.2% +15.0% ➖ noise
31 duckdb:vortex-compact -9.6% +1.7% -11.1% +12.7% ➖ noise
31 duckdb:vortex-file-compressed -4.2% +1.7% -5.9% +14.5% ➖ noise
32 datafusion:vortex-compact +9.1% -2.4% +11.8% +10.0% 🚨 regression
32 datafusion:vortex-file-compressed +7.0% -2.4% +9.6% +10.0% ➖ noise
32 duckdb:duckdb +3.8% -2.4% +6.4% +14.4% ➖ noise
32 duckdb:vortex-compact -2.7% -2.4% -0.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +2.0% -2.4% +4.5% +11.4% ➖ noise
33 datafusion:vortex-compact +11.4% +1.9% +9.3% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +0.7% +1.9% -1.2% +10.0% ➖ noise
33 duckdb:duckdb +7.3% +1.9% +5.3% +10.9% ➖ noise
33 duckdb:vortex-compact +8.1% +1.9% +6.1% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +3.0% +1.9% +1.1% +13.6% ➖ noise
34 datafusion:vortex-compact +5.6% +5.9% -0.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -0.9% +5.9% -6.4% +10.0% ➖ noise
34 duckdb:duckdb +11.0% +5.9% +4.8% +10.0% ➖ noise
34 duckdb:vortex-compact -1.2% +5.9% -6.7% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +3.4% +5.9% -2.4% +10.0% ➖ noise
35 datafusion:vortex-compact +10.3% +4.4% +5.7% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.3% +4.4% -2.0% +10.0% ➖ noise
35 duckdb:duckdb +18.0% +4.4% +13.0% +14.6% ➖ noise
35 duckdb:vortex-compact +1.0% +4.4% -3.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +4.5% +4.4% +0.1% +11.6% ➖ noise
36 datafusion:vortex-compact +9.5% -0.4% +9.9% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +8.0% -0.4% +8.4% +10.0% ➖ noise
36 duckdb:duckdb +14.2% -0.4% +14.6% +10.0% 🚨 regression
36 duckdb:vortex-compact +0.2% -0.4% +0.6% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +2.8% -0.4% +3.2% +11.3% ➖ noise
37 datafusion:vortex-compact +10.5% +5.5% +4.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +7.0% +5.5% +1.4% +10.5% ➖ noise
37 duckdb:duckdb +4.9% +5.5% -0.6% +13.7% ➖ noise
37 duckdb:vortex-compact -0.9% +5.5% -6.1% +12.3% ➖ noise
37 duckdb:vortex-file-compressed +4.8% +5.5% -0.7% +12.6% ➖ noise
38 datafusion:vortex-compact +9.7% +8.4% +1.2% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +12.3% +8.4% +3.6% +10.0% ➖ noise
38 duckdb:duckdb -4.8% +8.4% -12.2% +19.3% ➖ noise
38 duckdb:vortex-compact +1.2% +8.4% -6.6% +11.5% ➖ noise
38 duckdb:vortex-file-compressed +7.1% +8.4% -1.1% +10.0% ➖ noise
39 datafusion:vortex-compact +8.7% +4.8% +3.7% +11.9% ➖ noise
39 datafusion:vortex-file-compressed -0.8% +4.8% -5.3% +17.3% ➖ noise
39 duckdb:duckdb +35.0% +4.8% +28.8% +28.3% 🚨 regression
39 duckdb:vortex-compact +6.5% +4.8% +1.6% +17.4% ➖ noise
39 duckdb:vortex-file-compressed +6.3% +4.8% +1.4% +18.2% ➖ noise
40 datafusion:vortex-compact +14.2% +7.7% +6.0% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +9.4% +7.7% +1.6% +10.0% ➖ noise
40 duckdb:duckdb +6.5% +7.7% -1.1% +14.0% ➖ noise
40 duckdb:vortex-compact -1.3% +7.7% -8.4% +10.6% ➖ noise
40 duckdb:vortex-file-compressed +4.3% +7.7% -3.2% +13.2% ➖ noise
41 datafusion:vortex-compact +19.4% +4.8% +14.0% +10.6% 🚨 regression
41 datafusion:vortex-file-compressed +12.4% +4.8% +7.2% +12.6% ➖ noise
41 duckdb:duckdb +12.6% +4.8% +7.5% +10.0% ➖ noise
41 duckdb:vortex-compact +1.1% +4.8% -3.5% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +6.2% +4.8% +1.4% +10.3% ➖ noise
42 datafusion:vortex-compact +13.9% +6.9% +6.5% +12.1% ➖ noise
42 datafusion:vortex-file-compressed +12.1% +6.9% +4.9% +10.0% ➖ noise
42 duckdb:duckdb +14.7% +6.9% +7.3% +17.7% ➖ noise
42 duckdb:vortex-compact -1.2% +6.9% -7.6% +14.1% ➖ noise
42 duckdb:vortex-file-compressed +5.6% +6.9% -1.2% +14.8% ➖ noise
43 datafusion:vortex-compact +12.2% +1.8% +10.2% +10.0% 🚨 regression
43 datafusion:vortex-file-compressed +6.4% +1.8% +4.5% +10.0% ➖ noise
43 duckdb:duckdb +4.7% +1.8% +2.9% +10.0% ➖ noise
43 duckdb:vortex-compact +0.3% +1.8% -1.5% +10.0% ➖ noise
43 duckdb:vortex-file-compressed +2.6% +1.8% +0.8% +10.0% ➖ noise
44 datafusion:vortex-compact +9.0% +3.1% +5.7% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +3.6% +3.1% +0.5% +10.0% ➖ noise
44 duckdb:duckdb +7.2% +3.1% +4.0% +10.6% ➖ noise
44 duckdb:vortex-compact +1.4% +3.1% -1.6% +10.0% ➖ noise
44 duckdb:vortex-file-compressed +5.9% +3.1% +2.7% +10.0% ➖ noise
45 datafusion:vortex-compact +15.7% +3.6% +11.7% +10.0% 🚨 regression
45 datafusion:vortex-file-compressed +1.8% +3.6% -1.8% +10.0% ➖ noise
45 duckdb:duckdb +5.0% +3.6% +1.3% +12.6% ➖ noise
45 duckdb:vortex-compact -2.0% +3.6% -5.4% +11.2% ➖ noise
45 duckdb:vortex-file-compressed +3.0% +3.6% -0.6% +10.4% ➖ noise
46 datafusion:vortex-compact +13.9% +5.6% +7.9% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +4.4% +5.6% -1.1% +10.0% ➖ noise
46 duckdb:duckdb +16.1% +5.6% +9.9% +10.0% ➖ noise
46 duckdb:vortex-compact -3.4% +5.6% -8.6% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +3.2% +5.6% -2.3% +10.0% ➖ noise
47 datafusion:vortex-compact +17.4% +3.1% +13.8% +10.0% 🚨 regression
47 datafusion:vortex-file-compressed +4.5% +3.1% +1.3% +10.0% ➖ noise
47 duckdb:duckdb +12.2% +3.1% +8.8% +10.0% ➖ noise
47 duckdb:vortex-compact +4.8% +3.1% +1.7% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -0.4% +3.1% -3.4% +10.0% ➖ noise
48 datafusion:vortex-compact +9.6% +5.1% +4.3% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -3.3% +5.1% -8.0% +11.0% ➖ noise
48 duckdb:duckdb +7.0% +5.1% +1.8% +10.0% ➖ noise
48 duckdb:vortex-compact -1.0% +5.1% -5.8% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +2.6% +5.1% -2.4% +10.0% ➖ noise
49 datafusion:vortex-compact +9.8% +5.7% +3.8% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +4.2% +5.7% -1.5% +10.0% ➖ noise
49 duckdb:duckdb +10.1% +5.7% +4.1% +16.2% ➖ noise
49 duckdb:vortex-compact -7.3% +5.7% -12.3% +10.0% ✅ faster
49 duckdb:vortex-file-compressed +0.8% +5.7% -4.7% +10.0% ➖ noise
50 datafusion:vortex-compact +7.8% -1.6% +9.5% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +2.2% -1.6% +3.8% +10.0% ➖ noise
50 duckdb:duckdb +8.8% -1.6% +10.6% +10.0% 🚨 regression
50 duckdb:vortex-compact -1.5% -1.6% +0.0% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -0.3% -1.6% +1.3% +10.0% ➖ noise
51 datafusion:vortex-compact +7.5% +2.9% +4.5% +13.0% ➖ noise
51 datafusion:vortex-file-compressed +0.2% +2.9% -2.6% +14.1% ➖ noise
51 duckdb:duckdb +5.5% +2.9% +2.5% +19.7% ➖ noise
51 duckdb:vortex-compact +0.0% +2.9% -2.8% +18.4% ➖ noise
51 duckdb:vortex-file-compressed +1.8% +2.9% -1.1% +23.1% ➖ noise
52 datafusion:vortex-compact +17.3% -0.7% +18.0% +12.6% 🚨 regression
52 datafusion:vortex-file-compressed -3.9% -0.7% -3.2% +10.5% ➖ noise
52 duckdb:duckdb +10.8% -0.7% +11.5% +15.5% ➖ noise
52 duckdb:vortex-compact -1.9% -0.7% -1.2% +16.4% ➖ noise
52 duckdb:vortex-file-compressed +9.0% -0.7% +9.7% +17.6% ➖ noise
53 datafusion:vortex-compact +13.1% +4.0% +8.7% +11.7% ➖ noise
53 datafusion:vortex-file-compressed -4.2% +4.0% -7.9% +13.0% ➖ noise
53 duckdb:duckdb +7.3% +4.0% +3.1% +16.0% ➖ noise
53 duckdb:vortex-compact -2.7% +4.0% -6.5% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +10.6% +4.0% +6.3% +10.4% ➖ noise
54 datafusion:vortex-compact +6.9% +4.8% +1.9% +11.2% ➖ noise
54 datafusion:vortex-file-compressed -0.6% +4.8% -5.2% +10.0% ➖ noise
54 duckdb:duckdb +6.2% +4.8% +1.3% +10.7% ➖ noise
54 duckdb:vortex-compact +0.6% +4.8% -4.0% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +4.4% +4.8% -0.4% +12.9% ➖ noise
55 datafusion:vortex-compact +13.1% +5.9% +6.8% +10.0% ➖ noise
55 datafusion:vortex-file-compressed +1.9% +5.9% -3.8% +12.1% ➖ noise
55 duckdb:duckdb +15.8% +5.9% +9.4% +15.6% ➖ noise
55 duckdb:vortex-compact -2.0% +5.9% -7.4% +14.0% ➖ noise
55 duckdb:vortex-file-compressed -2.2% +5.9% -7.6% +18.5% ➖ noise
56 datafusion:vortex-compact +12.0% +4.6% +7.1% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +0.1% +4.6% -4.3% +10.0% ➖ noise
56 duckdb:duckdb +5.7% +4.6% +1.1% +10.0% ➖ noise
56 duckdb:vortex-compact +1.1% +4.6% -3.3% +10.5% ➖ noise
56 duckdb:vortex-file-compressed +4.4% +4.6% -0.2% +11.9% ➖ noise
57 datafusion:vortex-compact +11.3% +2.5% +8.5% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -2.7% +2.5% -5.1% +10.0% ➖ noise
57 duckdb:duckdb +11.2% +2.5% +8.5% +10.0% ➖ noise
57 duckdb:vortex-compact +2.5% +2.5% +0.0% +10.0% ➖ noise
57 duckdb:vortex-file-compressed +1.9% +2.5% -0.6% +15.0% ➖ noise
58 datafusion:vortex-compact +18.2% +1.3% +16.7% +10.0% 🚨 regression
58 datafusion:vortex-file-compressed +2.6% +1.3% +1.3% +10.0% ➖ noise
58 duckdb:duckdb +8.2% +1.3% +6.8% +11.3% ➖ noise
58 duckdb:vortex-compact -0.9% +1.3% -2.2% +14.0% ➖ noise
58 duckdb:vortex-file-compressed +3.1% +1.3% +1.8% +11.6% ➖ noise
59 datafusion:vortex-compact +13.0% -0.4% +13.5% +10.0% 🚨 regression
59 datafusion:vortex-file-compressed -0.4% -0.4% +0.0% +10.0% ➖ noise
59 duckdb:duckdb +5.6% -0.4% +6.1% +10.0% ➖ noise
59 duckdb:vortex-compact +1.8% -0.4% +2.3% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -0.9% -0.4% -0.5% +10.0% ➖ noise
60 datafusion:vortex-compact +25.9% +4.7% +20.3% +13.9% 🚨 regression
60 datafusion:vortex-file-compressed +3.1% +4.7% -1.5% +10.0% ➖ noise
60 duckdb:duckdb +9.1% +4.7% +4.2% +10.0% ➖ noise
60 duckdb:vortex-compact +2.5% +4.7% -2.1% +11.1% ➖ noise
60 duckdb:vortex-file-compressed +10.7% +4.7% +5.7% +13.1% ➖ noise
61 datafusion:vortex-compact +8.8% +2.8% +5.9% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -2.1% +2.8% -4.7% +10.0% ➖ noise
61 duckdb:duckdb +6.9% +2.8% +4.0% +10.1% ➖ noise
61 duckdb:vortex-compact +5.6% +2.8% +2.7% +10.5% ➖ noise
61 duckdb:vortex-file-compressed -7.2% +2.8% -9.7% +10.2% ✅ faster
62 datafusion:vortex-compact +13.3% +11.8% +1.4% +10.4% ➖ noise
62 datafusion:vortex-file-compressed +0.5% +11.8% -10.1% +11.4% ➖ noise
62 duckdb:duckdb +9.7% +11.8% -1.9% +22.3% ➖ noise
62 duckdb:vortex-compact +7.2% +11.8% -4.1% +24.6% ➖ noise
62 duckdb:vortex-file-compressed +10.8% +11.8% -0.9% +19.4% ➖ noise
63 datafusion:vortex-compact +8.4% +3.8% +4.4% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +1.0% +3.8% -2.7% +10.0% ➖ noise
63 duckdb:duckdb +13.7% +3.8% +9.5% +10.0% ➖ noise
63 duckdb:vortex-compact +10.0% +3.8% +5.9% +10.0% ➖ noise
63 duckdb:vortex-file-compressed -0.6% +3.8% -4.2% +11.5% ➖ noise
64 datafusion:vortex-compact +13.4% +1.9% +11.3% +10.0% 🚨 regression
64 datafusion:vortex-file-compressed +2.8% +1.9% +0.9% +10.0% ➖ noise
64 duckdb:duckdb +10.3% +1.9% +8.3% +10.0% ➖ noise
64 duckdb:vortex-compact +13.5% +1.9% +11.4% +10.0% 🚨 regression
64 duckdb:vortex-file-compressed +4.1% +1.9% +2.2% +10.0% ➖ noise
65 datafusion:vortex-compact +7.6% +2.8% +4.6% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +8.7% +2.8% +5.7% +10.0% ➖ noise
65 duckdb:duckdb +5.3% +2.8% +2.4% +14.5% ➖ noise
65 duckdb:vortex-compact +13.9% +2.8% +10.8% +10.9% ➖ noise
65 duckdb:vortex-file-compressed -1.1% +2.8% -3.9% +11.3% ➖ noise
66 datafusion:vortex-compact +9.6% -5.5% +16.0% +10.0% 🚨 regression
66 datafusion:vortex-file-compressed +6.8% -5.5% +13.0% +13.7% ➖ noise
66 duckdb:duckdb +2.8% -5.5% +8.9% +10.0% ➖ noise
66 duckdb:vortex-compact -0.5% -5.5% +5.3% +10.0% ➖ noise
66 duckdb:vortex-file-compressed +3.8% -5.5% +9.9% +10.0% ➖ noise
67 datafusion:vortex-compact +15.1% +5.7% +8.8% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -0.9% +5.7% -6.3% +10.0% ➖ noise
67 duckdb:duckdb +9.5% +5.7% +3.6% +10.0% ➖ noise
67 duckdb:vortex-compact +9.7% +5.7% +3.7% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +0.5% +5.7% -4.9% +10.0% ➖ noise
68 datafusion:vortex-compact +12.7% +3.4% +8.9% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +2.3% +3.4% -1.1% +10.0% ➖ noise
68 duckdb:duckdb +10.0% +3.4% +6.4% +10.0% ➖ noise
68 duckdb:vortex-compact +6.7% +3.4% +3.2% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -2.4% +3.4% -5.7% +10.0% ➖ noise
69 datafusion:vortex-compact +9.6% +2.3% +7.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +1.1% +2.3% -1.2% +10.0% ➖ noise
69 duckdb:duckdb +11.3% +2.3% +8.8% +10.8% ➖ noise
69 duckdb:vortex-compact +7.2% +2.3% +4.7% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -0.8% +2.3% -3.1% +10.0% ➖ noise
70 datafusion:vortex-compact +12.2% +7.0% +4.8% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +9.0% +7.0% +1.8% +10.0% ➖ noise
70 duckdb:duckdb -3.5% +7.0% -9.8% +16.4% ➖ noise
70 duckdb:vortex-compact +4.7% +7.0% -2.2% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +5.6% +7.0% -1.3% +10.0% ➖ noise
71 datafusion:vortex-compact +11.9% +4.9% +6.6% +10.9% ➖ noise
71 datafusion:vortex-file-compressed +4.5% +4.9% -0.4% +12.2% ➖ noise
71 duckdb:duckdb +2.7% +4.9% -2.1% +14.2% ➖ noise
71 duckdb:vortex-compact +8.2% +4.9% +3.2% +12.7% ➖ noise
71 duckdb:vortex-file-compressed -3.1% +4.9% -7.7% +12.0% ➖ noise
72 datafusion:vortex-compact +21.4% +0.2% +21.1% +10.0% 🚨 regression
72 datafusion:vortex-file-compressed +24.0% +0.2% +23.8% +10.3% 🚨 regression
72 duckdb:duckdb +6.7% +0.2% +6.5% +10.0% ➖ noise
72 duckdb:vortex-compact +4.6% +0.2% +4.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -1.3% +0.2% -1.5% +10.0% ➖ noise
73 datafusion:vortex-compact +15.4% +0.6% +14.8% +14.9% ➖ noise
73 datafusion:vortex-file-compressed +13.0% +0.6% +12.4% +16.1% ➖ noise
73 duckdb:duckdb +11.6% +0.6% +11.0% +13.6% ➖ noise
73 duckdb:vortex-compact +10.1% +0.6% +9.4% +10.6% ➖ noise
73 duckdb:vortex-file-compressed -3.1% +0.6% -3.6% +10.7% ➖ noise
74 datafusion:vortex-compact +12.4% +5.8% +6.3% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +17.8% +5.8% +11.4% +10.0% 🚨 regression
74 duckdb:duckdb +7.2% +5.8% +1.4% +10.0% ➖ noise
74 duckdb:vortex-compact +7.0% +5.8% +1.2% +10.0% ➖ noise
74 duckdb:vortex-file-compressed -2.1% +5.8% -7.4% +13.5% ➖ noise
75 datafusion:vortex-compact +11.0% +3.8% +6.9% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +16.6% +3.8% +12.3% +10.0% 🚨 regression
75 duckdb:duckdb +11.1% +3.8% +7.0% +10.0% ➖ noise
75 duckdb:vortex-compact +6.0% +3.8% +2.2% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +2.1% +3.8% -1.6% +10.9% ➖ noise
76 datafusion:vortex-compact +9.2% +4.0% +5.0% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +17.3% +4.0% +12.9% +10.2% 🚨 regression
76 duckdb:duckdb +12.7% +4.0% +8.4% +19.9% ➖ noise
76 duckdb:vortex-compact +11.3% +4.0% +7.1% +11.5% ➖ noise
76 duckdb:vortex-file-compressed +8.0% +4.0% +3.9% +16.4% ➖ noise
77 datafusion:vortex-compact +12.8% +5.7% +6.7% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +20.4% +5.7% +13.9% +10.0% 🚨 regression
77 duckdb:duckdb +8.5% +5.7% +2.6% +12.3% ➖ noise
77 duckdb:vortex-compact +3.8% +5.7% -1.8% +10.0% ➖ noise
77 duckdb:vortex-file-compressed -3.1% +5.7% -8.3% +10.9% ➖ noise
78 datafusion:vortex-compact +14.5% +3.0% +11.2% +10.0% 🚨 regression
78 datafusion:vortex-file-compressed +16.1% +3.0% +12.7% +10.0% 🚨 regression
78 duckdb:duckdb +11.4% +3.0% +8.2% +10.0% ➖ noise
78 duckdb:vortex-compact +6.8% +3.0% +3.7% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -7.8% +3.0% -10.5% +13.6% ➖ noise
79 datafusion:vortex-compact +9.3% +6.4% +2.7% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +11.2% +6.4% +4.5% +10.0% ➖ noise
79 duckdb:duckdb +15.8% +6.4% +8.8% +10.0% ➖ noise
79 duckdb:vortex-compact +2.9% +6.4% -3.4% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -2.1% +6.4% -8.0% +10.1% ➖ noise
80 datafusion:vortex-compact +11.9% +4.5% +7.1% +10.4% ➖ noise
80 datafusion:vortex-file-compressed +13.8% +4.5% +8.9% +10.0% ➖ noise
80 duckdb:duckdb +12.4% +4.5% +7.6% +13.9% ➖ noise
80 duckdb:vortex-compact +12.7% +4.5% +7.9% +13.1% ➖ noise
80 duckdb:vortex-file-compressed +1.4% +4.5% -2.9% +11.8% ➖ noise
81 datafusion:vortex-compact +12.1% +5.9% +5.9% +11.5% ➖ noise
81 datafusion:vortex-file-compressed +11.4% +5.9% +5.2% +13.7% ➖ noise
81 duckdb:duckdb +13.1% +5.9% +6.8% +10.2% ➖ noise
81 duckdb:vortex-compact +18.1% +5.9% +11.6% +18.9% ➖ noise
81 duckdb:vortex-file-compressed -4.6% +5.9% -9.9% +10.0% ✅ faster
82 datafusion:vortex-compact +16.0% +5.4% +10.0% +10.0% 🚨 regression
82 datafusion:vortex-file-compressed +23.2% +5.4% +16.9% +10.3% 🚨 regression
82 duckdb:duckdb +7.0% +5.4% +1.5% +13.9% ➖ noise
82 duckdb:vortex-compact +14.3% +5.4% +8.4% +14.4% ➖ noise
82 duckdb:vortex-file-compressed +7.5% +5.4% +2.0% +13.1% ➖ noise
83 datafusion:vortex-compact +13.5% +5.5% +7.7% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +11.0% +5.5% +5.3% +10.0% ➖ noise
83 duckdb:duckdb +9.5% +5.5% +3.8% +13.7% ➖ noise
83 duckdb:vortex-compact +8.7% +5.5% +3.1% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +2.3% +5.5% -3.0% +11.8% ➖ noise
84 datafusion:vortex-compact +14.3% +3.3% +10.7% +11.5% ➖ noise
84 datafusion:vortex-file-compressed +15.5% +3.3% +11.8% +10.0% 🚨 regression
84 duckdb:duckdb +6.5% +3.3% +3.2% +10.8% ➖ noise
84 duckdb:vortex-compact +12.6% +3.3% +9.1% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +0.3% +3.3% -2.9% +10.1% ➖ noise
85 datafusion:vortex-compact +11.5% +2.5% +8.8% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +11.2% +2.5% +8.4% +10.0% ➖ noise
85 duckdb:duckdb +6.7% +2.5% +4.1% +11.0% ➖ noise
85 duckdb:vortex-compact +15.1% +2.5% +12.2% +10.0% 🚨 regression
85 duckdb:vortex-file-compressed +1.3% +2.5% -1.2% +12.5% ➖ noise
86 datafusion:vortex-compact +20.6% -1.8% +22.8% +10.5% 🚨 regression
86 datafusion:vortex-file-compressed +14.9% -1.8% +17.0% +10.4% 🚨 regression
86 duckdb:duckdb +7.6% -1.8% +9.6% +13.4% ➖ noise
86 duckdb:vortex-compact +15.3% -1.8% +17.4% +11.4% 🚨 regression
86 duckdb:vortex-file-compressed -12.5% -1.8% -10.9% +20.3% ➖ noise
87 datafusion:vortex-compact +10.8% +0.7% +10.0% +10.0% 🚨 regression
87 datafusion:vortex-file-compressed +12.0% +0.7% +11.2% +10.0% 🚨 regression
87 duckdb:duckdb +4.2% +0.7% +3.5% +13.9% ➖ noise
87 duckdb:vortex-compact +16.1% +0.7% +15.2% +10.0% 🚨 regression
87 duckdb:vortex-file-compressed -0.7% +0.7% -1.5% +11.5% ➖ noise
88 datafusion:vortex-compact +5.0% +2.5% +2.4% +10.6% ➖ noise
88 datafusion:vortex-file-compressed +9.7% +2.5% +7.0% +10.6% ➖ noise
88 duckdb:duckdb +5.8% +2.5% +3.2% +10.0% ➖ noise
88 duckdb:vortex-compact +6.8% +2.5% +4.2% +11.5% ➖ noise
88 duckdb:vortex-file-compressed -2.9% +2.5% -5.3% +11.4% ➖ noise
89 datafusion:vortex-compact +14.5% +2.6% +11.6% +10.0% 🚨 regression
89 datafusion:vortex-file-compressed +11.8% +2.6% +8.9% +10.4% ➖ noise
89 duckdb:duckdb +12.6% +2.6% +9.8% +12.8% ➖ noise
89 duckdb:vortex-compact +11.7% +2.6% +8.8% +13.6% ➖ noise
89 duckdb:vortex-file-compressed +3.5% +2.6% +0.9% +10.0% ➖ noise
90 datafusion:vortex-compact +10.4% +2.3% +7.9% +10.0% ➖ noise
90 datafusion:vortex-file-compressed +10.2% +2.3% +7.7% +10.3% ➖ noise
90 duckdb:duckdb +16.7% +2.3% +14.0% +12.5% 🚨 regression
90 duckdb:vortex-compact +13.4% +2.3% +10.8% +10.7% 🚨 regression
90 duckdb:vortex-file-compressed +1.0% +2.3% -1.2% +13.5% ➖ noise
91 datafusion:vortex-compact +10.5% +2.0% +8.3% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +12.6% +2.0% +10.4% +10.0% 🚨 regression
91 duckdb:duckdb +8.5% +2.0% +6.5% +10.0% ➖ noise
91 duckdb:vortex-compact +8.1% +2.0% +6.1% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -1.6% +2.0% -3.5% +10.0% ➖ noise
92 datafusion:vortex-compact +14.1% +8.2% +5.5% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +17.1% +8.2% +8.3% +10.0% ➖ noise
92 duckdb:duckdb +2.4% +8.2% -5.4% +14.8% ➖ noise
92 duckdb:vortex-compact +25.1% +8.2% +15.7% +14.7% 🚨 regression
92 duckdb:vortex-file-compressed -0.3% +8.2% -7.8% +10.0% ➖ noise
93 datafusion:vortex-compact +13.8% +5.3% +8.1% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +17.7% +5.3% +11.8% +10.0% 🚨 regression
93 duckdb:duckdb +12.7% +5.3% +7.0% +14.7% ➖ noise
93 duckdb:vortex-compact +7.7% +5.3% +2.3% +10.0% ➖ noise
93 duckdb:vortex-file-compressed +2.4% +5.3% -2.7% +10.4% ➖ noise
94 datafusion:vortex-compact +12.6% -3.1% +16.2% +10.0% 🚨 regression
94 datafusion:vortex-file-compressed +17.7% -3.1% +21.4% +11.0% 🚨 regression
94 duckdb:duckdb +10.4% -3.1% +13.9% +11.1% 🚨 regression
94 duckdb:vortex-compact -0.7% -3.1% +2.4% +16.3% ➖ noise
94 duckdb:vortex-file-compressed +6.2% -3.1% +9.5% +10.0% ➖ noise
95 datafusion:vortex-compact +7.5% +4.8% +2.5% +10.8% ➖ noise
95 datafusion:vortex-file-compressed +9.3% +4.8% +4.2% +10.8% ➖ noise
95 duckdb:duckdb +8.6% +4.8% +3.6% +22.1% ➖ noise
95 duckdb:vortex-compact -5.9% +4.8% -10.2% +17.8% ➖ noise
95 duckdb:vortex-file-compressed +11.5% +4.8% +6.3% +16.0% ➖ noise
96 datafusion:vortex-compact +3.4% +5.3% -1.7% +11.2% ➖ noise
96 datafusion:vortex-file-compressed +18.0% +5.3% +12.1% +15.9% ➖ noise
96 duckdb:duckdb +9.8% +5.3% +4.3% +15.1% ➖ noise
96 duckdb:vortex-compact +5.2% +5.3% -0.0% +11.7% ➖ noise
96 duckdb:vortex-file-compressed -4.1% +5.3% -8.9% +11.7% ➖ noise
97 datafusion:vortex-compact +13.5% +3.6% +9.5% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +11.6% +3.6% +7.7% +10.0% ➖ noise
97 duckdb:duckdb +15.3% +3.6% +11.3% +15.1% ➖ noise
97 duckdb:vortex-compact +10.6% +3.6% +6.8% +11.3% ➖ noise
97 duckdb:vortex-file-compressed -3.4% +3.6% -6.7% +12.2% ➖ noise
98 datafusion:vortex-compact +16.4% +2.0% +14.2% +10.9% 🚨 regression
98 datafusion:vortex-file-compressed +15.4% +2.0% +13.2% +11.7% 🚨 regression
98 duckdb:duckdb +10.1% +2.0% +8.0% +16.3% ➖ noise
98 duckdb:vortex-compact +6.1% +2.0% +4.1% +16.1% ➖ noise
98 duckdb:vortex-file-compressed +3.1% +2.0% +1.1% +13.1% ➖ noise
99 datafusion:vortex-compact +18.8% -4.2% +24.0% +17.3% 🚨 regression
99 datafusion:vortex-file-compressed +13.2% -4.2% +18.2% +18.2% 🚨 regression
99 duckdb:duckdb +0.8% -4.2% +5.3% +15.5% ➖ noise
99 duckdb:vortex-compact +7.1% -4.2% +11.8% +19.1% ➖ noise
99 duckdb:vortex-file-compressed -2.6% -4.2% +1.6% +28.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.9%
Vortex (geomean): 1.065x ➖
Parquet (geomean): 1.031x ➖
Shifts: Parquet (control) +3.1% · Median polish +6.1%

datafusion / vortex-file-compressed (1.069x ➖, 0↑ 1↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 432842166 400262029 1.08
tpch_q02/datafusion:vortex-file-compressed 125849931 115806475 1.09
tpch_q03/datafusion:vortex-file-compressed 220987524 203123072 1.09
tpch_q04/datafusion:vortex-file-compressed 107475276 100011236 1.07
tpch_q05/datafusion:vortex-file-compressed 🚨 422076951 383334476 1.10
tpch_q06/datafusion:vortex-file-compressed 43085685 40717415 1.06
tpch_q07/datafusion:vortex-file-compressed 611464322 560512324 1.09
tpch_q08/datafusion:vortex-file-compressed 403661410 381851150 1.06
tpch_q09/datafusion:vortex-file-compressed 721984673 662086147 1.09
tpch_q10/datafusion:vortex-file-compressed 255123056 240223128 1.06
tpch_q11/datafusion:vortex-file-compressed 88781234 84540499 1.05
tpch_q12/datafusion:vortex-file-compressed 118813818 111102014 1.07
tpch_q13/datafusion:vortex-file-compressed 234376221 219735072 1.07
tpch_q14/datafusion:vortex-file-compressed 61124218 60343365 1.01
tpch_q15/datafusion:vortex-file-compressed 116044850 110079171 1.05
tpch_q16/datafusion:vortex-file-compressed 80323389 77869133 1.03
tpch_q17/datafusion:vortex-file-compressed 691092126 649603095 1.06
tpch_q18/datafusion:vortex-file-compressed 956783433 880586398 1.09
tpch_q19/datafusion:vortex-file-compressed 126277150 116941751 1.08
tpch_q20/datafusion:vortex-file-compressed 178298762 168908296 1.06
tpch_q21/datafusion:vortex-file-compressed 716279342 657489432 1.09
tpch_q22/datafusion:vortex-file-compressed 66135297 61534553 1.07
datafusion / vortex-compact (1.062x ➖, 0↑ 3↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 449621940 446352720 1.01
tpch_q02/datafusion:vortex-compact 128025087 121955890 1.05
tpch_q03/datafusion:vortex-compact 235982903 217582911 1.08
tpch_q04/datafusion:vortex-compact 127927410 120277977 1.06
tpch_q05/datafusion:vortex-compact 419657158 389632945 1.08
tpch_q06/datafusion:vortex-compact 67357824 63577284 1.06
tpch_q07/datafusion:vortex-compact 🚨 647633468 584027372 1.11
tpch_q08/datafusion:vortex-compact 412848461 391013413 1.06
tpch_q09/datafusion:vortex-compact 718520554 678530232 1.06
tpch_q10/datafusion:vortex-compact 286458076 271119900 1.06
tpch_q11/datafusion:vortex-compact 97645534 90497922 1.08
tpch_q12/datafusion:vortex-compact 178579638 168050935 1.06
tpch_q13/datafusion:vortex-compact 288110493 270923817 1.06
tpch_q14/datafusion:vortex-compact 77822792 75091571 1.04
tpch_q15/datafusion:vortex-compact 172552191 167426361 1.03
tpch_q16/datafusion:vortex-compact 85372057 81805638 1.04
tpch_q17/datafusion:vortex-compact 692083873 648751882 1.07
tpch_q18/datafusion:vortex-compact 🚨 980838702 891319855 1.10
tpch_q19/datafusion:vortex-compact 222536130 220360441 1.01
tpch_q20/datafusion:vortex-compact 210085933 195888252 1.07
tpch_q21/datafusion:vortex-compact 753963309 701322736 1.08
tpch_q22/datafusion:vortex-compact 🚨 77307022 70203086 1.10
datafusion / parquet (1.044x ➖, 0↑ 2↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 422896309 454515648 0.93
tpch_q02/datafusion:parquet 197080839 185258659 1.06
tpch_q03/datafusion:parquet 305167214 298356300 1.02
tpch_q04/datafusion:parquet 141097084 132625068 1.06
tpch_q05/datafusion:parquet 461015501 444863743 1.04
tpch_q06/datafusion:parquet 121497167 124906820 0.97
tpch_q07/datafusion:parquet 651878946 625587855 1.04
tpch_q08/datafusion:parquet 500267531 484720142 1.03
tpch_q09/datafusion:parquet 791261914 767512755 1.03
tpch_q10/datafusion:parquet 519391012 511431321 1.02
tpch_q11/datafusion:parquet 135555543 128889932 1.05
tpch_q12/datafusion:parquet 201202223 200385983 1.00
tpch_q13/datafusion:parquet 346520851 337720153 1.03
tpch_q14/datafusion:parquet 162485473 151022965 1.08
tpch_q15/datafusion:parquet 254324439 238818012 1.06
tpch_q16/datafusion:parquet 🚨 151631496 135431447 1.12
tpch_q17/datafusion:parquet 751409328 688178169 1.09
tpch_q18/datafusion:parquet 971103689 887261733 1.09
tpch_q19/datafusion:parquet 269391936 276473044 0.97
tpch_q20/datafusion:parquet 328172692 305257998 1.08
tpch_q21/datafusion:parquet 797330399 736354531 1.08
tpch_q22/datafusion:parquet 🚨 243835501 217900839 1.12
datafusion / arrow (1.069x ➖, 0↑ 3↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 629138194 599469994 1.05
tpch_q02/datafusion:arrow 171399551 164740978 1.04
tpch_q03/datafusion:arrow 490454755 459695870 1.07
tpch_q04/datafusion:arrow 370543565 353649018 1.05
tpch_q05/datafusion:arrow 980291796 922453754 1.06
tpch_q06/datafusion:arrow 297363097 279913771 1.06
tpch_q07/datafusion:arrow 1237842118 1141055238 1.08
tpch_q08/datafusion:arrow 1226865368 1136787925 1.08
tpch_q09/datafusion:arrow 1421160895 1341463386 1.06
tpch_q10/datafusion:arrow 644070608 598660798 1.08
tpch_q11/datafusion:arrow 154688462 147289731 1.05
tpch_q12/datafusion:arrow 696688266 663609740 1.05
tpch_q13/datafusion:arrow 520471037 525493315 0.99
tpch_q14/datafusion:arrow 🚨 346619167 309505977 1.12
tpch_q15/datafusion:arrow 🚨 768914967 656997673 1.17
tpch_q16/datafusion:arrow 111077095 106303258 1.04
tpch_q17/datafusion:arrow 1415241862 1307917070 1.08
tpch_q18/datafusion:arrow 1907562767 1816597132 1.05
tpch_q19/datafusion:arrow 546415291 499060661 1.09
tpch_q20/datafusion:arrow 535850949 490205741 1.09
tpch_q21/datafusion:arrow 2988750912 2868399335 1.04
tpch_q22/datafusion:arrow 🚨 156299823 140693982 1.11
duckdb / vortex-file-compressed (1.073x ➖, 0↑ 3↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 183661792 176837751 1.04
tpch_q02/duckdb:vortex-file-compressed 56779913 52865801 1.07
tpch_q03/duckdb:vortex-file-compressed 142642960 130724155 1.09
tpch_q04/duckdb:vortex-file-compressed 🚨 169136542 152023172 1.11
tpch_q05/duckdb:vortex-file-compressed 🚨 152903144 131933674 1.16
tpch_q06/duckdb:vortex-file-compressed 53700552 49020452 1.10
tpch_q07/duckdb:vortex-file-compressed 160798518 148343162 1.08
tpch_q08/duckdb:vortex-file-compressed 🚨 197501029 178615498 1.11
tpch_q09/duckdb:vortex-file-compressed 358957563 338249075 1.06
tpch_q10/duckdb:vortex-file-compressed 170692160 155689535 1.10
tpch_q11/duckdb:vortex-file-compressed 39170914 37207080 1.05
tpch_q12/duckdb:vortex-file-compressed 102392829 95563263 1.07
tpch_q13/duckdb:vortex-file-compressed 266056408 247057086 1.08
tpch_q14/duckdb:vortex-file-compressed 74520948 72049342 1.03
tpch_q15/duckdb:vortex-file-compressed 105005201 96915364 1.08
tpch_q16/duckdb:vortex-file-compressed 87109355 80100943 1.09
tpch_q17/duckdb:vortex-file-compressed 107981097 101260438 1.07
tpch_q18/duckdb:vortex-file-compressed 296445864 289110370 1.03
tpch_q19/duckdb:vortex-file-compressed 95664902 91885070 1.04
tpch_q20/duckdb:vortex-file-compressed 175924461 164179372 1.07
tpch_q21/duckdb:vortex-file-compressed 590403270 557253767 1.06
tpch_q22/duckdb:vortex-file-compressed 80768297 79258191 1.02
duckdb / vortex-compact (1.056x ➖, 0↑ 1↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 236043896 230743661 1.02
tpch_q02/duckdb:vortex-compact 63232188 59418552 1.06
tpch_q03/duckdb:vortex-compact 152399607 142447164 1.07
tpch_q04/duckdb:vortex-compact 194033794 178100386 1.09
tpch_q05/duckdb:vortex-compact 162355928 150255455 1.08
tpch_q06/duckdb:vortex-compact 87397092 86250611 1.01
tpch_q07/duckdb:vortex-compact 216024399 204267750 1.06
tpch_q08/duckdb:vortex-compact 200332984 193606571 1.03
tpch_q09/duckdb:vortex-compact 376229821 370852448 1.01
tpch_q10/duckdb:vortex-compact 198384209 187550336 1.06
tpch_q11/duckdb:vortex-compact 46157925 42115050 1.10
tpch_q12/duckdb:vortex-compact 216770279 210109888 1.03
tpch_q13/duckdb:vortex-compact 319450289 297663847 1.07
tpch_q14/duckdb:vortex-compact 110785977 105785163 1.05
tpch_q15/duckdb:vortex-compact 128970377 119500772 1.08
tpch_q16/duckdb:vortex-compact 91559898 87773969 1.04
tpch_q17/duckdb:vortex-compact 124771717 117486556 1.06
tpch_q18/duckdb:vortex-compact 301680753 295962247 1.02
tpch_q19/duckdb:vortex-compact 120291317 114967979 1.05
tpch_q20/duckdb:vortex-compact 🚨 229397021 207285370 1.11
tpch_q21/duckdb:vortex-compact 685088096 635813567 1.08
tpch_q22/duckdb:vortex-compact 95383930 90772809 1.05
duckdb / parquet (1.018x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 253159306 261140483 0.97
tpch_q02/duckdb:parquet 108991575 105998808 1.03
tpch_q03/duckdb:parquet 215666750 213890632 1.01
tpch_q04/duckdb:parquet 141354162 137724806 1.03
tpch_q05/duckdb:parquet 224238393 217785258 1.03
tpch_q06/duckdb:parquet 68236482 67841639 1.01
tpch_q07/duckdb:parquet 188614516 179955813 1.05
tpch_q08/duckdb:parquet 263180238 260422476 1.01
tpch_q09/duckdb:parquet 467875382 468216952 1.00
tpch_q10/duckdb:parquet 633289497 602744297 1.05
tpch_q11/duckdb:parquet 45938530 46000375 1.00
tpch_q12/duckdb:parquet 134035263 128593906 1.04
tpch_q13/duckdb:parquet 476443106 459558961 1.04
tpch_q14/duckdb:parquet 180707097 177980809 1.02
tpch_q15/duckdb:parquet 100673580 97318960 1.03
tpch_q16/duckdb:parquet 146224704 156376703 0.94
tpch_q17/duckdb:parquet 181038900 177777499 1.02
tpch_q18/duckdb:parquet 364828693 346501022 1.05
tpch_q19/duckdb:parquet 290559309 288113516 1.01
tpch_q20/duckdb:parquet 234611310 229951872 1.02
tpch_q21/duckdb:parquet 612067330 575852342 1.06
tpch_q22/duckdb:parquet 293215712 292923735 1.00
duckdb / duckdb (1.039x ➖, 0↑ 1↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117468553 120148076 0.98
tpch_q02/duckdb:duckdb 🚨 50775969 45764344 1.11
tpch_q03/duckdb:duckdb 100134387 97380045 1.03
tpch_q04/duckdb:duckdb 143868650 131850329 1.09
tpch_q05/duckdb:duckdb 117647686 111271135 1.06
tpch_q06/duckdb:duckdb 40595160 39981970 1.02
tpch_q07/duckdb:duckdb 88925841 85994603 1.03
tpch_q08/duckdb:duckdb 118393701 109641354 1.08
tpch_q09/duckdb:duckdb 289449433 279740639 1.03
tpch_q10/duckdb:duckdb 209233869 201254798 1.04
tpch_q11/duckdb:duckdb 16045882 15051803 1.07
tpch_q12/duckdb:duckdb 85491294 84007710 1.02
tpch_q13/duckdb:duckdb 258127776 256960565 1.00
tpch_q14/duckdb:duckdb 73915984 71137615 1.04
tpch_q15/duckdb:duckdb 80865109 77710726 1.04
tpch_q16/duckdb:duckdb 78896974 73579019 1.07
tpch_q17/duckdb:duckdb 86480062 84834067 1.02
tpch_q18/duckdb:duckdb 222234709 212787364 1.04
tpch_q19/duckdb:duckdb 119404005 115673378 1.03
tpch_q20/duckdb:duckdb 113421842 111884913 1.01
tpch_q21/duckdb:duckdb 317585114 303016556 1.05
tpch_q22/duckdb:duckdb 69063046 69071066 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +4.9% -5.0% +10.5% +12.3% ➖ noise
1 datafusion:vortex-compact +0.7% -5.0% +6.1% +13.4% ➖ noise
1 datafusion:vortex-file-compressed +8.1% -5.0% +13.9% +13.9% ➖ noise
1 duckdb:duckdb -2.2% -5.0% +2.9% +12.7% ➖ noise
1 duckdb:vortex-compact +2.3% -5.0% +7.7% +12.4% ➖ noise
1 duckdb:vortex-file-compressed +3.9% -5.0% +9.4% +13.7% ➖ noise
2 datafusion:arrow +4.0% +4.6% -0.5% +10.0% ➖ noise
2 datafusion:vortex-compact +5.0% +4.6% +0.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +8.7% +4.6% +3.9% +10.0% ➖ noise
2 duckdb:duckdb +11.0% +4.6% +6.1% +10.0% ➖ noise
2 duckdb:vortex-compact +6.4% +4.6% +1.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +7.4% +4.6% +2.7% +10.0% ➖ noise
3 datafusion:arrow +6.7% +1.6% +5.1% +10.0% ➖ noise
3 datafusion:vortex-compact +8.5% +1.6% +6.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +8.8% +1.6% +7.1% +10.0% ➖ noise
3 duckdb:duckdb +2.8% +1.6% +1.3% +10.0% ➖ noise
3 duckdb:vortex-compact +7.0% +1.6% +5.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +9.1% +1.6% +7.4% +10.0% ➖ noise
4 datafusion:arrow +4.8% +4.5% +0.3% +10.0% ➖ noise
4 datafusion:vortex-compact +6.4% +4.5% +1.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +7.5% +4.5% +2.8% +10.0% ➖ noise
4 duckdb:duckdb +9.1% +4.5% +4.4% +10.0% ➖ noise
4 duckdb:vortex-compact +8.9% +4.5% +4.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +11.3% +4.5% +6.5% +10.0% ➖ noise
5 datafusion:arrow +6.3% +3.3% +2.9% +10.0% ➖ noise
5 datafusion:vortex-compact +7.7% +3.3% +4.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +10.1% +3.3% +6.6% +10.0% ➖ noise
5 duckdb:duckdb +5.7% +3.3% +2.4% +10.0% ➖ noise
5 duckdb:vortex-compact +8.1% +3.3% +4.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +15.9% +3.3% +12.2% +10.0% 🚨 regression
6 datafusion:arrow +6.2% -1.1% +7.4% +10.0% ➖ noise
6 datafusion:vortex-compact +5.9% -1.1% +7.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +5.8% -1.1% +7.0% +10.0% ➖ noise
6 duckdb:duckdb +1.5% -1.1% +2.7% +16.1% ➖ noise
6 duckdb:vortex-compact +1.3% -1.1% +2.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +9.5% -1.1% +10.8% +12.0% ➖ noise
7 datafusion:arrow +8.5% +4.5% +3.8% +10.0% ➖ noise
7 datafusion:vortex-compact +10.9% +4.5% +6.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +9.1% +4.5% +4.4% +10.0% ➖ noise
7 duckdb:duckdb +3.4% +4.5% -1.1% +10.0% ➖ noise
7 duckdb:vortex-compact +5.8% +4.5% +1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +8.4% +4.5% +3.7% +10.0% ➖ noise
8 datafusion:arrow +7.9% +2.1% +5.7% +10.0% ➖ noise
8 datafusion:vortex-compact +5.6% +2.1% +3.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +5.7% +2.1% +3.5% +10.0% ➖ noise
8 duckdb:duckdb +8.0% +2.1% +5.7% +10.0% ➖ noise
8 duckdb:vortex-compact +3.5% +2.1% +1.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +10.6% +2.1% +8.3% +10.0% ➖ noise
9 datafusion:arrow +5.9% +1.5% +4.4% +10.0% ➖ noise
9 datafusion:vortex-compact +5.9% +1.5% +4.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +9.0% +1.5% +7.4% +10.0% ➖ noise
9 duckdb:duckdb +3.5% +1.5% +1.9% +10.0% ➖ noise
9 duckdb:vortex-compact +1.5% +1.5% -0.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +6.1% +1.5% +4.6% +10.0% ➖ noise
10 datafusion:arrow +7.6% +3.3% +4.2% +10.0% ➖ noise
10 datafusion:vortex-compact +5.7% +3.3% +2.3% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +6.2% +3.3% +2.8% +10.0% ➖ noise
10 duckdb:duckdb +4.0% +3.3% +0.6% +10.0% ➖ noise
10 duckdb:vortex-compact +5.8% +3.3% +2.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +9.6% +3.3% +6.1% +10.0% ➖ noise
11 datafusion:arrow +5.0% +2.5% +2.5% +10.0% ➖ noise
11 datafusion:vortex-compact +7.9% +2.5% +5.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +5.0% +2.5% +2.5% +10.0% ➖ noise
11 duckdb:duckdb +6.6% +2.5% +4.0% +15.9% ➖ noise
11 duckdb:vortex-compact +9.6% +2.5% +6.9% +14.0% ➖ noise
11 duckdb:vortex-file-compressed +5.3% +2.5% +2.7% +13.3% ➖ noise
12 datafusion:arrow +5.0% +2.3% +2.6% +47.1% ➖ noise
12 datafusion:vortex-compact +6.3% +2.3% +3.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +6.9% +2.3% +4.5% +10.0% ➖ noise
12 duckdb:duckdb +1.8% +2.3% -0.5% +10.0% ➖ noise
12 duckdb:vortex-compact +3.2% +2.3% +0.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +7.1% +2.3% +4.7% +10.0% ➖ noise
13 datafusion:arrow -1.0% +3.1% -4.0% +10.0% ➖ noise
13 datafusion:vortex-compact +6.3% +3.1% +3.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +6.7% +3.1% +3.4% +10.0% ➖ noise
13 duckdb:duckdb +0.5% +3.1% -2.6% +10.0% ➖ noise
13 duckdb:vortex-compact +7.3% +3.1% +4.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +7.7% +3.1% +4.4% +10.0% ➖ noise
14 datafusion:arrow +12.0% +4.5% +7.2% +10.0% ➖ noise
14 datafusion:vortex-compact +3.6% +4.5% -0.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.3% +4.5% -3.1% +12.0% ➖ noise
14 duckdb:duckdb +3.9% +4.5% -0.6% +10.0% ➖ noise
14 duckdb:vortex-compact +4.7% +4.5% +0.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +3.4% +4.5% -1.0% +10.0% ➖ noise
15 datafusion:arrow +17.0% +5.0% +11.5% +10.0% 🚨 regression
15 datafusion:vortex-compact +3.1% +5.0% -1.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +5.4% +5.0% +0.4% +10.0% ➖ noise
15 duckdb:duckdb +4.1% +5.0% -0.9% +10.0% ➖ noise
15 duckdb:vortex-compact +7.9% +5.0% +2.8% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +8.3% +5.0% +3.2% +10.0% ➖ noise
16 datafusion:arrow +4.5% +2.3% +2.1% +11.8% ➖ noise
16 datafusion:vortex-compact +4.4% +2.3% +2.0% +11.0% ➖ noise
16 datafusion:vortex-file-compressed +3.2% +2.3% +0.8% +11.4% ➖ noise
16 duckdb:duckdb +7.2% +2.3% +4.8% +10.2% ➖ noise
16 duckdb:vortex-compact +4.3% +2.3% +1.9% +10.6% ➖ noise
16 duckdb:vortex-file-compressed +8.7% +2.3% +6.3% +11.1% ➖ noise
17 datafusion:arrow +8.2% +5.4% +2.6% +10.0% ➖ noise
17 datafusion:vortex-compact +6.7% +5.4% +1.2% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +6.4% +5.4% +0.9% +10.0% ➖ noise
17 duckdb:duckdb +1.9% +5.4% -3.3% +10.0% ➖ noise
17 duckdb:vortex-compact +6.2% +5.4% +0.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +6.6% +5.4% +1.1% +10.0% ➖ noise
18 datafusion:arrow +5.0% +7.3% -2.2% +10.7% ➖ noise
18 datafusion:vortex-compact +10.0% +7.3% +2.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +8.7% +7.3% +1.2% +10.0% ➖ noise
18 duckdb:duckdb +4.4% +7.3% -2.7% +10.0% ➖ noise
18 duckdb:vortex-compact +1.9% +7.3% -5.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.5% +7.3% -4.5% +10.0% ➖ noise
19 datafusion:arrow +9.5% -0.9% +10.5% +10.0% 🚨 regression
19 datafusion:vortex-compact +1.0% -0.9% +1.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +8.0% -0.9% +8.9% +11.7% ➖ noise
19 duckdb:duckdb +3.2% -0.9% +4.1% +10.0% ➖ noise
19 duckdb:vortex-compact +4.6% -0.9% +5.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +4.1% -0.9% +5.0% +10.0% ➖ noise
20 datafusion:arrow +9.3% +4.7% +4.4% +10.0% ➖ noise
20 datafusion:vortex-compact +7.2% +4.7% +2.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +5.6% +4.7% +0.8% +10.0% ➖ noise
20 duckdb:duckdb +1.4% +4.7% -3.2% +10.0% ➖ noise
20 duckdb:vortex-compact +10.7% +4.7% +5.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +7.2% +4.7% +2.3% +10.0% ➖ noise
21 datafusion:arrow +4.2% +7.3% -2.9% +10.0% ➖ noise
21 datafusion:vortex-compact +7.5% +7.3% +0.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +8.9% +7.3% +1.5% +10.0% ➖ noise
21 duckdb:duckdb +4.8% +7.3% -2.3% +10.0% ➖ noise
21 duckdb:vortex-compact +7.7% +7.3% +0.4% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +5.9% +7.3% -1.2% +10.0% ➖ noise
22 datafusion:arrow +11.1% +5.8% +5.0% +10.0% ➖ noise
22 datafusion:vortex-compact +10.1% +5.8% +4.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +7.5% +5.8% +1.5% +10.0% ➖ noise
22 duckdb:duckdb -0.0% +5.8% -5.5% +10.0% ➖ noise
22 duckdb:vortex-compact +5.1% +5.8% -0.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +1.9% +5.8% -3.7% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +1.3%

duckdb / vortex-file-compressed (0.978x ➖, 1↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11089287 10944870 1.01
statpopgen_q01/duckdb:vortex-file-compressed 🚀 19623612 27597595 0.71
statpopgen_q02/duckdb:vortex-file-compressed 1305377378 1307112883 1.00
statpopgen_q03/duckdb:vortex-file-compressed 3092817883 2989645458 1.03
statpopgen_q04/duckdb:vortex-file-compressed 3074468274 3013222107 1.02
statpopgen_q05/duckdb:vortex-file-compressed 1381890691 1370552461 1.01
statpopgen_q06/duckdb:vortex-file-compressed 2056924488 2045339017 1.01
statpopgen_q07/duckdb:vortex-file-compressed 196711364 196822497 1.00
statpopgen_q08/duckdb:vortex-file-compressed 208931675 211259033 0.99
statpopgen_q09/duckdb:vortex-file-compressed 2809902067 2783491823 1.01
statpopgen_q10/duckdb:vortex-file-compressed 4612812149 4516010806 1.02
duckdb / vortex-compact (1.013x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10863064 10688094 1.02
statpopgen_q01/duckdb:vortex-compact 173769367 169527669 1.03
statpopgen_q02/duckdb:vortex-compact 1817631343 1795506717 1.01
statpopgen_q03/duckdb:vortex-compact 3493845678 3432912661 1.02
statpopgen_q04/duckdb:vortex-compact 3547576012 3503749424 1.01
statpopgen_q05/duckdb:vortex-compact 1807137103 1823175739 0.99
statpopgen_q06/duckdb:vortex-compact 2653216542 2651816515 1.00
statpopgen_q07/duckdb:vortex-compact 953883896 939218651 1.02
statpopgen_q08/duckdb:vortex-compact 982857102 974719708 1.01
statpopgen_q09/duckdb:vortex-compact 3388692362 3297138734 1.03
statpopgen_q10/duckdb:vortex-compact 5442535057 5354291624 1.02
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 320446837 320600749 1.00
statpopgen_q01/duckdb:parquet 407068817 402455986 1.01
statpopgen_q02/duckdb:parquet 983667355 1008607823 0.98
statpopgen_q03/duckdb:parquet 1510002105 1527471437 0.99
statpopgen_q04/duckdb:parquet 1524605794 1538897316 0.99
statpopgen_q05/duckdb:parquet 1002294045 1014043609 0.99
statpopgen_q06/duckdb:parquet 1493763607 1513065901 0.99
statpopgen_q07/duckdb:parquet 1903636496 1883281707 1.01
statpopgen_q08/duckdb:parquet 1901875304 1902217956 1.00
statpopgen_q09/duckdb:parquet 1375289141 1338005462 1.03
statpopgen_q10/duckdb:parquet 2679254633 2678866128 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +1.6% -0.0% +1.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +1.3% -0.0% +1.4% +10.0% ➖ noise
1 duckdb:vortex-compact +2.5% +1.1% +1.3% +27.9% ➖ noise
1 duckdb:vortex-file-compressed -28.9% +1.1% -29.7% +243.1% ➖ noise
2 duckdb:vortex-compact +1.2% -2.5% +3.8% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.1% -2.5% +2.4% +10.0% ➖ noise
3 duckdb:vortex-compact +1.8% -1.1% +3.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +3.5% -1.1% +4.6% +10.0% ➖ noise
4 duckdb:vortex-compact +1.3% -0.9% +2.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.0% -0.9% +3.0% +10.0% ➖ noise
5 duckdb:vortex-compact -0.9% -1.2% +0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.8% -1.2% +2.0% +10.0% ➖ noise
6 duckdb:vortex-compact +0.1% -1.3% +1.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.6% -1.3% +1.9% +10.0% ➖ noise
7 duckdb:vortex-compact +1.6% +1.1% +0.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.1% +1.1% -1.1% +10.0% ➖ noise
8 duckdb:vortex-compact +0.8% -0.0% +0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -1.1% -0.0% -1.1% +10.0% ➖ noise
9 duckdb:vortex-compact +2.8% +2.8% -0.0% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.9% +2.8% -1.8% +10.0% ➖ noise
10 duckdb:vortex-compact +1.6% +0.0% +1.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.1% +0.0% +2.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.8%
Vortex (geomean): 1.006x ➖
Parquet (geomean): 0.992x ➖
Shifts: Parquet (control) -0.8% · Median polish +0.5%

datafusion / vortex-file-compressed (1.013x ➖, 0↑ 1↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1914034 1956671 0.98
clickbench_q01/datafusion:vortex-file-compressed 14035378 13796267 1.02
clickbench_q02/datafusion:vortex-file-compressed 33242211 34504786 0.96
clickbench_q03/datafusion:vortex-file-compressed 36049420 37504107 0.96
clickbench_q04/datafusion:vortex-file-compressed 315868679 313748998 1.01
clickbench_q05/datafusion:vortex-file-compressed 321952500 327212235 0.98
clickbench_q06/datafusion:vortex-file-compressed 2015806 1925158 1.05
clickbench_q07/datafusion:vortex-file-compressed 18168177 18208671 1.00
clickbench_q08/datafusion:vortex-file-compressed 385126357 381959301 1.01
clickbench_q09/datafusion:vortex-file-compressed 561867388 556885838 1.01
clickbench_q10/datafusion:vortex-file-compressed 73969886 73849100 1.00
clickbench_q11/datafusion:vortex-file-compressed 82504371 81182105 1.02
clickbench_q12/datafusion:vortex-file-compressed 282788568 284623281 0.99
clickbench_q13/datafusion:vortex-file-compressed 416307390 419477475 0.99
clickbench_q14/datafusion:vortex-file-compressed 252435451 256513996 0.98
clickbench_q15/datafusion:vortex-file-compressed 372157993 372439155 1.00
clickbench_q16/datafusion:vortex-file-compressed 707694376 710304170 1.00
clickbench_q17/datafusion:vortex-file-compressed 699111681 696572150 1.00
clickbench_q18/datafusion:vortex-file-compressed 1383325966 1447752694 0.96
clickbench_q19/datafusion:vortex-file-compressed 24034568 24343446 0.99
clickbench_q20/datafusion:vortex-file-compressed 356460241 360043608 0.99
clickbench_q21/datafusion:vortex-file-compressed 414323793 423031553 0.98
clickbench_q22/datafusion:vortex-file-compressed 538523552 547030517 0.98
clickbench_q23/datafusion:vortex-file-compressed 656236542 629500442 1.04
clickbench_q24/datafusion:vortex-file-compressed 🚨 49132974 43191944 1.14
clickbench_q25/datafusion:vortex-file-compressed 70440962 68239288 1.03
clickbench_q26/datafusion:vortex-file-compressed 44247115 45095584 0.98
clickbench_q27/datafusion:vortex-file-compressed 808745372 791849267 1.02
clickbench_q28/datafusion:vortex-file-compressed 6792835490 6835813515 0.99
clickbench_q29/datafusion:vortex-file-compressed 257488123 243780896 1.06
clickbench_q30/datafusion:vortex-file-compressed 234842615 223248784 1.05
clickbench_q31/datafusion:vortex-file-compressed 267828115 260194711 1.03
clickbench_q32/datafusion:vortex-file-compressed 1434399816 1336544677 1.07
clickbench_q33/datafusion:vortex-file-compressed 1406434506 1426724126 0.99
clickbench_q34/datafusion:vortex-file-compressed 1400562371 1401474434 1.00
clickbench_q35/datafusion:vortex-file-compressed 514745604 500821161 1.03
clickbench_q36/datafusion:vortex-file-compressed 85254145 78048772 1.09
clickbench_q37/datafusion:vortex-file-compressed 40522261 39730239 1.02
clickbench_q38/datafusion:vortex-file-compressed 22942458 23074953 0.99
clickbench_q39/datafusion:vortex-file-compressed 151174405 148787206 1.02
clickbench_q40/datafusion:vortex-file-compressed 19051860 17821034 1.07
clickbench_q41/datafusion:vortex-file-compressed 18099322 16888901 1.07
clickbench_q42/datafusion:vortex-file-compressed 21056856 20206739 1.04
datafusion / parquet (0.981x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1794741 1893681 0.95
clickbench_q01/datafusion:parquet 21253101 20753068 1.02
clickbench_q02/datafusion:parquet 55286247 58923064 0.94
clickbench_q03/datafusion:parquet 44305010 45508417 0.97
clickbench_q04/datafusion:parquet 338741493 365116112 0.93
clickbench_q05/datafusion:parquet 369341763 384095621 0.96
clickbench_q06/datafusion:parquet 1816882 1799709 1.01
clickbench_q07/datafusion:parquet 27367981 26583113 1.03
clickbench_q08/datafusion:parquet 419095968 432192547 0.97
clickbench_q09/datafusion:parquet 672879126 733160582 0.92
clickbench_q10/datafusion:parquet 112022758 118044525 0.95
clickbench_q11/datafusion:parquet 140219426 139707912 1.00
clickbench_q12/datafusion:parquet 366809968 393683559 0.93
clickbench_q13/datafusion:parquet 520334158 564212375 0.92
clickbench_q14/datafusion:parquet 373170933 393364272 0.95
clickbench_q15/datafusion:parquet 390275983 423674722 0.92
clickbench_q16/datafusion:parquet 725200359 757564302 0.96
clickbench_q17/datafusion:parquet 692694669 737031791 0.94
clickbench_q18/datafusion:parquet 1409704640 1496759945 0.94
clickbench_q19/datafusion:parquet 34018661 32276052 1.05
clickbench_q20/datafusion:parquet 616639917 627229013 0.98
clickbench_q21/datafusion:parquet 680651776 701421125 0.97
clickbench_q22/datafusion:parquet 974817965 979508243 1.00
clickbench_q23/datafusion:parquet 3601680934 3812878378 0.94
clickbench_q24/datafusion:parquet 93351682 91706907 1.02
clickbench_q25/datafusion:parquet 140188975 141725874 0.99
clickbench_q26/datafusion:parquet 92282599 89386893 1.03
clickbench_q27/datafusion:parquet 1067025422 1049072989 1.02
clickbench_q28/datafusion:parquet 6533236499 6815956371 0.96
clickbench_q29/datafusion:parquet 247630627 257326769 0.96
clickbench_q30/datafusion:parquet 373740713 370832936 1.01
clickbench_q31/datafusion:parquet 400298661 397224699 1.01
clickbench_q32/datafusion:parquet 1349422802 1351784687 1.00
clickbench_q33/datafusion:parquet 1562391607 1563708163 1.00
clickbench_q34/datafusion:parquet 1522633630 1546807756 0.98
clickbench_q35/datafusion:parquet 527188382 546224179 0.97
clickbench_q36/datafusion:parquet 145781047 145458193 1.00
clickbench_q37/datafusion:parquet 62604644 61941222 1.01
clickbench_q38/datafusion:parquet 93357009 89745956 1.04
clickbench_q39/datafusion:parquet 280732650 278660160 1.01
clickbench_q40/datafusion:parquet 34690095 33433438 1.04
clickbench_q41/datafusion:parquet 30084028 30565468 0.98
clickbench_q42/datafusion:parquet 33044398 31853720 1.04
duckdb / vortex-file-compressed (0.999x ➖, 3↑ 6↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6186221 6542578 0.95
clickbench_q01/duckdb:vortex-file-compressed 14388408 13548964 1.06
clickbench_q02/duckdb:vortex-file-compressed 24919281 24265589 1.03
clickbench_q03/duckdb:vortex-file-compressed 30398923 30454795 1.00
clickbench_q04/duckdb:vortex-file-compressed 173728491 167832384 1.04
clickbench_q05/duckdb:vortex-file-compressed 200193322 196564548 1.02
clickbench_q06/duckdb:vortex-file-compressed 19925684 19439584 1.03
clickbench_q07/duckdb:vortex-file-compressed 15863649 14889792 1.07
clickbench_q08/duckdb:vortex-file-compressed 261919581 260678117 1.00
clickbench_q09/duckdb:vortex-file-compressed 376253169 376050187 1.00
clickbench_q10/duckdb:vortex-file-compressed 74579472 74696116 1.00
clickbench_q11/duckdb:vortex-file-compressed 80769638 81704124 0.99
clickbench_q12/duckdb:vortex-file-compressed 212289863 212612006 1.00
clickbench_q13/duckdb:vortex-file-compressed 428596504 435292944 0.98
clickbench_q14/duckdb:vortex-file-compressed 242444187 237504665 1.02
clickbench_q15/duckdb:vortex-file-compressed 214514858 209871093 1.02
clickbench_q16/duckdb:vortex-file-compressed 698299283 690367782 1.01
clickbench_q17/duckdb:vortex-file-compressed 548519693 537064177 1.02
clickbench_q18/duckdb:vortex-file-compressed 1211399329 1276908411 0.95
clickbench_q19/duckdb:vortex-file-compressed 21576741 20897655 1.03
clickbench_q20/duckdb:vortex-file-compressed 381528043 413774728 0.92
clickbench_q21/duckdb:vortex-file-compressed 406411366 419192204 0.97
clickbench_q22/duckdb:vortex-file-compressed 702477277 698928241 1.01
clickbench_q23/duckdb:vortex-file-compressed 🚀 691952663 1429123034 0.48
clickbench_q24/duckdb:vortex-file-compressed 41657627 41183813 1.01
clickbench_q25/duckdb:vortex-file-compressed 83814812 80875984 1.04
clickbench_q26/duckdb:vortex-file-compressed 🚀 38313942 47227559 0.81
clickbench_q27/duckdb:vortex-file-compressed 514448514 533885225 0.96
clickbench_q28/duckdb:vortex-file-compressed 3003411129 3014234851 1.00
clickbench_q29/duckdb:vortex-file-compressed 27912699 28012473 1.00
clickbench_q30/duckdb:vortex-file-compressed 174458677 175923515 0.99
clickbench_q31/duckdb:vortex-file-compressed 256809902 255688158 1.00
clickbench_q32/duckdb:vortex-file-compressed 1342009108 1340338624 1.00
clickbench_q33/duckdb:vortex-file-compressed 1553572279 1694430511 0.92
clickbench_q34/duckdb:vortex-file-compressed 🚀 1567780605 1773880535 0.88
clickbench_q35/duckdb:vortex-file-compressed 373043461 374634903 1.00
clickbench_q36/duckdb:vortex-file-compressed 🚨 35104992 29442979 1.19
clickbench_q37/duckdb:vortex-file-compressed 🚨 26240532 21178005 1.24
clickbench_q38/duckdb:vortex-file-compressed 🚨 27304822 23106421 1.18
clickbench_q39/duckdb:vortex-file-compressed 46872087 45593814 1.03
clickbench_q40/duckdb:vortex-file-compressed 🚨 24073159 21833714 1.10
clickbench_q41/duckdb:vortex-file-compressed 🚨 24476690 20739261 1.18
clickbench_q42/duckdb:vortex-file-compressed 🚨 26749346 22844585 1.17
duckdb / parquet (1.002x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 226632141 225142664 1.01
clickbench_q01/duckdb:parquet 51149686 50542578 1.01
clickbench_q02/duckdb:parquet 65326331 63980478 1.02
clickbench_q03/duckdb:parquet 64074035 63978999 1.00
clickbench_q04/duckdb:parquet 207945079 206152951 1.01
clickbench_q05/duckdb:parquet 278831215 279841020 1.00
clickbench_q06/duckdb:parquet 60838499 60939383 1.00
clickbench_q07/duckdb:parquet 52638565 54011088 0.97
clickbench_q08/duckdb:parquet 271763630 269881247 1.01
clickbench_q09/duckdb:parquet 397136564 397177025 1.00
clickbench_q10/duckdb:parquet 96274886 94327554 1.02
clickbench_q11/duckdb:parquet 108030702 108451147 1.00
clickbench_q12/duckdb:parquet 299000401 294117863 1.02
clickbench_q13/duckdb:parquet 512692617 518267207 0.99
clickbench_q14/duckdb:parquet 334183544 333711371 1.00
clickbench_q15/duckdb:parquet 245278790 243696588 1.01
clickbench_q16/duckdb:parquet 615908592 617001763 1.00
clickbench_q17/duckdb:parquet 516589052 523036639 0.99
clickbench_q18/duckdb:parquet 1063101267 1068777049 0.99
clickbench_q19/duckdb:parquet 49992613 49347155 1.01
clickbench_q20/duckdb:parquet 438494405 435318701 1.01
clickbench_q21/duckdb:parquet 560536307 555859079 1.01
clickbench_q22/duckdb:parquet 940279059 935070433 1.01
clickbench_q23/duckdb:parquet 317543950 316101955 1.00
clickbench_q24/duckdb:parquet 79340440 79525692 1.00
clickbench_q25/duckdb:parquet 140912722 140618573 1.00
clickbench_q26/duckdb:parquet 53590247 53306368 1.01
clickbench_q27/duckdb:parquet 649135522 641309578 1.01
clickbench_q28/duckdb:parquet 4857851008 4867202768 1.00
clickbench_q29/duckdb:parquet 62268678 61604510 1.01
clickbench_q30/duckdb:parquet 310216856 305355743 1.02
clickbench_q31/duckdb:parquet 352332411 349914524 1.01
clickbench_q32/duckdb:parquet 1117334608 1170396376 0.95
clickbench_q33/duckdb:parquet 1225213981 1253859150 0.98
clickbench_q34/duckdb:parquet 1274193392 1266974616 1.01
clickbench_q35/duckdb:parquet 353175069 355802102 0.99
clickbench_q36/duckdb:parquet 64409493 64714783 1.00
clickbench_q37/duckdb:parquet 53784335 53850008 1.00
clickbench_q38/duckdb:parquet 58893669 58620085 1.00
clickbench_q39/duckdb:parquet 104742857 104973550 1.00
clickbench_q40/duckdb:parquet 56112426 55953519 1.00
clickbench_q41/duckdb:parquet 59655371 59822462 1.00
clickbench_q42/duckdb:parquet 52874380 49985490 1.06
duckdb / duckdb (1.016x ➖, 0↑ 4↓)
name PR 9334719 (ns) base 9b1f954 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17499414 18180272 0.96
clickbench_q01/duckdb:duckdb 32774513 32540248 1.01
clickbench_q02/duckdb:duckdb 44779449 45227788 0.99
clickbench_q03/duckdb:duckdb 46761895 46978272 1.00
clickbench_q04/duckdb:duckdb 215269166 214549734 1.00
clickbench_q05/duckdb:duckdb 331606589 324576540 1.02
clickbench_q06/duckdb:duckdb 35240619 35699047 0.99
clickbench_q07/duckdb:duckdb 35623714 35781530 1.00
clickbench_q08/duckdb:duckdb 330934697 308881396 1.07
clickbench_q09/duckdb:duckdb 506125789 491151778 1.03
clickbench_q10/duckdb:duckdb 98702838 98534158 1.00
clickbench_q11/duckdb:duckdb 107867109 106792919 1.01
clickbench_q12/duckdb:duckdb 316593013 307205997 1.03
clickbench_q13/duckdb:duckdb 514596510 538237585 0.96
clickbench_q14/duckdb:duckdb 351203137 357329358 0.98
clickbench_q15/duckdb:duckdb 274222901 266190330 1.03
clickbench_q16/duckdb:duckdb 689751885 683326809 1.01
clickbench_q17/duckdb:duckdb 582842805 583892092 1.00
clickbench_q18/duckdb:duckdb 1269184659 1279774126 0.99
clickbench_q19/duckdb:duckdb 35062973 34424870 1.02
clickbench_q20/duckdb:duckdb 🚨 1110668301 942078771 1.18
clickbench_q21/duckdb:duckdb 🚨 1084944205 962562413 1.13
clickbench_q22/duckdb:duckdb 1098795629 1059569306 1.04
clickbench_q23/duckdb:duckdb 258411213 256101578 1.01
clickbench_q24/duckdb:duckdb 60711677 61076157 0.99
clickbench_q25/duckdb:duckdb 126761233 123997186 1.02
clickbench_q26/duckdb:duckdb 56503730 54533916 1.04
clickbench_q27/duckdb:duckdb 1060662685 1012581520 1.05
clickbench_q28/duckdb:duckdb 4677201687 4675924591 1.00
clickbench_q29/duckdb:duckdb 48492521 48035063 1.01
clickbench_q30/duckdb:duckdb 295828000 305912398 0.97
clickbench_q31/duckdb:duckdb 422513237 441895519 0.96
clickbench_q32/duckdb:duckdb 1473067897 1530963800 0.96
clickbench_q33/duckdb:duckdb 2009694729 1922532966 1.05
clickbench_q34/duckdb:duckdb 🚨 2203313788 1947736921 1.13
clickbench_q35/duckdb:duckdb 265894767 266319447 1.00
clickbench_q36/duckdb:duckdb 41512507 42216601 0.98
clickbench_q37/duckdb:duckdb 31873550 31059773 1.03
clickbench_q38/duckdb:duckdb 30453636 31419416 0.97
clickbench_q39/duckdb:duckdb 🚨 79838400 65867467 1.21
clickbench_q40/duckdb:duckdb 31285516 31418250 1.00
clickbench_q41/duckdb:duckdb 29905509 30628974 0.98
clickbench_q42/duckdb:duckdb 30909682 32066829 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -2.2% -2.3% +0.2% +560.8% ➖ noise
0 duckdb:duckdb -3.7% -2.3% -1.5% +257.6% ➖ noise
0 duckdb:vortex-file-compressed -5.4% -2.3% -3.2% +297.7% ➖ noise
1 datafusion:vortex-file-compressed +1.7% +1.8% -0.1% +29.0% ➖ noise
1 duckdb:duckdb +0.7% +1.8% -1.1% +55.4% ➖ noise
1 duckdb:vortex-file-compressed +6.2% +1.8% +4.3% +17.0% ➖ noise
2 datafusion:vortex-file-compressed -3.7% -2.1% -1.6% +34.8% ➖ noise
2 duckdb:duckdb -1.0% -2.1% +1.2% +22.4% ➖ noise
2 duckdb:vortex-file-compressed +2.7% -2.1% +4.9% +14.9% ➖ noise
3 datafusion:vortex-file-compressed -3.9% -1.3% -2.7% +165.3% ➖ noise
3 duckdb:duckdb -0.5% -1.3% +0.8% +52.2% ➖ noise
3 duckdb:vortex-file-compressed -0.2% -1.3% +1.1% +29.4% ➖ noise
4 datafusion:vortex-file-compressed +0.7% -3.3% +4.1% +10.0% ➖ noise
4 duckdb:duckdb +0.3% -3.3% +3.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.5% -3.3% +7.0% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.6% -2.1% +0.5% +10.0% ➖ noise
5 duckdb:duckdb +2.2% -2.1% +4.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.8% -2.1% +4.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.7% +0.4% +4.3% +41.0% ➖ noise
6 duckdb:duckdb -1.3% +0.4% -1.7% +27.8% ➖ noise
6 duckdb:vortex-file-compressed +2.5% +0.4% +2.1% +19.3% ➖ noise
7 datafusion:vortex-file-compressed -0.2% +0.2% -0.4% +16.6% ➖ noise
7 duckdb:duckdb -0.4% +0.2% -0.6% +11.2% ➖ noise
7 duckdb:vortex-file-compressed +6.5% +0.2% +6.4% +10.6% ➖ noise
8 datafusion:vortex-file-compressed +0.8% -1.2% +2.0% +10.0% ➖ noise
8 duckdb:duckdb +7.1% -1.2% +8.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.5% -1.2% +1.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.9% -4.2% +5.3% +10.0% ➖ noise
9 duckdb:duckdb +3.0% -4.2% +7.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.1% -4.2% +4.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.2% -1.6% +1.8% +10.0% ➖ noise
10 duckdb:duckdb +0.2% -1.6% +1.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.2% -1.6% +1.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.6% -0.0% +1.6% +10.0% ➖ noise
11 duckdb:duckdb +1.0% -0.0% +1.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.1% -0.0% -1.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -0.6% -2.7% +2.1% +10.0% ➖ noise
12 duckdb:duckdb +3.1% -2.7% +5.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.2% -2.7% +2.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.8% -4.5% +3.9% +10.0% ➖ noise
13 duckdb:duckdb -4.4% -4.5% +0.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -1.5% -4.5% +3.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.6% -2.5% +1.0% +10.0% ➖ noise
14 duckdb:duckdb -1.7% -2.5% +0.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.1% -2.5% +4.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.1% -3.7% +3.8% +10.0% ➖ noise
15 duckdb:duckdb +3.0% -3.7% +7.0% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +2.2% -3.7% +6.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.4% -2.2% +1.9% +10.0% ➖ noise
16 duckdb:duckdb +0.9% -2.2% +3.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.1% -2.2% +3.5% +20.8% ➖ noise
17 datafusion:vortex-file-compressed +0.4% -3.7% +4.2% +10.0% ➖ noise
17 duckdb:duckdb -0.2% -3.7% +3.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +2.1% -3.7% +6.0% +19.8% ➖ noise
18 datafusion:vortex-file-compressed -4.5% -3.2% -1.3% +10.0% ➖ noise
18 duckdb:duckdb -0.8% -3.2% +2.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -5.1% -3.2% -2.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -1.3% +3.3% -4.5% +21.4% ➖ noise
19 duckdb:duckdb +1.9% +3.3% -1.4% +11.4% ➖ noise
19 duckdb:vortex-file-compressed +3.2% +3.3% -0.1% +31.4% ➖ noise
20 datafusion:vortex-file-compressed -1.0% -0.5% -0.5% +169.2% ➖ noise
20 duckdb:duckdb +17.9% -0.5% +18.5% +20.7% ➖ noise
20 duckdb:vortex-file-compressed -7.8% -0.5% -7.3% +10.1% ➖ noise
21 datafusion:vortex-file-compressed -2.1% -1.1% -1.0% +10.0% ➖ noise
21 duckdb:duckdb +12.7% -1.1% +13.9% +11.1% 🚨 regression
21 duckdb:vortex-file-compressed -3.0% -1.1% -2.0% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.6% +0.0% -1.6% +10.0% ➖ noise
22 duckdb:duckdb +3.7% +0.0% +3.7% +15.1% ➖ noise
22 duckdb:vortex-file-compressed +0.5% +0.0% +0.5% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +4.2% -2.6% +7.0% +51.0% ➖ noise
23 duckdb:duckdb +0.9% -2.6% +3.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -51.6% -2.6% -50.3% +21.7% ✅ faster
24 datafusion:vortex-file-compressed +13.8% +0.8% +12.9% +24.8% ➖ noise
24 duckdb:duckdb -0.6% +0.8% -1.4% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +1.2% +0.8% +0.4% +39.0% ➖ noise
25 datafusion:vortex-file-compressed +3.2% -0.4% +3.7% +10.7% ➖ noise
25 duckdb:duckdb +2.2% -0.4% +2.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +3.6% -0.4% +4.1% +10.9% ➖ noise
26 datafusion:vortex-file-compressed -1.9% +1.9% -3.7% +12.3% ➖ noise
26 duckdb:duckdb +3.6% +1.9% +1.7% +13.2% ➖ noise
26 duckdb:vortex-file-compressed -18.9% +1.9% -20.4% +36.0% ➖ noise
27 datafusion:vortex-file-compressed +2.1% +1.5% +0.7% +10.0% ➖ noise
27 duckdb:duckdb +4.7% +1.5% +3.2% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -3.6% +1.5% -5.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.6% -2.2% +1.6% +10.0% ➖ noise
28 duckdb:duckdb +0.0% -2.2% +2.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.4% -2.2% +1.9% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +5.6% -1.4% +7.1% +15.3% ➖ noise
29 duckdb:duckdb +1.0% -1.4% +2.4% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -0.4% -1.4% +1.0% +15.5% ➖ noise
30 datafusion:vortex-file-compressed +5.2% +1.2% +4.0% +10.0% ➖ noise
30 duckdb:duckdb -3.3% +1.2% -4.4% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.8% +1.2% -2.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +2.9% +0.7% +2.2% +10.0% ➖ noise
31 duckdb:duckdb -4.4% +0.7% -5.1% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.4% +0.7% -0.3% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +7.3% -2.4% +9.9% +20.5% ➖ noise
32 duckdb:duckdb -3.8% -2.4% -1.4% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +0.1% -2.4% +2.6% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.4% -1.2% -0.2% +12.7% ➖ noise
33 duckdb:duckdb +4.5% -1.2% +5.8% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -8.3% -1.2% -7.2% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -0.1% -0.5% +0.4% +10.0% ➖ noise
34 duckdb:duckdb +13.1% -0.5% +13.7% +12.3% 🚨 regression
34 duckdb:vortex-file-compressed -11.6% -0.5% -11.2% +10.0% ✅ faster
35 datafusion:vortex-file-compressed +2.8% -2.1% +5.0% +10.0% ➖ noise
35 duckdb:duckdb -0.2% -2.1% +2.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -0.4% -2.1% +1.7% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +9.2% -0.1% +9.4% +10.5% ➖ noise
36 duckdb:duckdb -1.7% -0.1% -1.5% +12.1% ➖ noise
36 duckdb:vortex-file-compressed +19.2% -0.1% +19.4% +10.0% 🚨 regression
37 datafusion:vortex-file-compressed +2.0% +0.5% +1.5% +10.0% ➖ noise
37 duckdb:duckdb +2.6% +0.5% +2.1% +10.3% ➖ noise
37 duckdb:vortex-file-compressed +23.9% +0.5% +23.3% +13.2% 🚨 regression
38 datafusion:vortex-file-compressed -0.6% +2.2% -2.7% +10.0% ➖ noise
38 duckdb:duckdb -3.1% +2.2% -5.2% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +18.2% +2.2% +15.6% +16.2% ➖ noise
39 datafusion:vortex-file-compressed +1.6% +0.3% +1.3% +10.0% ➖ noise
39 duckdb:duckdb +21.2% +0.3% +20.9% +19.6% 🚨 regression
39 duckdb:vortex-file-compressed +2.8% +0.3% +2.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +6.9% +2.0% +4.8% +13.9% ➖ noise
40 duckdb:duckdb -0.4% +2.0% -2.4% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +10.3% +2.0% +8.1% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +7.2% -0.9% +8.2% +11.8% ➖ noise
41 duckdb:duckdb -2.4% -0.9% -1.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +18.0% -0.9% +19.1% +11.4% 🚨 regression
42 datafusion:vortex-file-compressed +4.2% +4.8% -0.5% +10.0% ➖ noise
42 duckdb:duckdb -3.6% +4.8% -8.0% +10.2% ➖ noise
42 duckdb:vortex-file-compressed +17.1% +4.8% +11.8% +11.1% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -12.3%
Vortex (geomean): 1.032x ➖
Parquet (geomean): 1.176x ➖
Shifts: Parquet (control) +17.6% · Median polish +5.7%

datafusion / vortex-file-compressed (1.163x ➖, 1↑ 8↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 264251253 183728303 1.44
tpch_q02/datafusion:vortex-file-compressed 🚨 632991023 423883919 1.49
tpch_q03/datafusion:vortex-file-compressed 504562780 397046072 1.27
tpch_q04/datafusion:vortex-file-compressed 270832331 235264134 1.15
tpch_q05/datafusion:vortex-file-compressed 516528314 413531017 1.25
tpch_q06/datafusion:vortex-file-compressed 234425234 268076744 0.87
tpch_q07/datafusion:vortex-file-compressed 414212011 369337917 1.12
tpch_q08/datafusion:vortex-file-compressed 574018051 631859077 0.91
tpch_q09/datafusion:vortex-file-compressed 🚨 526515272 397535153 1.32
tpch_q10/datafusion:vortex-file-compressed 🚨 658846114 412131130 1.60
tpch_q11/datafusion:vortex-file-compressed 🚨 401452432 275062893 1.46
tpch_q12/datafusion:vortex-file-compressed 🚨 694989168 467160136 1.49
tpch_q13/datafusion:vortex-file-compressed 🚨 356279797 223171607 1.60
tpch_q14/datafusion:vortex-file-compressed 255304007 231286789 1.10
tpch_q15/datafusion:vortex-file-compressed 🚨 491096417 351959203 1.40
tpch_q16/datafusion:vortex-file-compressed 179415793 200586815 0.89
tpch_q17/datafusion:vortex-file-compressed 349067110 307826630 1.13
tpch_q18/datafusion:vortex-file-compressed 362352876 436673420 0.83
tpch_q19/datafusion:vortex-file-compressed 352107061 345437177 1.02
tpch_q20/datafusion:vortex-file-compressed 429829334 390312296 1.10
tpch_q21/datafusion:vortex-file-compressed 503426811 466966007 1.08
tpch_q22/datafusion:vortex-file-compressed 🚀 184593327 266816998 0.69
datafusion / vortex-compact (1.089x ➖, 0↑ 3↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 312776538 256083149 1.22
tpch_q02/datafusion:vortex-compact 569614282 511756143 1.11
tpch_q03/datafusion:vortex-compact 379244039 427791861 0.89
tpch_q04/datafusion:vortex-compact 288917668 292854351 0.99
tpch_q05/datafusion:vortex-compact 566036346 491209159 1.15
tpch_q06/datafusion:vortex-compact 339212360 450162287 0.75
tpch_q07/datafusion:vortex-compact 465733651 606444165 0.77
tpch_q08/datafusion:vortex-compact 🚨 680638257 493204924 1.38
tpch_q09/datafusion:vortex-compact 473295483 394323418 1.20
tpch_q10/datafusion:vortex-compact 519645772 531858178 0.98
tpch_q11/datafusion:vortex-compact 292341499 253292226 1.15
tpch_q12/datafusion:vortex-compact 565873124 458171588 1.24
tpch_q13/datafusion:vortex-compact 280091563 216982456 1.29
tpch_q14/datafusion:vortex-compact 327257297 276061209 1.19
tpch_q15/datafusion:vortex-compact 550108441 577372919 0.95
tpch_q16/datafusion:vortex-compact 🚨 229831881 160902589 1.43
tpch_q17/datafusion:vortex-compact 422912272 381848911 1.11
tpch_q18/datafusion:vortex-compact 348777256 323449847 1.08
tpch_q19/datafusion:vortex-compact 🚨 525094905 367343948 1.43
tpch_q20/datafusion:vortex-compact 491197044 449982668 1.09
tpch_q21/datafusion:vortex-compact 573172517 702969902 0.82
tpch_q22/datafusion:vortex-compact 166726282 147620558 1.13
datafusion / parquet (1.390x ❌, 0↑ 11↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 264589590 269508745 0.98
tpch_q02/datafusion:parquet 🚨 558144245 415466358 1.34
tpch_q03/datafusion:parquet 🚨 974554604 385272666 2.53
tpch_q04/datafusion:parquet 🚨 552104950 169995266 3.25
tpch_q05/datafusion:parquet 🚨 1140770893 536730078 2.13
tpch_q06/datafusion:parquet 🚨 286414104 201389290 1.42
tpch_q07/datafusion:parquet 🚨 704523838 521840861 1.35
tpch_q08/datafusion:parquet 814349373 675505950 1.21
tpch_q09/datafusion:parquet 556025402 524115693 1.06
tpch_q10/datafusion:parquet 635417506 591890738 1.07
tpch_q11/datafusion:parquet 388941713 335199675 1.16
tpch_q12/datafusion:parquet 🚨 319274238 245392245 1.30
tpch_q13/datafusion:parquet 566219175 494674537 1.14
tpch_q14/datafusion:parquet 🚨 258722479 182759756 1.42
tpch_q15/datafusion:parquet 426591197 355670064 1.20
tpch_q16/datafusion:parquet 224486732 197897685 1.13
tpch_q17/datafusion:parquet 540367561 430483697 1.26
tpch_q18/datafusion:parquet 602742649 472754084 1.27
tpch_q19/datafusion:parquet 🚨 472879657 343869995 1.38
tpch_q20/datafusion:parquet 🚨 559581117 359575336 1.56
tpch_q21/datafusion:parquet 🚨 1201547405 577218183 2.08
tpch_q22/datafusion:parquet 164883690 169530487 0.97
duckdb / vortex-file-compressed (0.954x ➖, 1↑ 0↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 297012002 250263014 1.19
tpch_q02/duckdb:vortex-file-compressed 855320105 1037047828 0.82
tpch_q03/duckdb:vortex-file-compressed 516744234 650942000 0.79
tpch_q04/duckdb:vortex-file-compressed 390873265 397480194 0.98
tpch_q05/duckdb:vortex-file-compressed 923616356 967202949 0.95
tpch_q06/duckdb:vortex-file-compressed 360892460 384175981 0.94
tpch_q07/duckdb:vortex-file-compressed 852622701 727844673 1.17
tpch_q08/duckdb:vortex-file-compressed 1005440082 863544132 1.16
tpch_q09/duckdb:vortex-file-compressed 916054091 1096690481 0.84
tpch_q10/duckdb:vortex-file-compressed 770180693 704297962 1.09
tpch_q11/duckdb:vortex-file-compressed 519960153 484079286 1.07
tpch_q12/duckdb:vortex-file-compressed 🚀 455710420 673223802 0.68
tpch_q13/duckdb:vortex-file-compressed 466321278 444642251 1.05
tpch_q14/duckdb:vortex-file-compressed 502995756 510880141 0.98
tpch_q15/duckdb:vortex-file-compressed 293942797 390214524 0.75
tpch_q16/duckdb:vortex-file-compressed 325986839 400148765 0.81
tpch_q17/duckdb:vortex-file-compressed 714928576 709782080 1.01
tpch_q18/duckdb:vortex-file-compressed 644044448 539029475 1.19
tpch_q19/duckdb:vortex-file-compressed 440000957 410947271 1.07
tpch_q20/duckdb:vortex-file-compressed 764811832 970368523 0.79
tpch_q21/duckdb:vortex-file-compressed 1081475359 1164371237 0.93
tpch_q22/duckdb:vortex-file-compressed 351019915 365239700 0.96
duckdb / vortex-compact (0.937x ➖, 1↑ 0↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 269597653 300282083 0.90
tpch_q02/duckdb:vortex-compact 883195922 801706705 1.10
tpch_q03/duckdb:vortex-compact 577352841 551790944 1.05
tpch_q04/duckdb:vortex-compact 356141468 425146598 0.84
tpch_q05/duckdb:vortex-compact 849869354 1085626112 0.78
tpch_q06/duckdb:vortex-compact 460096598 458074145 1.00
tpch_q07/duckdb:vortex-compact 820331123 708748247 1.16
tpch_q08/duckdb:vortex-compact 876879805 743464388 1.18
tpch_q09/duckdb:vortex-compact 850045540 998579949 0.85
tpch_q10/duckdb:vortex-compact 751720661 785412211 0.96
tpch_q11/duckdb:vortex-compact 490247563 530660188 0.92
tpch_q12/duckdb:vortex-compact 429483898 403536293 1.06
tpch_q13/duckdb:vortex-compact 424149578 446450874 0.95
tpch_q14/duckdb:vortex-compact 551097254 629113639 0.88
tpch_q15/duckdb:vortex-compact 🚀 250902066 475615331 0.53
tpch_q16/duckdb:vortex-compact 326999228 319143713 1.02
tpch_q17/duckdb:vortex-compact 646844700 668656085 0.97
tpch_q18/duckdb:vortex-compact 516182587 629213890 0.82
tpch_q19/duckdb:vortex-compact 512391456 458869831 1.12
tpch_q20/duckdb:vortex-compact 756621210 810292995 0.93
tpch_q21/duckdb:vortex-compact 1041831918 1173912390 0.89
tpch_q22/duckdb:vortex-compact 378122199 389614101 0.97
duckdb / parquet (0.994x ➖, 0↑ 1↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 612305508 460041255 1.33
tpch_q02/duckdb:parquet 1367131934 1166875248 1.17
tpch_q03/duckdb:parquet 1128552025 1166132376 0.97
tpch_q04/duckdb:parquet 658655682 603273863 1.09
tpch_q05/duckdb:parquet 1554633251 1481306415 1.05
tpch_q06/duckdb:parquet 455386456 490666397 0.93
tpch_q07/duckdb:parquet 1271081120 1154709241 1.10
tpch_q08/duckdb:parquet 1558903291 1603203629 0.97
tpch_q09/duckdb:parquet 1684583539 1412811120 1.19
tpch_q10/duckdb:parquet 1490266561 1375300756 1.08
tpch_q11/duckdb:parquet 729785534 908956119 0.80
tpch_q12/duckdb:parquet 721003202 719903469 1.00
tpch_q13/duckdb:parquet 884453283 969847420 0.91
tpch_q14/duckdb:parquet 636103958 722426199 0.88
tpch_q15/duckdb:parquet 551040815 551846122 1.00
tpch_q16/duckdb:parquet 508598430 544073471 0.93
tpch_q17/duckdb:parquet 713629049 864520862 0.83
tpch_q18/duckdb:parquet 865791386 837358213 1.03
tpch_q19/duckdb:parquet 837585568 765742118 1.09
tpch_q20/duckdb:parquet 1085284084 1192426014 0.91
tpch_q21/duckdb:parquet 1197736471 1406988600 0.85
tpch_q22/duckdb:parquet 460723514 503531546 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +22.1% +14.3% +6.8% +128.0% ➖ noise
1 datafusion:vortex-file-compressed +43.8% +14.3% +25.8% +118.3% ➖ noise
1 duckdb:vortex-compact -10.2% +14.3% -21.5% +52.1% ➖ noise
1 duckdb:vortex-file-compressed +18.7% +14.3% +3.8% +60.9% ➖ noise
2 datafusion:vortex-compact +11.3% +25.5% -11.3% +52.1% ➖ noise
2 datafusion:vortex-file-compressed +49.3% +25.5% +19.0% +52.1% ➖ noise
2 duckdb:vortex-compact +10.2% +25.5% -12.2% +52.1% ➖ noise
2 duckdb:vortex-file-compressed -17.5% +25.5% -34.3% +52.1% ✅ faster
3 datafusion:vortex-compact -11.3% +56.5% -43.3% +105.8% ➖ noise
3 datafusion:vortex-file-compressed +27.1% +56.5% -18.8% +73.5% ➖ noise
3 duckdb:vortex-compact +4.6% +56.5% -33.1% +52.1% ➖ noise
3 duckdb:vortex-file-compressed -20.6% +56.5% -49.3% +52.1% ✅ faster
4 datafusion:vortex-compact -1.3% +88.3% -47.6% +59.6% ✅ faster
4 datafusion:vortex-file-compressed +15.1% +88.3% -38.9% +52.1% ✅ faster
4 duckdb:vortex-compact -16.2% +88.3% -55.5% +52.1% ✅ faster
4 duckdb:vortex-file-compressed -1.7% +88.3% -47.8% +87.8% ✅ faster
5 datafusion:vortex-compact +15.2% +49.4% -22.8% +52.1% ➖ noise
5 datafusion:vortex-file-compressed +24.9% +49.4% -16.4% +52.1% ➖ noise
5 duckdb:vortex-compact -21.7% +49.4% -47.6% +52.1% ✅ faster
5 duckdb:vortex-file-compressed -4.5% +49.4% -36.1% +52.1% ✅ faster
6 datafusion:vortex-compact -24.6% +14.9% -34.4% +52.1% ✅ faster
6 datafusion:vortex-file-compressed -12.6% +14.9% -23.9% +52.1% ➖ noise
6 duckdb:vortex-compact +0.4% +14.9% -12.6% +52.1% ➖ noise
6 duckdb:vortex-file-compressed -6.1% +14.9% -18.2% +52.1% ➖ noise
7 datafusion:vortex-compact -23.2% +21.9% -37.0% +52.1% ✅ faster
7 datafusion:vortex-file-compressed +12.1% +21.9% -8.0% +52.1% ➖ noise
7 duckdb:vortex-compact +15.7% +21.9% -5.1% +52.1% ➖ noise
7 duckdb:vortex-file-compressed +17.1% +21.9% -3.9% +52.1% ➖ noise
8 datafusion:vortex-compact +38.0% +8.3% +27.5% +52.1% ➖ noise
8 datafusion:vortex-file-compressed -9.2% +8.3% -16.1% +52.1% ➖ noise
8 duckdb:vortex-compact +17.9% +8.3% +8.9% +52.1% ➖ noise
8 duckdb:vortex-file-compressed +16.4% +8.3% +7.5% +52.1% ➖ noise
9 datafusion:vortex-compact +20.0% +12.5% +6.7% +52.1% ➖ noise
9 datafusion:vortex-file-compressed +32.4% +12.5% +17.8% +52.1% ➖ noise
9 duckdb:vortex-compact -14.9% +12.5% -24.3% +52.1% ➖ noise
9 duckdb:vortex-file-compressed -16.5% +12.5% -25.7% +52.1% ➖ noise
10 datafusion:vortex-compact -2.3% +7.9% -9.4% +52.1% ➖ noise
10 datafusion:vortex-file-compressed +59.9% +7.9% +48.2% +52.1% ➖ noise
10 duckdb:vortex-compact -4.3% +7.9% -11.3% +52.1% ➖ noise
10 duckdb:vortex-file-compressed +9.4% +7.9% +1.4% +52.1% ➖ noise
11 datafusion:vortex-compact +15.4% -3.5% +19.6% +52.1% ➖ noise
11 datafusion:vortex-file-compressed +45.9% -3.5% +51.2% +52.1% ➖ noise
11 duckdb:vortex-compact -7.6% -3.5% -4.3% +52.1% ➖ noise
11 duckdb:vortex-file-compressed +7.4% -3.5% +11.3% +52.1% ➖ noise
12 datafusion:vortex-compact +23.5% +14.2% +8.2% +52.1% ➖ noise
12 datafusion:vortex-file-compressed +48.8% +14.2% +30.3% +52.5% ➖ noise
12 duckdb:vortex-compact +6.4% +14.2% -6.8% +52.1% ➖ noise
12 duckdb:vortex-file-compressed -32.3% +14.2% -40.7% +52.1% ✅ faster
13 datafusion:vortex-compact +29.1% +2.2% +26.3% +52.1% ➖ noise
13 datafusion:vortex-file-compressed +59.6% +2.2% +56.3% +69.9% ➖ noise
13 duckdb:vortex-compact -5.0% +2.2% -7.0% +52.1% ➖ noise
13 duckdb:vortex-file-compressed +4.9% +2.2% +2.6% +52.1% ➖ noise
14 datafusion:vortex-compact +18.5% +11.6% +6.2% +52.1% ➖ noise
14 datafusion:vortex-file-compressed +10.4% +11.6% -1.1% +52.1% ➖ noise
14 duckdb:vortex-compact -12.4% +11.6% -21.5% +64.7% ➖ noise
14 duckdb:vortex-file-compressed -1.5% +11.6% -11.8% +52.1% ➖ noise
15 datafusion:vortex-compact -4.7% +9.4% -12.9% +52.1% ➖ noise
15 datafusion:vortex-file-compressed +39.5% +9.4% +27.5% +63.5% ➖ noise
15 duckdb:vortex-compact -47.2% +9.4% -51.8% +54.6% ✅ faster
15 duckdb:vortex-file-compressed -24.7% +9.4% -31.2% +52.1% ➖ noise
16 datafusion:vortex-compact +42.8% +3.0% +38.7% +52.1% ➖ noise
16 datafusion:vortex-file-compressed -10.6% +3.0% -13.1% +52.1% ➖ noise
16 duckdb:vortex-compact +2.5% +3.0% -0.5% +52.1% ➖ noise
16 duckdb:vortex-file-compressed -18.5% +3.0% -20.9% +52.1% ➖ noise
17 datafusion:vortex-compact +10.8% +1.8% +8.8% +52.1% ➖ noise
17 datafusion:vortex-file-compressed +13.4% +1.8% +11.4% +52.1% ➖ noise
17 duckdb:vortex-compact -3.3% +1.8% -5.0% +52.1% ➖ noise
17 duckdb:vortex-file-compressed +0.7% +1.8% -1.0% +52.1% ➖ noise
18 datafusion:vortex-compact +7.8% +14.8% -6.1% +52.1% ➖ noise
18 datafusion:vortex-file-compressed -17.0% +14.8% -27.7% +52.1% ➖ noise
18 duckdb:vortex-compact -18.0% +14.8% -28.5% +52.1% ➖ noise
18 duckdb:vortex-file-compressed +19.5% +14.8% +4.1% +52.1% ➖ noise
19 datafusion:vortex-compact +42.9% +22.6% +16.6% +53.5% ➖ noise
19 datafusion:vortex-file-compressed +1.9% +22.6% -16.9% +52.1% ➖ noise
19 duckdb:vortex-compact +11.7% +22.6% -9.0% +52.1% ➖ noise
19 duckdb:vortex-file-compressed +7.1% +22.6% -12.7% +52.1% ➖ noise
20 datafusion:vortex-compact +9.2% +19.0% -8.3% +52.1% ➖ noise
20 datafusion:vortex-file-compressed +10.1% +19.0% -7.5% +52.1% ➖ noise
20 duckdb:vortex-compact -6.6% +19.0% -21.5% +52.1% ➖ noise
20 duckdb:vortex-file-compressed -21.2% +19.0% -33.8% +52.1% ➖ noise
21 datafusion:vortex-compact -18.5% +33.1% -38.7% +66.7% ➖ noise
21 datafusion:vortex-file-compressed +7.8% +33.1% -19.0% +52.1% ➖ noise
21 duckdb:vortex-compact -11.3% +33.1% -33.3% +52.1% ➖ noise
21 duckdb:vortex-file-compressed -7.1% +33.1% -30.2% +52.1% ➖ noise
22 datafusion:vortex-compact +12.9% -5.7% +19.7% +52.1% ➖ noise
22 datafusion:vortex-file-compressed -30.8% -5.7% -26.7% +52.1% ➖ noise
22 duckdb:vortex-compact -2.9% -5.7% +2.9% +52.1% ➖ noise
22 duckdb:vortex-file-compressed -3.9% -5.7% +1.9% +52.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.4%
Vortex (geomean): 0.971x ➖
Parquet (geomean): 1.049x ➖
Shifts: Parquet (control) +4.9% · Median polish -4.1%

datafusion / vortex-file-compressed (1.043x ➖, 0↑ 1↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 55292205 32599121 1.70
fineweb_q01/datafusion:vortex-file-compressed 633250925 579675836 1.09
fineweb_q02/datafusion:vortex-file-compressed 534563798 594265957 0.90
fineweb_q03/datafusion:vortex-file-compressed 1374003440 1387696248 0.99
fineweb_q04/datafusion:vortex-file-compressed 1357388038 1381559764 0.98
fineweb_q05/datafusion:vortex-file-compressed 1339983622 1360418053 0.98
fineweb_q06/datafusion:vortex-file-compressed 1562256028 1608926044 0.97
fineweb_q07/datafusion:vortex-file-compressed 1369735969 1342743737 1.02
fineweb_q08/datafusion:vortex-file-compressed 528758321 571152146 0.93
datafusion / vortex-compact (0.956x ➖, 0↑ 0↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 42135716 37104039 1.14
fineweb_q01/datafusion:vortex-compact 514737228 611383630 0.84
fineweb_q02/datafusion:vortex-compact 648324776 721097696 0.90
fineweb_q03/datafusion:vortex-compact 1866572526 1929587330 0.97
fineweb_q04/datafusion:vortex-compact 2225536769 2335298023 0.95
fineweb_q05/datafusion:vortex-compact 1701413821 1731858536 0.98
fineweb_q06/datafusion:vortex-compact 1467831035 1557299891 0.94
fineweb_q07/datafusion:vortex-compact 1306835135 1379160008 0.95
fineweb_q08/datafusion:vortex-compact 396858271 413367902 0.96
datafusion / parquet (1.150x ➖, 0↑ 2↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1343415083 1191864193 1.13
fineweb_q01/datafusion:parquet 1956992082 1949065654 1.00
fineweb_q02/datafusion:parquet 🚨 2844061442 2097746878 1.36
fineweb_q03/datafusion:parquet 2365476424 1839050123 1.29
fineweb_q04/datafusion:parquet 2138292122 2172693469 0.98
fineweb_q05/datafusion:parquet 2339153713 1900696610 1.23
fineweb_q06/datafusion:parquet 🚨 2670936700 1930629344 1.38
fineweb_q07/datafusion:parquet 1911718822 1715318378 1.11
fineweb_q08/datafusion:parquet 2028692034 2132470339 0.95
duckdb / vortex-file-compressed (0.927x ➖, 0↑ 0↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 101642167 114186443 0.89
fineweb_q01/duckdb:vortex-file-compressed 641204340 721438326 0.89
fineweb_q02/duckdb:vortex-file-compressed 472358913 478664619 0.99
fineweb_q03/duckdb:vortex-file-compressed 1521297967 1622926731 0.94
fineweb_q04/duckdb:vortex-file-compressed 1489405802 1655280480 0.90
fineweb_q05/duckdb:vortex-file-compressed 1509084802 1644276291 0.92
fineweb_q06/duckdb:vortex-file-compressed 1632950402 1763122945 0.93
fineweb_q07/duckdb:vortex-file-compressed 1501520047 1626041361 0.92
fineweb_q08/duckdb:vortex-file-compressed 620691994 636758975 0.97
duckdb / vortex-compact (0.963x ➖, 0↑ 0↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 108995282 108299134 1.01
fineweb_q01/duckdb:vortex-compact 594272413 560224880 1.06
fineweb_q02/duckdb:vortex-compact 705625545 711259505 0.99
fineweb_q03/duckdb:vortex-compact 1624402475 1700259770 0.96
fineweb_q04/duckdb:vortex-compact 1686909157 1840712570 0.92
fineweb_q05/duckdb:vortex-compact 1481467955 1691444701 0.88
fineweb_q06/duckdb:vortex-compact 1569821443 1700345745 0.92
fineweb_q07/duckdb:vortex-compact 1353174225 1476480528 0.92
fineweb_q08/duckdb:vortex-compact 581820928 559207998 1.04
duckdb / parquet (0.957x ➖, 0↑ 0↓)
name PR 9334719 (ns) base ce9f13d (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1120467901 1092540690 1.03
fineweb_q01/duckdb:parquet 1666796994 1759429132 0.95
fineweb_q02/duckdb:parquet 1585888381 1771230971 0.90
fineweb_q03/duckdb:parquet 4384752368 4507926222 0.97
fineweb_q04/duckdb:parquet 1918354253 1967877138 0.97
fineweb_q05/duckdb:parquet 2717805390 2701834410 1.01
fineweb_q06/duckdb:parquet 3516467862 3633611204 0.97
fineweb_q07/duckdb:parquet 4367130791 4225220332 1.03
fineweb_q08/duckdb:parquet 1072791933 1326682543 0.81
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +13.6% +7.5% +5.6% +158.9% ➖ noise
0 datafusion:vortex-file-compressed +69.6% +7.5% +57.8% +146.6% ➖ noise
0 duckdb:vortex-compact +0.6% +7.5% -6.4% +71.5% ➖ noise
0 duckdb:vortex-file-compressed -11.0% +7.5% -17.2% +39.0% ➖ noise
1 datafusion:vortex-compact -15.8% -2.5% -13.7% +53.3% ➖ noise
1 datafusion:vortex-file-compressed +9.2% -2.5% +12.0% +72.7% ➖ noise
1 duckdb:vortex-compact +6.1% -2.5% +8.8% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -11.1% -2.5% -8.9% +51.5% ➖ noise
2 datafusion:vortex-compact -10.1% +10.2% -18.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -10.0% +10.2% -18.4% +33.7% ➖ noise
2 duckdb:vortex-compact -0.8% +10.2% -10.0% +43.4% ➖ noise
2 duckdb:vortex-file-compressed -1.3% +10.2% -10.4% +120.4% ➖ noise
3 datafusion:vortex-compact -3.3% +11.9% -13.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -1.0% +11.9% -11.5% +30.0% ➖ noise
3 duckdb:vortex-compact -4.5% +11.9% -14.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -6.3% +11.9% -16.2% +30.0% ➖ noise
4 datafusion:vortex-compact -4.7% -2.1% -2.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -1.7% -2.1% +0.3% +30.0% ➖ noise
4 duckdb:vortex-compact -8.4% -2.1% -6.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -10.0% -2.1% -8.1% +30.0% ➖ noise
5 datafusion:vortex-compact -1.8% +11.3% -11.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -1.5% +11.3% -11.5% +30.0% ➖ noise
5 duckdb:vortex-compact -12.4% +11.3% -21.3% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -8.2% +11.3% -17.5% +30.0% ➖ noise
6 datafusion:vortex-compact -5.7% +15.7% -18.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -2.9% +15.7% -16.1% +30.0% ➖ noise
6 duckdb:vortex-compact -7.7% +15.7% -20.2% +33.9% ➖ noise
6 duckdb:vortex-file-compressed -7.4% +15.7% -20.0% +30.0% ➖ noise
7 datafusion:vortex-compact -5.2% +7.3% -11.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +2.0% +7.3% -5.0% +30.0% ➖ noise
7 duckdb:vortex-compact -8.4% +7.3% -14.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -7.7% +7.3% -14.0% +30.0% ➖ noise
8 datafusion:vortex-compact -4.0% -12.3% +9.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -7.4% -12.3% +5.6% +30.0% ➖ noise
8 duckdb:vortex-compact +4.0% -12.3% +18.6% +42.7% ➖ noise
8 duckdb:vortex-file-compressed -2.5% -12.3% +11.1% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 26, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.9%
Vortex (geomean): 0.970x ➖
Parquet (geomean): 0.908x ➖
Shifts: Parquet (control) -9.2% · Median polish -1.5%

datafusion / vortex-file-compressed (0.914x ➖, 3↑ 0↓)
name PR 9334719 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 905583330 841398217 1.08
tpch_q02/datafusion:vortex-file-compressed 🚀 766433332 1371201478 0.56
tpch_q03/datafusion:vortex-file-compressed 819252529 898868447 0.91
tpch_q04/datafusion:vortex-file-compressed 715448141 663887573 1.08
tpch_q05/datafusion:vortex-file-compressed 1087072869 990852445 1.10
tpch_q06/datafusion:vortex-file-compressed 750975017 644314528 1.17
tpch_q07/datafusion:vortex-file-compressed 1384532861 1223140406 1.13
tpch_q08/datafusion:vortex-file-compressed 1178507253 1347846485 0.87
tpch_q09/datafusion:vortex-file-compressed 1291541413 1492024334 0.87
tpch_q10/datafusion:vortex-file-compressed 🚀 952709517 1442938883 0.66
tpch_q11/datafusion:vortex-file-compressed 🚀 480246556 858487271 0.56
tpch_q12/datafusion:vortex-file-compressed 1083010249 1239305650 0.87
tpch_q13/datafusion:vortex-file-compressed 517494773 518634742 1.00
tpch_q14/datafusion:vortex-file-compressed 597260253 639036674 0.93
tpch_q15/datafusion:vortex-file-compressed 1290058499 1264247791 1.02
tpch_q16/datafusion:vortex-file-compressed 530118056 697913377 0.76
tpch_q17/datafusion:vortex-file-compressed 1474998759 1339248753 1.10
tpch_q18/datafusion:vortex-file-compressed 1839223944 1421004264 1.29
tpch_q19/datafusion:vortex-file-compressed 843850416 906901440 0.93
tpch_q20/datafusion:vortex-file-compressed 925615416 1191506613 0.78
tpch_q21/datafusion:vortex-file-compressed 1760153708 1653655420 1.06
tpch_q22/datafusion:vortex-file-compressed 343877955 408348892 0.84
datafusion / vortex-compact (1.031x ➖, 1↑ 1↓)
name PR 9334719 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 748842332 726991069 1.03
tpch_q02/datafusion:vortex-compact 745521288 917267924 0.81
tpch_q03/datafusion:vortex-compact 960618111 991650994 0.97
tpch_q04/datafusion:vortex-compact 621622994 567873413 1.09
tpch_q05/datafusion:vortex-compact 1307010477 1056990588 1.24
tpch_q06/datafusion:vortex-compact 628103816 565417578 1.11
tpch_q07/datafusion:vortex-compact 1040579496 1132624205 0.92
tpch_q08/datafusion:vortex-compact 1278721565 1129978201 1.13
tpch_q09/datafusion:vortex-compact 1476296426 1216239380 1.21
tpch_q10/datafusion:vortex-compact 1070200403 1071716696 1.00
tpch_q11/datafusion:vortex-compact 473841682 538939423 0.88
tpch_q12/datafusion:vortex-compact 796499010 933115448 0.85
tpch_q13/datafusion:vortex-compact 399418345 469892692 0.85
tpch_q14/datafusion:vortex-compact 663735447 671896793 0.99
tpch_q15/datafusion:vortex-compact 1411439416 1089867981 1.30
tpch_q16/datafusion:vortex-compact 🚨 451297888 276713968 1.63
tpch_q17/datafusion:vortex-compact 1424322851 1192206313 1.19
tpch_q18/datafusion:vortex-compact 1398515964 1173594846 1.19
tpch_q19/datafusion:vortex-compact 775853165 678495344 1.14
tpch_q20/datafusion:vortex-compact 911378472 1051507280 0.87
tpch_q21/datafusion:vortex-compact 1488303700 1530423784 0.97
tpch_q22/datafusion:vortex-compact 🚀 421945308 607588381 0.69
datafusion / parquet (0.962x ➖, 1↑ 0↓)
name PR 9334719 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 805971242 824854377 0.98
tpch_q02/datafusion:parquet 811750036 708597392 1.15
tpch_q03/datafusion:parquet 1134476696 988154359 1.15
tpch_q04/datafusion:parquet 638304211 539506781 1.18
tpch_q05/datafusion:parquet 1686608980 1491468217 1.13
tpch_q06/datafusion:parquet 670299458 792541739 0.85
tpch_q07/datafusion:parquet 1640103343 1659272756 0.99
tpch_q08/datafusion:parquet 🚀 1905854790 2877972856 0.66
tpch_q09/datafusion:parquet 2022197549 2270691303 0.89
tpch_q10/datafusion:parquet 2300420445 2942070678 0.78
tpch_q11/datafusion:parquet 580436410 632466443 0.92
tpch_q12/datafusion:parquet 863360803 839183833 1.03
tpch_q13/datafusion:parquet 975609883 827969325 1.18
tpch_q14/datafusion:parquet 866065369 1163777163 0.74
tpch_q15/datafusion:parquet 1322201627 1501087243 0.88
tpch_q16/datafusion:parquet 398949846 538747780 0.74
tpch_q17/datafusion:parquet 1665590921 1410386866 1.18
tpch_q18/datafusion:parquet 1786595321 1550272952 1.15
tpch_q19/datafusion:parquet 1077083953 1008312315 1.07
tpch_q20/datafusion:parquet 1342384237 1410599813 0.95
tpch_q21/datafusion:parquet 2292807418 2070806097 1.11
tpch_q22/datafusion:parquet 1248342064 1591179845 0.78
duckdb / vortex-file-compressed (0.934x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 602333983 608130129 0.99
tpch_q02/duckdb:vortex-file-compressed 1253705537 1553929785 0.81
tpch_q03/duckdb:vortex-file-compressed 934244464 1211493131 0.77
tpch_q04/duckdb:vortex-file-compressed 704901023 793432426 0.89
tpch_q05/duckdb:vortex-file-compressed 1157527992 1369539000 0.85
tpch_q06/duckdb:vortex-file-compressed 919822716 806559976 1.14
tpch_q07/duckdb:vortex-file-compressed 1414012056 1207140127 1.17
tpch_q08/duckdb:vortex-file-compressed 1439861618 1508146443 0.95
tpch_q09/duckdb:vortex-file-compressed 1536174326 1445247972 1.06
tpch_q10/duckdb:vortex-file-compressed 1240042666 1468442546 0.84
tpch_q11/duckdb:vortex-file-compressed 688132726 719723434 0.96
tpch_q12/duckdb:vortex-file-compressed 723005842 1024802719 0.71
tpch_q13/duckdb:vortex-file-compressed 982739298 1022375106 0.96
tpch_q14/duckdb:vortex-file-compressed 869491557 843786222 1.03
tpch_q15/duckdb:vortex-file-compressed 626385753 609407750 1.03
tpch_q16/duckdb:vortex-file-compressed 464834846 580134214 0.80
tpch_q17/duckdb:vortex-file-compressed 1108050464 943896229 1.17
tpch_q18/duckdb:vortex-file-compressed 1041194892 1358792317 0.77
tpch_q19/duckdb:vortex-file-compressed 839923933 845436084 0.99
tpch_q20/duckdb:vortex-file-compressed 1269499926 1397969903 0.91
tpch_q21/duckdb:vortex-file-compressed 2198623914 2114434092 1.04
tpch_q22/duckdb:vortex-file-compressed 631512307 703340360 0.90
duckdb / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR 9334719 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 669999642 633529597 1.06
tpch_q02/duckdb:vortex-compact 1079059577 1211388423 0.89
tpch_q03/duckdb:vortex-compact 984436510 973578616 1.01
tpch_q04/duckdb:vortex-compact 539902890 506226401 1.07
tpch_q05/duckdb:vortex-compact 1147283962 1010203422 1.14
tpch_q06/duckdb:vortex-compact 775323271 713000238 1.09
tpch_q07/duckdb:vortex-compact 1082556590 1016701007 1.06
tpch_q08/duckdb:vortex-compact 1393691081 1509065033 0.92
tpch_q09/duckdb:vortex-compact 1391091680 1545279843 0.90
tpch_q10/duckdb:vortex-compact 1103437534 1463411566 0.75
tpch_q11/duckdb:vortex-compact 683405981 667042106 1.02
tpch_q12/duckdb:vortex-compact 704403600 664538087 1.06
tpch_q13/duckdb:vortex-compact 963940586 1080694688 0.89
tpch_q14/duckdb:vortex-compact 946155286 887147507 1.07
tpch_q15/duckdb:vortex-compact 634026285 536081096 1.18
tpch_q16/duckdb:vortex-compact 407094191 387344885 1.05
tpch_q17/duckdb:vortex-compact 1017999504 875309296 1.16
tpch_q18/duckdb:vortex-compact 811169687 668327621 1.21
tpch_q19/duckdb:vortex-compact 786825135 963638055 0.82
tpch_q20/duckdb:vortex-compact 1250992554 1188268853 1.05
tpch_q21/duckdb:vortex-compact 1867646849 1617891063 1.15
tpch_q22/duckdb:vortex-compact 616111009 807680299 0.76
duckdb / parquet (0.856x ➖, 1↑ 0↓)
name PR 9334719 (ns) base 86c3568 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1028971004 1420931136 0.72
tpch_q02/duckdb:parquet 1474161468 1630134088 0.90
tpch_q03/duckdb:parquet 1917737047 2248242696 0.85
tpch_q04/duckdb:parquet 1032198441 1393231378 0.74
tpch_q05/duckdb:parquet 2396844213 2675699327 0.90
tpch_q06/duckdb:parquet 706056104 785577665 0.90
tpch_q07/duckdb:parquet 1847189839 2330251872 0.79
tpch_q08/duckdb:parquet 2760298822 3076643469 0.90
tpch_q09/duckdb:parquet 2726579636 2542322596 1.07
tpch_q10/duckdb:parquet 3139328830 3580763423 0.88
tpch_q11/duckdb:parquet 940910263 1084409903 0.87
tpch_q12/duckdb:parquet 1174303363 1126038199 1.04
tpch_q13/duckdb:parquet 1274463519 1668077296 0.76
tpch_q14/duckdb:parquet 1317755453 1472203482 0.90
tpch_q15/duckdb:parquet 952726576 1325000032 0.72
tpch_q16/duckdb:parquet 768813090 1085864244 0.71
tpch_q17/duckdb:parquet 1180038980 1556901279 0.76
tpch_q18/duckdb:parquet 🚀 1505899484 2257942417 0.67
tpch_q19/duckdb:parquet 1580756147 1542057960 1.03
tpch_q20/duckdb:parquet 1839360289 1697509229 1.08
tpch_q21/duckdb:parquet 1874247251 2467240440 0.76
tpch_q22/duckdb:parquet 1052731789 967278604 1.09
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +3.0% -15.9% +22.5% +59.7% ➖ noise
1 datafusion:vortex-file-compressed +7.6% -15.9% +28.0% +85.5% ➖ noise
1 duckdb:vortex-compact +5.8% -15.9% +25.7% +51.7% ➖ noise
1 duckdb:vortex-file-compressed -1.0% -15.9% +17.7% +50.4% ➖ noise
2 datafusion:vortex-compact -18.7% +1.8% -20.1% +38.5% ➖ noise
2 datafusion:vortex-file-compressed -44.1% +1.8% -45.1% +68.9% ✅ faster
2 duckdb:vortex-compact -10.9% +1.8% -12.5% +36.2% ➖ noise
2 duckdb:vortex-file-compressed -19.3% +1.8% -20.7% +43.2% ➖ noise
3 datafusion:vortex-compact -3.1% -1.0% -2.1% +62.0% ➖ noise
3 datafusion:vortex-file-compressed -8.9% -1.0% -7.9% +69.8% ➖ noise
3 duckdb:vortex-compact +1.1% -1.0% +2.2% +44.1% ➖ noise
3 duckdb:vortex-file-compressed -22.9% -1.0% -22.1% +51.8% ➖ noise
4 datafusion:vortex-compact +9.5% -6.4% +16.9% +49.4% ➖ noise
4 datafusion:vortex-file-compressed +7.8% -6.4% +15.1% +45.2% ➖ noise
4 duckdb:vortex-compact +6.7% -6.4% +13.9% +47.7% ➖ noise
4 duckdb:vortex-file-compressed -11.2% -6.4% -5.1% +45.0% ➖ noise
5 datafusion:vortex-compact +23.7% +0.6% +22.9% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +9.7% +0.6% +9.0% +30.0% ➖ noise
5 duckdb:vortex-compact +13.6% +0.6% +12.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -15.5% +0.6% -16.0% +30.0% ➖ noise
6 datafusion:vortex-compact +11.1% -12.8% +27.4% +34.2% ➖ noise
6 datafusion:vortex-file-compressed +16.6% -12.8% +33.7% +39.9% ➖ noise
6 duckdb:vortex-compact +8.7% -12.8% +24.7% +31.5% ➖ noise
6 duckdb:vortex-file-compressed +14.0% -12.8% +30.8% +32.2% ➖ noise
7 datafusion:vortex-compact -8.1% -11.5% +3.8% +31.6% ➖ noise
7 datafusion:vortex-file-compressed +13.2% -11.5% +27.9% +41.3% ➖ noise
7 duckdb:vortex-compact +6.5% -11.5% +20.3% +43.9% ➖ noise
7 duckdb:vortex-file-compressed +17.1% -11.5% +32.3% +38.3% ➖ noise
8 datafusion:vortex-compact +13.2% -22.9% +46.8% +35.1% 🚨 regression
8 datafusion:vortex-file-compressed -12.6% -22.9% +13.4% +51.1% ➖ noise
8 duckdb:vortex-compact -7.6% -22.9% +19.8% +36.2% ➖ noise
8 duckdb:vortex-file-compressed -4.5% -22.9% +23.9% +30.0% ➖ noise
9 datafusion:vortex-compact +21.4% -2.3% +24.2% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -13.4% -2.3% -11.4% +30.0% ➖ noise
9 duckdb:vortex-compact -10.0% -2.3% -7.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +6.3% -2.3% +8.8% +30.0% ➖ noise
10 datafusion:vortex-compact -0.1% -17.2% +20.6% +45.1% ➖ noise
10 datafusion:vortex-file-compressed -34.0% -17.2% -20.3% +34.0% ➖ noise
10 duckdb:vortex-compact -24.6% -17.2% -8.9% +43.6% ➖ noise
10 duckdb:vortex-file-compressed -15.6% -17.2% +2.0% +37.2% ➖ noise
11 datafusion:vortex-compact -12.1% -10.8% -1.5% +39.9% ➖ noise
11 datafusion:vortex-file-compressed -44.1% -10.8% -37.3% +38.0% ✅ faster
11 duckdb:vortex-compact +2.5% -10.8% +14.8% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -4.4% -10.8% +7.1% +194.3% ➖ noise
12 datafusion:vortex-compact -14.6% +3.6% -17.6% +32.8% ➖ noise
12 datafusion:vortex-file-compressed -12.6% +3.6% -15.6% +54.0% ➖ noise
12 duckdb:vortex-compact +6.0% +3.6% +2.3% +32.1% ➖ noise
12 duckdb:vortex-file-compressed -29.4% +3.6% -31.9% +59.8% ➖ noise
13 datafusion:vortex-compact -15.0% -5.1% -10.4% +104.1% ➖ noise
13 datafusion:vortex-file-compressed -0.2% -5.1% +5.2% +86.6% ➖ noise
13 duckdb:vortex-compact -10.8% -5.1% -6.0% +78.0% ➖ noise
13 duckdb:vortex-file-compressed -3.9% -5.1% +1.3% +86.2% ➖ noise
14 datafusion:vortex-compact -1.2% -18.4% +21.0% +31.6% ➖ noise
14 datafusion:vortex-file-compressed -6.5% -18.4% +14.5% +30.0% ➖ noise
14 duckdb:vortex-compact +6.7% -18.4% +30.7% +30.0% 🚨 regression
14 duckdb:vortex-file-compressed +3.0% -18.4% +26.3% +30.0% ➖ noise
15 datafusion:vortex-compact +29.5% -20.4% +62.7% +31.8% 🚨 regression
15 datafusion:vortex-file-compressed +2.0% -20.4% +28.2% +30.0% ➖ noise
15 duckdb:vortex-compact +18.3% -20.4% +48.6% +30.0% 🚨 regression
15 duckdb:vortex-file-compressed +2.8% -20.4% +29.2% +33.8% ➖ noise
16 datafusion:vortex-compact +63.1% -27.6% +125.2% +48.6% 🚨 regression
16 datafusion:vortex-file-compressed -24.0% -27.6% +4.9% +42.7% ➖ noise
16 duckdb:vortex-compact +5.1% -27.6% +45.1% +41.1% 🚨 regression
16 duckdb:vortex-file-compressed -19.9% -27.6% +10.7% +45.9% ➖ noise
17 datafusion:vortex-compact +19.5% -5.4% +26.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +10.1% -5.4% +16.4% +30.0% ➖ noise
17 duckdb:vortex-compact +16.3% -5.4% +22.9% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +17.4% -5.4% +24.1% +30.0% ➖ noise
18 datafusion:vortex-compact +19.2% -12.3% +35.9% +30.0% 🚨 regression
18 datafusion:vortex-file-compressed +29.4% -12.3% +47.6% +30.0% 🚨 regression
18 duckdb:vortex-compact +21.4% -12.3% +38.4% +30.0% 🚨 regression
18 duckdb:vortex-file-compressed -23.4% -12.3% -12.6% +38.1% ➖ noise
19 datafusion:vortex-compact +14.3% +4.6% +9.3% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -7.0% +4.6% -11.1% +53.2% ➖ noise
19 duckdb:vortex-compact -18.3% +4.6% -22.0% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -0.7% +4.6% -5.1% +30.0% ➖ noise
20 datafusion:vortex-compact -13.3% +1.5% -14.6% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -22.3% +1.5% -23.5% +30.0% ✅ faster
20 duckdb:vortex-compact +5.3% +1.5% +3.7% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -9.2% +1.5% -10.6% +30.0% ➖ noise
21 datafusion:vortex-compact -2.8% -8.3% +6.0% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +6.4% -8.3% +16.1% +30.0% ➖ noise
21 duckdb:vortex-compact +15.4% -8.3% +25.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +4.0% -8.3% +13.4% +30.0% ➖ noise
22 datafusion:vortex-compact -30.6% -7.6% -24.8% +59.9% ➖ noise
22 datafusion:vortex-file-compressed -15.8% -7.6% -8.9% +42.5% ➖ noise
22 duckdb:vortex-compact -23.7% -7.6% -17.4% +41.3% ➖ noise
22 duckdb:vortex-file-compressed -10.2% -7.6% -2.8% +47.3% ➖ noise

@AdamGS AdamGS added action/benchmark-sql Trigger SQL benchmarks to run on this PR and removed changelog/chore A trivial change labels Mar 26, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026
@AdamGS AdamGS added changelog/chore A trivial change action/benchmark-sql Trigger SQL benchmarks to run on this PR and removed changelog/chore A trivial change labels Mar 26, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026
@AdamGS AdamGS force-pushed the adamg/pr-benchmarks-label-fix branch from cdf984b to 9334719 Compare March 26, 2026 15:12
@AdamGS AdamGS changed the title Fix PR benchmarks concurrency group to keep progress visible Unify benchmark dispatch into a workflow Mar 26, 2026
@AdamGS AdamGS marked this pull request as ready for review March 26, 2026 15:13
@AdamGS AdamGS added changelog/chore A trivial change action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Mar 26, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 26, 2026
AdamGS added 2 commits March 26, 2026 15:52
@AdamGS
Try and keep benchmark run in UI
27c2ed1 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS
Restructure to multi-layer workflow dispatch
19897db 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/pr-benchmarks-label-fix branch from 9334719 to 19897db Compare March 26, 2026 15:52
0ax1
0ax1 reviewed Mar 27, 2026
View reviewed changes
.github/workflows/bench-pr.yml
with:
message: |
# 🚨🚨🚨❌❌❌ BENCHMARK FAILED ❌❌❌🚨🚨🚨
# BENCHMARK FAILED
Copy link
Copy Markdown
Contributor

@0ax1 0ax1 Mar 27, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ty

@AdamGS AdamGS merged commit 6fade3c into develop Mar 27, 2026
62 checks passed
@AdamGS AdamGS deleted the adamg/pr-benchmarks-label-fix branch March 27, 2026 11:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@0ax1 0ax1 0ax1 approved these changes

@joseph-isaacs joseph-isaacs Awaiting requested review from joseph-isaacs

@robert3005 robert3005 Awaiting requested review from robert3005

Assignees

No one assigned

Labels

changelog/chore A trivial change

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@AdamGS @0ax1