Skip to content

Conversation

@alamb
Copy link
Contributor

@alamb alamb commented Jan 2, 2026

Which issue does this PR close?

Rationale for this change

the nullif kernel has an optimization for counting nulls as part of applying nullif, and I did not know if that made a difference (turns out it does).

I made a benchmark to be able to measure this difference

What changes are included in this PR?

Add a nullif_kernel benchmark

Are these changes tested?

I ran them manually

Are there any user-facing changes?

No new benchmark

@github-actions github-actions bot added arrow Changes to the arrow crate parquet Changes to the parquet crate labels Jan 2, 2026
@alamb alamb mentioned this pull request Jan 2, 2026
@alamb alamb force-pushed the alamb/nullif_benchmark branch from 94fe993 to d171d8b Compare January 2, 2026 14:37
/// # Panic
///
/// Panics if any of the [`BooleanArray`] contain nulls
#[inline(never)]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are these inline tags for profiling or performance?

impl Default for RowSelectionPolicy {
fn default() -> Self {
Self::Auto { threshold: 32 }
Self::Auto { threshold: 16 }
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a great call @Weijun-H -- this is left over code that was not indended for this PR. Sorry about that I will remove it

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed in 7266d10

@alamb alamb marked this pull request as draft January 5, 2026 21:20
@alamb alamb marked this pull request as ready for review January 7, 2026 16:35
@github-actions github-actions bot removed the parquet Changes to the parquet crate label Jan 7, 2026
@alamb
Copy link
Contributor Author

alamb commented Jan 11, 2026

Thanks @Jefffrey and @Weijun-H

@alamb alamb merged commit f338149 into apache:main Jan 11, 2026
24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

arrow Changes to the arrow crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants