Skip to content

feat(transaction): RowDelta merge-on-read deletion vectors (carries forward #2203) #2678

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
raghav-reglobe wants to merge 15 commits into
base: main
Choose a base branch
from
Open

feat(transaction): RowDelta merge-on-read deletion vectors (carries forward #2203) #2678

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
8f67b72
feat(transaction): add RowDelta transaction action for row-level modi…
wirybeaver Mar 2, 2026
0f43c4a
add improvements
wirybeaver Mar 9, 2026
f2679fc
refactor(row_delta): address review feedback
wirybeaver Apr 16, 2026
f204457
fix(row_delta): avoid unwrap_err() to sidestep ActionCommit: Debug bound
wirybeaver Apr 16, 2026
a362495
fix(row_delta): implement manifest rewriting and address mbutrovich r…
wirybeaver Apr 30, 2026
4ff9da5
feat(delete-vector): write/read V3 deletion-vector-v1 Puffin blobs
raghav-reglobe Jun 19, 2026
9bbae4f
feat(row-delta): implement add_delete_files MoR commit (content=Delet…
raghav-reglobe Jun 19, 2026
9d98064
feat(delete-vector): glue DV -> Puffin file -> PositionDeletes DataFile
raghav-reglobe Jun 19, 2026
c1247a7
feat(delete-vector): make module public + add real-data REST/S3 valid…
raghav-reglobe Jun 19, 2026
299c832
test(delete-vector): wire S3 StorageFactory into the real-data DV exa…
raghav-reglobe Jun 19, 2026
c8ad5b5
test(delete-vector): byte-parity with Apache Iceberg-Java golden DV p…
raghav-reglobe Jun 19, 2026
0a9766a
test(delete-vector): empty + boundary-position parity tests (vs icebe…
raghav-reglobe Jun 19, 2026
041f9b6
test(delete-vector): 2 more Java golden byte-parity vectors (empty, s…
raghav-reglobe Jun 19, 2026
a8bc543
style: rustfmt the DV-write changes (CI gate)
raghav-reglobe Jun 19, 2026
207aca3
fix(ci): adapt to current main + regenerate CI artifacts
raghav-reglobe Jun 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .typos.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ extend-ignore-identifiers-re = ["^bimap$"]
[default.extend-words]
AGS = "AGS"
ags = "ags"
mor = "mor"

[files]
extend-exclude = ["**/testdata", "CHANGELOG.md", "**/public-api.txt"]
2 changes: 2 additions & 0 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

1 change: 1 addition & 0 deletions Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -73,6 +73,7 @@ bytes = "1.11"
cfg-if = "1"
chrono = "0.4.41"
clap = { version = "4.5.48", features = ["derive", "cargo"] }
crc32fast = "1.5"
dashmap = "6"
datafusion = "53.1.0"
datafusion-cli = "53.0.0"
Expand Down
1 change: 1 addition & 0 deletions crates/catalog/rest/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,7 @@ typed-builder = { workspace = true }
uuid = { workspace = true, features = ["v4"] }

[dev-dependencies]
iceberg-storage-opendal = { workspace = true }
iceberg_test_utils = { path = "../../test_utils", features = ["tests"] }
mockito = { workspace = true }
tokio = { workspace = true }
Loading
Loading