refactor: event handling in parseable#1218

Closed

de-sh wants to merge 46 commits intoparseablehq:mainfrom

Commits on Feb 28, 2025

refactor: accept array in `push_logs`
Devdutt Shenoi
committed
move tests to associated module
Devdutt Shenoi
committed
refactor: remove `is_schema_matching`
Devdutt Shenoi
committed

Commits on Mar 1, 2025

doc: improve readability
Devdutt Shenoi
committed
simplify `replace_columns`
Devdutt Shenoi
committed
ci: fix imports
Devdutt Shenoi
committed
push flattening into `Event`
Devdutt Shenoi
committed
refactor: move kinesis to lib level
Devdutt Shenoi
committed
refactor: perform flattening in `to_data` alone
Devdutt Shenoi
committed
refactor: further streamline, associate w/ `Parseable`
Devdutt Shenoi
committed
ci: deepsource suggestion
Devdutt Shenoi
committed
fix: flattening
Devdutt Shenoi
committed
remove unused code
Devdutt Shenoi
committed
fix: partitioning
Devdutt Shenoi
committed
refactor: share `Stream` state when processing
Devdutt Shenoi
committed
refactor: `Parseable::commit_schema`
Devdutt Shenoi
committed
map schema keys to recordbatches
Devdutt Shenoi
committed
construct map directly
Devdutt Shenoi
committed
fix: concat to not lose data
Devdutt Shenoi
committed
refactor: extract `byte_size` during json deserialization
Devdutt Shenoi
committed

Commits on Mar 2, 2025

ci: clippy suggestion
Devdutt Shenoi
committed
feat: `DiskWriter` handles writing to arrow part file
Devdutt Shenoi
committed
test: fix expectation
Devdutt Shenoi
committed
refactor: don't add a step
Devdutt Shenoi
committed
refactor: `get_schemas_if_present`
Devdutt Shenoi
committed

Commits on Mar 3, 2025

refactor: `prepare_and_validate_schema`
Devdutt Shenoi
committed
refactor: event construction and processing
Devdutt Shenoi
committed
fix: concat at once
Devdutt Shenoi
committed
refactor: separate out flatten from schema inference
Devdutt Shenoi
committed
style: `anyhow::Result`
Devdutt Shenoi
committed
fix: rb per object
Devdutt Shenoi
committed

Commits on Mar 4, 2025

Merge remote-tracking branch 'origin/main'
Devdutt Shenoi
committed
perf: partition at json level
Devdutt Shenoi
committed
style: deepsource suggestion
Devdutt Shenoi
committed

Commits on Mar 7, 2025

Merge branch 'main' into main
Devdutt Shenoi
authored

Commits on Mar 10, 2025

chore: remove unused
Devdutt Shenoi
committed
fix: custom partitioned file names
Devdutt Shenoi
committed
perf: use a buffer
Devdutt Shenoi
committed
refactor: drop to flush
Devdutt Shenoi
committed
fix & test: prefix generation
Devdutt Shenoi
committed

Commits on Mar 14, 2025

Merge branch 'main' into main
Devdutt Shenoi
authored

Commits on Mar 16, 2025

Merge remote-tracking branch 'origin/main'
Devdutt Shenoi
committed
Merge branch 'main' into main
Devdutt Shenoi
authored

Commits on Mar 18, 2025

spinoff #1251
Devdutt Shenoi
committed

Commits on Mar 21, 2025

revert removal of `is_schema_matching`
Devdutt Shenoi
committed
Merge remote-tracking branch 'origin/main'
Devdutt Shenoi
committed