-
Notifications
You must be signed in to change notification settings - Fork 990
Closed
Labels
parquetChanges to the parquet crateChanges to the parquet crateparquet-variantparquet-variant* cratesparquet-variant* crates
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
- While writing examples in Add
variant_experimental
feature toparquet
crate #8133 I hit an an issue that the conversion from JSON --> Variant is only supported for StringArray which was surprising to me
Specifically the code here only supports StringArray:
arrow-rs/parquet-variant-compute/src/from_json.rs
Lines 30 to 35 in f248da3
let input_string_array = match input.as_any().downcast_ref::<StringArray>() { | |
Some(string_array) => Ok(string_array), | |
None => Err(ArrowError::CastError( | |
"Expected reference to StringArray as input".into(), | |
)), | |
}?; |
Describe the solution you'd like
I would like to be able to convert data other than just StringArray such as LargeStringArray
and StringViewArray
Describe alternatives you've considered
Add support and tests for LargeStringArray and StringViewArray to batch_json_string_to_variant
Additional context
Metadata
Metadata
Assignees
Labels
parquetChanges to the parquet crateChanges to the parquet crateparquet-variantparquet-variant* cratesparquet-variant* crates