This is an automated email from the ASF dual-hosted git repository. tustvold pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
The following commit(s) were added to refs/heads/master by this push: new 92376a765 Update to 32.0.0 and update changelog (#3611) 92376a765 is described below commit 92376a76570f9a22f3c37637e24f6cdc8dae8f85 Author: Ian Alexander Joiner <14581281+iajoi...@users.noreply.github.com> AuthorDate: Fri Jan 27 10:57:41 2023 -0500 Update to 32.0.0 and update changelog (#3611) * Update version * update change log * fix doc in the update_change_log script --- CHANGELOG-old.md | 76 ++++++++++++++++ CHANGELOG.md | 124 +++++++++++++-------------- arrow-arith/Cargo.toml | 10 +-- arrow-array/Cargo.toml | 8 +- arrow-buffer/Cargo.toml | 2 +- arrow-cast/Cargo.toml | 12 +-- arrow-csv/Cargo.toml | 12 +-- arrow-data/Cargo.toml | 6 +- arrow-flight/Cargo.toml | 14 +-- arrow-flight/README.md | 2 +- arrow-integration-test/Cargo.toml | 6 +- arrow-integration-testing/Cargo.toml | 2 +- arrow-ipc/Cargo.toml | 12 +-- arrow-json/Cargo.toml | 12 +-- arrow-ord/Cargo.toml | 12 +-- arrow-pyarrow-integration-testing/Cargo.toml | 4 +- arrow-row/Cargo.toml | 14 +-- arrow-schema/Cargo.toml | 2 +- arrow-select/Cargo.toml | 10 +-- arrow-string/Cargo.toml | 12 +-- arrow/Cargo.toml | 28 +++--- arrow/README.md | 2 +- dev/release/README.md | 2 +- dev/release/update_change_log.sh | 6 +- parquet/Cargo.toml | 20 ++--- parquet_derive/Cargo.toml | 4 +- parquet_derive/README.md | 4 +- parquet_derive_test/Cargo.toml | 6 +- 28 files changed, 250 insertions(+), 174 deletions(-) diff --git a/CHANGELOG-old.md b/CHANGELOG-old.md index 2bf0aef99..65a95579e 100644 --- a/CHANGELOG-old.md +++ b/CHANGELOG-old.md @@ -19,6 +19,82 @@ # Historical Changelog +## [31.0.0](https://github.com/apache/arrow-rs/tree/31.0.0) (2023-01-13) + +[Full Changelog](https://github.com/apache/arrow-rs/compare/30.0.1...31.0.0) + +**Breaking changes:** + +- support RFC3339 style timestamps in `arrow-json` [\#3449](https://github.com/apache/arrow-rs/pull/3449) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([JayjeetAtGithub](https://github.com/JayjeetAtGithub)) +- Improve arrow flight batch splitting and naming [\#3444](https://github.com/apache/arrow-rs/pull/3444) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) +- Parquet record API: timestamp as signed integer [\#3437](https://github.com/apache/arrow-rs/pull/3437) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([ByteBaker](https://github.com/ByteBaker)) +- Support decimal int32/64 for writer [\#3431](https://github.com/apache/arrow-rs/pull/3431) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([liukun4515](https://github.com/liukun4515)) + +**Implemented enhancements:** + +- Support casting Date32 to timestamp [\#3504](https://github.com/apache/arrow-rs/issues/3504) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] +- Support casting strings like `'2001-01-01'` to timestamp [\#3492](https://github.com/apache/arrow-rs/issues/3492) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] +- CLI to "rewrite" parquet files [\#3476](https://github.com/apache/arrow-rs/issues/3476) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] +- Add more dictionary value type support to `build_compare` [\#3465](https://github.com/apache/arrow-rs/issues/3465) +- Allow `concat_batches` to take non owned RecordBatch [\#3456](https://github.com/apache/arrow-rs/issues/3456) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] +- Release Arrow `30.0.1` \(maintenance release for `30.0.0`\) [\#3455](https://github.com/apache/arrow-rs/issues/3455) +- Add string comparisons \(starts\_with, ends\_with, and contains\) to kernel [\#3442](https://github.com/apache/arrow-rs/issues/3442) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] +- make\_builder Loses Timezone and Decimal Scale Information [\#3435](https://github.com/apache/arrow-rs/issues/3435) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] +- Use RFC3339 style timestamps in arrow-json [\#3416](https://github.com/apache/arrow-rs/issues/3416) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] +- ArrayData`get_slice_memory_size` or similar [\#3407](https://github.com/apache/arrow-rs/issues/3407) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] + +**Fixed bugs:** + +- Unable to read CSV with null boolean value [\#3521](https://github.com/apache/arrow-rs/issues/3521) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] +- Make consistent behavior on zeros equality on floating point types [\#3509](https://github.com/apache/arrow-rs/issues/3509) +- Sliced batch w/ bool column doesn't roundtrip through IPC [\#3496](https://github.com/apache/arrow-rs/issues/3496) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] +- take kernel on List array introduces nulls instead of empty lists [\#3471](https://github.com/apache/arrow-rs/issues/3471) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] +- Infinite Loop If Skipping More CSV Lines than Present [\#3469](https://github.com/apache/arrow-rs/issues/3469) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] + +**Merged pull requests:** + +- Fix reading null booleans from CSV [\#3523](https://github.com/apache/arrow-rs/pull/3523) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- minor fix: use the unified decimal type builder [\#3522](https://github.com/apache/arrow-rs/pull/3522) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([liukun4515](https://github.com/liukun4515)) +- Update version to `31.0.0` and add changelog [\#3518](https://github.com/apache/arrow-rs/pull/3518) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([iajoiner](https://github.com/iajoiner)) +- Additional nullif re-export [\#3515](https://github.com/apache/arrow-rs/pull/3515) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Make consistent behavior on zeros equality on floating point types [\#3510](https://github.com/apache/arrow-rs/pull/3510) ([viirya](https://github.com/viirya)) +- Enable cast Date32 to Timestamp [\#3508](https://github.com/apache/arrow-rs/pull/3508) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([comphead](https://github.com/comphead)) +- Update prost-build requirement from =0.11.5 to =0.11.6 [\#3507](https://github.com/apache/arrow-rs/pull/3507) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([dependabot[bot]](https://github.com/apps/dependabot)) +- minor fix for the comments [\#3505](https://github.com/apache/arrow-rs/pull/3505) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([liukun4515](https://github.com/liukun4515)) +- Fix DataTypeLayout for LargeList [\#3503](https://github.com/apache/arrow-rs/pull/3503) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) +- Add string comparisons \(starts\_with, ends\_with, and contains\) to kernel [\#3502](https://github.com/apache/arrow-rs/pull/3502) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([snmvaughan](https://github.com/snmvaughan)) +- Add a function to get memory size of array slice [\#3501](https://github.com/apache/arrow-rs/pull/3501) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([askoa](https://github.com/askoa)) +- Fix IPCWriter for Sliced BooleanArray [\#3498](https://github.com/apache/arrow-rs/pull/3498) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([crepererum](https://github.com/crepererum)) +- Fix: Added support to cast string without time [\#3494](https://github.com/apache/arrow-rs/pull/3494) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([gaelwjl](https://github.com/gaelwjl)) +- Fix negative interval prettyprint [\#3491](https://github.com/apache/arrow-rs/pull/3491) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([Jefffrey](https://github.com/Jefffrey)) +- Fixes a broken link in the arrow lib.rs rustdoc [\#3487](https://github.com/apache/arrow-rs/pull/3487) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([AdamGS](https://github.com/AdamGS)) +- Refactoring build\_compare for decimal and using downcast\_primitive [\#3484](https://github.com/apache/arrow-rs/pull/3484) ([viirya](https://github.com/viirya)) +- Add tests for record batch size splitting logic in FlightClient [\#3481](https://github.com/apache/arrow-rs/pull/3481) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) +- change `concat_batches` parameter to non owned reference [\#3480](https://github.com/apache/arrow-rs/pull/3480) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([askoa](https://github.com/askoa)) +- feat: add `parquet-rewrite` CLI [\#3477](https://github.com/apache/arrow-rs/pull/3477) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([crepererum](https://github.com/crepererum)) +- Preserve empty list array elements in take kernel [\#3473](https://github.com/apache/arrow-rs/pull/3473) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([jonmmease](https://github.com/jonmmease)) +- Add a test for stream writer for writing sliced array [\#3472](https://github.com/apache/arrow-rs/pull/3472) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) +- Fix CSV infinite loop and improve error messages [\#3470](https://github.com/apache/arrow-rs/pull/3470) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Add more dictionary value type support to `build_compare` [\#3466](https://github.com/apache/arrow-rs/pull/3466) ([viirya](https://github.com/viirya)) +- Add tests for `FlightClient::{list_flights, list_actions, do_action, get_schema}` [\#3463](https://github.com/apache/arrow-rs/pull/3463) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) +- Minor: add ticket links to failing ipc integration tests [\#3461](https://github.com/apache/arrow-rs/pull/3461) ([alamb](https://github.com/alamb)) +- feat: `column_name` based index access for `RecordBatch` and `StructArray` [\#3458](https://github.com/apache/arrow-rs/pull/3458) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([askoa](https://github.com/askoa)) +- Support Decimal256 in FFI [\#3453](https://github.com/apache/arrow-rs/pull/3453) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) +- Remove multiversion dependency [\#3452](https://github.com/apache/arrow-rs/pull/3452) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Re-export nullif kernel [\#3451](https://github.com/apache/arrow-rs/pull/3451) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Meaningful error message for map builder with null keys [\#3450](https://github.com/apache/arrow-rs/pull/3450) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([Jefffrey](https://github.com/Jefffrey)) +- Parquet writer v2: clear buffer after page flush [\#3447](https://github.com/apache/arrow-rs/pull/3447) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([askoa](https://github.com/askoa)) +- Verify ArrayData::data\_type compatible in PrimitiveArray::from [\#3440](https://github.com/apache/arrow-rs/pull/3440) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Preserve DataType metadata in make\_builder [\#3438](https://github.com/apache/arrow-rs/pull/3438) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Consolidate arrow ipc tests and increase coverage [\#3427](https://github.com/apache/arrow-rs/pull/3427) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([alamb](https://github.com/alamb)) +- Generic bytes dictionary builder [\#3426](https://github.com/apache/arrow-rs/pull/3426) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) +- Minor: Improve docs for arrow-ipc, remove clippy ignore [\#3421](https://github.com/apache/arrow-rs/pull/3421) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([alamb](https://github.com/alamb)) +- refactor: convert `*like_dyn`, `*like_utf8_scalar_dyn` and `*like_dict` functions to macros [\#3411](https://github.com/apache/arrow-rs/pull/3411) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([askoa](https://github.com/askoa)) +- Add parquet-index binary [\#3405](https://github.com/apache/arrow-rs/pull/3405) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([tustvold](https://github.com/tustvold)) +- Complete mid-level `FlightClient` [\#3402](https://github.com/apache/arrow-rs/pull/3402) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) +- Implement `RecordBatch` \<--\> `FlightData` encode/decode + tests [\#3391](https://github.com/apache/arrow-rs/pull/3391) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) +- Provide `into_builder` for bytearray [\#3326](https://github.com/apache/arrow-rs/pull/3326) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) + ## [30.0.1](https://github.com/apache/arrow-rs/tree/30.0.1) (2023-01-04) [Full Changelog](https://github.com/apache/arrow-rs/compare/30.0.0...30.0.1) diff --git a/CHANGELOG.md b/CHANGELOG.md index 109453c30..19b1fe68d 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -19,81 +19,81 @@ # Changelog -## [31.0.0](https://github.com/apache/arrow-rs/tree/31.0.0) (2023-01-13) +## [32.0.0](https://github.com/apache/arrow-rs/tree/32.0.0) (2023-01-26) -[Full Changelog](https://github.com/apache/arrow-rs/compare/30.0.1...31.0.0) +[Full Changelog](https://github.com/apache/arrow-rs/compare/31.0.0...32.0.0) **Breaking changes:** -- support RFC3339 style timestamps in `arrow-json` [\#3449](https://github.com/apache/arrow-rs/pull/3449) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([JayjeetAtGithub](https://github.com/JayjeetAtGithub)) -- Improve arrow flight batch splitting and naming [\#3444](https://github.com/apache/arrow-rs/pull/3444) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) -- Parquet record API: timestamp as signed integer [\#3437](https://github.com/apache/arrow-rs/pull/3437) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([ByteBaker](https://github.com/ByteBaker)) -- Support decimal int32/64 for writer [\#3431](https://github.com/apache/arrow-rs/pull/3431) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([liukun4515](https://github.com/liukun4515)) +- Allow `StringArray` construction with `Vec<Option<String>>` [\#3602](https://github.com/apache/arrow-rs/pull/3602) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([sinistersnare](https://github.com/sinistersnare)) +- Use native types in PageIndex \(\#3575\) [\#3578](https://github.com/apache/arrow-rs/pull/3578) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([tustvold](https://github.com/tustvold)) +- Add external variant to ParquetError \(\#3285\) [\#3574](https://github.com/apache/arrow-rs/pull/3574) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([tustvold](https://github.com/tustvold)) +- Return reference from ListArray::values [\#3561](https://github.com/apache/arrow-rs/pull/3561) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- feat: Add `RunEndEncodedArray` [\#3553](https://github.com/apache/arrow-rs/pull/3553) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([askoa](https://github.com/askoa)) **Implemented enhancements:** -- Support casting Date32 to timestamp [\#3504](https://github.com/apache/arrow-rs/issues/3504) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] -- Support casting strings like `'2001-01-01'` to timestamp [\#3492](https://github.com/apache/arrow-rs/issues/3492) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] -- CLI to "rewrite" parquet files [\#3476](https://github.com/apache/arrow-rs/issues/3476) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] -- Add more dictionary value type support to `build_compare` [\#3465](https://github.com/apache/arrow-rs/issues/3465) -- Allow `concat_batches` to take non owned RecordBatch [\#3456](https://github.com/apache/arrow-rs/issues/3456) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] -- Release Arrow `30.0.1` \(maintenance release for `30.0.0`\) [\#3455](https://github.com/apache/arrow-rs/issues/3455) -- Add string comparisons \(starts\_with, ends\_with, and contains\) to kernel [\#3442](https://github.com/apache/arrow-rs/issues/3442) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] -- make\_builder Loses Timezone and Decimal Scale Information [\#3435](https://github.com/apache/arrow-rs/issues/3435) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] -- Use RFC3339 style timestamps in arrow-json [\#3416](https://github.com/apache/arrow-rs/issues/3416) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] -- ArrayData`get_slice_memory_size` or similar [\#3407](https://github.com/apache/arrow-rs/issues/3407) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] +- There should be a `From<Vec<Option<String>>>` impl for `GenericStringArray<OffsetSize>` [\#3599](https://github.com/apache/arrow-rs/issues/3599) +- FlightDataEncoder Optionally send Schema even when no record batches [\#3591](https://github.com/apache/arrow-rs/issues/3591) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] +- \[object\_store\] support more identity based auth flows for azure [\#3580](https://github.com/apache/arrow-rs/issues/3580) +- Use Native Types in PageIndex [\#3575](https://github.com/apache/arrow-rs/issues/3575) +- Packing array into dictionary of generic byte array [\#3571](https://github.com/apache/arrow-rs/issues/3571) +- Implement `Error::Source` for ArrowError and FlightError [\#3566](https://github.com/apache/arrow-rs/issues/3566) +- \[FlightSQL\] Allow access to underlying FlightClient [\#3551](https://github.com/apache/arrow-rs/issues/3551) +- Arrow CSV writer should not fail when cannot cast the value [\#3547](https://github.com/apache/arrow-rs/issues/3547) +- Implement workload identity and application default credentials for GCP object store. [\#3533](https://github.com/apache/arrow-rs/issues/3533) +- Write Deprecated Min Max Statistics When ColumnOrder Signed [\#3526](https://github.com/apache/arrow-rs/issues/3526) +- Support footer kv metadata for IPC file [\#3432](https://github.com/apache/arrow-rs/issues/3432) +- Add `External` variant to ParquetError [\#3285](https://github.com/apache/arrow-rs/issues/3285) **Fixed bugs:** -- Unable to read CSV with null boolean value [\#3521](https://github.com/apache/arrow-rs/issues/3521) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] -- Make consistent behavior on zeros equality on floating point types [\#3509](https://github.com/apache/arrow-rs/issues/3509) -- Sliced batch w/ bool column doesn't roundtrip through IPC [\#3496](https://github.com/apache/arrow-rs/issues/3496) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] -- take kernel on List array introduces nulls instead of empty lists [\#3471](https://github.com/apache/arrow-rs/issues/3471) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] -- Infinite Loop If Skipping More CSV Lines than Present [\#3469](https://github.com/apache/arrow-rs/issues/3469) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] +- Nullif of NULL Predicate is not NULL [\#3589](https://github.com/apache/arrow-rs/issues/3589) +- BooleanBufferBuilder Fails to Clear Set Bits On Truncate [\#3587](https://github.com/apache/arrow-rs/issues/3587) +- `nullif` incorrectly calculates `null_count`, sometimes panics with substraction overflow error [\#3579](https://github.com/apache/arrow-rs/issues/3579) +- Meet warning when use pyarrow [\#3543](https://github.com/apache/arrow-rs/issues/3543) +- Incorrect row group total\_byte\_size written to parquet file [\#3530](https://github.com/apache/arrow-rs/issues/3530) +- Overflow when casting timestamps prior to the epoch [\#3512](https://github.com/apache/arrow-rs/issues/3512) + +**Closed issues:** + +- Panic on Key Overflow in Dictionary Builders [\#3562](https://github.com/apache/arrow-rs/issues/3562) +- Bumping version gives compilation error \(arrow-array\) [\#3525](https://github.com/apache/arrow-rs/issues/3525) +- Release Arrow `31.0.0` \(next release after `30.0.0`\) [\#3415](https://github.com/apache/arrow-rs/issues/3415) **Merged pull requests:** -- Fix reading null booleans from CSV [\#3523](https://github.com/apache/arrow-rs/pull/3523) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) -- minor fix: use the unified decimal type builder [\#3522](https://github.com/apache/arrow-rs/pull/3522) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([liukun4515](https://github.com/liukun4515)) -- Update version to `31.0.0` and add changelog [\#3518](https://github.com/apache/arrow-rs/pull/3518) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([iajoiner](https://github.com/iajoiner)) -- Additional nullif re-export [\#3515](https://github.com/apache/arrow-rs/pull/3515) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) -- Make consistent behavior on zeros equality on floating point types [\#3510](https://github.com/apache/arrow-rs/pull/3510) ([viirya](https://github.com/viirya)) -- Enable cast Date32 to Timestamp [\#3508](https://github.com/apache/arrow-rs/pull/3508) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([comphead](https://github.com/comphead)) -- Update prost-build requirement from =0.11.5 to =0.11.6 [\#3507](https://github.com/apache/arrow-rs/pull/3507) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([dependabot[bot]](https://github.com/apps/dependabot)) -- minor fix for the comments [\#3505](https://github.com/apache/arrow-rs/pull/3505) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([liukun4515](https://github.com/liukun4515)) -- Fix DataTypeLayout for LargeList [\#3503](https://github.com/apache/arrow-rs/pull/3503) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) -- Add string comparisons \(starts\_with, ends\_with, and contains\) to kernel [\#3502](https://github.com/apache/arrow-rs/pull/3502) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([snmvaughan](https://github.com/snmvaughan)) -- Add a function to get memory size of array slice [\#3501](https://github.com/apache/arrow-rs/pull/3501) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([askoa](https://github.com/askoa)) -- Fix IPCWriter for Sliced BooleanArray [\#3498](https://github.com/apache/arrow-rs/pull/3498) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([crepererum](https://github.com/crepererum)) -- Fix: Added support to cast string without time [\#3494](https://github.com/apache/arrow-rs/pull/3494) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([gaelwjl](https://github.com/gaelwjl)) -- Fix negative interval prettyprint [\#3491](https://github.com/apache/arrow-rs/pull/3491) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([Jefffrey](https://github.com/Jefffrey)) -- Fixes a broken link in the arrow lib.rs rustdoc [\#3487](https://github.com/apache/arrow-rs/pull/3487) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([AdamGS](https://github.com/AdamGS)) -- Refactoring build\_compare for decimal and using downcast\_primitive [\#3484](https://github.com/apache/arrow-rs/pull/3484) ([viirya](https://github.com/viirya)) -- Add tests for record batch size splitting logic in FlightClient [\#3481](https://github.com/apache/arrow-rs/pull/3481) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) -- change `concat_batches` parameter to non owned reference [\#3480](https://github.com/apache/arrow-rs/pull/3480) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([askoa](https://github.com/askoa)) -- feat: add `parquet-rewrite` CLI [\#3477](https://github.com/apache/arrow-rs/pull/3477) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([crepererum](https://github.com/crepererum)) -- Preserve empty list array elements in take kernel [\#3473](https://github.com/apache/arrow-rs/pull/3473) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([jonmmease](https://github.com/jonmmease)) -- Add a test for stream writer for writing sliced array [\#3472](https://github.com/apache/arrow-rs/pull/3472) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) -- Fix CSV infinite loop and improve error messages [\#3470](https://github.com/apache/arrow-rs/pull/3470) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) -- Add more dictionary value type support to `build_compare` [\#3466](https://github.com/apache/arrow-rs/pull/3466) ([viirya](https://github.com/viirya)) -- Add tests for `FlightClient::{list_flights, list_actions, do_action, get_schema}` [\#3463](https://github.com/apache/arrow-rs/pull/3463) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) -- Minor: add ticket links to failing ipc integration tests [\#3461](https://github.com/apache/arrow-rs/pull/3461) ([alamb](https://github.com/alamb)) -- feat: `column_name` based index access for `RecordBatch` and `StructArray` [\#3458](https://github.com/apache/arrow-rs/pull/3458) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([askoa](https://github.com/askoa)) -- Support Decimal256 in FFI [\#3453](https://github.com/apache/arrow-rs/pull/3453) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) -- Remove multiversion dependency [\#3452](https://github.com/apache/arrow-rs/pull/3452) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) -- Re-export nullif kernel [\#3451](https://github.com/apache/arrow-rs/pull/3451) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) -- Meaningful error message for map builder with null keys [\#3450](https://github.com/apache/arrow-rs/pull/3450) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([Jefffrey](https://github.com/Jefffrey)) -- Parquet writer v2: clear buffer after page flush [\#3447](https://github.com/apache/arrow-rs/pull/3447) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([askoa](https://github.com/askoa)) -- Verify ArrayData::data\_type compatible in PrimitiveArray::from [\#3440](https://github.com/apache/arrow-rs/pull/3440) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) -- Preserve DataType metadata in make\_builder [\#3438](https://github.com/apache/arrow-rs/pull/3438) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) -- Consolidate arrow ipc tests and increase coverage [\#3427](https://github.com/apache/arrow-rs/pull/3427) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([alamb](https://github.com/alamb)) -- Generic bytes dictionary builder [\#3426](https://github.com/apache/arrow-rs/pull/3426) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) -- Minor: Improve docs for arrow-ipc, remove clippy ignore [\#3421](https://github.com/apache/arrow-rs/pull/3421) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([alamb](https://github.com/alamb)) -- refactor: convert `*like_dyn`, `*like_utf8_scalar_dyn` and `*like_dict` functions to macros [\#3411](https://github.com/apache/arrow-rs/pull/3411) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([askoa](https://github.com/askoa)) -- Add parquet-index binary [\#3405](https://github.com/apache/arrow-rs/pull/3405) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([tustvold](https://github.com/tustvold)) -- Complete mid-level `FlightClient` [\#3402](https://github.com/apache/arrow-rs/pull/3402) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) -- Implement `RecordBatch` \<--\> `FlightData` encode/decode + tests [\#3391](https://github.com/apache/arrow-rs/pull/3391) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) -- Provide `into_builder` for bytearray [\#3326](https://github.com/apache/arrow-rs/pull/3326) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) +- Update to flatbuffers 23.1.21 [\#3597](https://github.com/apache/arrow-rs/pull/3597) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Faster BooleanBufferBuilder::append\_n for true values [\#3596](https://github.com/apache/arrow-rs/pull/3596) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Support sending schemas for empty streams [\#3594](https://github.com/apache/arrow-rs/pull/3594) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) +- Faster ListArray to StringArray conversion [\#3593](https://github.com/apache/arrow-rs/pull/3593) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Add conversion from StringArray to BinaryArray [\#3592](https://github.com/apache/arrow-rs/pull/3592) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Fix nullif null count \(\#3579\) [\#3590](https://github.com/apache/arrow-rs/pull/3590) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Clear bits in BooleanBufferBuilder \(\#3587\) [\#3588](https://github.com/apache/arrow-rs/pull/3588) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Iterate all dictionary key types in cast test [\#3585](https://github.com/apache/arrow-rs/pull/3585) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) +- Propagate EOF Error from AsyncRead [\#3576](https://github.com/apache/arrow-rs/pull/3576) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([Sach1nAgarwal](https://github.com/Sach1nAgarwal)) +- Show row\_counts also for \(FixedLen\)ByteArray [\#3573](https://github.com/apache/arrow-rs/pull/3573) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([bmmeijers](https://github.com/bmmeijers)) +- Packing array into dictionary of generic byte array [\#3572](https://github.com/apache/arrow-rs/pull/3572) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) +- Remove unwrap on datetime cast for CSV writer [\#3570](https://github.com/apache/arrow-rs/pull/3570) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([comphead](https://github.com/comphead)) +- Implement `std::error::Error::source` for `ArrowError` and `FlightError` [\#3567](https://github.com/apache/arrow-rs/pull/3567) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([alamb](https://github.com/alamb)) +- Improve GenericBytesBuilder offset overflow panic message \(\#139\) [\#3564](https://github.com/apache/arrow-rs/pull/3564) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Implement Extend for ArrayBuilder \(\#1841\) [\#3563](https://github.com/apache/arrow-rs/pull/3563) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Update pyarrow method call with kwargs [\#3560](https://github.com/apache/arrow-rs/pull/3560) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([Frankonly](https://github.com/Frankonly)) +- Update pyo3 requirement from 0.17 to 0.18 [\#3557](https://github.com/apache/arrow-rs/pull/3557) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) +- Expose Inner FlightServiceClient on FlightSqlServiceClient \(\#3551\) [\#3556](https://github.com/apache/arrow-rs/pull/3556) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([tustvold](https://github.com/tustvold)) +- Fix final page row count in parquet-index binary [\#3554](https://github.com/apache/arrow-rs/pull/3554) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([tustvold](https://github.com/tustvold)) +- Parquet Avoid Reading 8 Byte Footer Twice from AsyncRead [\#3550](https://github.com/apache/arrow-rs/pull/3550) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([Sach1nAgarwal](https://github.com/Sach1nAgarwal)) +- Improve concat kernel capacity estimation [\#3546](https://github.com/apache/arrow-rs/pull/3546) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([tustvold](https://github.com/tustvold)) +- Update proc-macro2 requirement from =1.0.49 to =1.0.50 [\#3545](https://github.com/apache/arrow-rs/pull/3545) [[arrow-flight](https://github.com/apache/arrow-rs/labels/arrow-flight)] ([dependabot[bot]](https://github.com/apps/dependabot)) +- Update pyarrow method call to avoid warning [\#3544](https://github.com/apache/arrow-rs/pull/3544) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([Frankonly](https://github.com/Frankonly)) +- Enable casting between Utf8/LargeUtf8 and Binary/LargeBinary [\#3542](https://github.com/apache/arrow-rs/pull/3542) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) +- Use GHA concurrency groups \(\#3495\) [\#3538](https://github.com/apache/arrow-rs/pull/3538) ([tustvold](https://github.com/tustvold)) +- set sum of uncompressed column size as row group size for parquet files [\#3531](https://github.com/apache/arrow-rs/pull/3531) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([sidred](https://github.com/sidred)) +- Minor: Add documentation about memory use for ArrayData [\#3529](https://github.com/apache/arrow-rs/pull/3529) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([alamb](https://github.com/alamb)) +- Upgrade to clap 4.1 + fix test [\#3528](https://github.com/apache/arrow-rs/pull/3528) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([tustvold](https://github.com/tustvold)) +- Write backwards compatible row group statistics \(\#3526\) [\#3527](https://github.com/apache/arrow-rs/pull/3527) [[parquet](https://github.com/apache/arrow-rs/labels/parquet)] ([tustvold](https://github.com/tustvold)) +- No panic on timestamp buffer overflow [\#3519](https://github.com/apache/arrow-rs/pull/3519) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([comphead](https://github.com/comphead)) +- Support casting from binary to dictionary of binary [\#3482](https://github.com/apache/arrow-rs/pull/3482) [[arrow](https://github.com/apache/arrow-rs/labels/arrow)] ([viirya](https://github.com/viirya)) diff --git a/arrow-arith/Cargo.toml b/arrow-arith/Cargo.toml index 67f82c058..774bb11bb 100644 --- a/arrow-arith/Cargo.toml +++ b/arrow-arith/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-arith" -version = "31.0.0" +version = "32.0.0" description = "Arrow arithmetic kernels" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -38,10 +38,10 @@ path = "src/lib.rs" bench = false [dependencies] -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } chrono = { version = "0.4.23", default-features = false } half = { version = "2.1", default-features = false } num = { version = "0.4", default-features = false, features = ["std"] } diff --git a/arrow-array/Cargo.toml b/arrow-array/Cargo.toml index 155dcc412..c109db369 100644 --- a/arrow-array/Cargo.toml +++ b/arrow-array/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-array" -version = "31.0.0" +version = "32.0.0" description = "Array abstractions for Apache Arrow" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -45,9 +45,9 @@ ahash = { version = "0.8", default-features = false, features = ["compile-time-r ahash = { version = "0.8", default-features = false, features = ["runtime-rng"] } [dependencies] -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } chrono = { version = "0.4.23", default-features = false, features = ["clock"] } chrono-tz = { version = "0.8", optional = true } num = { version = "0.4", default-features = false, features = ["std"] } diff --git a/arrow-buffer/Cargo.toml b/arrow-buffer/Cargo.toml index bef5a7a8a..d46e2f11a 100644 --- a/arrow-buffer/Cargo.toml +++ b/arrow-buffer/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-buffer" -version = "31.0.0" +version = "32.0.0" description = "Buffer abstractions for Apache Arrow" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" diff --git a/arrow-cast/Cargo.toml b/arrow-cast/Cargo.toml index cab1edccc..2ce83e856 100644 --- a/arrow-cast/Cargo.toml +++ b/arrow-cast/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-cast" -version = "31.0.0" +version = "32.0.0" description = "Cast kernel and utilities for Apache Arrow" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -38,11 +38,11 @@ path = "src/lib.rs" bench = false [dependencies] -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } -arrow-select = { version = "31.0.0", path = "../arrow-select" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } +arrow-select = { version = "32.0.0", path = "../arrow-select" } chrono = { version = "0.4.23", default-features = false, features = ["clock"] } num = { version = "0.4", default-features = false, features = ["std"] } lexical-core = { version = "^0.8", default-features = false, features = ["write-integers", "write-floats", "parse-integers", "parse-floats"] } diff --git a/arrow-csv/Cargo.toml b/arrow-csv/Cargo.toml index 674e15907..517ffa33f 100644 --- a/arrow-csv/Cargo.toml +++ b/arrow-csv/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-csv" -version = "31.0.0" +version = "32.0.0" description = "Support for parsing CSV format into the Arrow format" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -38,11 +38,11 @@ path = "src/lib.rs" bench = false [dependencies] -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-cast = { version = "31.0.0", path = "../arrow-cast" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-cast = { version = "32.0.0", path = "../arrow-cast" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } chrono = { version = "0.4.23", default-features = false, features = ["clock"] } csv = { version = "1.1", default-features = false } csv-core = { version = "0.1"} diff --git a/arrow-data/Cargo.toml b/arrow-data/Cargo.toml index fc5839522..42e1f43bf 100644 --- a/arrow-data/Cargo.toml +++ b/arrow-data/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-data" -version = "31.0.0" +version = "32.0.0" description = "Array data abstractions for Apache Arrow" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -45,8 +45,8 @@ force_validate = [] [dependencies] -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } num = { version = "0.4", default-features = false, features = ["std"] } half = { version = "2.1", default-features = false } diff --git a/arrow-flight/Cargo.toml b/arrow-flight/Cargo.toml index bad94457b..e5a900a0d 100644 --- a/arrow-flight/Cargo.toml +++ b/arrow-flight/Cargo.toml @@ -18,7 +18,7 @@ [package] name = "arrow-flight" description = "Apache Arrow Flight" -version = "31.0.0" +version = "32.0.0" edition = "2021" rust-version = "1.62" authors = ["Apache Arrow <d...@arrow.apache.org>"] @@ -27,12 +27,12 @@ repository = "https://github.com/apache/arrow-rs" license = "Apache-2.0" [dependencies] -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } # Cast is needed to work around https://github.com/apache/arrow-rs/issues/3389 -arrow-cast = { version = "31.0.0", path = "../arrow-cast" } -arrow-ipc = { version = "31.0.0", path = "../arrow-ipc" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } +arrow-cast = { version = "32.0.0", path = "../arrow-cast" } +arrow-ipc = { version = "32.0.0", path = "../arrow-ipc" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } base64 = { version = "0.21", default-features = false, features = ["std"] } tonic = { version = "0.8", default-features = false, features = ["transport", "codegen", "prost"] } bytes = { version = "1", default-features = false } @@ -50,7 +50,7 @@ flight-sql-experimental = [] tls = ["tonic/tls"] [dev-dependencies] -arrow = { version = "31.0.0", path = "../arrow", features = ["prettyprint"] } +arrow = { version = "32.0.0", path = "../arrow", features = ["prettyprint"] } tempfile = "3.3" tokio-stream = { version = "0.1", features = ["net"] } tower = "0.4.13" diff --git a/arrow-flight/README.md b/arrow-flight/README.md index 5159d5499..cb543c956 100644 --- a/arrow-flight/README.md +++ b/arrow-flight/README.md @@ -27,7 +27,7 @@ Add this to your Cargo.toml: ```toml [dependencies] -arrow-flight = "31.0.0" +arrow-flight = "32.0.0" ``` Apache Arrow Flight is a gRPC based protocol for exchanging Arrow data between processes. See the blog post [Introducing Apache Arrow Flight: A Framework for Fast Data Transport](https://arrow.apache.org/blog/2019/10/13/introducing-arrow-flight/) for more information. diff --git a/arrow-integration-test/Cargo.toml b/arrow-integration-test/Cargo.toml index 6177c7b37..35b088b16 100644 --- a/arrow-integration-test/Cargo.toml +++ b/arrow-integration-test/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-integration-test" -version = "31.0.0" +version = "32.0.0" description = "Support for the Apache Arrow JSON test data format" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -38,8 +38,8 @@ path = "src/lib.rs" bench = false [dependencies] -arrow = { version = "31.0.0", path = "../arrow", default-features = false } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } +arrow = { version = "32.0.0", path = "../arrow", default-features = false } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } hex = { version = "0.4", default-features = false, features = ["std"] } serde = { version = "1.0", default-features = false, features = ["rc", "derive"] } serde_json = { version = "1.0", default-features = false, features = ["std"] } diff --git a/arrow-integration-testing/Cargo.toml b/arrow-integration-testing/Cargo.toml index 3f07da7d3..46b2bb369 100644 --- a/arrow-integration-testing/Cargo.toml +++ b/arrow-integration-testing/Cargo.toml @@ -18,7 +18,7 @@ [package] name = "arrow-integration-testing" description = "Binaries used in the Arrow integration tests (NOT PUBLISHED TO crates.io)" -version = "31.0.0" +version = "32.0.0" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" authors = ["Apache Arrow <d...@arrow.apache.org>"] diff --git a/arrow-ipc/Cargo.toml b/arrow-ipc/Cargo.toml index d2274e895..79b34a7b4 100644 --- a/arrow-ipc/Cargo.toml +++ b/arrow-ipc/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-ipc" -version = "31.0.0" +version = "32.0.0" description = "Support for the Arrow IPC format" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -38,11 +38,11 @@ path = "src/lib.rs" bench = false [dependencies] -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-cast = { version = "31.0.0", path = "../arrow-cast" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-cast = { version = "32.0.0", path = "../arrow-cast" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } flatbuffers = { version = "23.1.21", default-features = false } lz4 = { version = "1.23", default-features = false, optional = true } zstd = { version = "0.12.0", default-features = false, optional = true } diff --git a/arrow-json/Cargo.toml b/arrow-json/Cargo.toml index c6aa9b486..2a3a7ec17 100644 --- a/arrow-json/Cargo.toml +++ b/arrow-json/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-json" -version = "31.0.0" +version = "32.0.0" description = "Support for parsing JSON format into the Arrow format" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -38,11 +38,11 @@ path = "src/lib.rs" bench = false [dependencies] -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-cast = { version = "31.0.0", path = "../arrow-cast" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-cast = { version = "32.0.0", path = "../arrow-cast" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } half = { version = "2.1", default-features = false } indexmap = { version = "1.9", default-features = false, features = ["std"] } num = { version = "0.4", default-features = false, features = ["std"] } diff --git a/arrow-ord/Cargo.toml b/arrow-ord/Cargo.toml index a8f9fcdf8..b029c8b91 100644 --- a/arrow-ord/Cargo.toml +++ b/arrow-ord/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-ord" -version = "31.0.0" +version = "32.0.0" description = "Ordering kernels for arrow arrays" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -38,11 +38,11 @@ path = "src/lib.rs" bench = false [dependencies] -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } -arrow-select = { version = "31.0.0", path = "../arrow-select" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } +arrow-select = { version = "32.0.0", path = "../arrow-select" } num = { version = "0.4", default-features = false, features = ["std"] } [dev-dependencies] diff --git a/arrow-pyarrow-integration-testing/Cargo.toml b/arrow-pyarrow-integration-testing/Cargo.toml index 7a2dc563a..02a96cf68 100644 --- a/arrow-pyarrow-integration-testing/Cargo.toml +++ b/arrow-pyarrow-integration-testing/Cargo.toml @@ -18,7 +18,7 @@ [package] name = "arrow-pyarrow-integration-testing" description = "" -version = "31.0.0" +version = "32.0.0" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" authors = ["Apache Arrow <d...@arrow.apache.org>"] @@ -32,7 +32,7 @@ name = "arrow_pyarrow_integration_testing" crate-type = ["cdylib"] [dependencies] -arrow = { path = "../arrow", version = "31.0.0", features = ["pyarrow"] } +arrow = { path = "../arrow", version = "32.0.0", features = ["pyarrow"] } pyo3 = { version = "0.18", features = ["extension-module"] } [package.metadata.maturin] diff --git a/arrow-row/Cargo.toml b/arrow-row/Cargo.toml index 436f6d04b..f82e499cc 100644 --- a/arrow-row/Cargo.toml +++ b/arrow-row/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-row" -version = "31.0.0" +version = "32.0.0" description = "Arrow row format" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -44,17 +44,17 @@ ahash = { version = "0.8", default-features = false, features = ["compile-time-r ahash = { version = "0.8", default-features = false, features = ["runtime-rng"] } [dependencies] -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } half = { version = "2.1", default-features = false } hashbrown = { version = "0.13", default-features = false } [dev-dependencies] -arrow-cast = { version = "31.0.0", path = "../arrow-cast" } -arrow-ord = { version = "31.0.0", path = "../arrow-ord" } +arrow-cast = { version = "32.0.0", path = "../arrow-cast" } +arrow-ord = { version = "32.0.0", path = "../arrow-ord" } rand = { version = "0.8", default-features = false, features = ["std", "std_rng"] } [features] diff --git a/arrow-schema/Cargo.toml b/arrow-schema/Cargo.toml index 8ccf565bf..c36305b0b 100644 --- a/arrow-schema/Cargo.toml +++ b/arrow-schema/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-schema" -version = "31.0.0" +version = "32.0.0" description = "Defines the logical types for arrow arrays" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" diff --git a/arrow-select/Cargo.toml b/arrow-select/Cargo.toml index a1ba58900..8a8af0dbb 100644 --- a/arrow-select/Cargo.toml +++ b/arrow-select/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-select" -version = "31.0.0" +version = "32.0.0" description = "Selection kernels for arrow arrays" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -38,10 +38,10 @@ path = "src/lib.rs" bench = false [dependencies] -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } -arrow-array = { version = "31.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } num = { version = "0.4", default-features = false, features = ["std"] } [features] diff --git a/arrow-string/Cargo.toml b/arrow-string/Cargo.toml index f62ec919d..47740275c 100644 --- a/arrow-string/Cargo.toml +++ b/arrow-string/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow-string" -version = "31.0.0" +version = "32.0.0" description = "String kernels for arrow arrays" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -38,11 +38,11 @@ path = "src/lib.rs" bench = false [dependencies] -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-select = { version = "31.0.0", path = "../arrow-select" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-select = { version = "32.0.0", path = "../arrow-select" } regex = { version = "1.7.0", default-features = false, features = ["std", "unicode", "perf"] } regex-syntax = { version = "0.6.27", default-features = false, features = ["unicode"] } diff --git a/arrow/Cargo.toml b/arrow/Cargo.toml index bb67bfc40..6de513df3 100644 --- a/arrow/Cargo.toml +++ b/arrow/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "arrow" -version = "31.0.0" +version = "32.0.0" description = "Rust implementation of Apache Arrow" homepage = "https://github.com/apache/arrow-rs" repository = "https://github.com/apache/arrow-rs" @@ -45,19 +45,19 @@ ahash = { version = "0.8", default-features = false, features = ["compile-time-r ahash = { version = "0.8", default-features = false, features = ["runtime-rng"] } [dependencies] -arrow-arith = { version = "31.0.0", path = "../arrow-arith" } -arrow-array = { version = "31.0.0", path = "../arrow-array" } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer" } -arrow-cast = { version = "31.0.0", path = "../arrow-cast" } -arrow-csv = { version = "31.0.0", path = "../arrow-csv", optional = true } -arrow-data = { version = "31.0.0", path = "../arrow-data" } -arrow-ipc = { version = "31.0.0", path = "../arrow-ipc", optional = true } -arrow-json = { version = "31.0.0", path = "../arrow-json", optional = true } -arrow-ord = { version = "31.0.0", path = "../arrow-ord" } -arrow-row = { version = "31.0.0", path = "../arrow-row" } -arrow-schema = { version = "31.0.0", path = "../arrow-schema" } -arrow-select = { version = "31.0.0", path = "../arrow-select" } -arrow-string = { version = "31.0.0", path = "../arrow-string" } +arrow-arith = { version = "32.0.0", path = "../arrow-arith" } +arrow-array = { version = "32.0.0", path = "../arrow-array" } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer" } +arrow-cast = { version = "32.0.0", path = "../arrow-cast" } +arrow-csv = { version = "32.0.0", path = "../arrow-csv", optional = true } +arrow-data = { version = "32.0.0", path = "../arrow-data" } +arrow-ipc = { version = "32.0.0", path = "../arrow-ipc", optional = true } +arrow-json = { version = "32.0.0", path = "../arrow-json", optional = true } +arrow-ord = { version = "32.0.0", path = "../arrow-ord" } +arrow-row = { version = "32.0.0", path = "../arrow-row" } +arrow-schema = { version = "32.0.0", path = "../arrow-schema" } +arrow-select = { version = "32.0.0", path = "../arrow-select" } +arrow-string = { version = "32.0.0", path = "../arrow-string" } rand = { version = "0.8", default-features = false, features = ["std", "std_rng"], optional = true } comfy-table = { version = "6.0", optional = true, default-features = false } diff --git a/arrow/README.md b/arrow/README.md index d0c778582..68598078c 100644 --- a/arrow/README.md +++ b/arrow/README.md @@ -35,7 +35,7 @@ This crate is tested with the latest stable version of Rust. We do not currently The arrow crate follows the [SemVer standard](https://doc.rust-lang.org/cargo/reference/semver.html) defined by Cargo and works well within the Rust crate ecosystem. -However, for historical reasons, this crate uses versions with major numbers greater than `0.x` (e.g. `31.0.0`), unlike many other crates in the Rust ecosystem which spend extended time releasing versions `0.x` to signal planned ongoing API changes. Minor arrow releases contain only compatible changes, while major releases may contain breaking API changes. +However, for historical reasons, this crate uses versions with major numbers greater than `0.x` (e.g. `32.0.0`), unlike many other crates in the Rust ecosystem which spend extended time releasing versions `0.x` to signal planned ongoing API changes. Minor arrow releases contain only compatible changes, while major releases may contain breaking API changes. ## Feature Flags diff --git a/dev/release/README.md b/dev/release/README.md index 1fcc0862f..f86513822 100644 --- a/dev/release/README.md +++ b/dev/release/README.md @@ -70,7 +70,7 @@ git pull git checkout -b <RELEASE_BRANCH> # Update versions. Make sure to run it before the next step since we do not want CHANGELOG-old.md affected. -sed -i '' -e 's/14.0.0/31.0.0/g' `find . -name 'Cargo.toml' -or -name '*.md' | grep -v CHANGELOG.md` +sed -i '' -e 's/14.0.0/32.0.0/g' `find . -name 'Cargo.toml' -or -name '*.md' | grep -v CHANGELOG.md` git commit -a -m 'Update version' # Copy the content of CHANGELOG.md to the beginning of CHANGELOG-old.md diff --git a/dev/release/update_change_log.sh b/dev/release/update_change_log.sh index 236809ed5..2b8396347 100755 --- a/dev/release/update_change_log.sh +++ b/dev/release/update_change_log.sh @@ -25,12 +25,12 @@ # arrow-rs/.github_changelog_generator # # Usage: -# CHANGELOG_GITHUB_TOKEN=<TOKEN> ./update_change_log.sh +# ARROW_GITHUB_API_TOKEN=<TOKEN> ./update_change_log.sh set -e -SINCE_TAG="30.0.0" -FUTURE_RELEASE="31.0.0" +SINCE_TAG="31.0.0" +FUTURE_RELEASE="32.0.0" SOURCE_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" SOURCE_TOP_DIR="$(cd "${SOURCE_DIR}/../../" && pwd)" diff --git a/parquet/Cargo.toml b/parquet/Cargo.toml index 43bd52bee..a112ec354 100644 --- a/parquet/Cargo.toml +++ b/parquet/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "parquet" -version = "31.0.0" +version = "32.0.0" license = "Apache-2.0" description = "Apache Parquet implementation in Rust" homepage = "https://github.com/apache/arrow-rs" @@ -35,14 +35,14 @@ ahash = { version = "0.8", default-features = false, features = ["compile-time-r ahash = { version = "0.8", default-features = false, features = ["runtime-rng"] } [dependencies] -arrow-array = { version = "31.0.0", path = "../arrow-array", default-features = false, optional = true } -arrow-buffer = { version = "31.0.0", path = "../arrow-buffer", default-features = false, optional = true } -arrow-cast = { version = "31.0.0", path = "../arrow-cast", default-features = false, optional = true } -arrow-csv = { version = "31.0.0", path = "../arrow-csv", default-features = false, optional = true } -arrow-data = { version = "31.0.0", path = "../arrow-data", default-features = false, optional = true } -arrow-schema = { version = "31.0.0", path = "../arrow-schema", default-features = false, optional = true } -arrow-select = { version = "31.0.0", path = "../arrow-select", default-features = false, optional = true } -arrow-ipc = { version = "31.0.0", path = "../arrow-ipc", default-features = false, optional = true } +arrow-array = { version = "32.0.0", path = "../arrow-array", default-features = false, optional = true } +arrow-buffer = { version = "32.0.0", path = "../arrow-buffer", default-features = false, optional = true } +arrow-cast = { version = "32.0.0", path = "../arrow-cast", default-features = false, optional = true } +arrow-csv = { version = "32.0.0", path = "../arrow-csv", default-features = false, optional = true } +arrow-data = { version = "32.0.0", path = "../arrow-data", default-features = false, optional = true } +arrow-schema = { version = "32.0.0", path = "../arrow-schema", default-features = false, optional = true } +arrow-select = { version = "32.0.0", path = "../arrow-select", default-features = false, optional = true } +arrow-ipc = { version = "32.0.0", path = "../arrow-ipc", default-features = false, optional = true } object_store = { version = "0.5", path = "../object_store", default-features = false, optional = true } bytes = { version = "1.1", default-features = false, features = ["std"] } @@ -76,7 +76,7 @@ flate2 = { version = "1.0", default-features = false, features = ["rust_backend" lz4 = { version = "1.23", default-features = false } zstd = { version = "0.12", default-features = false } serde_json = { version = "1.0", features = ["std"], default-features = false } -arrow = { path = "../arrow", version = "31.0.0", default-features = false, features = ["ipc", "test_utils", "prettyprint", "json"] } +arrow = { path = "../arrow", version = "32.0.0", default-features = false, features = ["ipc", "test_utils", "prettyprint", "json"] } tokio = { version = "1.0", default-features = false, features = ["macros", "rt", "io-util", "fs"] } rand = { version = "0.8", default-features = false, features = ["std", "std_rng"] } diff --git a/parquet_derive/Cargo.toml b/parquet_derive/Cargo.toml index 8234d02d4..3fdcd66f2 100644 --- a/parquet_derive/Cargo.toml +++ b/parquet_derive/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "parquet_derive" -version = "31.0.0" +version = "32.0.0" license = "Apache-2.0" description = "Derive macros for the Rust implementation of Apache Parquet" homepage = "https://github.com/apache/arrow-rs" @@ -35,4 +35,4 @@ proc-macro = true proc-macro2 = { version = "1.0", default-features = false } quote = { version = "1.0", default-features = false } syn = { version = "1.0", features = ["extra-traits"] } -parquet = { path = "../parquet", version = "31.0.0", default-features = false } +parquet = { path = "../parquet", version = "32.0.0", default-features = false } diff --git a/parquet_derive/README.md b/parquet_derive/README.md index 72e2568e4..14d3c066c 100644 --- a/parquet_derive/README.md +++ b/parquet_derive/README.md @@ -32,8 +32,8 @@ Add this to your Cargo.toml: ```toml [dependencies] -parquet = "31.0.0" -parquet_derive = "31.0.0" +parquet = "32.0.0" +parquet_derive = "32.0.0" ``` and this to your crate root: diff --git a/parquet_derive_test/Cargo.toml b/parquet_derive_test/Cargo.toml index 47f5a54b3..e3306e7c4 100644 --- a/parquet_derive_test/Cargo.toml +++ b/parquet_derive_test/Cargo.toml @@ -17,7 +17,7 @@ [package] name = "parquet_derive_test" -version = "31.0.0" +version = "32.0.0" license = "Apache-2.0" description = "Integration test package for parquet-derive" homepage = "https://github.com/apache/arrow-rs" @@ -29,6 +29,6 @@ publish = false rust-version = "1.62" [dependencies] -parquet = { path = "../parquet", version = "31.0.0", default-features = false } -parquet_derive = { path = "../parquet_derive", version = "31.0.0", default-features = false } +parquet = { path = "../parquet", version = "32.0.0", default-features = false } +parquet_derive = { path = "../parquet_derive", version = "32.0.0", default-features = false } chrono = { version="0.4.23", default-features = false, features = [ "clock" ] }