This is an automated email from the ASF dual-hosted git repository.
tustvold pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
The following commit(s) were added to refs/heads/main by this push:
new 89a2ef8e06 Prepare object_store 0.12.0 (#7234)
89a2ef8e06 is described below
commit 89a2ef8e06088c29433c41a8d8f6f2a46ba8f399
Author: Raphael Taylor-Davies <[email protected]>
AuthorDate: Wed Mar 5 10:39:59 2025 +0000
Prepare object_store 0.12.0 (#7234)
* Prepare object_store 0.12.0
* Changelog tweaks
---
object_store/CHANGELOG-old.md | 36 +++++++++++++++
object_store/CHANGELOG.md | 63 ++++++++++++++++-----------
object_store/Cargo.toml | 2 +-
object_store/dev/release/update_change_log.sh | 4 +-
4 files changed, 76 insertions(+), 29 deletions(-)
diff --git a/object_store/CHANGELOG-old.md b/object_store/CHANGELOG-old.md
index c42689240d..f157e6f0a4 100644
--- a/object_store/CHANGELOG-old.md
+++ b/object_store/CHANGELOG-old.md
@@ -19,6 +19,42 @@
# Historical Changelog
+##
[object_store_0.11.2](https://github.com/apache/arrow-rs/tree/object_store_0.11.2)
(2024-12-20)
+
+[Full
Changelog](https://github.com/apache/arrow-rs/compare/object_store_0.11.1...object_store_0.11.2)
+
+**Implemented enhancements:**
+
+- object-store's AzureClient should protect against multiple streams
performing put\_block in parallel for the same BLOB path
[\#6868](https://github.com/apache/arrow-rs/issues/6868)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- Support S3 Put IfMatch
[\#6799](https://github.com/apache/arrow-rs/issues/6799)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- object\_store Azure Government using OAuth
[\#6759](https://github.com/apache/arrow-rs/issues/6759)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- Support for AWS Requester Pays buckets
[\#6716](https://github.com/apache/arrow-rs/issues/6716)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- \[object-store\]: Implement credential\_process support for S3
[\#6422](https://github.com/apache/arrow-rs/issues/6422)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- object\_store: Conditional put and rename\_if\_not\_exist on S3
[\#6285](https://github.com/apache/arrow-rs/issues/6285)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+
+**Fixed bugs:**
+
+- `object_store` errors when `reqwest` `gzip` feature is enabled
[\#6842](https://github.com/apache/arrow-rs/issues/6842)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- Multi-part s3 uploads fail when using checksum
[\#6793](https://github.com/apache/arrow-rs/issues/6793)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- `with_unsigned_payload` shouldn't generate payload hash
[\#6697](https://github.com/apache/arrow-rs/issues/6697)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- \[Object\_store\] min\_ttl is too high for GKE tokens
[\#6625](https://github.com/apache/arrow-rs/issues/6625)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- object\_store `test_private_bucket` fails - store: "S3", source:
BucketNotFound { bucket: "bloxbender" }
[\#6600](https://github.com/apache/arrow-rs/issues/6600)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- S3 endpoint and trailing slash result in weird/invalid requests
[\#6580](https://github.com/apache/arrow-rs/issues/6580)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+
+**Merged pull requests:**
+
+- Use randomized content ID for Azure multipart uploads
[\#6869](https://github.com/apache/arrow-rs/pull/6869)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([avarnon](https://github.com/avarnon))
+- Always explicitly disable `gzip` automatic decompression on reqwest client
used by object\_store [\#6843](https://github.com/apache/arrow-rs/pull/6843)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([phillipleblanc](https://github.com/phillipleblanc))
+- object-store: remove S3ConditionalPut::ETagPutIfNotExists
[\#6802](https://github.com/apache/arrow-rs/pull/6802)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([benesch](https://github.com/benesch))
+- Fix multipart uploads with checksums on object locked buckets
[\#6794](https://github.com/apache/arrow-rs/pull/6794)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([avantgardnerio](https://github.com/avantgardnerio))
+- Add AuthorityHost to AzureConfigKey
[\#6773](https://github.com/apache/arrow-rs/pull/6773)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([zadeluca](https://github.com/zadeluca))
+- object\_store: Add support for requester pays buckets
[\#6768](https://github.com/apache/arrow-rs/pull/6768)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([kylebarron](https://github.com/kylebarron))
+- check sign\_payload instead of skip\_signature before computing checksum
[\#6698](https://github.com/apache/arrow-rs/pull/6698)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([mherrerarendon](https://github.com/mherrerarendon))
+- Update quick-xml requirement from 0.36.0 to 0.37.0 in /object\_store
[\#6687](https://github.com/apache/arrow-rs/pull/6687)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([crepererum](https://github.com/crepererum))
+- Support native S3 conditional writes
[\#6682](https://github.com/apache/arrow-rs/pull/6682)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([benesch](https://github.com/benesch))
+- \[object\_store\] fix S3 endpoint and trailing slash result in invalid
requests [\#6641](https://github.com/apache/arrow-rs/pull/6641)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([adbmal](https://github.com/adbmal))
+- Lower GCP token min\_ttl to 4 minutes and add backoff to token refresh logic
[\#6638](https://github.com/apache/arrow-rs/pull/6638)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([mwylde](https://github.com/mwylde))
+- Remove `test_private_bucket` object\_store test
[\#6601](https://github.com/apache/arrow-rs/pull/6601)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([alamb](https://github.com/alamb))
##
[object_store_0.11.1](https://github.com/apache/arrow-rs/tree/object_store_0.11.1)
(2024-10-15)
diff --git a/object_store/CHANGELOG.md b/object_store/CHANGELOG.md
index 0e834c5e2e..6dd9d0f15e 100644
--- a/object_store/CHANGELOG.md
+++ b/object_store/CHANGELOG.md
@@ -19,42 +19,53 @@
# Changelog
-##
[object_store_0.11.2](https://github.com/apache/arrow-rs/tree/object_store_0.11.2)
(2024-12-20)
+##
[object_store_0.12.0](https://github.com/apache/arrow-rs/tree/object_store_0.12.0)
(2025-03-05)
-[Full
Changelog](https://github.com/apache/arrow-rs/compare/object_store_0.11.1...object_store_0.11.2)
+[Full
Changelog](https://github.com/apache/arrow-rs/compare/object_store_0.11.2...object_store_0.12.0)
+
+**Breaking changes:**
+
+- feat: add `Extensions` to object store `PutMultipartOpts`
[\#7214](https://github.com/apache/arrow-rs/pull/7214)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([crepererum](https://github.com/crepererum))
+- feat: add `Extensions` to object store `PutOptions`
[\#7213](https://github.com/apache/arrow-rs/pull/7213)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([crepererum](https://github.com/crepererum))
+- chore: enable conditional put by default for S3
[\#7181](https://github.com/apache/arrow-rs/pull/7181)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([meteorgan](https://github.com/meteorgan))
+- feat: add `Extensions` to object store `GetOptions`
[\#7170](https://github.com/apache/arrow-rs/pull/7170)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([crepererum](https://github.com/crepererum))
+- feat\(object\_store\): Override DNS Resolution to Randomize IP Selection
[\#7123](https://github.com/apache/arrow-rs/pull/7123)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([crepererum](https://github.com/crepererum))
+- Use `u64` range instead of `usize`, for better wasm32 support
[\#6961](https://github.com/apache/arrow-rs/pull/6961)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([XiangpengHao](https://github.com/XiangpengHao))
+- object\_store: Add enabled-by-default "fs" feature
[\#6636](https://github.com/apache/arrow-rs/pull/6636)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([Turbo87](https://github.com/Turbo87))
+- Return `BoxStream` with `'static` lifetime from `ObjectStore::list`
[\#6619](https://github.com/apache/arrow-rs/pull/6619)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([kylebarron](https://github.com/kylebarron))
+- object\_store: Migrate from snafu to thiserror
[\#6266](https://github.com/apache/arrow-rs/pull/6266)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([Turbo87](https://github.com/Turbo87))
**Implemented enhancements:**
-- object-store's AzureClient should protect against multiple streams
performing put\_block in parallel for the same BLOB path
[\#6868](https://github.com/apache/arrow-rs/issues/6868)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- Support S3 Put IfMatch
[\#6799](https://github.com/apache/arrow-rs/issues/6799)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- object\_store Azure Government using OAuth
[\#6759](https://github.com/apache/arrow-rs/issues/6759)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- Support for AWS Requester Pays buckets
[\#6716](https://github.com/apache/arrow-rs/issues/6716)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- \[object-store\]: Implement credential\_process support for S3
[\#6422](https://github.com/apache/arrow-rs/issues/6422)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- object\_store: Conditional put and rename\_if\_not\_exist on S3
[\#6285](https://github.com/apache/arrow-rs/issues/6285)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- Object Store: S3 IP address selection is biased
[\#7117](https://github.com/apache/arrow-rs/issues/7117)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- object\_store: GCSObjectStore should derive Clone
[\#7113](https://github.com/apache/arrow-rs/issues/7113)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- Remove all RCs after release
[\#7059](https://github.com/apache/arrow-rs/issues/7059)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- LocalFileSystem::list\_with\_offset is very slow over network file system
[\#7018](https://github.com/apache/arrow-rs/issues/7018)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- Release object store `0.11.2` \(non API breaking\) Around Dec 15 2024
[\#6902](https://github.com/apache/arrow-rs/issues/6902)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
**Fixed bugs:**
-- `object_store` errors when `reqwest` `gzip` feature is enabled
[\#6842](https://github.com/apache/arrow-rs/issues/6842)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- Multi-part s3 uploads fail when using checksum
[\#6793](https://github.com/apache/arrow-rs/issues/6793)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- `with_unsigned_payload` shouldn't generate payload hash
[\#6697](https://github.com/apache/arrow-rs/issues/6697)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- \[Object\_store\] min\_ttl is too high for GKE tokens
[\#6625](https://github.com/apache/arrow-rs/issues/6625)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- object\_store `test_private_bucket` fails - store: "S3", source:
BucketNotFound { bucket: "bloxbender" }
[\#6600](https://github.com/apache/arrow-rs/issues/6600)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
-- S3 endpoint and trailing slash result in weird/invalid requests
[\#6580](https://github.com/apache/arrow-rs/issues/6580)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
+- LocalFileSystem errors with satisfiable range request
[\#6749](https://github.com/apache/arrow-rs/issues/6749)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
**Merged pull requests:**
-- Use randomized content ID for Azure multipart uploads
[\#6869](https://github.com/apache/arrow-rs/pull/6869)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([avarnon](https://github.com/avarnon))
-- Always explicitly disable `gzip` automatic decompression on reqwest client
used by object\_store [\#6843](https://github.com/apache/arrow-rs/pull/6843)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([phillipleblanc](https://github.com/phillipleblanc))
-- object-store: remove S3ConditionalPut::ETagPutIfNotExists
[\#6802](https://github.com/apache/arrow-rs/pull/6802)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([benesch](https://github.com/benesch))
-- Fix multipart uploads with checksums on object locked buckets
[\#6794](https://github.com/apache/arrow-rs/pull/6794)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([avantgardnerio](https://github.com/avantgardnerio))
-- Add AuthorityHost to AzureConfigKey
[\#6773](https://github.com/apache/arrow-rs/pull/6773)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([zadeluca](https://github.com/zadeluca))
-- object\_store: Add support for requester pays buckets
[\#6768](https://github.com/apache/arrow-rs/pull/6768)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([kylebarron](https://github.com/kylebarron))
-- check sign\_payload instead of skip\_signature before computing checksum
[\#6698](https://github.com/apache/arrow-rs/pull/6698)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([mherrerarendon](https://github.com/mherrerarendon))
-- Update quick-xml requirement from 0.36.0 to 0.37.0 in /object\_store
[\#6687](https://github.com/apache/arrow-rs/pull/6687)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([crepererum](https://github.com/crepererum))
-- Support native S3 conditional writes
[\#6682](https://github.com/apache/arrow-rs/pull/6682)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([benesch](https://github.com/benesch))
-- \[object\_store\] fix S3 endpoint and trailing slash result in invalid
requests [\#6641](https://github.com/apache/arrow-rs/pull/6641)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([adbmal](https://github.com/adbmal))
-- Lower GCP token min\_ttl to 4 minutes and add backoff to token refresh logic
[\#6638](https://github.com/apache/arrow-rs/pull/6638)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([mwylde](https://github.com/mwylde))
-- Remove `test_private_bucket` object\_store test
[\#6601](https://github.com/apache/arrow-rs/pull/6601)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([alamb](https://github.com/alamb))
+- ObjectStore WASM32 Support
[\#7226](https://github.com/apache/arrow-rs/pull/7226)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([tustvold](https://github.com/tustvold))
+- \[main\] Bump arrow version to 54.2.1 \(\#7207\)
[\#7212](https://github.com/apache/arrow-rs/pull/7212)
([alamb](https://github.com/alamb))
+- Decouple ObjectStore from Reqwest
[\#7183](https://github.com/apache/arrow-rs/pull/7183)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([tustvold](https://github.com/tustvold))
+- object\_store: Disable all compression formats in HTTP reqwest client
[\#7143](https://github.com/apache/arrow-rs/pull/7143)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([kylewlacy](https://github.com/kylewlacy))
+- refactor: remove unused `async` from `InMemory::entry`
[\#7133](https://github.com/apache/arrow-rs/pull/7133)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([crepererum](https://github.com/crepererum))
+- object\_store/gcp: derive Clone for GoogleCloudStorage
[\#7112](https://github.com/apache/arrow-rs/pull/7112)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([james-rms](https://github.com/james-rms))
+- Update version to 54.2.0 and add CHANGELOG
[\#7110](https://github.com/apache/arrow-rs/pull/7110)
([alamb](https://github.com/alamb))
+- Remove all RCs after release
[\#7060](https://github.com/apache/arrow-rs/pull/7060)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([kou](https://github.com/kou))
+- Update release schedule README.md
[\#7053](https://github.com/apache/arrow-rs/pull/7053)
([alamb](https://github.com/alamb))
+- Create GitHub releases automatically on tagging
[\#7042](https://github.com/apache/arrow-rs/pull/7042)
([kou](https://github.com/kou))
+- Change Log On Succesful S3 Copy / Multipart Upload to Debug
[\#7033](https://github.com/apache/arrow-rs/pull/7033)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([diptanu](https://github.com/diptanu))
+- Prepare for `54.1.0` release
[\#7031](https://github.com/apache/arrow-rs/pull/7031)
([alamb](https://github.com/alamb))
+- Add a custom implementation `LocalFileSystem::list_with_offset`
[\#7019](https://github.com/apache/arrow-rs/pull/7019)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([corwinjoy](https://github.com/corwinjoy))
+- Improve docs for `AmazonS3Builder::from_env`
[\#6977](https://github.com/apache/arrow-rs/pull/6977)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([kylebarron](https://github.com/kylebarron))
+- Fix WASM CI for Rust 1.84 release
[\#6963](https://github.com/apache/arrow-rs/pull/6963)
([alamb](https://github.com/alamb))
+- Update itertools requirement from 0.13.0 to 0.14.0 in /object\_store
[\#6925](https://github.com/apache/arrow-rs/pull/6925)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([dependabot[bot]](https://github.com/apps/dependabot))
+- Fix LocalFileSystem with range request that ends beyond end of file
[\#6751](https://github.com/apache/arrow-rs/pull/6751)
[[object-store](https://github.com/apache/arrow-rs/labels/object-store)]
([kylebarron](https://github.com/kylebarron))
diff --git a/object_store/Cargo.toml b/object_store/Cargo.toml
index 0372514dba..0b40862c5c 100644
--- a/object_store/Cargo.toml
+++ b/object_store/Cargo.toml
@@ -17,7 +17,7 @@
[package]
name = "object_store"
-version = "0.11.2"
+version = "0.12.0"
edition = "2021"
license = "MIT/Apache-2.0"
readme = "README.md"
diff --git a/object_store/dev/release/update_change_log.sh
b/object_store/dev/release/update_change_log.sh
index 2797b62c00..f52c9f4e93 100755
--- a/object_store/dev/release/update_change_log.sh
+++ b/object_store/dev/release/update_change_log.sh
@@ -29,8 +29,8 @@
set -e
-SINCE_TAG="object_store_0.11.1"
-FUTURE_RELEASE="object_store_0.11.2"
+SINCE_TAG="object_store_0.11.2"
+FUTURE_RELEASE="object_store_0.12.0"
SOURCE_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
SOURCE_TOP_DIR="$(cd "${SOURCE_DIR}/../../" && pwd)"
