alamb commented on code in PR #765: URL: https://github.com/apache/arrow-rs-object-store/pull/765#discussion_r3437776407
########## CHANGELOG.md: ########## @@ -19,75 +19,96 @@ # Changelog -## [v0.13.2](https://github.com/apache/arrow-rs-object-store/tree/v0.13.2) (2026-03-19) +## [v0.13.2](https://github.com/apache/arrow-rs-object-store/tree/v0.13.2) (2026-06-18) -[Full Changelog](https://github.com/apache/arrow-rs-object-store/compare/v0.12.5...v0.13.2) +[Full Changelog](https://github.com/apache/arrow-rs-object-store/compare/v0.13.2...v0.13.2) -**Implemented enhancements:** +**Breaking changes:** -- `Path::join(Self, &PathPart) -> Self` [\#665](https://github.com/apache/arrow-rs-object-store/issues/665) -- Support for AWS Encryption Client encryption [\#647](https://github.com/apache/arrow-rs-object-store/issues/647) -- `LocalFileSystem`: use `read_at` instead of seek + read [\#622](https://github.com/apache/arrow-rs-object-store/issues/622) -- Avoid reading metadata for `LocalFileSystem::read_ranges` \(and other methods\) [\#614](https://github.com/apache/arrow-rs-object-store/issues/614) -- expose `Inner` from `HttpRequestBody` [\#606](https://github.com/apache/arrow-rs-object-store/issues/606) -- Release object store `0.13.1` \(maintenance\) - Target Jan 2026 [\#598](https://github.com/apache/arrow-rs-object-store/issues/598) -- Support AWS\_ENDPOINT\_URL\_S3 in aws backend [\#589](https://github.com/apache/arrow-rs-object-store/issues/589) -- Release object store `0.12.5` \(maintenance\) - Target Dec 2025 [\#582](https://github.com/apache/arrow-rs-object-store/issues/582) -- Support upper-case configuration options in parse\_url\_opts [\#529](https://github.com/apache/arrow-rs-object-store/issues/529) -- object\_store: Support `{az,abfs,abfss}://[email protected].{core.windows.net,fabric.microsoft.com}` URLs [\#430](https://github.com/apache/arrow-rs-object-store/issues/430) -- Support `Transfer-Encoding: chunked` responses in HttpStore [\#340](https://github.com/apache/arrow-rs-object-store/issues/340) -- Use reconstructed ListBlobs marker to provide list offset support in `MicrosoftAzure` store [\#461](https://github.com/apache/arrow-rs-object-store/issues/461) +- Add `Extensions` in `*Result` objects [\#743](https://github.com/apache/arrow-rs-object-store/pull/743) ([criccomini](https://github.com/criccomini)) +- Make `reqwest` optional [\#724](https://github.com/apache/arrow-rs-object-store/pull/724) ([awesterb](https://github.com/awesterb)) +- Pluggable Crypto / Update reqwest 0.13 [\#707](https://github.com/apache/arrow-rs-object-store/pull/707) ([goffrie](https://github.com/goffrie)) +- Add CRC64NVME checksum support [\#633](https://github.com/apache/arrow-rs-object-store/pull/633) ([kdn36](https://github.com/kdn36)) -**Fixed bugs:** +**Implemented enhancements:** -- Azure Fabric: Unsigned integer underflow when fetching token causes integer overflow panic [\#640](https://github.com/apache/arrow-rs-object-store/issues/640) -- Error body missing for 5xx errors after retry exhausted [\#617](https://github.com/apache/arrow-rs-object-store/issues/617) -- Heavy contention on credentials cache [\#541](https://github.com/apache/arrow-rs-object-store/issues/541) -- AWS/S3 Default Headers are not considered for signature calculation [\#484](https://github.com/apache/arrow-rs-object-store/issues/484) -- az:// \<container\> not work as expected [\#443](https://github.com/apache/arrow-rs-object-store/issues/443) +- Support PutMultipartOptions for MultipartStore::create\_multipart [\#745](https://github.com/apache/arrow-rs-object-store/issues/745) +- Supporting CPKs for Azure Blob Requests [\#741](https://github.com/apache/arrow-rs-object-store/issues/741) +- Support `Extensions` in `*Result` objects [\#740](https://github.com/apache/arrow-rs-object-store/issues/740) +- Implement `Signer` on `PrefixStore` [\#738](https://github.com/apache/arrow-rs-object-store/issues/738) +- Make `reqwest` optional [\#723](https://github.com/apache/arrow-rs-object-store/issues/723) +- Expose azure::split\_sas for custom SAS credential providers [\#720](https://github.com/apache/arrow-rs-object-store/issues/720) +- GCS: support bearer-token auth in parse\_url\_opts without bypassing default option handling [\#716](https://github.com/apache/arrow-rs-object-store/issues/716) +- Custom credentials for signing cannot be provided to GCP stores [\#698](https://github.com/apache/arrow-rs-object-store/issues/698) +- Read timeouts are not supported [\#680](https://github.com/apache/arrow-rs-object-store/issues/680) +- AWS\_REQUEST\_PAYER="requester" vs Boolean [\#668](https://github.com/apache/arrow-rs-object-store/issues/668) +- Reliable file writes for LocalFileSystem: explicit close error checking and opt-in sync [\#661](https://github.com/apache/arrow-rs-object-store/issues/661) +- infer `use_fabric_endpoint` based on URI containing "dfs.fabric.microsoft.com" [\#658](https://github.com/apache/arrow-rs-object-store/issues/658) +- Support CRC checksum [\#611](https://github.com/apache/arrow-rs-object-store/issues/611) +- Change crypto provider from ring to aws-rust-lc [\#413](https://github.com/apache/arrow-rs-object-store/issues/413) -**Performance improvements:** +**Fixed bugs:** -- Preallocate single `Vec` in `get_ranges` for LocalFilesystem [\#634](https://github.com/apache/arrow-rs-object-store/issues/634) -- Use platform specific `read_at` when available [\#628](https://github.com/apache/arrow-rs-object-store/pull/628) ([AdamGS](https://github.com/AdamGS)) -- Avoid metadata lookup for `LocalFileSystem::read_ranges` and `chunked_stream` [\#621](https://github.com/apache/arrow-rs-object-store/pull/621) ([Dandandan](https://github.com/Dandandan)) +- `resolve_bucket_region` fails TLS handshake for bucket names containing dots [\#747](https://github.com/apache/arrow-rs-object-store/issues/747) +- Extensions not passed in `BufWriter` single put case [\#735](https://github.com/apache/arrow-rs-object-store/issues/735) +- GoogleCloudStorage::copy overwrite semantics are flipped. [\#712](https://github.com/apache/arrow-rs-object-store/issues/712) +- BUG: in-memory storage loss part on upload [\#682](https://github.com/apache/arrow-rs-object-store/issues/682) +- PrefixStore::head doesn't strip prefix from meta.location [\#664](https://github.com/apache/arrow-rs-object-store/issues/664) +- Invalid range in read with `get` from object\_store [\#654](https://github.com/apache/arrow-rs-object-store/issues/654) +- newline\_delimited\_stream incorrect processing `Generic { store: "LineDelimiter", source: UnterminatedString }` on valid CSVs \(impacts datafusion\) [\#650](https://github.com/apache/arrow-rs-object-store/issues/650) +- When the backend service returns an HTTP 500, the object store panics [\#414](https://github.com/apache/arrow-rs-object-store/issues/414) +- Object store failing during bulk delete in S3 [\#277](https://github.com/apache/arrow-rs-object-store/issues/277) **Closed issues:** -- \[Security Alert\] Exposed API key\(s\) detected: AWS Access Key [\#659](https://github.com/apache/arrow-rs-object-store/issues/659) -- AWS S3 token expired on multi-threaded app with Arc usage [\#655](https://github.com/apache/arrow-rs-object-store/issues/655) -- Emulator tests fail in CI due to an unsupported service version header in Azurite [\#626](https://github.com/apache/arrow-rs-object-store/issues/626) +- Document new feature flag system [\#749](https://github.com/apache/arrow-rs-object-store/issues/749) +- Add CI check to ensure reqwest is not accidentally added [\#748](https://github.com/apache/arrow-rs-object-store/issues/748) +- Discuss feature naming for optional transport and crypto support [\#744](https://github.com/apache/arrow-rs-object-store/issues/744) +- S3: delete\(\) now requires DeleteObjects \(bulk delete\) support, breaks S3-compatible providers \(Alibaba Cloud OSS, etc.\) [\#731](https://github.com/apache/arrow-rs-object-store/issues/731) +- use `startFrom` when listing blobs from OneLake endpoints [\#697](https://github.com/apache/arrow-rs-object-store/issues/697) +- MicrosoftAzure::list\_with\_offset returns empty on OneLake since 0.13.0 \(regression from \#623\) [\#695](https://github.com/apache/arrow-rs-object-store/issues/695) +- Release object store 0.14.0 \(breaking API changes\), target May 2026 [\#673](https://github.com/apache/arrow-rs-object-store/issues/673) +- Release object store 0.13.3 \(non-breaking API changes\), Target May 2026 [\#672](https://github.com/apache/arrow-rs-object-store/issues/672) **Merged pull requests:** -- Replace `Path::child` with `Path::join` [\#666](https://github.com/apache/arrow-rs-object-store/pull/666) ([Kinrany](https://github.com/Kinrany)) -- Support --xa-s3 suffix for S3 Express One Zone bucket access points [\#663](https://github.com/apache/arrow-rs-object-store/pull/663) ([pdeva](https://github.com/pdeva)) -- docs: clarify `Clone` behavior [\#656](https://github.com/apache/arrow-rs-object-store/pull/656) ([crepererum](https://github.com/crepererum)) -- Implement Clone for local and memory stores [\#653](https://github.com/apache/arrow-rs-object-store/pull/653) ([DoumanAsh](https://github.com/DoumanAsh)) -- Unify `from_env` behaviours [\#652](https://github.com/apache/arrow-rs-object-store/pull/652) ([miraclx](https://github.com/miraclx)) -- docs: add examples to the aws docs where appropriate [\#651](https://github.com/apache/arrow-rs-object-store/pull/651) ([CommanderStorm](https://github.com/CommanderStorm)) -- Switch TokenCache to RWLock [\#648](https://github.com/apache/arrow-rs-object-store/pull/648) ([tustvold](https://github.com/tustvold)) -- Minimize futures dependency into relevant sub-crates [\#646](https://github.com/apache/arrow-rs-object-store/pull/646) ([AdamGS](https://github.com/AdamGS)) -- Clarify ShuffleResolver doc-comments [\#645](https://github.com/apache/arrow-rs-object-store/pull/645) ([jkosh44](https://github.com/jkosh44)) -- Introduce a "tokio" to allow pulling a trait-only build [\#644](https://github.com/apache/arrow-rs-object-store/pull/644) ([AdamGS](https://github.com/AdamGS)) -- fix\(azure\): fix integer overflow in Fabric token expiry check [\#641](https://github.com/apache/arrow-rs-object-store/pull/641) ([desmondcheongzx](https://github.com/desmondcheongzx)) -- chore: upgrade to `rand` 0.10 [\#637](https://github.com/apache/arrow-rs-object-store/pull/637) ([crepererum](https://github.com/crepererum)) -- fix\(aws\): Include default headers in signature calculation \(\#484\) [\#636](https://github.com/apache/arrow-rs-object-store/pull/636) ([singhsaabir](https://github.com/singhsaabir)) -- fix\(azure\): correct Microsoft Fabric blob endpoint domain [\#631](https://github.com/apache/arrow-rs-object-store/pull/631) ([kevinjqliu](https://github.com/kevinjqliu)) -- Unblock emulator based tests [\#627](https://github.com/apache/arrow-rs-object-store/pull/627) ([AdamGS](https://github.com/AdamGS)) -- Azure ADLS list\_with\_offset support [\#623](https://github.com/apache/arrow-rs-object-store/pull/623) ([omar](https://github.com/omar)) -- Implement tests for range and partial content responses [\#619](https://github.com/apache/arrow-rs-object-store/pull/619) ([vitoordaz](https://github.com/vitoordaz)) -- fix: missing 5xx error body when retry exhausted [\#618](https://github.com/apache/arrow-rs-object-store/pull/618) ([jackye1995](https://github.com/jackye1995)) -- build\(deps\): update nix requirement from 0.30.0 to 0.31.1 [\#616](https://github.com/apache/arrow-rs-object-store/pull/616) ([dependabot[bot]](https://github.com/apps/dependabot)) -- Clarify behavior of `parse_url_opts` with regards to case sensitivity [\#613](https://github.com/apache/arrow-rs-object-store/pull/613) ([AdamGS](https://github.com/AdamGS)) -- Fix logical format conflict [\#605](https://github.com/apache/arrow-rs-object-store/pull/605) ([tustvold](https://github.com/tustvold)) -- Fix Azure URL parsing [\#604](https://github.com/apache/arrow-rs-object-store/pull/604) ([tustvold](https://github.com/tustvold)) -- build\(deps\): update quick-xml requirement from 0.38.0 to 0.39.0 [\#602](https://github.com/apache/arrow-rs-object-store/pull/602) ([dependabot[bot]](https://github.com/apps/dependabot)) -- Only read file metadata once in `LocalFileSystem::read_ranges` [\#595](https://github.com/apache/arrow-rs-object-store/pull/595) ([AdamGS](https://github.com/AdamGS)) -- feat: Add support for AWS\_ENDPOINT\_URL\_S3 environment variable [\#590](https://github.com/apache/arrow-rs-object-store/pull/590) ([rajatgoel](https://github.com/rajatgoel)) -- feat: impl MultipartStore for PrefixStore [\#587](https://github.com/apache/arrow-rs-object-store/pull/587) ([ddupg](https://github.com/ddupg)) -- Implement typos-cli [\#570](https://github.com/apache/arrow-rs-object-store/pull/570) ([jayvdb](https://github.com/jayvdb)) -- feat \(azure\): support for '.blob.core.windows.net' in "az://" scheme [\#431](https://github.com/apache/arrow-rs-object-store/pull/431) ([vladidobro](https://github.com/vladidobro)) +- Clarify aws-lc-rs feature docs and fix CI comment URL [\#764](https://github.com/apache/arrow-rs-object-store/pull/764) ([alamb](https://github.com/alamb)) +- fix\(local\): fsync create-mode rename source delete [\#758](https://github.com/apache/arrow-rs-object-store/pull/758) ([kevinjqliu](https://github.com/kevinjqliu)) +- Fix flaky local close-file tests [\#757](https://github.com/apache/arrow-rs-object-store/pull/757) ([kevinjqliu](https://github.com/kevinjqliu)) +- build\(deps\): update itertools requirement from 0.14.0 to 0.15.0 [\#755](https://github.com/apache/arrow-rs-object-store/pull/755) ([dependabot[bot]](https://github.com/apps/dependabot)) +- Support PutMultipartOptions for MultipartStore::create\_multipart for AWS/GCP. [\#754](https://github.com/apache/arrow-rs-object-store/pull/754) ([BearMinimum98](https://github.com/BearMinimum98)) +- Use path-style URL in `resolve_bucket_region` for dotted bucket names [\#752](https://github.com/apache/arrow-rs-object-store/pull/752) ([brankogrb-db](https://github.com/brankogrb-db)) +- refactor!: remove `cloud` feature alias [\#751](https://github.com/apache/arrow-rs-object-store/pull/751) ([kevinjqliu](https://github.com/kevinjqliu)) Review Comment: You are right. While the existing docs https://docs.rs/object_store/0.13.2/object_store/#available-objectstore-implementations didn't list `cloud` The code actually has it: https://github.com/apache/arrow-rs-object-store/blob/7a65b75b0d26fd8a282999462cb7030fb85fdcc3/Cargo.toml#L78 I will add the tag -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
