dependabot[bot] opened a new pull request, #1255: URL: https://github.com/apache/datafusion-python/pull/1255
Bumps [arrow](https://github.com/apache/arrow-rs) from 56.1.0 to 56.2.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/releases";>arrow's releases</a>.</em></p> <blockquote> <h2>arrow 56.2.0</h2> <!-- raw HTML omitted --> <h1>Changelog</h1> <h2><a href="https://github.com/apache/arrow-rs/tree/56.2.0";>56.2.0</a> (2025-09-19)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/56.1.0...56.2.0";>Full Changelog</a></p> <p><strong>Implemented enhancements:</strong></p> <ul> <li>[Variant] Add variant to arrow primitives for unsigned integers <a href="https://redirect.github.com/apache/arrow-rs/issues/8368";>#8368</a></li> <li>[Variant] [Shredding] Support typed_access for <code>FixedSizeBinary</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8335";>#8335</a></li> <li>[Variant] [Shredding] Support typed_access for <code>Utf8</code> and <code>BinaryView</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8333";>#8333</a></li> <li>[Variant] [Shredding] Support typed_access for <code>Boolean</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8329";>#8329</a></li> <li>Allow specifying projection in ParquetRecordBatchReader::try_new_with_row_groups <a href="https://redirect.github.com/apache/arrow-rs/issues/8326";>#8326</a></li> <li>[Parquet] Expose predicates from RowFilter <a href="https://redirect.github.com/apache/arrow-rs/issues/8314";>#8314</a></li> <li>[Variant] Use row-oriented builders in <code>cast_to_variant</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8310";>#8310</a></li> <li>Use apache/arrow-dotnet for integration test <a href="https://redirect.github.com/apache/arrow-rs/issues/8294";>#8294</a></li> <li>[Variant] Add <code>Vairant::as_u*</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8283";>#8283</a></li> <li>Add a way to modify WriterProperties <a href="https://redirect.github.com/apache/arrow-rs/issues/8273";>#8273</a></li> <li>Dont truncate timestamps on display for Row <a href="https://redirect.github.com/apache/arrow-rs/issues/8265";>#8265</a></li> <li>[Parquet] Add row group write with AsyncArrowWriter <a href="https://redirect.github.com/apache/arrow-rs/issues/8261";>#8261</a></li> <li>[Parquet] Expose ArrowRowGroupWriter <a href="https://redirect.github.com/apache/arrow-rs/issues/8259";>#8259</a></li> <li>[Parquet] Do not compress v2 data page when compress is bad quality <a href="https://redirect.github.com/apache/arrow-rs/issues/8256";>#8256</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[Variant] Refactor <code>cast_to_variant</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8234";>#8234</a></li> <li>[Variant]: Implement <code>DataType::Union</code> support for <code>cast_to_variant</code> kernel <a href="https://redirect.github.com/apache/arrow-rs/issues/8195";>#8195</a></li> <li>[Variant]: Implement <code>DataType::Duration</code> support for <code>cast_to_variant</code> kernel <a href="https://redirect.github.com/apache/arrow-rs/issues/8194";>#8194</a></li> <li>[Variant] Support typed access for numeric types in variant_get <a href="https://redirect.github.com/apache/arrow-rs/issues/8178";>#8178</a></li> <li>[Parquet] Implement a "push style" API for decoding Parquet Metadata <a href="https://redirect.github.com/apache/arrow-rs/issues/8164";>#8164</a></li> <li>[Variant] Support creating Variants with pre-existing Metadata <a href="https://redirect.github.com/apache/arrow-rs/issues/8152";>#8152</a></li> <li>[Variant] Support Shredded Objects in <code>variant_get</code>: typed path access (STEP 1) <a href="https://redirect.github.com/apache/arrow-rs/issues/8150";>#8150</a></li> <li>[Variant] Add <code>variant</code> feature to <code>parquet</code> crate <a href="https://redirect.github.com/apache/arrow-rs/issues/8132";>#8132</a></li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/arrow-rs/blob/main/CHANGELOG.md";>arrow's changelog</a>.</em></p> <blockquote> <h2><a href="https://github.com/apache/arrow-rs/tree/56.2.0";>56.2.0</a> (2025-09-19)</h2> <p><a href="https://github.com/apache/arrow-rs/compare/56.1.0...56.2.0";>Full Changelog</a></p> <p><strong>Implemented enhancements:</strong></p> <ul> <li>[Variant] Add variant to arrow primitives for unsigned integers <a href="https://redirect.github.com/apache/arrow-rs/issues/8368";>#8368</a></li> <li>[Variant] [Shredding] Support typed_access for <code>FixedSizeBinary</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8335";>#8335</a></li> <li>[Variant] [Shredding] Support typed_access for <code>Utf8</code> and <code>BinaryView</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8333";>#8333</a></li> <li>[Variant] [Shredding] Support typed_access for <code>Boolean</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8329";>#8329</a></li> <li>Allow specifying projection in ParquetRecordBatchReader::try_new_with_row_groups <a href="https://redirect.github.com/apache/arrow-rs/issues/8326";>#8326</a></li> <li>[Parquet] Expose predicates from RowFilter <a href="https://redirect.github.com/apache/arrow-rs/issues/8314";>#8314</a></li> <li>[Variant] Use row-oriented builders in <code>cast_to_variant</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8310";>#8310</a></li> <li>Use apache/arrow-dotnet for integration test <a href="https://redirect.github.com/apache/arrow-rs/issues/8294";>#8294</a></li> <li>[Variant] Add <code>Vairant::as_u*</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8283";>#8283</a></li> <li>Add a way to modify WriterProperties <a href="https://redirect.github.com/apache/arrow-rs/issues/8273";>#8273</a></li> <li>Dont truncate timestamps on display for Row <a href="https://redirect.github.com/apache/arrow-rs/issues/8265";>#8265</a></li> <li>[Parquet] Add row group write with AsyncArrowWriter <a href="https://redirect.github.com/apache/arrow-rs/issues/8261";>#8261</a></li> <li>[Parquet] Expose ArrowRowGroupWriter <a href="https://redirect.github.com/apache/arrow-rs/issues/8259";>#8259</a></li> <li>[Parquet] Do not compress v2 data page when compress is bad quality <a href="https://redirect.github.com/apache/arrow-rs/issues/8256";>#8256</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[Variant] Refactor <code>cast_to_variant</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8234";>#8234</a></li> <li>[Variant]: Implement <code>DataType::Union</code> support for <code>cast_to_variant</code> kernel <a href="https://redirect.github.com/apache/arrow-rs/issues/8195";>#8195</a></li> <li>[Variant]: Implement <code>DataType::Duration</code> support for <code>cast_to_variant</code> kernel <a href="https://redirect.github.com/apache/arrow-rs/issues/8194";>#8194</a></li> <li>[Variant] Support typed access for numeric types in variant_get <a href="https://redirect.github.com/apache/arrow-rs/issues/8178";>#8178</a></li> <li>[Parquet] Implement a "push style" API for decoding Parquet Metadata <a href="https://redirect.github.com/apache/arrow-rs/issues/8164";>#8164</a></li> <li>[Variant] Support creating Variants with pre-existing Metadata <a href="https://redirect.github.com/apache/arrow-rs/issues/8152";>#8152</a></li> <li>[Variant] Support Shredded Objects in <code>variant_get</code>: typed path access (STEP 1) <a href="https://redirect.github.com/apache/arrow-rs/issues/8150";>#8150</a></li> <li>[Variant] Add <code>variant</code> feature to <code>parquet</code> crate <a href="https://redirect.github.com/apache/arrow-rs/issues/8132";>#8132</a></li> <li>[Parquet] Concurrent writes with ArrowWriter.get_column_writers should parallelize across row groups <a href="https://redirect.github.com/apache/arrow-rs/issues/8115";>#8115</a></li> <li>[Variant] Implement <code>VariantArray::value</code> for shredded variants <a href="https://redirect.github.com/apache/arrow-rs/issues/8091";>#8091</a></li> <li>[Variant] Integration tests for reading parquet w/ Variants <a href="https://redirect.github.com/apache/arrow-rs/issues/8084";>#8084</a></li> <li>[Variant]: Implement <code>DataType::Map</code> support for <code>cast_to_variant</code> kernel <a href="https://redirect.github.com/apache/arrow-rs/issues/8063";>#8063</a></li> <li>[Variant]: Implement <code>DataType::List/LargeList</code> support for <code>cast_to_variant</code> kernel <a href="https://redirect.github.com/apache/arrow-rs/issues/8060";>#8060</a></li> </ul> <p><strong>Fixed bugs:</strong></p> <ul> <li>Casting floating point numbers fails for Decimal64 but works for other variants <a href="https://redirect.github.com/apache/arrow-rs/issues/8362";>#8362</a></li> <li>[Variant] cast_to_variant conflates empty map with NULL <a href="https://redirect.github.com/apache/arrow-rs/issues/8289";>#8289</a></li> <li>[Avro] Decoder flush panics for map whose value field contains metadata <a href="https://redirect.github.com/apache/arrow-rs/issues/8270";>#8270</a></li> <li>Parquet: Avoid page size exceeds i32::MAX <a href="https://redirect.github.com/apache/arrow-rs/issues/8263";>#8263</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>]</li> <li>[Avro] Decoder panics on flush when schema contains map whose value is non-nullable <a href="https://redirect.github.com/apache/arrow-rs/issues/8253";>#8253</a></li> <li>Avro nullable field decode failure leads to panic upon decoder flush <a href="https://redirect.github.com/apache/arrow-rs/issues/8212";>#8212</a></li> <li>Avro to arrow schema conversion fails when a field has a default type that is not string <a href="https://redirect.github.com/apache/arrow-rs/issues/8209";>#8209</a></li> <li>parquet: No method named <code>to_ne_bytes</code> found for struct <code>bloom_filter::Block</code> for target <code>s390x-unknown-linux-gnu</code> <a href="https://redirect.github.com/apache/arrow-rs/issues/8207";>#8207</a></li> <li>[Variant] cast_to_variant will panic on certain <code>Date64</code> or Timestamp Values values <a href="https://redirect.github.com/apache/arrow-rs/issues/8155";>#8155</a></li> <li>Parquet: Avoid page-size overflows i32 <a href="https://redirect.github.com/apache/arrow-rs/pull/8264";>#8264</a> [<a href="https://github.com/apache/arrow-rs/labels/parquet";>parquet</a>] (<a href="https://github.com/mapleFU";>mapleFU</a>)</li> </ul> <p><strong>Documentation updates:</strong></p> <ul> <li>Update docstring comment for Writer::write() in writer.rs <a href="https://redirect.github.com/apache/arrow-rs/pull/8267";>#8267</a> [<a href="https://github.com/apache/arrow-rs/labels/arrow";>arrow</a>] (<a href="https://github.com/YKoustubhRao";>YKoustubhRao</a>)</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/arrow-rs/commit/ae8e6c631abf6587ebffae7f87174f60af621855";><code>ae8e6c6</code></a> Update version to <code>56.2.0</code>, add changelog (<a href="https://redirect.github.com/apache/arrow-rs/issues/8372";>#8372</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/322745de67737482fde169d3ed2bf6139d2b0041";><code>322745d</code></a> Enable parallel writing across row groups when writing encrypted parquet (<a href="https://redirect.github.com/apache/arrow-rs/issues/8162";>#8162</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/f4840f6df1c2549ce0947305b7111edad638b445";><code>f4840f6</code></a> [Variant] Implement new VariantValueArrayBuilder (<a href="https://redirect.github.com/apache/arrow-rs/issues/8360";>#8360</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/aed2f3b6a72375acb06cf958c9e3ff3c6ecb760f";><code>aed2f3b</code></a> Add arrow-avro Reader support for Dense Union and Union resolution (Part 1) (...</li> <li><a href="https://github.com/apache/arrow-rs/commit/1f77ac51c760108ec6263c30666d6581955da336";><code>1f77ac5</code></a> [Variant] Support Variant to PrimitiveArrow for unsigned integer (<a href="https://redirect.github.com/apache/arrow-rs/issues/8369";>#8369</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/d6f40ce62b824af467acedc4da57fd6d22864a86";><code>d6f40ce</code></a> [Variant] Allow lossless casting from integer to floating point (<a href="https://redirect.github.com/apache/arrow-rs/issues/8357";>#8357</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/d74d9baff62ad5a61d50f6b13577274e0356aa90";><code>d74d9ba</code></a> Adds Map & Enum support, round-trip & benchmark tests (<a href="https://redirect.github.com/apache/arrow-rs/issues/8353";>#8353</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/b06996bb77ff51ddbb1a07c5d6d64fe9a0f5505c";><code>b06996b</code></a> [Variant] [Shredding] Support typed_access for Utf8 and BinaryView (<a href="https://redirect.github.com/apache/arrow-rs/issues/8364";>#8364</a>)</li> <li><a href="https://github.com/apache/arrow-rs/commit/2ec77b548d9242bc85ca36f04761d116ceab8963";><code>2ec77b5</code></a> Update <code>variant_integration</code> test to use final approved <code>parquet-testing</code> dat...</li> <li><a href="https://github.com/apache/arrow-rs/commit/769643206fa230a41d60cf3a9044a073b91f431e";><code>7696432</code></a> Fix casting floats to Decimal64 (<a href="https://redirect.github.com/apache/arrow-rs/issues/8363";>#8363</a>)</li> <li>Additional commits viewable in <a href="https://github.com/apache/arrow-rs/compare/56.1.0...56.2.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
