dependabot[bot] opened a new pull request, #20640: URL: https://github.com/apache/druid/pull/20640
Bumps `delta-kernel.version` from 4.4.0 to 4.4.1. Updates `io.delta:delta-kernel-api` from 4.4.0 to 4.4.1 <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/delta-io/delta/releases";>io.delta:delta-kernel-api's releases</a>.</em></p> <blockquote> <h2>Delta Lake 4.4.1</h2> <p>We are pleased to announce the release of <a href="https://github.com/delta-io/delta/releases/tag/v4.4.1";>Delta Lake 4.4.1</a>, a patch release on top of <a href="https://github.com/delta-io/delta/releases/tag/v4.4.0";>Delta Lake 4.4.0</a>. This release improves maintenance safety for catalog-managed tables and fixes snapshot construction for tables that use coordinated commits.</p> <h2>Bug Fixes</h2> <ul> <li><strong>[Spark] Safer maintenance for catalog-managed tables:</strong> Delta extends existing safeguards on catalog-managed tables to prevent dangerous data and metadata cleanup operations. Automatic maintenance operations are skipped so writes can complete successfully without failure.</li> <li><strong>[Spark] S3A Fast Listing:</strong> Fixed an issue that could produce incorrect snapshots. Users can enable fast listing with <code>delta.enableFastS3AListFrom</code> again.</li> </ul> <h2>Delta Spark</h2> <p>Delta Spark 4.4.1 is built for <a href="https://spark.apache.org/releases/spark-release-4-2-0.html";>Apache Spark 4.2.0</a>, <a href="https://spark.apache.org/releases/spark-release-4-1-0.html";>Apache Spark 4.1.0</a>, and <a href="https://spark.apache.org/releases/spark-release-4-0-1.html";>Apache Spark 4.0.1</a>. As with Apache Spark, Maven artifacts are published for Scala 2.13.</p> <ul> <li>Maven artifacts for Spark 4.2.0: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-spark_4.2_2.13/4.4.1/";>delta-spark_4.2_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-client_4.2_2.13/4.4.1/";>delta-connect-client_4.2_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-common_4.2_2.13/4.4.1/";>delta-connect-common_4.2_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-server_4.2_2.13/4.4.1/";>delta-connect-server_4.2_2.13</a></li> </ul> </li> <li>Maven artifacts for Spark 4.1.0: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-spark_4.1_2.13/4.4.1/";>delta-spark_4.1_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-client_4.1_2.13/4.4.1/";>delta-connect-client_4.1_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-common_4.1_2.13/4.4.1/";>delta-connect-common_4.1_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-server_4.1_2.13/4.4.1/";>delta-connect-server_4.1_2.13</a></li> </ul> </li> <li>Maven artifacts for Spark 4.0.1: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-spark_4.0_2.13/4.4.1/";>delta-spark_4.0_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-client_4.0_2.13/4.4.1/";>delta-connect-client_4.0_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-common_4.0_2.13/4.4.1/";>delta-connect-common_4.0_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-server_4.0_2.13/4.4.1/";>delta-connect-server_4.0_2.13</a></li> </ul> </li> <li>Backward-compatibility artifacts without a Spark version in the name default to Spark 4.2.0: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-spark_2.13/4.4.1/";>delta-spark_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-client_2.13/4.4.1/";>delta-connect-client_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-common_2.13/4.4.1/";>delta-connect-common_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-server_2.13/4.4.1/";>delta-connect-server_2.13</a></li> </ul> </li> <li>Other Maven artifacts: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-contribs_2.13/4.4.1/";>delta-contribs_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-storage/4.4.1/";>delta-storage</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-storage-s3-dynamodb/4.4.1/";>delta-storage-s3-dynamodb</a></li> </ul> </li> <li>Python artifact: <ul> <li><a href="https://pypi.org/project/delta-spark/4.4.1/";>delta-spark</a></li> </ul> </li> </ul> <p>The fixes and behavior changes in this release are:</p> <ul> <li><strong>Safer maintenance for catalog-managed tables</strong> (<a href="https://redirect.github.com/delta-io/delta/pull/7603";>#7603</a>): Catalog-managed tables require the catalog to control destructive maintenance. Delta now rejects unsupported direct data cleanup, data reorganization, and transaction-log cleanup before changing the table. This release blocks metadata cleanup, column-mapping removal, and manual symlink-format manifest generation on top of those that are already blocked. Delta skips automatic log cleanup, auto compaction, and automatic symlink-format manifest generation on these tables so that the original write can complete. Tables that are not catalog-managed keep their existing behavior.</li> <li><strong>Correct staged-commit handling in filesystem listings</strong> (<a href="https://redirect.github.com/delta-io/delta/pull/7648";>#7648</a>): An S3A Fast List setup can return files from <code>_delta_log/_staged_commits</code>. Delta now ignores these files unless the commit coordinator has ratified the commit. This prevents an orphaned staged commit from appearing as a committed table version and prevents duplicate versions when staged and backfilled copies both appear. Ratified commits remain readable before backfill completes.</li> </ul> <h2>Delta Kernel</h2> <p><a href="https://delta.io/blog/delta-kernel/";>Delta Kernel</a> is a set of Java libraries for building Delta connectors that read and write Delta tables without requiring each connector to implement the Delta protocol directly.</p> <ul> <li>Maven artifacts: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-kernel-api/4.4.1/";>delta-kernel-api</a></li> </ul> </li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/delta-io/delta/commit/cebdc44dc07d331383e72811177af4ffc8638990";><code>cebdc44</code></a> [Release] Prepare version 4.4.1 for release (<a href="https://redirect.github.com/delta-io/delta/issues/7682";>#7682</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/09af6cd5e6b1f4d3bf78559f3372ea3a9a52126d";><code>09af6cd</code></a> [Spark][4.4] Ignore staged commits in filesystem listings (<a href="https://redirect.github.com/delta-io/delta/issues/7648";>#7648</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/709e95da78342bb9741fd7635d169cbeab9a1da6";><code>709e95d</code></a> [Spark][4.4] Revert staged commit filesystem filtering (<a href="https://redirect.github.com/delta-io/delta/issues/7617";>#7617</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/f4285e1661aef8c9e6106bf0e9c2ac1720c769ef";><code>f4285e1</code></a> [Spark][4.4] Ignore staged commits in filesystem listings (<a href="https://redirect.github.com/delta-io/delta/issues/7599";>#7599</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/d9a473433dfd09cb367db03dbc5db5aae186b2b1";><code>d9a4734</code></a> [Spark][4.4] Block unsupported maintenance on catalog-managed tables (<a href="https://redirect.github.com/delta-io/delta/issues/7603";>#7603</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/febec50418e12b027bb4cf599713d0034ad700bc";><code>febec50</code></a> [Release] Restore version to 4.4.1-SNAPSHOT (<a href="https://redirect.github.com/delta-io/delta/issues/7494";>#7494</a>)</li> <li>See full diff in <a href="https://github.com/delta-io/delta/compare/v4.4.0...v4.4.1";>compare view</a></li> </ul> </details> <br /> Updates `io.delta:delta-kernel-defaults` from 4.4.0 to 4.4.1 <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/delta-io/delta/releases";>io.delta:delta-kernel-defaults's releases</a>.</em></p> <blockquote> <h2>Delta Lake 4.4.1</h2> <p>We are pleased to announce the release of <a href="https://github.com/delta-io/delta/releases/tag/v4.4.1";>Delta Lake 4.4.1</a>, a patch release on top of <a href="https://github.com/delta-io/delta/releases/tag/v4.4.0";>Delta Lake 4.4.0</a>. This release improves maintenance safety for catalog-managed tables and fixes snapshot construction for tables that use coordinated commits.</p> <h2>Bug Fixes</h2> <ul> <li><strong>[Spark] Safer maintenance for catalog-managed tables:</strong> Delta extends existing safeguards on catalog-managed tables to prevent dangerous data and metadata cleanup operations. Automatic maintenance operations are skipped so writes can complete successfully without failure.</li> <li><strong>[Spark] S3A Fast Listing:</strong> Fixed an issue that could produce incorrect snapshots. Users can enable fast listing with <code>delta.enableFastS3AListFrom</code> again.</li> </ul> <h2>Delta Spark</h2> <p>Delta Spark 4.4.1 is built for <a href="https://spark.apache.org/releases/spark-release-4-2-0.html";>Apache Spark 4.2.0</a>, <a href="https://spark.apache.org/releases/spark-release-4-1-0.html";>Apache Spark 4.1.0</a>, and <a href="https://spark.apache.org/releases/spark-release-4-0-1.html";>Apache Spark 4.0.1</a>. As with Apache Spark, Maven artifacts are published for Scala 2.13.</p> <ul> <li>Maven artifacts for Spark 4.2.0: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-spark_4.2_2.13/4.4.1/";>delta-spark_4.2_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-client_4.2_2.13/4.4.1/";>delta-connect-client_4.2_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-common_4.2_2.13/4.4.1/";>delta-connect-common_4.2_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-server_4.2_2.13/4.4.1/";>delta-connect-server_4.2_2.13</a></li> </ul> </li> <li>Maven artifacts for Spark 4.1.0: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-spark_4.1_2.13/4.4.1/";>delta-spark_4.1_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-client_4.1_2.13/4.4.1/";>delta-connect-client_4.1_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-common_4.1_2.13/4.4.1/";>delta-connect-common_4.1_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-server_4.1_2.13/4.4.1/";>delta-connect-server_4.1_2.13</a></li> </ul> </li> <li>Maven artifacts for Spark 4.0.1: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-spark_4.0_2.13/4.4.1/";>delta-spark_4.0_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-client_4.0_2.13/4.4.1/";>delta-connect-client_4.0_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-common_4.0_2.13/4.4.1/";>delta-connect-common_4.0_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-server_4.0_2.13/4.4.1/";>delta-connect-server_4.0_2.13</a></li> </ul> </li> <li>Backward-compatibility artifacts without a Spark version in the name default to Spark 4.2.0: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-spark_2.13/4.4.1/";>delta-spark_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-client_2.13/4.4.1/";>delta-connect-client_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-common_2.13/4.4.1/";>delta-connect-common_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-connect-server_2.13/4.4.1/";>delta-connect-server_2.13</a></li> </ul> </li> <li>Other Maven artifacts: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-contribs_2.13/4.4.1/";>delta-contribs_2.13</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-storage/4.4.1/";>delta-storage</a></li> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-storage-s3-dynamodb/4.4.1/";>delta-storage-s3-dynamodb</a></li> </ul> </li> <li>Python artifact: <ul> <li><a href="https://pypi.org/project/delta-spark/4.4.1/";>delta-spark</a></li> </ul> </li> </ul> <p>The fixes and behavior changes in this release are:</p> <ul> <li><strong>Safer maintenance for catalog-managed tables</strong> (<a href="https://redirect.github.com/delta-io/delta/pull/7603";>#7603</a>): Catalog-managed tables require the catalog to control destructive maintenance. Delta now rejects unsupported direct data cleanup, data reorganization, and transaction-log cleanup before changing the table. This release blocks metadata cleanup, column-mapping removal, and manual symlink-format manifest generation on top of those that are already blocked. Delta skips automatic log cleanup, auto compaction, and automatic symlink-format manifest generation on these tables so that the original write can complete. Tables that are not catalog-managed keep their existing behavior.</li> <li><strong>Correct staged-commit handling in filesystem listings</strong> (<a href="https://redirect.github.com/delta-io/delta/pull/7648";>#7648</a>): An S3A Fast List setup can return files from <code>_delta_log/_staged_commits</code>. Delta now ignores these files unless the commit coordinator has ratified the commit. This prevents an orphaned staged commit from appearing as a committed table version and prevents duplicate versions when staged and backfilled copies both appear. Ratified commits remain readable before backfill completes.</li> </ul> <h2>Delta Kernel</h2> <p><a href="https://delta.io/blog/delta-kernel/";>Delta Kernel</a> is a set of Java libraries for building Delta connectors that read and write Delta tables without requiring each connector to implement the Delta protocol directly.</p> <ul> <li>Maven artifacts: <ul> <li><a href="https://repo1.maven.org/maven2/io/delta/delta-kernel-api/4.4.1/";>delta-kernel-api</a></li> </ul> </li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/delta-io/delta/commit/cebdc44dc07d331383e72811177af4ffc8638990";><code>cebdc44</code></a> [Release] Prepare version 4.4.1 for release (<a href="https://redirect.github.com/delta-io/delta/issues/7682";>#7682</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/09af6cd5e6b1f4d3bf78559f3372ea3a9a52126d";><code>09af6cd</code></a> [Spark][4.4] Ignore staged commits in filesystem listings (<a href="https://redirect.github.com/delta-io/delta/issues/7648";>#7648</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/709e95da78342bb9741fd7635d169cbeab9a1da6";><code>709e95d</code></a> [Spark][4.4] Revert staged commit filesystem filtering (<a href="https://redirect.github.com/delta-io/delta/issues/7617";>#7617</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/f4285e1661aef8c9e6106bf0e9c2ac1720c769ef";><code>f4285e1</code></a> [Spark][4.4] Ignore staged commits in filesystem listings (<a href="https://redirect.github.com/delta-io/delta/issues/7599";>#7599</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/d9a473433dfd09cb367db03dbc5db5aae186b2b1";><code>d9a4734</code></a> [Spark][4.4] Block unsupported maintenance on catalog-managed tables (<a href="https://redirect.github.com/delta-io/delta/issues/7603";>#7603</a>)</li> <li><a href="https://github.com/delta-io/delta/commit/febec50418e12b027bb4cf599713d0034ad700bc";><code>febec50</code></a> [Release] Restore version to 4.4.1-SNAPSHOT (<a href="https://redirect.github.com/delta-io/delta/issues/7494";>#7494</a>)</li> <li>See full diff in <a href="https://github.com/delta-io/delta/compare/v4.4.0...v4.4.1";>compare view</a></li> </ul> </details> <br /> Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
