dependabot[bot] opened a new pull request, #36915: URL: https://github.com/apache/beam/pull/36915
Bumps [ray](https://github.com/ray-project/ray) from 2.51.1 to 2.52.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/ray-project/ray/releases";>ray's releases</a>.</em></p> <blockquote> <h2>Ray-2.52.0</h2> <h1>Release Highlights</h1> <p><strong>Ray Core:</strong></p> <ul> <li>End of Life for Python 3.9 Support: Ray will no longer be releasing Python 3.9 wheels from now on.</li> <li>Token authentication: Ray now supports built-in token authentication across all components including the dashboard, CLI, API clients, and internal services. This provides an additional layer of security for production deployments to reduce the risk of unauthorized code execution. Token authentication is initially off by default. For more information, see: <a href="https://docs.ray.io/en/latest/ray-security/token-auth.html";>https://docs.ray.io/en/latest/ray-security/token-auth.html</a></li> </ul> <p><strong>Ray Data:</strong></p> <ul> <li>We’ve added a number of improvements for Iceberg, including upserts, predicate and projection pushdown, and overwrite.</li> <li>We’ve added significant improvements to our expressions framework, including temporal, list, tensor, and struct datatype expressions.</li> </ul> <h1>Ray Libraries</h1> <h2>Ray Data</h2> <p>🎉 New Features:</p> <ul> <li>Added predicate pushdown rule that pushes filter predicates past eligible operators (<a href="https://redirect.github.com/ray-project/ray/pull/58150";>#58150</a>,[ <a href="https://redirect.github.com/ray-project/ray/issues/58555";>#58555</a>](<a href="https://redirect.github.com/ray-project/ray/pull/58555";>ray-project/ray#58555</a>))</li> <li>Iceberg support for upsert tables, schema updates, and overwrite operations (<a href="https://redirect.github.com/ray-project/ray/pull/58270";>#58270</a>)</li> <li>Iceberg support for predicate and projection pushdown (<a href="https://redirect.github.com/ray-project/ray/pull/58286";>#58286</a>)</li> <li>Iceberg write datafiles in write() then commit (<a href="https://redirect.github.com/ray-project/ray/pull/58601";>#58601</a>)</li> <li>Enhanced Unity Catalog integration (<a href="https://redirect.github.com/ray-project/ray/pull/57954";>#57954</a>)</li> <li>Namespaced expressions that expose PyArrow functions (<a href="https://redirect.github.com/ray-project/ray/pull/58465";>#58465</a>)</li> <li>Added version argument to read_delta_lake (<a href="https://redirect.github.com/ray-project/ray/pull/54976";>#54976</a>)</li> <li>Generator UDF support for map_groups (<a href="https://redirect.github.com/ray-project/ray/pull/58039";>#58039</a>)</li> <li>ApproximateTopK aggregator (<a href="https://redirect.github.com/ray-project/ray/pull/57950";>#57950</a>)</li> <li>Serialization framework for preprocessors (<a href="https://redirect.github.com/ray-project/ray/pull/58321";>#58321</a>)</li> <li>Support for temporal, list, tensor, and struct datatypes (<a href="https://redirect.github.com/ray-project/ray/pull/58225";>#58225</a>)</li> </ul> <p>💫 Enhancements:</p> <ul> <li>Use approximate quantile for RobustScaler preprocessor (<a href="https://redirect.github.com/ray-project/ray/pull/58371";>#58371</a>)</li> <li>Map batches support for limit pushdown (<a href="https://redirect.github.com/ray-project/ray/pull/57880";>#57880</a>)</li> <li>Make all map operations zero-copy by default (<a href="https://redirect.github.com/ray-project/ray/pull/58285";>#58285</a>)</li> <li>Use tqdm_ray for progress reporting from workers (<a href="https://redirect.github.com/ray-project/ray/pull/58277";>#58277</a>)</li> <li>Improved concurrency cap backpressure tuning (<a href="https://redirect.github.com/ray-project/ray/pull/58163";>#58163</a>,[ <a href="https://redirect.github.com/ray-project/ray/issues/58023";>#58023</a>](<a href="https://redirect.github.com/ray-project/ray/pull/58023),%5B">ray-project/ray#58023</a> <a href="https://redirect.github.com/ray-project/ray/issues/57996";>#57996</a>](<a href="https://redirect.github.com/ray-project/ray/pull/57996";>ray-project/ray#57996</a>))</li> <li>Sample finalized partitions randomly to avoid lens effect (<a href="https://redirect.github.com/ray-project/ray/pull/58456";>#58456</a>)</li> <li>Allow file extensions starting with '.' (<a href="https://redirect.github.com/ray-project/ray/pull/58339";>#58339</a>)</li> <li>Set default file_extensions for read_parquet (<a href="https://redirect.github.com/ray-project/ray/pull/56481";>#56481</a>)</li> <li>URL decode values in parse_hive_path (<a href="https://redirect.github.com/ray-project/ray/pull/57625";>#57625</a>)</li> <li>Streaming partition enforces row_num per block (<a href="https://redirect.github.com/ray-project/ray/pull/57984";>#57984</a>)</li> <li>Streaming repartition combines small blocks (<a href="https://redirect.github.com/ray-project/ray/pull/58020";>#58020</a>)</li> <li>Lower DEFAULT_ACTOR_MAX_TASKS_IN_FLIGHT_TO_MAX_CONCURRENCY_FACTOR to 2 (<a href="https://redirect.github.com/ray-project/ray/pull/58262";>#58262</a>)</li> <li>Set udf-modifying-row-count default to false (<a href="https://redirect.github.com/ray-project/ray/pull/58264";>#58264</a>)</li> <li>Cache PyArrow schema operations (<a href="https://redirect.github.com/ray-project/ray/pull/58583";>#58583</a>)</li> <li>Explain optimized plans (<a href="https://redirect.github.com/ray-project/ray/pull/58074";>#58074</a>)</li> <li>Ranker interface (<a href="https://redirect.github.com/ray-project/ray/pull/58513";>#58513</a>)</li> </ul> <p>🔨 Fixes:</p> <ul> <li>Fixed renamed columns to be appropriately dropped from output (<a href="https://redirect.github.com/ray-project/ray/pull/58040";>#58040</a>,[ <a href="https://redirect.github.com/ray-project/ray/issues/58071";>#58071</a>](<a href="https://redirect.github.com/ray-project/ray/pull/58071";>ray-project/ray#58071</a>))</li> <li>Fixed handling of renames in projection pushdown (<a href="https://redirect.github.com/ray-project/ray/pull/58033";>#58033</a>,[ <a href="https://redirect.github.com/ray-project/ray/issues/58037";>#58037</a>](<a href="https://redirect.github.com/ray-project/ray/pull/58037";>ray-project/ray#58037</a>))</li> <li>Fixed broken LogicalOperator abstraction barrier in predicate pushdown rule (<a href="https://redirect.github.com/ray-project/ray/pull/58683";>#58683</a>)</li> <li>Fixed file size ordering in download partitioning with multiple URI columns (<a href="https://redirect.github.com/ray-project/ray/pull/58517";>#58517</a>)</li> <li>Fixed HTTP streaming file download by using open_input_stream (<a href="https://redirect.github.com/ray-project/ray/pull/58542";>#58542</a>)</li> <li>Fixed expression mapping for Pandas (<a href="https://redirect.github.com/ray-project/ray/pull/57868";>#57868</a>)</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/ray-project/ray/commit/9527a555280fb9837ce73dabf01559c20656a456";><code>9527a55</code></a> [core] Cherry pick token authentication UX improvements (<a href="https://redirect.github.com/ray-project/ray/issues/58831";>#58831</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/d7f80559bafbeed6ced9e26c3e4a223d7a2957f3";><code>d7f8055</code></a> [core] Cherry pick fallback authorization header (<a href="https://redirect.github.com/ray-project/ray/issues/58826";>#58826</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/1cd18e2810805a9d8696c18391daed21f96cc82b";><code>1cd18e2</code></a> [core] Cherry pick token generation change (<a href="https://redirect.github.com/ray-project/ray/issues/58825";>#58825</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/56afc3f1261b5852a1ad4102e2dd3690db803ec7";><code>56afc3f</code></a> [core] Cherry pick KubeRay authentication guide (<a href="https://redirect.github.com/ray-project/ray/issues/58824";>#58824</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/3cd2f9d62fa6291e83b5b7dbd40a5c92cb61f5f8";><code>3cd2f9d</code></a> cherrypick <a href="https://redirect.github.com/ray-project/ray/issues/58762";>#58762</a> (<a href="https://redirect.github.com/ray-project/ray/issues/58814";>#58814</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/d72c20e6104997d2ce0be3188d817ee5c3ac152e";><code>d72c20e</code></a> cherrypick <a href="https://redirect.github.com/ray-project/ray/issues/58765";>#58765</a> (<a href="https://redirect.github.com/ray-project/ray/issues/58812";>#58812</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/7be797e415aca9622cecb6f70d76e4d1681b8cc0";><code>7be797e</code></a> [core] Cherry pick use-after-free fix in <code>RayletClient</code> (<a href="https://redirect.github.com/ray-project/ray/issues/58747";>#58747</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/519975f403056c86cd11301ca709e0b2663a76b4";><code>519975f</code></a> [release] keep building python 3.9 wheel for internal testing (<a href="https://redirect.github.com/ray-project/ray/issues/58732";>#58732</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/78260b9cd6be1333c3f3906a91e656e01ac596d2";><code>78260b9</code></a> change version to 2.52.0 (<a href="https://redirect.github.com/ray-project/ray/issues/58730";>#58730</a>)</li> <li><a href="https://github.com/ray-project/ray/commit/323e92b3b3304621f11bd7c0497e2482ba2cbb3f";><code>323e92b</code></a> [deps][ci] correctly checking for valid subset (<a href="https://redirect.github.com/ray-project/ray/issues/58716";>#58716</a>)</li> <li>Additional commits viewable in <a href="https://github.com/ray-project/ray/compare/ray-2.51.1...ray-2.52.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/beam/network/alerts). </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
