dependabot[bot] opened a new pull request, #42: URL: https://github.com/apache/beam-starter-go/pull/42
Bumps [github.com/apache/beam/sdks/v2](https://github.com/apache/beam) from 2.58.1 to 2.59.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/releases";>github.com/apache/beam/sdks/v2's releases</a>.</em></p> <blockquote> <h2>Beam 2.59.0 release</h2> <p>We are happy to present the new 2.59.0 release of Beam. This release includes both improvements and new functionality. See the <a href="https://beam.apache.org/get-started/downloads/#2590-2024-09-11";>download page</a> for this release.</p> <!-- raw HTML omitted --> <p>For more information on changes in 2.59.0, check out the <a href="https://github.com/apache/beam/milestone/23";>detailed release notes</a>.</p> <h2>Highlights</h2> <ul> <li>Added support for setting a configureable timeout when loading a model and performing inference in the <a href="https://beam.apache.org/documentation/ml/inference-overview/";>RunInference</a> transform using <a href="https://beam.apache.org/releases/pydoc/current/apache_beam.ml.inference.base.html#apache_beam.ml.inference.base.RunInference.with_exception_handling";>with_exception_handling</a> (<a href="https://redirect.github.com/apache/beam/issues/32137";>#32137</a>)</li> <li>Initial experimental support for using Prism with the Java and Python SDKs <ul> <li>Prism is presently targeting local testing usage, or other small scale execution.</li> <li>For Java, use 'PrismRunner', or 'TestPrismRunner' as an argument to the <code>--runner</code> flag.</li> <li>For Python, use 'PrismRunner' as an argument to the <code>--runner</code> flag.</li> <li>Go already uses Prism as the default local runner.</li> </ul> </li> </ul> <h2>I/Os</h2> <ul> <li>Improvements to the performance of BigqueryIO when using withPropagateSuccessfulStorageApiWrites(true) method (Java) (<a href="https://redirect.github.com/apache/beam/pull/31840";>#31840</a>).</li> <li>[Managed Iceberg] Added support for writing to partitioned tables (<a href="https://redirect.github.com/apache/beam/pull/32102";>#32102</a>)</li> <li>Update ClickHouseIO to use the latest version of the ClickHouse JDBC driver (<a href="https://redirect.github.com/apache/beam/issues/32228";>#32228</a>).</li> <li>Add ClickHouseIO dedicated User-Agent (<a href="https://redirect.github.com/apache/beam/issues/32252";>#32252</a>).</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>BigQuery endpoint can be overridden via PipelineOptions, this enables BigQuery emulators (Java) (<a href="https://redirect.github.com/apache/beam/issues/28149";>#28149</a>).</li> <li>Go SDK Minimum Go Version updated to 1.21 (<a href="https://redirect.github.com/apache/beam/pull/32092";>#32092</a>).</li> <li>[BigQueryIO] Added support for withFormatRecordOnFailureFunction() for STORAGE_WRITE_API and STORAGE_API_AT_LEAST_ONCE methods (Java) (<a href="https://redirect.github.com/apache/beam/issues/31354";>#31354</a>).</li> <li>Updated Go protobuf package to new version (Go) (<a href="https://redirect.github.com/apache/beam/issues/21515";>#21515</a>).</li> <li>Added support for setting a configureable timeout when loading a model and performing inference in the <a href="https://beam.apache.org/documentation/ml/inference-overview/";>RunInference</a> transform using <a href="https://beam.apache.org/releases/pydoc/current/apache_beam.ml.inference.base.html#apache_beam.ml.inference.base.RunInference.with_exception_handling";>with_exception_handling</a> (<a href="https://redirect.github.com/apache/beam/issues/32137";>#32137</a>)</li> <li>Adds OrderedListState support for Java SDK via FnApi.</li> <li>Initial support for using Prism from the Python and Java SDKs.</li> </ul> <h2>Bugfixes</h2> <ul> <li>Fixed incorrect service account impersonation flow for Python pipelines using BigQuery IOs (<a href="https://redirect.github.com/apache/beam/issues/32030";>#32030</a>).</li> <li>Auto-disable broken and meaningless <code>upload_graph</code> feature when using Dataflow Runner V2 (<a href="https://redirect.github.com/apache/beam/issues/32159";>#32159</a>).</li> <li>(Python) Upgraded google-cloud-storage to version 2.18.2 to fix a data corruption issue (<a href="https://redirect.github.com/apache/beam/pull/32135";>#32135</a>).</li> <li>(Go) Fix corruption on State API writes. (<a href="https://redirect.github.com/apache/beam/issues/32245";>#32245</a>).</li> </ul> <h2>Known Issues</h2> <ul> <li>Prism is under active development and does not yet support all pipelines. See <a href="https://redirect.github.com/apache/beam/issues/29650";>#29650</a> for progress. <ul> <li>In the 2.59.0 release, Prism passes most runner validations tests with the exceptions of pipelines using the following features: OrderedListState, OnWindowExpiry (eg. GroupIntoBatches), CustomWindows, MergingWindowFns, Trigger and WindowingStrategy associated features, Bundle Finalization, Looping Timers, and some Coder related issues such as with Python combiner packing, and Java Schema transforms, and heterogenous flatten coders. Processing Time timers do not yet have real time support.</li> <li>If your pipeline is having difficulty with the Python or Java direct runners, but runs well on Prism, please let us know.</li> </ul> </li> </ul> <p>For the most up to date list of known issues, see <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>https://github.com/apache/beam/blob/master/CHANGES.md</a></p> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>github.com/apache/beam/sdks/v2's changelog</a>.</em></p> <blockquote> <h1>[2.59.0] - 2024-09-11</h1> <h2>Highlights</h2> <ul> <li>Added support for setting a configureable timeout when loading a model and performing inference in the <a href="https://beam.apache.org/documentation/ml/inference-overview/";>RunInference</a> transform using <a href="https://beam.apache.org/releases/pydoc/current/apache_beam.ml.inference.base.html#apache_beam.ml.inference.base.RunInference.with_exception_handling";>with_exception_handling</a> (<a href="https://redirect.github.com/apache/beam/issues/32137";>#32137</a>)</li> <li>Initial experimental support for using Prism with the Java and Python SDKs <ul> <li>Prism is presently targeting local testing usage, or other small scale execution.</li> <li>For Java, use 'PrismRunner', or 'TestPrismRunner' as an argument to the <code>--runner</code> flag.</li> <li>For Python, use 'PrismRunner' as an argument to the <code>--runner</code> flag.</li> <li>Go already uses Prism as the default local runner.</li> </ul> </li> </ul> <h2>I/Os</h2> <ul> <li>Improvements to the performance of BigqueryIO when using withPropagateSuccessfulStorageApiWrites(true) method (Java) (<a href="https://redirect.github.com/apache/beam/pull/31840";>#31840</a>).</li> <li>[Managed Iceberg] Added support for writing to partitioned tables (<a href="https://redirect.github.com/apache/beam/pull/32102";>#32102</a>)</li> <li>Update ClickHouseIO to use the latest version of the ClickHouse JDBC driver (<a href="https://redirect.github.com/apache/beam/issues/32228";>#32228</a>).</li> <li>Add ClickHouseIO dedicated User-Agent (<a href="https://redirect.github.com/apache/beam/issues/32252";>#32252</a>).</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>BigQuery endpoint can be overridden via PipelineOptions, this enables BigQuery emulators (Java) (<a href="https://redirect.github.com/apache/beam/issues/28149";>#28149</a>).</li> <li>Go SDK Minimum Go Version updated to 1.21 (<a href="https://redirect.github.com/apache/beam/pull/32092";>#32092</a>).</li> <li>[BigQueryIO] Added support for withFormatRecordOnFailureFunction() for STORAGE_WRITE_API and STORAGE_API_AT_LEAST_ONCE methods (Java) (<a href="https://redirect.github.com/apache/beam/issues/31354";>#31354</a>).</li> <li>Updated Go protobuf package to new version (Go) (<a href="https://redirect.github.com/apache/beam/issues/21515";>#21515</a>).</li> <li>Added support for setting a configureable timeout when loading a model and performing inference in the <a href="https://beam.apache.org/documentation/ml/inference-overview/";>RunInference</a> transform using <a href="https://beam.apache.org/releases/pydoc/current/apache_beam.ml.inference.base.html#apache_beam.ml.inference.base.RunInference.with_exception_handling";>with_exception_handling</a> (<a href="https://redirect.github.com/apache/beam/issues/32137";>#32137</a>)</li> <li>Adds OrderedListState support for Java SDK via FnApi.</li> <li>Initial support for using Prism from the Python and Java SDKs.</li> </ul> <h2>Bugfixes</h2> <ul> <li>Fixed incorrect service account impersonation flow for Python pipelines using BigQuery IOs (<a href="https://redirect.github.com/apache/beam/issues/32030";>#32030</a>).</li> <li>Auto-disable broken and meaningless <code>upload_graph</code> feature when using Dataflow Runner V2 (<a href="https://redirect.github.com/apache/beam/issues/32159";>#32159</a>).</li> <li>(Python) Upgraded google-cloud-storage to version 2.18.2 to fix a data corruption issue (<a href="https://redirect.github.com/apache/beam/pull/32135";>#32135</a>).</li> <li>(Go) Fix corruption on State API writes. (<a href="https://redirect.github.com/apache/beam/issues/32245";>#32245</a>).</li> </ul> <h2>Known Issues</h2> <ul> <li>Prism is under active development and does not yet support all pipelines. See <a href="https://redirect.github.com/apache/beam/issues/29650";>#29650</a> for progress. <ul> <li>In the 2.59.0 release, Prism passes most runner validations tests with the exceptions of pipelines using the following features: OrderedListState, OnWindowExpiry (eg. GroupIntoBatches), CustomWindows, MergingWindowFns, Trigger and WindowingStrategy associated features, Bundle Finalization, Looping Timers, and some Coder related issues such as with Python combiner packing, and Java Schema transforms, and heterogenous flatten coders. Processing Time timers do not yet have real time support.</li> <li>If your pipeline is having difficulty with the Python or Java direct runners, but runs well on Prism, please let us know.</li> </ul> </li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/beam/commit/c56007595053fd69dcf5490563e1e963afb52343";><code>c560075</code></a> Set version for 2.59.0 RC1</li> <li><a href="https://github.com/apache/beam/commit/57d5ab5a144c03cba9d309fa2beed4baa984a474";><code>57d5ab5</code></a> Cherry Pick <a href="https://redirect.github.com/apache/beam/issues/32294";>#32294</a> (Java PrismRunner and TestPrismRunner) to the release. (<a href="https://redirect.github.com/apache/beam/issues/3";>#3</a>...</li> <li><a href="https://github.com/apache/beam/commit/b552e0fd026113b2270b1cafc2e39b2978fc009d";><code>b552e0f</code></a> Check experiment for hotkey logging (<a href="https://redirect.github.com/apache/beam/issues/32285";>#32285</a>) (<a href="https://redirect.github.com/apache/beam/issues/32290";>#32290</a>)</li> <li><a href="https://github.com/apache/beam/commit/4173f54504fbc95dd1e85c897f99b4333e7590ec";><code>4173f54</code></a> Cherrypick <a href="https://redirect.github.com/apache/beam/issues/32276";>#32276</a> to 2.59.0 release branch. (<a href="https://redirect.github.com/apache/beam/issues/32280";>#32280</a>)</li> <li><a href="https://github.com/apache/beam/commit/efa8dbc3cff4737092bb4bccab6eba6bf91cc7d5";><code>efa8dbc</code></a> Set Dataflow container to release version.</li> <li><a href="https://github.com/apache/beam/commit/a62ff34b7cf8ff525a386fd105826d451f445891";><code>a62ff34</code></a> Better error message when trying to get Beam Schema from proto schema with St...</li> <li><a href="https://github.com/apache/beam/commit/ed4c03e37794277b3308330884f66d8691ce7328";><code>ed4c03e</code></a> Do not create new Executor everytime createRunner (<a href="https://redirect.github.com/apache/beam/issues/32272";>#32272</a>)</li> <li><a href="https://github.com/apache/beam/commit/512b52a2b234fd2248b4ab86173a08a59c9ae175";><code>512b52a</code></a> Better error when Python xlang download jar not available (<a href="https://redirect.github.com/apache/beam/issues/32269";>#32269</a>)</li> <li><a href="https://github.com/apache/beam/commit/65f556d861e6842c6c9bae3504b18ce292a1a011";><code>65f556d</code></a> Update requests package to 2.32.0 (<a href="https://redirect.github.com/apache/beam/issues/32270";>#32270</a>)</li> <li><a href="https://github.com/apache/beam/commit/c5bf5fc7395f8b8c7cf65c0f8fd36b9b98a4ea01";><code>c5bf5fc</code></a> Revert "Portable runner fixes (<a href="https://redirect.github.com/apache/beam/issues/32247";>#32247</a>)" (<a href="https://redirect.github.com/apache/beam/issues/32271";>#32271</a>)</li> <li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.58.1...v2.59.0";>compare view</a></li> </ul> </details> <br /> [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@beam.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
