Re: [VOTE] Release 2.53.0, release candidate #2
+1 (binding) Validated the Go SDK against my own pipleines. Robert Burke On Wed, Jan 3, 2024, 7:52 AM Chamikara Jayalath via dev wrote: > +1 (binding) > > Validated Java/Python x-lang jobs. > > - Cham > > On Tue, Jan 2, 2024 at 7:35 AM Jack McCluskey via dev > wrote: > >> Happy New Year, everyone! >> >> Now that we're through the holidays I just wanted to bump the voting >> thread so we can keep the RC moving. >> >> Thanks, >> >> Jack McCluskey >> >> On Fri, Dec 29, 2023 at 11:58 AM Johanna Öjeling via dev < >> dev@beam.apache.org> wrote: >> >>> +1 (non-binding). >>> >>> Tested Go SDK with Dataflow on own use cases. >>> >>> On Fri, Dec 29, 2023 at 2:57 AM Yi Hu via dev >>> wrote: >>> +1 (non-binding) Tested with Beam GCP IOs benchmarking ( https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/main/it/google-cloud-platform ) On Thu, Dec 28, 2023 at 11:36 AM Svetak Sundhar via dev < dev@beam.apache.org> wrote: > +1 (non binding) > > Tested with Healthcare notebooks. > > > Svetak Sundhar > > Data Engineer > s vetaksund...@google.com > > > > On Thu, Dec 28, 2023 at 3:52 AM Jan Lukavský wrote: > >> +1 (binding) >> >> Tested Java SDK with Flink Runner. >> >> Jan >> On 12/27/23 14:13, Danny McCormick via dev wrote: >> >> +1 (non-binding) >> >> Tested with some example ML notebooks. >> >> Thanks, >> Danny >> >> On Tue, Dec 26, 2023 at 6:41 PM XQ Hu via dev >> wrote: >> >>> +1 (non-binding) >>> >>> Tested with the simple RunInference pipeline: >>> https://github.com/google/dataflow-ml-starter/actions/runs/7332832875/job/19967521369 >>> >>> On Tue, Dec 26, 2023 at 3:29 PM Jack McCluskey via dev < >>> dev@beam.apache.org> wrote: >>> Happy holidays everyone, Please review and vote on the release candidate #2 for the version 2.53.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) Reviewers are encouraged to test their own use cases with the release candidate, and vote +1 if no issues are found. Only PMC member votes will count towards the final vote, but votes from all community members are encouraged and helpful for finding regressions; you can either test your own use cases [13] or use cases from the validation sheet [10]. The complete staging area is available for your review, which includes: * GitHub Release notes [1], * the official Apache source release to be deployed to dist.apache.org [2], which is signed with the key with fingerprint DF3CBA4F3F4199F4 (D20316F712213422 if automated) [3], * all artifacts to be deployed to the Maven Central Repository [4], * source code tag "v1.2.3-RC3" [5], * website pull request listing the release [6], the blog post [6], and publishing the API reference manual [7]. * Python artifacts are deployed along with the source release to the dist.apache.org [2] and PyPI[8]. * Go artifacts and documentation are available at pkg.go.dev [9] * Validation sheet with a tab for 2.53.0 release to help with validation [10]. * Docker images published to Docker Hub [11]. * PR to run tests against release branch [12]. The vote will be open for at least 72 hours. It is adopted by majority approval, with at least 3 PMC affirmative votes. For guidelines on how to try the release in your projects, check out our RC testing guide [13]. Thanks, Jack McCluskey [1] https://github.com/apache/beam/milestone/17 [2] https://dist.apache.org/repos/dist/dev/beam/2.53.0/ [3] https://dist.apache.org/repos/dist/release/beam/KEYS [4] https://repository.apache.org/content/repositories/orgapachebeam-1365/ [5] https://github.com/apache/beam/tree/v2.53.0-RC2 [6] https://github.com/apache/beam/pull/29856 [7] https://github.com/apache/beam-site/pull/657 [8] https://pypi.org/project/apache-beam/2.53.0rc2/ [9] https://pkg.go.dev/github.com/apache/beam/sdks/v2@v2.53.0-RC2/go/pkg/beam [10] https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=1290249774 [11] https://hub.docker.com/search?q=apache%2Fbeam&type=image [12] https://github.com/apache/beam/pull/29758 [13] https://github.com/apache/beam/blob/master/contributor-docs/rc-testing-guide.md -- Jack McCluskey SWE - DataPLS PLAT/ Dataflow ML >>>
Re: [VOTE] Release 2.53.0, release candidate #2
+1 (binding) Validated Java/Python x-lang jobs. - Cham On Tue, Jan 2, 2024 at 7:35 AM Jack McCluskey via dev wrote: > Happy New Year, everyone! > > Now that we're through the holidays I just wanted to bump the voting > thread so we can keep the RC moving. > > Thanks, > > Jack McCluskey > > On Fri, Dec 29, 2023 at 11:58 AM Johanna Öjeling via dev < > dev@beam.apache.org> wrote: > >> +1 (non-binding). >> >> Tested Go SDK with Dataflow on own use cases. >> >> On Fri, Dec 29, 2023 at 2:57 AM Yi Hu via dev >> wrote: >> >>> +1 (non-binding) >>> >>> Tested with Beam GCP IOs benchmarking ( >>> https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/main/it/google-cloud-platform >>> ) >>> >>> On Thu, Dec 28, 2023 at 11:36 AM Svetak Sundhar via dev < >>> dev@beam.apache.org> wrote: >>> +1 (non binding) Tested with Healthcare notebooks. Svetak Sundhar Data Engineer s vetaksund...@google.com On Thu, Dec 28, 2023 at 3:52 AM Jan Lukavský wrote: > +1 (binding) > > Tested Java SDK with Flink Runner. > > Jan > On 12/27/23 14:13, Danny McCormick via dev wrote: > > +1 (non-binding) > > Tested with some example ML notebooks. > > Thanks, > Danny > > On Tue, Dec 26, 2023 at 6:41 PM XQ Hu via dev > wrote: > >> +1 (non-binding) >> >> Tested with the simple RunInference pipeline: >> https://github.com/google/dataflow-ml-starter/actions/runs/7332832875/job/19967521369 >> >> On Tue, Dec 26, 2023 at 3:29 PM Jack McCluskey via dev < >> dev@beam.apache.org> wrote: >> >>> Happy holidays everyone, >>> >>> Please review and vote on the release candidate #2 for the version >>> 2.53.0, as follows: >>> >>> [ ] +1, Approve the release >>> [ ] -1, Do not approve the release (please provide specific comments) >>> >>> Reviewers are encouraged to test their own use cases with the >>> release candidate, and vote +1 if no issues are found. Only PMC member >>> votes will count towards the final vote, but votes from all community >>> members are encouraged and helpful for finding regressions; you can >>> either >>> test your own use cases [13] or use cases from the validation sheet >>> [10]. >>> >>> The complete staging area is available for your review, which >>> includes: >>> * GitHub Release notes [1], >>> * the official Apache source release to be deployed to >>> dist.apache.org [2], which is signed with the key with fingerprint >>> DF3CBA4F3F4199F4 (D20316F712213422 if automated) [3], >>> * all artifacts to be deployed to the Maven Central Repository [4], >>> * source code tag "v1.2.3-RC3" [5], >>> * website pull request listing the release [6], the blog post [6], >>> and publishing the API reference manual [7]. >>> * Python artifacts are deployed along with the source release to the >>> dist.apache.org [2] and PyPI[8]. >>> * Go artifacts and documentation are available at pkg.go.dev [9] >>> * Validation sheet with a tab for 2.53.0 release to help with >>> validation [10]. >>> * Docker images published to Docker Hub [11]. >>> * PR to run tests against release branch [12]. >>> >>> The vote will be open for at least 72 hours. It is adopted by >>> majority approval, with at least 3 PMC affirmative votes. >>> >>> For guidelines on how to try the release in your projects, check out >>> our RC testing guide [13]. >>> >>> Thanks, >>> >>> Jack McCluskey >>> >>> [1] https://github.com/apache/beam/milestone/17 >>> [2] https://dist.apache.org/repos/dist/dev/beam/2.53.0/ >>> [3] https://dist.apache.org/repos/dist/release/beam/KEYS >>> [4] >>> https://repository.apache.org/content/repositories/orgapachebeam-1365/ >>> [5] https://github.com/apache/beam/tree/v2.53.0-RC2 >>> [6] https://github.com/apache/beam/pull/29856 >>> [7] https://github.com/apache/beam-site/pull/657 >>> [8] https://pypi.org/project/apache-beam/2.53.0rc2/ >>> [9] >>> https://pkg.go.dev/github.com/apache/beam/sdks/v2@v2.53.0-RC2/go/pkg/beam >>> [10] >>> https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=1290249774 >>> [11] https://hub.docker.com/search?q=apache%2Fbeam&type=image >>> [12] https://github.com/apache/beam/pull/29758 >>> [13] >>> https://github.com/apache/beam/blob/master/contributor-docs/rc-testing-guide.md >>> >>> >>> -- >>> >>> >>> Jack McCluskey >>> SWE - DataPLS PLAT/ Dataflow ML >>> RDU >>> jrmcclus...@google.com >>> >>> >>>
Beam High Priority Issue Report (49)
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/29825 [Bug]: Usage of logical types breaks Beam YAML Sql https://github.com/apache/beam/issues/29413 [Bug]: Can not use Avro over 1.8.2 with Beam 2.52.0 https://github.com/apache/beam/issues/29099 [Bug]: FnAPI Java SDK Harness doesn't update user counters in OnTimer callback functions https://github.com/apache/beam/issues/29022 [Failing Test]: Python Github actions tests are failing due to update of pip https://github.com/apache/beam/issues/28760 [Bug]: EFO Kinesis IO reader provided by apache beam does not pick the event time for watermarking https://github.com/apache/beam/issues/28715 [Bug]: Python WriteToBigtable get stuck for large jobs due to client dead lock https://github.com/apache/beam/issues/28383 [Failing Test]: org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest.testMaxThreadMetric https://github.com/apache/beam/issues/28339 Fix failing "beam_PostCommit_XVR_GoUsingJava_Dataflow" job https://github.com/apache/beam/issues/28326 Bug: apache_beam.io.gcp.pubsublite.ReadFromPubSubLite not working https://github.com/apache/beam/issues/28142 [Bug]: [Go SDK] Memory seems to be leaking on 2.49.0 with Dataflow https://github.com/apache/beam/issues/27892 [Bug]: ignoreUnknownValues not working when using CreateDisposition.CREATE_IF_NEEDED https://github.com/apache/beam/issues/27648 [Bug]: Python SDFs (e.g. PeriodicImpulse) running in Flink and polling using tracker.defer_remainder have checkpoint size growing indefinitely https://github.com/apache/beam/issues/27616 [Bug]: Unable to use applyRowMutations() in bigquery IO apache beam java https://github.com/apache/beam/issues/27486 [Bug]: Read from datastore with inequality filters https://github.com/apache/beam/issues/27314 [Failing Test]: bigquery.StorageApiSinkCreateIfNeededIT.testCreateManyTables[1] https://github.com/apache/beam/issues/27238 [Bug]: Window trigger has lag when using Kafka and GroupByKey on Dataflow Runner https://github.com/apache/beam/issues/26911 [Bug]: UNNEST ARRAY with a nested ROW (described below) https://github.com/apache/beam/issues/26343 [Bug]: apache_beam.io.gcp.bigquery_read_it_test.ReadAllBQTests.test_read_queries is flaky https://github.com/apache/beam/issues/26329 [Bug]: BigQuerySourceBase does not propagate a Coder to AvroSource https://github.com/apache/beam/issues/26041 [Bug]: Unable to create exactly-once Flink pipeline with stream source and file sink https://github.com/apache/beam/issues/24776 [Bug]: Race condition in Python SDK Harness ProcessBundleProgress https://github.com/apache/beam/issues/24389 [Failing Test]: HadoopFormatIOElasticTest.classMethod ExceptionInInitializerError ContainerFetchException https://github.com/apache/beam/issues/24313 [Flaky]: apache_beam/runners/portability/portable_runner_test.py::PortableRunnerTestWithSubprocesses::test_pardo_state_with_custom_key_coder https://github.com/apache/beam/issues/23944 beam_PreCommit_Python_Cron regularily failing - test_pardo_large_input flaky https://github.com/apache/beam/issues/23709 [Flake]: Spark batch flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInProcessElement and ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundle https://github.com/apache/beam/issues/23525 [Bug]: Default PubsubMessage coder will drop message id and orderingKey https://github.com/apache/beam/issues/22913 [Bug]: beam_PostCommit_Java_ValidatesRunner_Flink is flakes in org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testAfterProcessingTimeContinuationTriggerUsingState https://github.com/apache/beam/issues/22605 [Bug]: Beam Python failure for dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest.test_metrics_it https://github.com/apache/beam/issues/21714 PulsarIOTest.testReadFromSimpleTopic is very flaky https://github.com/apache/beam/issues/21706 Flaky timeout in github Python unit test action StatefulDoFnOnDirectRunnerTest.test_dynamic_timer_clear_then_set_timer https://github.com/apache/beam/issues/21643 FnRunnerTest with non-trivial (order 1000 elements) numpy input flakes in non-cython environment https://github.com/apache/beam/issues/21476 WriteToBigQuery Dynamic table destinations returns wrong tableId https://github.com/apache/beam/issues/21469 beam_PostCommit_XVR_Flink flaky: Connection refused https://github.com/apache/beam/issues/21424 Java VR (Dataflow, V2, Streaming) failing: ParDoTest$TimestampTests/OnWindowExpirationTests https://github.com/apache/beam/issues/21262 Python AfterAny, AfterAll do not follow spec https://github.com/apache/beam/issues/21260 Python DirectRunner does not emit data at GC time https://github.com/apache/beam/issues/21121 apache_beam.examples.streaming_wordcount_it_t
