Re: [VOTE] Release 2.58.0, release candidate #2

+1 (non-binding) Tested DataflowTemplates (including YamlTemplate, excluding Python UDF) integration suites. On Thu, Aug 1, 2024 at 3:15 AM Jan Lukavský wrote: > +1 (binding) > > Tested FlinkRunner with Java SDK. > > Jan > On 7/30/24 21:12, Jack McCluskey via dev wrote: > > Hi everyone, > >

Re: How to override sticky dependencies in gradle?

Update: "org.apache.hive:hive-exec" is actually a shaded jar that doesn't do any repackaging for popular libraries (e.g. like "protobuf-java"). My gradle logic was working as intended, but I was still running into issues because multiple classes with the same name were available to the Java class

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31985 [Failing Test]:

Re: [VOTE] Release 2.58.0, release candidate #2

+1 (binding) Tested FlinkRunner with Java SDK.  Jan On 7/30/24 21:12, Jack McCluskey via dev wrote: Hi everyone, Please review and vote on the release candidate #2 for the version 2.58.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific

Re: [VOTE] Release 2.58.0, release candidate #2

+1 (non-binding). Tested it with a simple Dataflow ML job: https://github.com/google/dataflow-ml-starter/actions/runs/10178582950/job/28152491434 . On Wed, Jul 31, 2024 at 3:12 AM Jack McCluskey via dev wrote: > Hi everyone, > > Please review and vote on the release candidate #2 for the version

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31985 [Failing Test]:

[VOTE] Release 2.58.0, release candidate #2

Hi everyone, Please review and vote on the release candidate #2 for the version 2.58.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) Reviewers are encouraged to test their own use cases with the release candidate, and vote +1 if no

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31985 [Failing Test]:

Re: How to override sticky dependencies in gradle?

"resolutionStrategy.force" should work. Use "./gradlew dependencies" to debug the dependencies. https://docs.gradle.org/current/userguide/viewing_debugging_dependencies.html On Mon, Jul 29, 2024 at 4:23 PM Ahmed Abualsaud via dev wrote: > Hey all, > > Does anyone have experience with sticky

How to override sticky dependencies in gradle?

Hey all, Does anyone have experience with sticky dependencies in gradle? I'm experimenting with the new Managed Iceberg connector and trying to write to GCS with a Hive catalog. I naturally need to pull some hive dependencies, but one particular module is very stubborn with its dependencies:

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31985 [Failing Test]:

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31985 [Failing Test]:

[PR] Publish docs for 2.58.0 release [beam-site]

jrmccluskey opened a new pull request, #668: URL: https://github.com/apache/beam-site/pull/668 Content generated from https://github.com/apache/beam/tree/v2.58.0-RC2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Publish docs for 2.58.0 release [beam-site]

jrmccluskey closed pull request #667: Publish docs for 2.58.0 release URL: https://github.com/apache/beam-site/pull/667 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Publish docs for 2.58.0 release [beam-site]

jrmccluskey commented on PR #667: URL: https://github.com/apache/beam-site/pull/667#issuecomment-2250650514 Moving to RC2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P0 Issues: https://github.com/apache/beam/issues/31970 [Bug]: Beam YAML

Re: Apache beam Python ReadFromKafka Issue GroupByKey cannot be applied to an unbounded PCollection

Please use beam.io.fileio.WriteToFiles On Thu, Jul 25, 2024 at 2:48 AM Dhirendra Singh wrote: > Hello Beam Devs, > > Thank you for your help. > I have been trying to connect to the Kafka Enabled Azure event hub > using Dataflow beam code using Python. > Apache Beam version: 2.56.0 > Python

Re: [VOTE] Release 2.58.0, release candidate #1

Ack, will wait for a fix + cherrypick and advance to RC2. This vote is now closed. I'm anticipating this bug fix being the only difference between RCs 1 and 2. Thanks, Jack McCluskey On Wed, Jul 24, 2024 at 4:27 PM Jeff Kinard wrote: > -1 > > Candidate breaks the Beam YAML provider framework.

Re: [VOTE] Release 2.58.0, release candidate #1

-1 Candidate breaks the Beam YAML provider framework. Filed bug: https://github.com/apache/beam/issues/31970 I am working on a fix right now. Requesting to release rc3 with either a revert of affected commit or include my upcoming fix. Thanks, - Jeff On Wed, Jul 17, 2024 at 5:35 PM Jack

Re: [VOTE] Release 2.58.0, release candidate #1

+1 (binding) Checked that the Go Prism linux amd64 artifact worked with a Go pipeline. On 2024/07/24 00:50:36 Valentyn Tymofieiev via dev wrote: > +1 (binding), checked that Dataflow containers have been released, checked > release notes, spot-checked some Python test suites and ran a pipeline

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P0 Issues: https://github.com/apache/beam/issues/31913 [Bug]:

Re: [VOTE] Release 2.58.0, release candidate #1

+1 (binding), checked that Dataflow containers have been released, checked release notes, spot-checked some Python test suites and ran a pipeline on Python 3.12. On Tue, Jul 23, 2024 at 6:20 AM Jack McCluskey via dev wrote: > Hey everyone, > > Validation has had positive results so far;

Re: [VOTE] Release 2.58.0, release candidate #1

Hey everyone, Validation has had positive results so far; however, we are lacking PMC votes to promote the candidate. Non-PMC members should continue any validation, but we do need at least two more PMC members involved. Thanks, Jack McCluskey On Mon, Jul 22, 2024 at 9:56 AM Yi Hu via dev

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P0 Issues: https://github.com/apache/beam/issues/31913 [Bug]:

Re: [VOTE] Release 2.58.0, release candidate #1

+1 (non-binding) Validated DataflowTemplates Java integration tests (i.e. except for YamlTemplates and except for PythonUDF templates): https://github.com/GoogleCloudPlatform/DataflowTemplates/pull/1738 also validated GCP IO load tests on Dataflow (legacy runner and runner v2):

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P0 Issues: https://github.com/apache/beam/issues/31913 [Bug]:

Beam High Priority Issue Report (64)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P0 Issues: https://github.com/apache/beam/issues/31913 [Bug]:

Re: [VOTE] Release 2.58.0, release candidate #1

+1 (binding) Validated Flink Runner with Java SDK.  Jan On 7/18/24 16:24, XQ Hu via dev wrote: +1 (non-binding). Tested it with a simple Dataflow ML pipeline and looks good: https://github.com/google/dataflow-ml-starter/actions/runs/9991815564/job/27615395240 On Wed, Jul 17, 2024 at 5:35 

Re: [VOTE] Release 2.58.0, release candidate #1

+1 (non-binding). Tested it with a simple Dataflow ML pipeline and looks good: https://github.com/google/dataflow-ml-starter/actions/runs/9991815564/job/27615395240 On Wed, Jul 17, 2024 at 5:35 PM Jack McCluskey via dev wrote: > Hi everyone, > > Please review and vote on the release candidate

Beam High Priority Issue Report (63)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P0 Issues: https://github.com/apache/beam/issues/31913 [Bug]:

[VOTE] Release 2.58.0, release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for the version 2.58.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) Reviewers are encouraged to test their own use cases with the release candidate, and vote +1 if no

Beam High Priority Issue Report (61)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P0 Issues: https://github.com/apache/beam/issues/31913 [Bug]:

[PR] Publish docs for 2.58.0 release [beam-site]

jrmccluskey opened a new pull request, #667: URL: https://github.com/apache/beam-site/pull/667 Content generated from https://github.com/apache/beam/tree/v2.58.0-RC1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Beam High Priority Issue Report (58)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31859 The Cancel Stale

Beam High Priority Issue Report (59)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31882 The Build python

Re: Apache beam github repo collaborator

Welcome to Beam! You can start contributing now. Some useful docs: - https://github.com/apache/beam/blob/master/CONTRIBUTING.md - https://github.com/apache/beam/tree/master/contributor-docs - https://cwiki.apache.org/confluence/display/BEAM/Developer+Guides You can start with some good

Apache beam github repo collaborator

Hi Team, I would like to contribute to the Apache beam repository for which I would like to request for the Contributor Access to the repo. Thanks. Best Regards, Prerit Chandok

Beam High Priority Issue Report (56)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31859 The Cancel Stale

Re: Beam 2.58.0 Release Branch Cut

Thank you! On Wed, Jul 10, 2024 at 8:59 AM Jack McCluskey via dev wrote: > Hey everyone, > > I just cut the 2.58.0 release branch ( > https://github.com/apache/beam/tree/release-2.58.0) and will be working > on getting the release branch stabilized. > > There are currently two release blockers

Beam 2.58.0 Release Branch Cut

Hey everyone, I just cut the 2.58.0 release branch ( https://github.com/apache/beam/tree/release-2.58.0) and will be working on getting the release branch stabilized. There are currently two release blockers on the release milestone ( https://github.com/apache/beam/milestone/22) with fixes

Beam High Priority Issue Report (52)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31814 [Failing Test]:

Beam High Priority Issue Report (50)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31800 [Bug]:

Re: [ANNOUNCE] New Committer: XQ Hu

Congratulations XQ! On Tue, Jun 25, 2024 at 9:17 AM Ahmed Abualsaud via dev wrote: > Congrats XQ! > > On Tue, Jun 25, 2024 at 3:17 AM Desire L wrote: > >> Congratulations XQ!邏邏 >> >> 2024. 6. 25. 오전 8:32, XQ Hu via dev 작성: >> >>  >> Thanks a lot! Happy to keep working with all of you! >> >>

Beam High Priority Issue Report (49)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Re: design docs that get deleted, etc

> google docs -> markdown converters https://workspace.google.com/marketplace/app/docs_to_markdown/700168918607 is a pretty good gdocs addon that converts to markdown There are some issues which may need some manual cleanup, but provided the Gdoc is relatively 'simple', it works well. --

Beam High Priority Issue Report (49)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Re: [EXTERNAL] Re: Beam Example Bugs

Created a new issue: https://github.com/apache/beam/issues/31780. Best regards, Vitaly From: Robert Bradshaw via dev Sent: Wednesday, 3 July 2024 11:12:49 PM To: dev@beam.apache.org Cc: Robert Bradshaw Subject: [EXTERNAL] Re: Beam Example Bugs We should be

Beam High Priority Issue Report (49)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Re: Beam Example Bugs

We should be validating as much of our documentation as possible in our testing, e.g. https://github.com/apache/beam/tree/master/sdks/python/apache_beam/examples/snippets is where the actual code and examples on our website (for Python) lives to ensure it is regularly tested (on each PR) doesn't

Re: Beam Example Bugs

Thanks for flagging this Joey, I reopened https://github.com/apache/beam/issues/31624. We can certainly validate any aspect of Beam during the release. I think it should be possible to detect issues like this in a website/playground test suite, and include that suite in the list of postcommit

Beam Example Bugs

There are a handful of bugs with the interactive examples on the Beam docs page https://beam.apache.org/documentation/transforms/python/elementwise/flatmap/#example-3-flatmap-without-a-function https://beam.apache.org/documentation/transforms/python/elementwise/map/ (example 8) I wonder if it

Beam High Priority Issue Report (49)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31725 The PostCommit

Re: [Discussion] Strategy on drop Java 8 support

Thank you all for the inputs. I see we currently have agreements on 1. bumping straight to Java 17 for the build system. For the concern for > (we need to be sure we don't rely on pieces of the standard library that are missing in JRE8) in Java9+ `--release 8` javac flag does exactly this, and

Beam High Priority Issue Report (52)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31725 The PostCommit

Re: [Discussion] Strategy on drop Java 8 support

;tldr - I think we are too early to drop Java 8 support, and that means we need to keep building/testing Java 8. > Java8 has ended premier support in March 2022, the next LTS, Java11 also ended premier support in Sept 2023. Should we bump the default Java version to 17 for CI at once (while

Beam High Priority Issue Report (52)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31725 The PostCommit

Re: [Python SDK] Allowing int values for floats when checking types

Yeah, that makes a lot of sense to me. (I suppose we could promote both of them to complexes as well.) On Fri, Jun 28, 2024 at 8:36 AM Joey Tran wrote: > > Hey all, > > We're running into a fairly common situation where we get a TypeCheckError > when we supply an int value where a float

[Python SDK] Allowing int values for floats when checking types

Hey all, We're running into a fairly common situation where we get a TypeCheckError when we supply an int value where a float parameter is expected. It's easy enough to work around this on a case-by-case basis by just casting ints to floats, but this is an easy thing to forget to do, which means

Beam High Priority Issue Report (51)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Beam High Priority Issue Report (50)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Beam 2.58.0 Release

Hey everyone, The next release (2.58.0) branch cut is scheduled for July 10, 2024, 2 weeks from today, according to the release calendar [1]. I'd like to perform this release; I will cut the branch on that date, and cherrypick release-blocking fixes afterwards, if any. Please help with the

[RESULT] [VOTE] Release 2.57.0, release candidate #1

Thanks for validating and voting everyone! There are 10 approving votes, 6 of which are binding: - Jean-Baptiste Onofré (binding) - Jan Lukavský (binding) - Robert Bradshaw (binding) - Kenneth Knowles (binding) - Valentyn Timofieiev (binding) - Chamikara Jayalath (binding) - XQ Hu -

Beam High Priority Issue Report (50)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Re: [VOTE] Release 2.57.0, release candidate #1

+1 Validated multi-lang Java/Python pipelines. Thanks, Cham On Tue, Jun 25, 2024 at 4:45 PM Valentyn Tymofieiev via dev < dev@beam.apache.org> wrote: > +1. > > On Tue, Jun 25, 2024 at 12:18 PM Kenneth Knowles wrote: > >> +1 (binding) >> >> I will continue to wait until 3 work days to conclude

Re: [VOTE] Release 2.57.0, release candidate #1

+1. On Tue, Jun 25, 2024 at 12:18 PM Kenneth Knowles wrote: > +1 (binding) > > I will continue to wait until 3 work days to conclude the vote, for plenty > of validation time. > > On Mon, Jun 24, 2024 at 8:38 PM Yi Hu via dev wrote: > >> +1 (non-binding) >> >> Validated DataflowTemplates

Re: [VOTE] Release 2.57.0, release candidate #1

+1 (binding) I will continue to wait until 3 work days to conclude the vote, for plenty of validation time. On Mon, Jun 24, 2024 at 8:38 PM Yi Hu via dev wrote: > +1 (non-binding) > > Validated DataflowTemplates integration tests (all templates except for > YamlTemplates, where a separate vote

Re: [ANNOUNCE] New Committer: XQ Hu

Congrats XQ! On Tue, Jun 25, 2024 at 3:17 AM Desire L wrote: > Congratulations XQ!邏邏 > > 2024. 6. 25. 오전 8:32, XQ Hu via dev 작성: > >  > Thanks a lot! Happy to keep working with all of you! > > On Mon, Jun 24, 2024 at 6:22 PM Valentyn Tymofieiev via dev < > dev@beam.apache.org> wrote: > >>

Beam High Priority Issue Report (50)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Re: [ANNOUNCE] New Committer: XQ Hu

Congratulations XQ!邏邏2024. 6. 25. 오전 8:32, XQ Hu via dev 작성:Thanks a lot! Happy to keep working with all of you!On Mon, Jun 24, 2024 at 6:22 PM Valentyn Tymofieiev via dev wrote:Congratulations and thank you for all your contributions to Beam!On Mon, Jun 24, 2024 at 1:49 PM

Re: [ANNOUNCE] New Committer: XQ Hu

Congratulations XQ!  Jan On 6/25/24 06:43, Chamikara Jayalath via dev wrote: Congrats XQ! On Mon, Jun 24, 2024 at 9:28 PM Ritesh Ghorse via dev wrote: Congratulations XQ! Well deserved! On Tue, Jun 25, 2024 at 7:37 AM Damon Douglas wrote: Congratulations!

Re: [ANNOUNCE] New Committer: XQ Hu

Congrats XQ! On Mon, Jun 24, 2024 at 9:28 PM Ritesh Ghorse via dev wrote: > Congratulations XQ! Well deserved! > > On Tue, Jun 25, 2024 at 7:37 AM Damon Douglas > wrote: > >> Congratulations!  Well deserved! >> >> On Mon, Jun 24, 2024, 4:32 PM XQ Hu via dev wrote: >> >>> Thanks a

Re: [ANNOUNCE] New Committer: XQ Hu

Congratulations XQ! Well deserved! On Tue, Jun 25, 2024 at 7:37 AM Damon Douglas wrote: > Congratulations!  Well deserved! > > On Mon, Jun 24, 2024, 4:32 PM XQ Hu via dev wrote: > >> Thanks a lot! Happy to keep working with all of you! >> >> On Mon, Jun 24, 2024 at 6:22 PM Valentyn

Re: [VOTE] Release 2.57.0, release candidate #1

+1 (non-binding) Validated DataflowTemplates integration tests (all templates except for YamlTemplates, where a separate vote is entered; and except for PythonUDF templates due to https://github.com/apache/beam/issues/31680): https://github.com/GoogleCloudPlatform/DataflowTemplates/pull/1681 On

Re: [VOTE] Release 2.57.0, release candidate #1

+1 (non-binding) - Validated against Dataflow YamlTemplate and several Yaml pipeline examples. - Jeff On Fri, Jun 21, 2024 at 4:18 PM Kenneth Knowles wrote: > Hi everyone, > > Please review and vote on the release candidate #1 for the version 2.57.0, > as follows: > > [ ] +1, Approve the

Re: [ANNOUNCE] New Committer: XQ Hu

Congratulations!  Well deserved! On Mon, Jun 24, 2024, 4:32 PM XQ Hu via dev wrote: > Thanks a lot! Happy to keep working with all of you! > > On Mon, Jun 24, 2024 at 6:22 PM Valentyn Tymofieiev via dev < > dev@beam.apache.org> wrote: > >> Congratulations and thank you for all your

Re: [ANNOUNCE] New Committer: XQ Hu

Thanks a lot! Happy to keep working with all of you! On Mon, Jun 24, 2024 at 6:22 PM Valentyn Tymofieiev via dev < dev@beam.apache.org> wrote: > Congratulations and thank you for all your contributions to Beam! > > On Mon, Jun 24, 2024 at 1:49 PM Robert Burke wrote: > >> Congratulations XQ! >>

Re: [VOTE] Release 2.57.0, release candidate #1

I've re-run the jobs failing on the verification PR. There are two that remain red (or so flaky I cannot get a green in a few reruns) "PostCommit XVR GoUsingJava Dataflow" - this is perma-red and appears to have never had a successful run in any context. "PostCommit Java PVR Spark Batch" - this

Re: [ANNOUNCE] New Committer: XQ Hu

Congratulations and thank you for all your contributions to Beam! On Mon, Jun 24, 2024 at 1:49 PM Robert Burke wrote: > Congratulations XQ! > > On Mon, Jun 24, 2024, 1:43 PM Svetak Sundhar via dev > wrote: > >> Congrats XQ! >> >> >> Svetak Sundhar >> >> Data Engineer >> s

Re: [VOTE] Release 2.57.0, release candidate #1

+1 (nonbinding) tested in a customer environment (specifically java sdk). Svetak Sundhar Data Engineer s vetaksund...@google.com On Mon, Jun 24, 2024 at 12:32 PM Kenneth Knowles wrote: > > > On Mon, Jun 24, 2024 at 9:26 AM Valentyn Tymofieiev via dev < > dev@beam.apache.org> wrote: > >>

Re: [ANNOUNCE] New Committer: XQ Hu

Congratulations XQ! On Mon, Jun 24, 2024, 1:43 PM Svetak Sundhar via dev wrote: > Congrats XQ! > > > Svetak Sundhar > > Data Engineer > s vetaksund...@google.com > > > > On Mon, Jun 24, 2024 at 4:42 PM Byron Ellis via dev > wrote: > >> Congrats XQ! >> >> On Mon, Jun 24, 2024 at 1:40 PM

Re: [ANNOUNCE] New Committer: XQ Hu

Congrats XQ! Svetak Sundhar Data Engineer s vetaksund...@google.com On Mon, Jun 24, 2024 at 4:42 PM Byron Ellis via dev wrote: > Congrats XQ! > > On Mon, Jun 24, 2024 at 1:40 PM Kenneth Knowles wrote: > >> Hi all, >> >> Please join me and the rest of the Beam PMC in welcoming a new

Re: [ANNOUNCE] New Committer: XQ Hu

Congrats XQ! On Mon, Jun 24, 2024 at 1:40 PM Kenneth Knowles wrote: > Hi all, > > Please join me and the rest of the Beam PMC in welcoming a new committer: > XQ Hu (x...@apache.org). > > XQ has been with Beam since mid-2022. In that time he's contributed many > fixes throughout the project,

[ANNOUNCE] New Committer: XQ Hu

Hi all, Please join me and the rest of the Beam PMC in welcoming a new committer: XQ Hu (x...@apache.org). XQ has been with Beam since mid-2022. In that time he's contributed many fixes throughout the project, including examples, documentation fixes, bugfixes, test fixes, dependency upgrades,

Re: [Discussion] Strategy on drop Java 8 support

On Mon, Jun 24, 2024 at 9:59 AM Kenneth Knowles wrote: > > Step 1 and 2 sound great. (I tried a first step with > https://github.com/apache/beam/pull/29992 but didn't have bandwidth) > > This will make it easier for people to get started with beam without having > to deal with ancient version

Re: [Discussion] Strategy on drop Java 8 support

Step 1 and 2 sound great. (I tried a first step with https://github.com/apache/beam/pull/29992 but didn't have bandwidth) This will make it easier for people to get started with beam without having to deal with ancient version compatibility and installing old Java, etc. Even as a minor point,

[Discussion] Strategy on drop Java 8 support

Dear Beam developers, As Java8 has gone through end-of-public-update, many Beam dependencies have already deprecated Java8 (see [1]), and dropping Java8 supports are planned. Beam hasn't deprecated Java8, moreover, currently Beam CI is using Java8 to test and release Beam. Referring to other

Re: [VOTE] Release 2.57.0, release candidate #1

On Mon, Jun 24, 2024 at 9:26 AM Valentyn Tymofieiev via dev < dev@beam.apache.org> wrote: > Ran a Python 3.12 pipeline on Dataflow without issues, noted a suboptimal > dependency resolution: https://github.com/apache/beam/issues/31676, > verified that this is not a regression in 2.57.0, will

Re: [VOTE] Release 2.57.0, release candidate #1

Ran a Python 3.12 pipeline on Dataflow without issues, noted a suboptimal dependency resolution: https://github.com/apache/beam/issues/31676, verified that this is not a regression in 2.57.0, will follow up separately. https://github.com/apache/beam/pull/31513 has several failures, can you please

Re: [VOTE] Release 2.57.0, release candidate #1

+1 (binding) The signatures and artifacts all look good. Also tested out some pipelines with the Python SDK installed into a fresh virtual environment. On Mon, Jun 24, 2024 at 2:20 AM Jan Lukavský wrote: > > +1 (binding) > > Tested Java SDK with Flink Runner 1.18. > > Jan > > On 6/22/24

Beam High Priority Issue Report (50)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Re: [VOTE] Release 2.57.0, release candidate #1

+1 (binding) Tested Java SDK with Flink Runner 1.18.  Jan On 6/22/24 06:43, Jean-Baptiste Onofré wrote: +1 (binding) Regards JB On Fri, Jun 21, 2024 at 10:17 PM Kenneth Knowles wrote: Hi everyone, Please review and vote on the release candidate #1 for the version 2.57.0, as follows: [

Re: [VOTE] Release 2.57.0, release candidate #1

+1 (binding) Regards JB On Fri, Jun 21, 2024 at 10:17 PM Kenneth Knowles wrote: > > Hi everyone, > > Please review and vote on the release candidate #1 for the version 2.57.0, as > follows: > > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments)

Re: [VOTE] Release 2.57.0, release candidate #1

+1 (non-binding). Tested this with a simple Dataflow ML pipeline with Python: https://github.com/google/dataflow-ml-starter/actions/runs/9619553472/job/26536415002 On Fri, Jun 21, 2024 at 4:18 PM Kenneth Knowles wrote: > Hi everyone, > > Please review and vote on the release candidate #1 for

[VOTE] Release 2.57.0, release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for the version 2.57.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) Reviewers are encouraged to test their own use cases with the release candidate, and vote +1 if

Re: Getting started with Apache Beam Quest

Hi Ronobir, The quest is free now; could you navigate to https://www.cloudskillsboost.google/catalog?qlcampaign=3l-event-90, and search "Getting Started with Apache Beam" and try? Let me know if you run into any issues, Svetak Sundhar Data Engineer s vetaksund...@google.com On Tue, Jun

Beam High Priority Issue Report (50)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Beam High Priority Issue Report (51)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Beam High Priority Issue Report (51)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Beam High Priority Issue Report (52)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

Beam High Priority Issue Report (51)

This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/31432 The PreCommit Java

  1   2   3   4   5   6   7   8   9   10   >