Re: Beam Website Feedback

2021-10-06 Thread Ahmet Altay
Thank you for reporting. https://github.com/apache/beam/pull/15671 would fix the issues you mentioned. On Wed, Oct 6, 2021 at 2:56 PM Mike Stayton wrote: > Your contact-us page has some bad links > > https://beam.apache.org/community/contact-us/ > Subsribe and Unsubscribe: > > Prior to sending

Beam Website Feedback

2021-10-06 Thread Mike Stayton
Your contact-us page has some bad links https://beam.apache.org/community/contact-us/ Subsribe and Unsubscribe: Prior to sending emails to these lists, you need to subscribe. To subscribe, send a blank email touser-subscr...@beam.apache.org

Re: Flaky test in JmsIO help

2021-10-06 Thread Miguel Anzo Palomo
Thanks for the observations, I’m still looking at the issue. As mentioned by Alexey, yes, the flake happens very rarely, I haven’t found regular occurrences. I'm looking for the possibility of it being a race condition issue as mentioned, but the error seems to happen when the first messages are

Re: [Question|Assignee] I am happy to be assignee for the task https://issues.apache.org/jira/browse/BEAM-12730.

2021-10-06 Thread Dmitrii Kuzin
Hi, Pablo! No, I don’t have a use case around this bug. But I thought, it is good opportunity for making more in-depth contributions to Beam Python) From: Pablo Estrada Reply-To: "dev@beam.apache.org" Date: Wednesday, October 6, 2021 at 22:10 To: dev Subject: Re: [Question|Assignee] I am

Re: [Question|Assignee] I am happy to be assignee for the task https://issues.apache.org/jira/browse/BEAM-12730.

2021-10-06 Thread Dmitrii Kuzin
Alexey, thank you! From: Alexey Romanenko Reply-To: "dev@beam.apache.org" Date: Wednesday, October 6, 2021 at 19:03 To: "dev@beam.apache.org" Subject: Re: [Question|Assignee] I am happy to be assignee for the task https://issues.apache.org/jira/browse/BEAM-12730. Hi Dmitrii, I added you as

Re: Multi Environment Support

2021-10-06 Thread Ke Wu
I have a quick follow up questions. When using multiple external environments, is there a way to configure the multiple external service address? It looks like the current PipelineOptions only supports specifying one external address. Best, Ke > On Oct 4, 2021, at 4:12 PM, Ke Wu wrote: > >

Flaky test issue report (32)

2021-10-06 Thread Beam Jira Bot
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to

P1 issues report (43)

2021-10-06 Thread Beam Jira Bot
This is your daily summary of Beam's current P1 issues, not including flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20priority%20%3D%20P1%20AND%20(labels%20is%20EMPTY%20OR%20labels%20!%3D%20flake). See

Re: Reshuffle Discrepancy in Classic vs Portable Pipeline

2021-10-06 Thread Robert Burke
The GoSDK handles the urn as unkeyed. That is, reshuffling a PCollection will ignore the keys, and produce a PCollection> with the random keys. This would split user keys up to multiple partitions. This is the same as though it were unkeyed. Doing anything with the user key specifically would

Re: Reshuffle Discrepancy in Classic vs Portable Pipeline

2021-10-06 Thread Ke Wu
> The only usage of of the keyed Reshuffle in the Java SDK is for write files > with a single key and the use case there would benefit from being replaced > with GroupIntoBatches instead. I think there are more use cases for keyed reshuffle , e.g. in Samza runner, it is also used when we

Re: Flaky test in JmsIO help

2021-10-06 Thread Alexey Romanenko
Looking at this test (“testCheckpointMarkSafety()"), I’m not sure that it’s thread-safe to use the same instance of JmsIO.UnboundedJmsReader in another thread. Probably, it may cause some race conditions there but seems it happens quite rarely. — Alexey > On 5 Oct 2021, at 21:24, JB Onofré

Re: [VOTE] Release 2.33.0, release candidate 2

2021-10-06 Thread Lukáš Drbal
+1 (non-binding) validated by running our pipelines (Java SDK, Flink Runner, Flink 1.13.2) Thanks! On Mon, Oct 4, 2021 at 11:27 PM Udi Meiri wrote: > Hi everyone, > Please review and vote on the release candidate #2 for the version 2.33.0, > as follows: > [ ] +1, Approve the release > [ ] -1,

Re: introducing myself to the Beam community

2021-10-06 Thread Alexey Romanenko
Hi Sachin, Welcome to Beam! Feel free to share your ideas or post any questions here about the things in Beam that you are mostly interested in. — Alexey > On 5 Oct 2021, at 22:09, Sachin Agarwal wrote: > > Hey folks, > > I just wanted to drop a quick note to introduce myself. I'm Sachin

Re: [Question|Assignee] I am happy to be assignee for the task https://issues.apache.org/jira/browse/BEAM-12730.

2021-10-06 Thread Alexey Romanenko
Hi Dmitrii, I added you as a contributor in Beam Jira and assigned this task to you. Thank you for contribution! — Alexey > On 6 Oct 2021, at 14:58, Dmitrii Kuzin wrote: > > Hello! > I am happy to be assignee for the task > https://issues.apache.org/jira/browse/BEAM-12730 >

[Question|Assignee] I am happy to be assignee for the task https://issues.apache.org/jira/browse/BEAM-12730.

2021-10-06 Thread Dmitrii Kuzin
Hello! I am happy to be assignee for the task https://issues.apache.org/jira/browse/BEAM-12730. Could you please assign the task to me? Thank you -- DMITRII KUZIN Lead Software Engineer Nizhny Novgorod, Russia Working Remotely Timezone: (UTC+03:00) EPAM.COM