Re: Automation for Jira

2020-06-01 Thread Kenneth Knowles
I have now added modified 4: 4a. labeling stale-P2 for unassigned 60 day old jiras 4b. after 14 days downgrading stale-P2 labeled jiras to P3 On Mon, Jun 1, 2020 at 9:06 PM Kenneth Knowles wrote: > I just added 3a and 3b. The comments will appear to be coming from me. > That is a

Re: Automation for Jira

2020-06-01 Thread Kenneth Knowles
I just added 3a and 3b. The comments will appear to be coming from me. That is a misconfiguration that I have now fixed. In the future they will come from the "Beam Jira Bot". There were 1119 stale-assigned issues. Kenn On Fri, May 1, 2020 at 1:41 PM Kenneth Knowles wrote: > Based on the mild

Re: Jira Beam Contributor Permission

2020-06-01 Thread Prathap Reddy
Thanks Ahmet On 2020/06/02 02:51:41, Ahmet Altay wrote: > Welcome. I added you as a contributor. > > On Mon, Jun 1, 2020 at 7:51 PM Prathap Reddy > wrote: > > > Hi All, > > > > I am Prathap Reddy from Google and would like to contribute to beam. > > Please add me (ASF ID: prathapreddy22) as

Re:

2020-06-01 Thread Ahmet Altay
Welcome. I added you as a contributor. On Mon, Jun 1, 2020 at 7:51 PM Prathap Reddy wrote: > Hi All, > > I am Prathap Reddy from Google and would like to contribute to beam. > Please add me (ASF ID: prathapreddy22) as a contributor in the Beam issue > tracker. > > Thanks, > Prathap > > >

[no subject]

2020-06-01 Thread Prathap Reddy
Hi All, I am Prathap Reddy from Google and would like to contribute to beam. Please add me (ASF ID: prathapreddy22) as a contributor in the Beam issue tracker. Thanks, Prathap

Multiple Tenant Consolidation via ElasticSearch in Beam Pipeline

2020-06-01 Thread Rion Williams
Hi folks, I was talking with a colleague about a scenario he was facing and we were exploring the idea of Beam as a possible solution. I thought I’d reach out to the audience hear to get their opinions. Basically, we have a series of single tenant Elasticsearch indices that we are attempting

Re: Jira components for cross-language transforms

2020-06-01 Thread Kenneth Knowles
On Sun, May 31, 2020 at 12:34 PM Chamikara Jayalath wrote: > > > On Fri, May 29, 2020 at 8:53 PM Kenneth Knowles wrote: > >> -0, sorry I'm late. But I guess you are not sorry since everyone else >> agrees :-) >> >> I just don't know what this accomplishes. Most components correspond to a >>

Re: dealing with late data output timestamps

2020-06-01 Thread Kenneth Knowles
Quick reply about one top-level thing: output timestamps and watermark holds are closely related. A hold is precisely reserving the right to output at a particular time. The part that is unintuitive is that these are ever different. That is, really, a hack to allow downstream processing to proceed

Re: Fwd: [DISCUSSION] Use github actions for python wheels ?

2020-06-01 Thread Ahmet Altay
> @Ahmet Altay happy to understand the extent of what you had in mind, maybe the extensions are not as important to plan out, as they're straightforwardly bolted on (ex: daily builds). More tactically would be valuable to ensure I understand what all needs to occur. Any other source of info to

Re: latest release on Github

2020-06-01 Thread Udi Meiri
Thanks Nathan and Kyle! On Mon, Jun 1, 2020 at 12:22 PM Kyle Weaver wrote: > Filed https://jira.apache.org/jira/browse/BEAM-10168 > > On Mon, Jun 1, 2020 at 3:20 PM Kyle Weaver wrote: > >> I fixed it. There was a discussion on the mailing list recently about >> automating Github releases [1],

Re: latest release on Github

2020-06-01 Thread Kyle Weaver
Filed https://jira.apache.org/jira/browse/BEAM-10168 On Mon, Jun 1, 2020 at 3:20 PM Kyle Weaver wrote: > I fixed it. There was a discussion on the mailing list recently about > automating Github releases [1], short of that however we can just use the > UI. > > [1] >

Re: latest release on Github

2020-06-01 Thread Kyle Weaver
I fixed it. There was a discussion on the mailing list recently about automating Github releases [1], short of that however we can just use the UI. [1] https://lists.apache.org/thread.html/re367d262333078501c47856e9b8a0fc3fd7db60c2d2ebb181275481a%40%3Cdev.beam.apache.org%3E On Mon, Jun 1, 2020

latest release on Github

2020-06-01 Thread Udi Meiri
Hi, Trying out the new Github layout (feature preview) I've noticed that the latest release is featured more prominently and is at v2.16.0 for some reason. https://github.com/apache/beam/releases/tag/v2.16.0 Any idea how to fix this, and what instructions should be added to the release guide?

Re: 2.22.0 Release Update

2020-06-01 Thread Ismaël Mejía
I agree but having noisey test signals when validating a release does not sound also as a good idea. On Mon, Jun 1, 2020 at 7:18 PM Brian Hulette wrote: > > I don't think https://issues.apache.org/jira/browse/BEAM-10024 and > https://issues.apache.org/jira/browse/BEAM-10025 should block the

Re: New Dev

2020-06-01 Thread Ismaël Mejía
Welcome Ben! On Mon, Jun 1, 2020 at 7:28 PM Pablo Estrada wrote: > > Welcome Ben! > I've added you as a contributor. > Best > -P. > > On Mon, Jun 1, 2020 at 9:44 AM Benji Mitchell > wrote: >> >> Hi Beam dev team. My name is Ben Mitchell and I'm interested in >> contributing to the Beam

Re: New Dev

2020-06-01 Thread Pablo Estrada
Welcome Ben! I've added you as a contributor. Best -P. On Mon, Jun 1, 2020 at 9:44 AM Benji Mitchell < benjamin.neil.mitch...@gmail.com> wrote: > Hi Beam dev team. My name is Ben Mitchell and I'm interested in > contributing to the Beam project! I would like access to assign some > beginner Jira

Re: 2.22.0 Release Update

2020-06-01 Thread Brian Hulette
I don't think https://issues.apache.org/jira/browse/BEAM-10024 and https://issues.apache.org/jira/browse/BEAM-10025 should block the release since they're not regressions, they're failures in a newly added test that is misclassified. Brian On

Re: [ANNOUNCE] Beam 2.21.0 Released

2020-06-01 Thread Yichi Zhang
Great work. Thanks, Kyle! On Fri, May 29, 2020 at 6:05 PM Ahmet Altay wrote: > Thank you, Kyle! > > On Fri, May 29, 2020 at 12:52 AM Ismaël Mejía wrote: > >> Thanks Kyle for all the work and patience as a release manager for this >> version. >> >> On Thu, May 28, 2020, 7:47 PM Udi Meiri

New Dev

2020-06-01 Thread Benji Mitchell
Hi Beam dev team. My name is Ben Mitchell and I'm interested in contributing to the Beam project! I would like access to assign some beginner Jira tickets to myself. ASF Username: bennm. Regards. Ben.

Re: Fwd: [DISCUSSION] Use github actions for python wheels ?

2020-06-01 Thread Kamil Wasilewski
"unistd.h" C header is present on POSIX systems (MacOS and Linux), but not on Windows, therefore you can't build a wheel for Windows. I took a look and "statesampler_fast.pyx" uses "unistd.h" only because of the `usleep` function. Unless we use C++ which offers [1], the solution would be to

Re: Fwd: [DISCUSSION] Use github actions for python wheels ?

2020-06-01 Thread Tobiasz Kędzierski
Hi everyone, Austin Benett I would like cooperate with you with introducing GitHub actions for python wheels. Since last week I am trying to figure out how to do this and I was able to build wheels for Linux and MacOS with help of https://github.com/joerick/cibuildwheel/

Beam Dependency Check Report (2020-06-01)

2020-06-01 Thread Apache Jenkins Server
ERROR: File 'src/build/dependencyUpdates/beam-dependency-check-report.html' does not exist