Re: Custom 2.20 failing on Dataflow: what am I doing wrong?

2020-02-18 Thread Alex Van Boxel
Thanks everyone. This really helped a lot. I used Gleb's tip to make it work. Successfully validated my Pull Requests against Dataflow! _/ _/ Alex Van Boxel On Mon, Feb 17, 2020 at 11:55 PM Brian Hulette wrote: > I think if you update past [1] this will go away. We had to build a new > worker

Re: [REQUEST] Workshop at Data Day in Mexico City - March 26th

2020-02-18 Thread Pablo Estrada
I suspect Gris accidentally emailed in spanish, and did not realize she was responding to the dev@ list, but it's still worth mentioning - let's stick to writing in English in the lists. This is in the spirit of being inclusive to everyone who participates in the list, and may be interested in the

[DISCUSS] Drop support for Flink 1.7

2020-02-18 Thread jincheng sun
Hi folks, Apache Flink 1.10 has completed the release announcement [1]. Then we would like to add Flink 1.10 build target and make Flink Runner compatible with Flink 1.10 [2]. So, I would suggest that at most three versions of Flink runner for Apache Beam community according to the update Policy o

[ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread Pablo Estrada
Hi everyone, Please join me and the rest of the Beam PMC in welcoming a new committer: Alex Van Boxel Alex has contributed to Beam in many ways - as an organizer for Beam Summit, and meetups - and also with the Protobuf extensions for schemas. In consideration of his contributions, the Beam PMC

Re: [ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread Brian Hulette
Congratulations Alex! Well deserved! On Tue, Feb 18, 2020 at 7:49 AM Pablo Estrada wrote: > Hi everyone, > > Please join me and the rest of the Beam PMC in welcoming a new committer: > Alex Van Boxel > > Alex has contributed to Beam in many ways - as an organizer for Beam > Summit, and meetups -

Re: [ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread Gleb Kanterov
Congratulations! On Tue, Feb 18, 2020 at 5:02 PM Brian Hulette wrote: > Congratulations Alex! Well deserved! > > On Tue, Feb 18, 2020 at 7:49 AM Pablo Estrada wrote: > >> Hi everyone, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Alex Van Boxel >> >> Alex ha

Re: Java Build broken

2020-02-18 Thread Pulasthi Supun Wickramasinghe
Hi All, Was this issue resolved? I started to get the same error on my local build suddenly. Best Regards, Pulasthi On Thu, Jan 23, 2020 at 10:17 AM Maximilian Michels wrote: > Do you have any overrides in your ~/.m2/settings.xml? The artifacts > should be found as part of Maven central, e.g.

Re: [ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread Ismaël Mejía
Congrats Alex! Well done! On Tue, Feb 18, 2020 at 5:10 PM Gleb Kanterov wrote: > Congratulations! > > On Tue, Feb 18, 2020 at 5:02 PM Brian Hulette wrote: > >> Congratulations Alex! Well deserved! >> >> On Tue, Feb 18, 2020 at 7:49 AM Pablo Estrada wrote: >> >>> Hi everyone, >>> >>> Please joi

Re: [DISCUSS] Drop support for Flink 1.7

2020-02-18 Thread je . ik
Hi Jincheng,I think there should be a "process" for this. I would propose to: a) create new branch with support for new (snapshot) flink - currently that would mean flink 1.11 b) as part of this brach drop support for all version up to N - 3I think that that dropping all versions and adding new ver

Re: [DISCUSS] Drop support for Flink 1.7

2020-02-18 Thread Ismaël Mejía
Just to be sure, you mean Flink 1.11.0-SNAPSHOT ONLY in the next branch dependency? We shou,d not have any SNAPSHOT dependency from other projects in Beam. On Tue, Feb 18, 2020 at 5:34 PM wrote: > Hi Jincheng, > I think there should be a "process" for this. I would propose to: > a) create new b

Re: [DISCUSS] Drop support for Flink 1.7

2020-02-18 Thread Thomas Weise
+1 for dropping Flink 1.7 support I agree that we should avoid the SNAPSHOT dependency. Generally I think that the version support should remain based on user feedback and independent of the Flink release policy. If there are Beam users that require an older Flink version and it is difficult to u

Re: [ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread Thomas Weise
Congratulations! On Tue, Feb 18, 2020 at 8:33 AM Ismaël Mejía wrote: > Congrats Alex! Well done! > > On Tue, Feb 18, 2020 at 5:10 PM Gleb Kanterov wrote: > >> Congratulations! >> >> On Tue, Feb 18, 2020 at 5:02 PM Brian Hulette >> wrote: >> >>> Congratulations Alex! Well deserved! >>> >>> On

Re: [DISCUSS] Drop support for Flink 1.7

2020-02-18 Thread Ismaël Mejía
+1 Forgot to mention I am also pro removal of 1.7 support, but let's wait a bit to see if someone differs. On Tue, Feb 18, 2020 at 6:46 PM Thomas Weise wrote: > +1 for dropping Flink 1.7 support > > I agree that we should avoid the SNAPSHOT dependency. > > Generally I think that the version supp

Re: [DISCUSS] Drop support for Flink 1.7

2020-02-18 Thread je . ik
Hi Ismael,yes, sure. The proposal would be to have snapshot dependency in the feature branch. The snapshot must be changed to release before merge to master.JanDne 18. 2. 2020 17:55 napsal uživatel Ismaël Mejía :Just to be sure, you mean Flink 1.11.0-SNAPSHOT ONLY in the next branch dependency?We s

Re: [ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread je . ik
Congrats Alex!JanDne 18. 2. 2020 18:46 napsal uživatel Thomas Weise :Congratulations!On Tue, Feb 18, 2020 at 8:33 AM Ismaël Mejía wrote:Congrats Alex! Well done!On Tue, Feb 18, 2020 at 5:10 PM Gleb Kanterov wrote:Congratulations!On Tue, Feb 18, 2020 at 5:02 PM

Re: [ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread Alex Van Boxel
Thank you everyone! _/ _/ Alex Van Boxel On Tue, Feb 18, 2020 at 7:05 PM wrote: > Congrats Alex! > Jan > > > Dne 18. 2. 2020 18:46 napsal uživatel Thomas Weise : > > Congratulations! > > > On Tue, Feb 18, 2020 at 8:33 AM Ismaël Mejía wrote: > > Congrats Alex! Well done! > > On Tue, Feb 18, 2

thrift command missing on Jenkins?

2020-02-18 Thread Alex Van Boxel
I think the Thrift PR broke master. I rebased (and see other new PR's) fail with: * What went wrong:*15:30:40* Execution failed for task ':sdks:java:io:thrift:compileThrift'.*15:30:40* > A problem occurred starting process 'command 'thrift'' _/ _/ Alex Van Boxel

Re: [DISCUSS] BIP reloaded

2020-02-18 Thread Alex Van Boxel
So how should we do the voting now? Ask for a vote on BIP-1, but what of open issues... could people add open issues, or should this be done before the vote? _/ _/ Alex Van Boxel On Mon, Feb 17, 2020 at 4:29 PM Jan Lukavský wrote: > Hi Alex, > > +1, I think that the current structure is cool.

Contributing Twister2 runner to Apache Beam

2020-02-18 Thread Pulasthi Supun Wickramasinghe
Hi All, I have created the initial pull request [1] to contribute the Twister2 Beam runner to the Apache Beam codebase. More information on Twister2 can be found here[2] and the Twister2 codebase is available here[3]. At the moment only batch mode is supported in the runner, but we are planning to

Re: thrift command missing on Jenkins?

2020-02-18 Thread Ismaël Mejía
Mmm that one could be on me, I tested it locally and merged the PR today, it worked flawlessly in my machine, but now I realize that I have thrift installed locally because it is a requirement when you hack on parquet-mr code. So two workarounds possible: 1. We install Thrift 0.12 in all the Jenk

Re: thrift command missing on Jenkins?

2020-02-18 Thread Ismaël Mejía
For info we decided to took the approach 2 Chris will open a PR to do so and we will get it fixed ASAP. Thanks Alex for reporting and sorry for the inconvenience. On Tue, Feb 18, 2020 at 9:36 PM Ismaël Mejía wrote: > Mmm that one could be on me, I tested it locally and merged the PR today, > it

Re: [ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread Valentyn Tymofieiev
Congratulations! On Tue, Feb 18, 2020 at 10:38 AM Alex Van Boxel wrote: > Thank you everyone! > > _/ > _/ Alex Van Boxel > > > On Tue, Feb 18, 2020 at 7:05 PM wrote: > >> Congrats Alex! >> Jan >> >> >> Dne 18. 2. 2020 18:46 napsal uživatel Thomas Weise : >> >> Congratulations! >> >> >> On Tue,

Re: [ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread Robin Qiu
Congratulations, Alex! On Tue, Feb 18, 2020 at 1:48 PM Valentyn Tymofieiev wrote: > Congratulations! > > On Tue, Feb 18, 2020 at 10:38 AM Alex Van Boxel wrote: > >> Thank you everyone! >> >> _/ >> _/ Alex Van Boxel >> >> >> On Tue, Feb 18, 2020 at 7:05 PM wrote: >> >>> Congrats Alex! >>> Jan

Re: thrift command missing on Jenkins?

2020-02-18 Thread Ismaël Mejía
For info the fix was merged into master, kudos to Christopher Larsen for the quick fix. On Tue, Feb 18, 2020 at 9:43 PM Ismaël Mejía wrote: > For info we decided to took the approach 2 Chris will open a PR to do so > and we will get it fixed ASAP. > Thanks Alex for reporting and sorry for the in

Re: [ANNOUNCE] New committer: Alex Van Boxel

2020-02-18 Thread jincheng sun
Congratulations! Best, Jincheng Robin Qiu 于2020年2月19日 周三05:52写道: > Congratulations, Alex! > > On Tue, Feb 18, 2020 at 1:48 PM Valentyn Tymofieiev > wrote: > >> Congratulations! >> >> On Tue, Feb 18, 2020 at 10:38 AM Alex Van Boxel wrote: >> >>> Thank you everyone! >>> >>> _/ >>> _/ Alex Van B

Re: Cleaning up Approximate Algorithms in Beam

2020-02-18 Thread Reza Rokni
Hi, I will be making time for completing this in March, with completion and reviews planned for April. Cheers Reza On Wed, 27 Nov 2019 at 02:29, Robert Bradshaw wrote: > I think this thread is sufficient. > > On Mon, Nov 25, 2019 at 5:59 PM Reza Rokni wrote: > >> Hi, >> >> So do we need a vo

Re: Please comment on draft comms strategy by Oct 16

2020-02-18 Thread Matthias Baetens
To make things more concrete, we could start by giving the YouTube channel more structure & drafting Tweets to go out on the different channels. Is this something you'd be able to help out with? Thanks! Matthias On Sun, 16 Feb 2020 at 10:29, Matthias Baetens wrote: > Hey Maria, > > Great work!!