Re: [Proposal] Requesting PMC approval to start planning for Beam Summits 2020

2020-04-02 Thread Maximilian Michels
Hi Brittany, Thanks for sharing the proposal. After we organized Beam Summit Europe and Beam Summit NA in 2019, I'm really looking forward to the digital 2020 version of the summit! tl;dr For it to be an official Beam event, the Beam trademark use needs to be approved by the PMC. We'll have a sep

Re: Unportable Dataflow Pipeline Questions

2020-04-02 Thread Chamikara Jayalath
On Wed, Apr 1, 2020 at 11:31 AM Sam Rohde wrote: > Okay cool, so it sounds like the cleanup can be done in two phases: move > the apply_ methods to transform replacements, then move Dataflow onto the > Cloudv1b3 protos. AFAIU, after phase one will make the Pipeline object > portable? If the Inter

Re: Unportable Dataflow Pipeline Questions

2020-04-02 Thread Robert Burke
In particular, ideally the Dataflow Service is handling the Dataflow specific format translation, rather than each SDK. Move the v1 beta3 pipeline to an internal detail. Ideally Dataflow would support a JobManagment endpoint directly, but I imagine that's a more involved task that's out of scope f

Re: Unportable Dataflow Pipeline Questions

2020-04-02 Thread Chamikara Jayalath
On Thu, Apr 2, 2020 at 7:48 AM Robert Burke wrote: > In particular, ideally the Dataflow Service is handling the Dataflow > specific format translation, rather than each SDK. Move the v1 beta3 > pipeline to an internal detail. > > Ideally Dataflow would support a JobManagment endpoint directly, b

[PROPOSAL] Preparing for Beam 2.21 release

2020-04-02 Thread Kyle Weaver
Hi all, The next (2.21) release branch cut is scheduled for Apr 8, according to the calendar . I would like to volunteer myself to do this release. The plan is to cut the branch on that date, an

[VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Julian Bruno
Hello Apache Beam Community, Please vote on the acceptance of the final design of the Firefly as Beam's mascot [1]. Please share your input no later than Monday, April 6, at noon Pacific Time. [ ] +1, Accept the donation of the Firefly design as Beam Mascot [ ] -1, Decline the donation of the Fi

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Andrew Pilloud
+1, Accept the donation of the Firefly design as Beam Mascot On Thu, Apr 2, 2020 at 10:19 AM Julian Bruno wrote: > Hello Apache Beam Community, > > Please vote on the acceptance of the final design of the Firefly as Beam's > mascot [1]. Please share your input no later than Monday, April 6, at n

Golang SDK Katas

2020-04-02 Thread Damon Douglas
Hello Everyone, I would like to start an initiative to contribute to the Apache Beam katas for the golang SDK. My JIRA username is `damondouglas`. I will be adding subtasks under https://issues.apache.org/jira/browse/BEAM-9676 Thank you for including me in this exciting project. Sincerely, Da

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Alex Van Boxel
I don't want to be a spoiler... but this vote feels like a final deliverable... but without a style guide as Kenn originally suggested most of use will not be able to adapt the design. This would include: - frontal view - side view - back view actually different posses so we can mix and

Re: [PROPOSAL] Preparing for Beam 2.21 release

2020-04-02 Thread Luke Cwik
Thanks for picking this up. On Thu, Apr 2, 2020 at 10:09 AM Kyle Weaver wrote: > Hi all, > > The next (2.21) release branch cut is scheduled for Apr 8, according to > the calendar > > . > I wo

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Aizhamal Nurmamat kyzy
Good point, Alex. Actually Julian and I have talked about producing this kind of guide. It will be delivered as an additional contribution in the follow up. We think this will be a derivative of the original design, and be done after the original is officially accepted. With this vote, we want to

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Alex Van Boxel
Thanks for clearing this up Aizhamal. +1 (non binding) _/ _/ Alex Van Boxel On Thu, Apr 2, 2020 at 8:14 PM Aizhamal Nurmamat kyzy wrote: > Good point, Alex. Actually Julian and I have talked about producing this > kind of guide. It will be delivered as an additional contribution in the > foll

Re: Golang SDK Katas

2020-04-02 Thread Robert Burke
Welcome to the community! It was great talking to you this morning too. As discussed: https://issues.apache.org/jira/browse/BEAM-9676 filed for Go SDK Katas The current Go SDK roadmap https://beam.apache.org/roadmap/go-sdk/ The general contribution guide https://beam.apache.org/contribute And

Re: Golang SDK Katas

2020-04-02 Thread Pablo Estrada
Very excited to get Go Katas going! On Thu, Apr 2, 2020 at 11:21 AM Robert Burke wrote: > Welcome to the community! > > It was great talking to you this morning too. As discussed: > > https://issues.apache.org/jira/browse/BEAM-9676 filed for Go SDK Katas > > The current Go SDK roadmap > https://

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Pablo Estrada
+1! (binding) On Thu, Apr 2, 2020 at 11:19 AM Alex Van Boxel wrote: > Thanks for clearing this up Aizhamal. > > +1 (non binding) > > _/ > _/ Alex Van Boxel > > > On Thu, Apr 2, 2020 at 8:14 PM Aizhamal Nurmamat kyzy > wrote: > >> Good point, Alex. Actually Julian and I have talked about produci

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Luke Cwik
+1 (binding) On Thu, Apr 2, 2020 at 11:54 AM Pablo Estrada wrote: > +1! (binding) > > On Thu, Apr 2, 2020 at 11:19 AM Alex Van Boxel wrote: > >> Thanks for clearing this up Aizhamal. >> >> +1 (non binding) >> >> _/ >> _/ Alex Van Boxel >> >> >> On Thu, Apr 2, 2020 at 8:14 PM Aizhamal Nurmamat k

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Austin Bennett
+1 (nonbinding) On Thu, Apr 2, 2020 at 12:10 PM Luke Cwik wrote: > +1 (binding) > > On Thu, Apr 2, 2020 at 11:54 AM Pablo Estrada wrote: > >> +1! (binding) >> >> On Thu, Apr 2, 2020 at 11:19 AM Alex Van Boxel wrote: >> >>> Thanks for clearing this up Aizhamal. >>> >>> +1 (non binding) >>> >>>

Re: Golang SDK Katas

2020-04-02 Thread Robert Burke
Could someone in the PMC add Damon's username to be assignable in Jira? On Thu, Apr 2, 2020, 11:50 AM Pablo Estrada wrote: > Very excited to get Go Katas going! > > On Thu, Apr 2, 2020 at 11:21 AM Robert Burke wrote: > >> Welcome to the community! >> >> It was great talking to you this morning

Re: Golang SDK Katas

2020-04-02 Thread Pablo Estrada
Added him as contributor! On Thu, Apr 2, 2020 at 2:48 PM Robert Burke wrote: > Could someone in the PMC add Damon's username to be assignable in Jira? > > On Thu, Apr 2, 2020, 11:50 AM Pablo Estrada wrote: > >> Very excited to get Go Katas going! >> >> On Thu, Apr 2, 2020 at 11:21 AM Robert Bur

Re: Golang SDK Katas

2020-04-02 Thread Ahmet Altay
Welcome! This will be a great contribution. I hear lots of positive things about existing Katas. On Thu, Apr 2, 2020 at 2:52 PM Pablo Estrada wrote: > Added him as contributor! > > On Thu, Apr 2, 2020 at 2:48 PM Robert Burke wrote: > >> Could someone in the PMC add Damon's username to be assign

Re: Unportable Dataflow Pipeline Questions

2020-04-02 Thread Robert Bradshaw
On Thu, Apr 2, 2020 at 7:54 AM Chamikara Jayalath wrote: > > > On Thu, Apr 2, 2020 at 7:48 AM Robert Burke wrote: > >> In particular, ideally the Dataflow Service is handling the Dataflow >> specific format translation, rather than each SDK. Move the v1 beta3 >> pipeline to an internal detail. >

Re: Unportable Dataflow Pipeline Questions

2020-04-02 Thread Robert Burke
It's stateless translation code and nothing is sourced outside of the beam pipeline proto, so it should be fairly straightforward code to write and test. One can collect several before and afters of the existing translations and use them to validate. There are a few quirks that were previously nec

Re: Contributing Twister2 runner to Apache Beam

2020-04-02 Thread Pulasthi Supun Wickramasinghe
Hi Ismaël Did you get some free time to perform a code review on the pull request Best Regards Pulasthi On Tue, Mar 10, 2020 at 3:30 PM Luke Cwik wrote: > I have to disagree. Allowing for runners within the Apache Beam repo and > SDKs that reach into the implementation details of each other ar

BEAM-8751: Code Review Wanted for PR 11208

2020-04-02 Thread Tomo Suzuki
Hi Luke and Beam Committers, Would you review/merge this google-api-client dependency upgrade https://github.com/apache/beam/pull/11208 -- Regards, Tomo

Re: Default WindowFn for Unbounded source

2020-04-02 Thread amit kumar
Thank you all! your responses are very helpful. On Wed, Apr 1, 2020 at 11:37 AM Robert Bradshaw wrote: > > > On Wed, Apr 1, 2020 at 12:53 AM Jan Lukavský wrote: > >> Hi Amit, >> >> answers inline. >> On 4/1/20 12:23 AM, amit kumar wrote: >> >> Thanks Ankur for your reply. >> >> By default the a

PythonDocker PreCommit

2020-04-02 Thread Hannah Jiang
Hello Dev@ A new precommit was added for Python. It is in master now. *PythonDocker ("Run PythonDocker PreCommit")* is a job to build Python SDK containers with licenses/notices of third party dependencies. The trigger rule is the same as Python Precommit and the test runs for Py2, Py35, Py36 and

[VOTE] Release 2.20.0, release candidate #1

2020-04-02 Thread Rui Wang
Hi everyone, Please review and vote on the release candidate #1 for the version 1.20.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *