Re: [ANNOUNCE] New committer: Michał Walenia

Congrats, Michał! On Tue, Jan 28, 2020 at 3:03 AM Udi Meiri wrote: > Congratulations Michał! > > On Mon, Jan 27, 2020 at 3:49 PM Chamikara Jayalath > wrote: > >> Congrats Michał! >> >> On Mon, Jan 27, 2020 at 2:59 PM Reza Rokni wrote: >> >>> Congratulations buddy! >>> >>> On Tue, 28 Jan 2020,

Re: Subclassing MapElements

It might be more trouble than it is worth, saving typing but adding complexity. Especially since you've got @AutoValue and @AutoValue.Builder to do all the heavy lifting anyhow ( https://beam.apache.org/contribute/ptransform-style-guide/#api). Kenn

Subclassing MapElements

Hi Beam Community, Our team has a number of PTransforms that are basically wrappers around MapElements, which give us a concise syntax when specifying pipelines which leverage shared map stages. One example that we are looking at currently is a function which takes JSON and maps it into

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations Michał! On Mon, Jan 27, 2020 at 3:49 PM Chamikara Jayalath wrote: > Congrats Michał! > > On Mon, Jan 27, 2020 at 2:59 PM Reza Rokni wrote: > >> Congratulations buddy! >> >> On Tue, 28 Jan 2020, 06:52 Valentyn Tymofieiev, >> wrote: >> >>> Congratulations, Michał! >>> >>> On

Re: Apache Beam KafkaIO Transform "go" available?

Thank you so much for your prompt reply. This really helped us make design decisions for our future projects. I appreciate your help. Daisy Wu On Monday, January 27, 2020, 10:10:40 AM PST, Robert Burke wrote: +cc dev@beam Hello Daisy!There presently isn't a Kafka transform for Go. 

Re: [DISCUSS][PROPOSAL] Improvements to the Apache Beam website

On Mon, Jan 27, 2020 at 11:19 AM Aizhamal Nurmamat kyzy wrote: > Hi Alexey, > > Answers are inline: > > Do we have any user demands for documentation translation into other >> languages? I’m asking this because, in my experience, it’s quite tough work >> to translate everything and it won’t be

Re: [ANNOUNCE] New committer: Michał Walenia

Congrats Michał! On Mon, Jan 27, 2020 at 2:59 PM Reza Rokni wrote: > Congratulations buddy! > > On Tue, 28 Jan 2020, 06:52 Valentyn Tymofieiev, > wrote: > >> Congratulations, Michał! >> >> On Mon, Jan 27, 2020 at 2:24 PM Austin Bennett < >> whatwouldausti...@gmail.com> wrote: >> >>> Nice --

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations buddy! On Tue, 28 Jan 2020, 06:52 Valentyn Tymofieiev, wrote: > Congratulations, Michał! > > On Mon, Jan 27, 2020 at 2:24 PM Austin Bennett < > whatwouldausti...@gmail.com> wrote: > >> Nice -- keep up the good work! >> >> On Mon, Jan 27, 2020 at 2:02 PM Mikhail Gryzykhin >>

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations, Michał! On Mon, Jan 27, 2020 at 2:24 PM Austin Bennett wrote: > Nice -- keep up the good work! > > On Mon, Jan 27, 2020 at 2:02 PM Mikhail Gryzykhin > wrote: > > > > Congratulations Michal! > > > > --Mikhail > > > > On Mon, Jan 27, 2020 at 1:01 PM Kyle Weaver wrote: > >> > >>

Beam Meetup LA -- KICKOFF (10 March)

Come join the community kicking off in LA (in person) on 10 March: https://www.meetup.com/Los-Angeles-Apache-Beam/events/268207085/

Re: [ANNOUNCE] New committer: Michał Walenia

Nice -- keep up the good work! On Mon, Jan 27, 2020 at 2:02 PM Mikhail Gryzykhin wrote: > > Congratulations Michal! > > --Mikhail > > On Mon, Jan 27, 2020 at 1:01 PM Kyle Weaver wrote: >> >> Congratulations Michał! Looking forward to your future contributions :) >> >> Thanks, >> Kyle >> >> On

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations Michal! --Mikhail On Mon, Jan 27, 2020 at 1:01 PM Kyle Weaver wrote: > Congratulations Michał! Looking forward to your future contributions :) > > Thanks, > Kyle > > On Mon, Jan 27, 2020 at 12:47 PM Pablo Estrada wrote: > >> Hi everyone, >> >> Please join me and the rest of

Re: Using very slow changing stream of data (KV) as side input

Hi Mohil, Please, take a look at. https://beam.apache.org/documentation/patterns/side-inputs/#slowly-updating-global-window-side-inputs Also, I have design doc out that handles similar case. I'm working on prototyping it in python atm.

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations Michał! Looking forward to your future contributions :) Thanks, Kyle On Mon, Jan 27, 2020 at 12:47 PM Pablo Estrada wrote: > Hi everyone, > > Please join me and the rest of the Beam PMC in welcoming a new > committer: Michał Walenia > > Michał has contributed to Beam in many

[ANNOUNCE] New committer: Michał Walenia

Hi everyone, Please join me and the rest of the Beam PMC in welcoming a new committer: Michał Walenia Michał has contributed to Beam in many ways, including the performance testing infrastructure, and has even spoken at events about Beam. In consideration of his contributions, the Beam PMC

Re: Go SplittableDoFn prototype and proposed changes

As a follow-up to the proposed changes from my first email, I've worked on a doc with a more detailed changelist, including details still up for discussion: https://docs.google.com/document/d/1UeG5uNO00xCByGEZzDXk0m0LghX6HBWlMfRbMv_Xiyc/edit?usp=sharing The doc is mostly full of my brainstorming

Re: GSOC announced!

Hi Xinbin, that sounds enough to get started. You can get permission on JIRA and then assign JIRA that you want to work on to yourself. -Rui On Fri, Jan 24, 2020 at 1:22 PM Xinbin Huang wrote: > Hi Rui, > > Yes, I would like to contribute to Apache Beam, but I don't have a > specific topic

Re: [DISCUSS][PROPOSAL] Improvements to the Apache Beam website

Hi Alexey, Answers are inline: Do we have any user demands for documentation translation into other > languages? I’m asking this because, in my experience, it’s quite tough work > to translate everything and it won’t be always up-to-date with the > mainstream docs in English. > We know of at

Re: [DISCUSS] Autoformat python code with Black

Thanks. I commented on the PR. I think if we're going this route we should add a pre-commit, plus instructions on how to run the tool (similar to spotless). On Mon, Jan 27, 2020 at 10:00 AM Udi Meiri wrote: > > I've done a pass on the PR on code I'm familiar with. > Please make a pass and add

Re: New contributor

Done. Added xbhuang to the list of contributors. On Mon, Jan 27, 2020 at 10:45 AM Xinbin Huang wrote: > Hi > > This is Xinbin Huang. Can someone add me as a contributor for Beam's Jira > issue tracker? I would like to create/assign tickets for my work. > > My Jira username is xbhuang . > >

Re: New contributor

Hi This is Xinbin Huang. Can someone add me as a contributor for Beam's Jira issue tracker? I would like to create/assign tickets for my work. My Jira username is xbhuang . Thanks Bin >

Re: [DISCUSS][PROPOSAL] Improvements to the Apache Beam website

HI Aizhamal, Thank you for working on documentation improvement! This should be very helpful even if Beam site is in quite good shape now (though it lacks updates on new features and revision of the old ones). > On 27 Jan 2020, at 08:33, Aizhamal Nurmamat kyzy wrote: > > First, is to enable

Re: Apache Beam KafkaIO Transform "go" available?

+cc dev@beam Hello Daisy! There presently isn't a Kafka transform for Go. The Go SDK is still experimental, largely due to scalable IO support, which is why the Go SDK isn't represented in the built-in io page . There's presently no way for an

Re: [DISCUSS] Autoformat python code with Black

I've done a pass on the PR on code I'm familiar with. Please make a pass and add your suggestions on the PR. On Fri, Jan 24, 2020 at 7:15 AM Ismaël Mejía wrote: > Java build fails on any unformatted code so python probably should be like > that. > We have to ensure however that it fails early

Using very slow changing stream of data (KV) as side input

Hi, This is Mohil Khare from San Jose, California. I work in an early stage startup: Prosimo. We use Apache beam with gcp dataflow for all real time stats processing with Kafka and Pubsub as data source while elasticsearch and GCS as sinks. I am trying to solve the following use with sideinputs.

Pipeline with PAssert on flink issue

Hello all! Did any of you encounter a similar problem with PAssert on Flink (set up as standalone instance not embedded one)? For simple test: PCollection res = pipeline.apply("Generate 5", Create.of(5)); PAssert.thatSingleton(res).isEqualTo(5); Only ~1 of 10 attempts (rough estimations) ends

Re: Jenkins jobs not running for my PR 10438

Thanks, Ismaël. *Rehman Murad Ali* Software Engineer Mobile: +92 3452076766 Skype: rehman.muradali On Mon, Jan 27, 2020 at 6:18 PM Ismaël Mejía wrote: > done > > On Mon, Jan 27, 2020 at 2:13 PM Rehman Murad Ali < > rehman.murad...@venturedive.com> wrote: > >> Hi, >> >> I appreciate if

Re: Jenkins jobs not running for my PR 10438

done On Mon, Jan 27, 2020 at 2:13 PM Rehman Murad Ali < rehman.murad...@venturedive.com> wrote: > Hi, > > I appreciate if somebody can run jobs for this PR: > > https://github.com/apache/beam/pull/10627 > > *Thanks & Regards* > > > > *Rehman Murad Ali* > Software Engineer > Mobile: +92

Re: Jenkins jobs not running for my PR 10438

Hi, I appreciate if somebody can run jobs for this PR: https://github.com/apache/beam/pull/10627 *Thanks & Regards* *Rehman Murad Ali* Software Engineer Mobile: +92 3452076766 Skype: rehman.muradali On Fri, Jan 24, 2020 at 3:53 AM Rui Wang wrote: > Done > > > -Rui > > On Thu, Jan 23,

Beam Dependency Check Report (2020-01-27)

High Priority Dependency Updates Of Beam Python SDK: Dependency Name Current Version Latest Version Release Date Of the Current Used Version Release Date Of The Latest Release JIRA Issue cachetools 3.1.1 4.0.0 2019-12-23

Contribution to Apache Beam

Hi, I am Pasan Kamburugamuwa and I am 4th year student of Sri Lanka Insitute of Information Technology. I would like to contribute Apache Beam with the topic of, 1) Azure Blobstore File System for Java & Python Please can you guys help me to make a strong proposal and make