Re: [PROPOSAL] A brand new DoFn

+1 At first I liked the API but was skeptical because I though that this would require reflective invocation. Then I read on and saw that code generation is used and was convinced. :-) I especially like how it both cleans up the API and allows more optimizations in the future, especially with sid

Re: Suggestion for Writing Sink Implementation

Thanks Sumit. Looks like your question is, indeed, specific to the Flink runner, and I'll then defer to somebody familiar with it. On Wed, Jul 27, 2016 at 5:25 PM Chawla,Sumit wrote: > Thanks a lot Eugene. > > >>>My immediate requirement is to run this Sink on FlinkRunner. Which > mandates that

Re: Suggestion for Writing Sink Implementation

Thanks a lot Eugene. >>>My immediate requirement is to run this Sink on FlinkRunner. Which mandates that my implementation must also implement SinkFunction<>. In that >>>case, none of the Sink<> methods get called anyway. I am using FlinkRunner. The Sink implementation that i was writing by exte

Re: Suggestion for Writing Sink Implementation

Hi Sumit, All reusable parts of a pipeline, including connectors to storage systems, should be packaged as PTransform's. Sink is an advanced API that you can use under the hood to implement the transform, if this particular connector benefits from this API - but you don't have to, and many connec

Fwd: Suggestion for Writing Sink Implementation

Hi Please suggest me on what is the best way to write a Sink in Beam. I see that there is a Sink abstract class which is in experimental state. What is the expected outcome of this one? Do we have the api frozen, or this could still change? Most of the existing Sink implementations like KafkaIO.

Re: Podling Report Reminder - August 2016

+1 On Wed, Jul 27, 2016, 21:14 Amit Sela wrote: > +1 > > On Wed, Jul 27, 2016, 22:12 Dan Halperin > wrote: > > > +1 on all the above. > > > > On Wed, Jul 27, 2016 at 12:07 PM, Jean-Baptiste Onofré > > wrote: > > > > > Hi James, > > > > > > Sure, please go ahead. > > > > > > I propose to send t

Re: Podling Report Reminder - August 2016

Hi James, Sure, please go ahead. I propose to send the draft on the mailing list for review. When reviewed, we will add on the incubator wiki (I will help you if you don't have the permission to do so). Regards JB On 07/27/2016 07:22 PM, James Malone wrote: Hi all, Unless anyone disagrees

Re: Podling Report Reminder - August 2016

+1 On Wed, Jul 27, 2016, 22:12 Dan Halperin wrote: > +1 on all the above. > > On Wed, Jul 27, 2016 at 12:07 PM, Jean-Baptiste Onofré > wrote: > > > Hi James, > > > > Sure, please go ahead. > > > > I propose to send the draft on the mailing list for review. When > reviewed, > > we will add on th

Re: Podling Report Reminder - August 2016

+1 on all the above. On Wed, Jul 27, 2016 at 12:07 PM, Jean-Baptiste Onofré wrote: > Hi James, > > Sure, please go ahead. > > I propose to send the draft on the mailing list for review. When reviewed, > we will add on the incubator wiki (I will help you if you don't have the > permission to do s

Re: Podling Report Reminder - August 2016

Hi all, Unless anyone disagrees, I will volunteer to write this podling report. My goal is to get a draft out this week so we can review it as a project before we submit it to the Incubator PMC. Cheers! James On Wed, Jul 27, 2016 at 4:47 AM wrote: > Dear podling, > > This email was sent by an

Re: Build failed in Jenkins: beam_Release_NightlySnapshot #115

Hi Ken, I gonna take a look tonight. Regards JB On 07/27/2016 05:45 PM, Kenneth Knowles wrote: This is day 2 of proxy errors when deploying the nightly snapshot, right? Apologies if I missed a thread about the prior failure. Is anyone already looking at this? On Wed, Jul 27, 2016 at 12:03 AM,

Re: Build failed in Jenkins: beam_Release_NightlySnapshot #115

This is day 2 of proxy errors when deploying the nightly snapshot, right? Apologies if I missed a thread about the prior failure. Is anyone already looking at this? On Wed, Jul 27, 2016 at 12:03 AM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/

Build failed in Jenkins: beam_Release_NightlySnapshot #115

See Changes: [mxm] [flink] improve example section in README [owenzhang1990] [BEAM-489] remove headerLocation from maven-checkstyle-plugin [dhalperi] Remove spark test dependency on DirectRunner [dhalperi] Spark tests: fo

Podling Report Reminder - August 2016

Dear podling, This email was sent by an automated system on behalf of the Apache Incubator PMC. It is an initial reminder to give you plenty of time to prepare your quarterly board report. The board meeting is scheduled for Wed, 17 August 2016, 10:30 am PDT. The report for your podling will form