We've hit 1000 PRs!

Hey folks! Just wanted to send out a note -- we've hit 1000 PRs in GitHub as of Saturday! That's a tremendous amount of work for the 7 months since PR#1. I bet we hit 2000 in much fewer than 7 months ;) Dan

Re: Preferred locations (or data locality) for batch pipelines.

Thanks for the through response Dan, what you mentioned is very interesting and would clearly benefit runners. I was actually talking about something more "old-school", and specific to batch. If running a job on YARN - via MapReduce, Spark, etc. - you'd prefer that YARN would assign tasks working

Re: Jenkins build failing

Good idea ! Thanks for the reminder Dan. Regards JB On 09/26/2016 09:28 PM, Dan Halperin wrote: Hi JB, could you file a JIRA and follow up there? I don't want someone else to come along and start working on the same issue :) On Mon, Sep 26, 2016 at 10:04 AM, Jean-Baptiste Onofré wrote: By

Re: Preferred locations (or data locality) for batch pipelines.

Hi Amit, Sorry to be late to the thread, but I've been traveling. I'm not sure I fully grokked the question, but here's one attempt at an answer: In general, any options on where a pipeline is executed should be runner-specific. One example: for Dataflow, we have the zone

Re: Jenkins build failing

Done: https://issues.apache.org/jira/browse/BEAM-679 Regards JB On 09/26/2016 09:28 PM, Dan Halperin wrote: Hi JB, could you file a JIRA and follow up there? I don't want someone else to come along and start working on the same issue :) On Mon, Sep 26, 2016 at 10:04 AM, Jean-Baptiste Onofré

Re: Jenkins build failing

Hi JB, could you file a JIRA and follow up there? I don't want someone else to come along and start working on the same issue :) On Mon, Sep 26, 2016 at 10:04 AM, Jean-Baptiste Onofré wrote: > By the way, the issue is: > > java.lang.NoClassDefFoundError: Could not initialize class > com.google.c

Re: Jenkins build failing

By the way, the issue is: java.lang.NoClassDefFoundError: Could not initialize class com.google.cloud.bigtable.grpc.BigtableSessionSharedThreadPools So, it sounds like a classloader issue. I'm on git bisect to identify the cause (maybe shading change). I keep you posted. Regards JB On 09/

Jenkins build is still unstable: beam_Release_NightlySnapshot #180

See

Jenkins build failing

Hi Beamers, just to let you know that the nightly build is failing on Jenkins due to Bigtable ITest failing. I'm investigating and hopefully I will fix later today. Sorry about that. Thanks, Regards JB -- Jean-Baptiste Onofré jbono...@apache.org http://blog.nanthrax.net Talend - http://www.t