Re: [VOTE] Release 0.4.0-incubating, release candidate #3

2016-12-20 Thread Sergio Fernández
es > >>>>> > >>>>> Additionally: > >>>>> > >>>>> - Went over the generated javadoc (filed tickets but no release > >>>>> blockers) > >>>>> - Went over the generated release notes > >>&g

Re: [DISCUSS] [BEAM-438] Rename one of PTransform.apply or PInput.apply

2016-12-08 Thread Sergio Fernández
issues.apache.org/jira/browse/BEAM-438 > [PR #1538] https://github.com/apache/incubator-beam/pull/1538 > > p.s. there is a really amusing and confusing call chain: PCollection.apply > -> Pipeline.applyTransform -> Pipeline.applyInternal -> > PipelineRunner.apply -> PTransform.apply

Re: DataCamp II Salzburg

2016-12-07 Thread Sergio Fernández
ble). > > On Thu, Dec 1, 2016 at 6:04 AM, Sergio Fernández > wrote: > > > Hi folks, > > > > the next week we have in Salzburg a DataCamp, a meetup about Big Data: > > > > https://www.meetup.com/Salzburg-Big-Data-Meetup/events/231844168/ > > > >

DataCamp II Salzburg

2016-12-01 Thread Sergio Fernández
Hi folks, the next week we have in Salzburg a DataCamp, a meetup about Big Data: https://www.meetup.com/Salzburg-Big-Data-Meetup/events/231844168/ Where I'm going to make a session introducing Apache Beam. I'll share here the material afterwards, very introductory anyway. Cheers,

Re: DoFn relying on Microservices

2016-12-01 Thread Sergio Fernández
icroservice ? > Yep, exactly that. Thanks so much! On 11/25/2016 01:18 PM, Sergio Fernández wrote: > Hi JB, > > On Tue, Nov 22, 2016 at 11:14 AM, Jean-Baptiste Onofré > wrote: > >> >> DoFn will execute per element (with eventually a hook on StartBundle, >&

Re: DoFn relying on Microservices

2016-11-25 Thread Sergio Fernández
cale up and down independently of the pipeline. So I'm more than welcome to discuss ideas ;-) Thanks. Cheers, > On 11/22/2016 10:39 AM, Sergio Fernández wrote: > >> Hi, >> >> I'd like resume the idea to have TensorFlow-based tasks running in a Beam >&

Re: [DISCUSS] Graduation to a top-level project

2016-11-22 Thread Sergio Fernández
As an external person who has been following the podling very closely from the very beginning, I definetelly think you are ready for graduation :-) On Nov 22, 2016 19:19, "Davor Bonaci" wrote: > Hi everyone, > With all the progress we’ve had recently in Apache Beam, I think it is time > we start

DoFn relying on Microservices

2016-11-22 Thread Sergio Fernández
se of a DoFn which actually runs externally? Thanks in advance for the feedback. Cheers, -- Sergio Fernández Partner Technology Manager Redlink GmbH m: +43 6602747925 e: sergio.fernan...@redlink.co w: http://redlink.co

Re: Meet up at ApacheCon Seville

2016-11-14 Thread Sergio Fernández
gt; >> See you folks there. :) > > >> > > >> On Nov 11, 2016 11:25 AM, "Jean-Baptiste Onofré" > > wrote: > > >> > > >> Hi Sergio, > > >>> > > >>> "Going Under The Hood with Apache Beam"

Re: Meet up at ApacheCon Seville

2016-11-11 Thread Sergio Fernández
JB >> and I will be there to give a Beam talk Wednesday morning; I'm around all >> week. >> >> I'd love to sync in person with anyone who wants to talk Beam. Please >> reach >> out to me directly if you'd like to meet. >> >> Thanks! >&g

Re: [VOTE] Release 0.3.0-incubating, release candidate #1

2016-10-26 Thread Sergio Fernández
.0-incubating, are you thinking about graduation? I think you should ;-) On Oct 25, 2016, 11:53, at 11:53, "Sergio Fernández" > wrote: > >On Tue, Oct 25, 2016 at 11:36 AM, Jean-Baptiste Onofré > > > >wrote: > > > >> By the way, your vote is not bindi

Re: [VOTE] Release 0.3.0-incubating, release candidate #1

2016-10-26 Thread Sergio Fernández
e can discuss it over the code. Hope that helps. Cheers, [1] https://github.com/apache/incubator-beam/pull/1206 [2] https://issues.apache.org/jira/browse/BEAM-841 On Tue, 25 Oct 2016 at 11:53 Sergio Fernández wrote: > > > On Tue, Oct 25, 2016 at 11:36 AM, Jean-Baptiste Onofré > &g

Re: [VOTE] Release 0.3.0-incubating, release candidate #1

2016-10-25 Thread Sergio Fernández
;-) Cheers, > On Oct 25, 2016, 11:33, at 11:33, "Sergio Fernández" > wrote: > >+1 (binding) > > > >So far I've successfully checked: > >* signatures and digests > >* source releases file layouts > >* matched git tags and commit ids

Re: [VOTE] Release 0.3.0-incubating, release candidate #1

2016-10-25 Thread Sergio Fernández
[3] > https://repository.apache.org/content/repositories/staging/ > org/apache/beam/ > [4] > https://git-wip-us.apache.org/repos/asf?p=incubator-beam.git;a=tag;h= > 5d86ff7f04862444c266142b0d5acecb5a6b7144 > [5] https://github.com/apache/incubator-beam-site/pull/52 > -- Sergio Fernández Partner Technology Manager Redlink GmbH m: +43 6602747925 e: sergio.fernan...@redlink.co w: http://redlink.co

Re: A CI Server for Beam?

2016-10-23 Thread Sergio Fernández
> runners. > Exactly that was the idea :-) Have you tried more complex setups? For instance, deploy to clusters with the different runners. Very interesting stuff, JB! Cheers, On Oct 24, 2016, 08:12, at 08:12, "Sergio Fernández" > wrote: > >Related, but a bit off-topic:

Re: A CI Server for Beam?

2016-10-23 Thread Sergio Fernández
gt; On Oct 22, 2016, 21:56, at 21:56, Neelesh Salian > > wrote: > > >Hello, > > > > > >I wanted to check to see if there is continuous integration service > > >used to > > >build and test Beam similar to Travis. > > >Would certainly help

Re: [KUDOS] Contributed runner: Apache Apex!

2016-10-17 Thread Sergio Fernández
awesome! On Oct 17, 2016 18:52, "Kenneth Knowles" wrote: > Hi all, > > I would to, once again, call attention to a great addition to Beam: a > runner for Apache Apex. > > After lots of review and much thoughtful revision, pull request #540 has > been merged to the apex-runner feature branch toda

Re: Integrate Python SDK in the Maven build

2016-08-29 Thread Sergio Fernández
5 > > I prefer the first option as it is the more Pythonic way of addressing this > problem. What do you think? > > Thank you, > Ahmet > > [1] https://www.python.org/dev/peps/pep-0440/ > > > On Tue, Aug 16, 2016 at 6:04 AM, Sergio Fernández > wrote: > > >

Re: ApacheCon?

2016-08-29 Thread Sergio Fernández
Great, JB! On Mon, Aug 29, 2016 at 10:15 AM, Jean-Baptiste Onofré wrote: > Hi Sergio, > > I already submitted a talk (in July !!): > > Introduction to Apache Beam Apache: Big Data Europe 07/10/2016 - > 21:14 New > > Regards > JB > > > On 08/29/2

ApacheCon?

2016-08-29 Thread Sergio Fernández
;d be much more valuable something form the PPM directly. Cheers, -- Sergio Fernández Partner Technology Manager Redlink GmbH m: +43 6602747925 e: sergio.fernan...@redlink.co w: http://redlink.co

Re: Integrate Python SDK in the Maven build

2016-08-16 Thread Sergio Fernández
tegy. Not sure if it has been discussed. But commonly to version APIs and SDKs sometimes people uses the following schema: - version X.Y identifies the API - version X.Y.Z identified the SDK compatible with API X.Y Anyway, as we did with the code PR, I'd prefer to keep the versioning for

Integrate Python SDK in the Maven build

2016-08-12 Thread Sergio Fernández
align the versions [3]. Thanks for the feedback. Cheers, [1] https://issues.apache.org/jira/browse/BEAM-378 [2] https://github.com/apache/incubator-beam/pull/537 [3] https://issues.apache.org/jira/browse/BEAM-547 -- Sergio Fernández Partner Technology Manager Redlink GmbH m: +43 6602747

Re: [VOTE] Release Apache Beam, version 0.2.0-incubating

2016-08-01 Thread Sergio Fernández
AA8k_FJeyg%2BGWUBMeSPFQhnaPN3V4MrenJtrDbiyXyKJkzH7ZA%40mail.gmail.com%3E > [7] > http://mail-archives.apache.org/mod_mbox/incubator-beam-dev/201607.mbox/browser > -- Sergio Fernández Partner Technology Manager Redlink GmbH m: +43 6602747925 e: sergio.fernan...@redlink.co w: http://redlink.co

Re: Beam Interview

2016-07-07 Thread Sergio Fernández
> >> I really appreciate you taking the time to answer things. I'll publish the >> results of the Q and A on my blog and email out the link once it's up >> there. >> >> Thanks, >> >> Jesse >> >> > -- > Jean-Baptiste

Re: Improvements to issue/version tracking

2016-06-27 Thread Sergio Fernández
My two cents: On Tue, Jun 28, 2016 at 1:01 AM, Davor Bonaci wrote: > > * For closed (or resolved) issues, "Fix Versions" field indicates a > released or unreleased version that has the fix. For us normally resolved issues will always have a development version as "Fix Versions" field, so the is

Re: newbie question about beam

2016-06-16 Thread Sergio Fernández
lower-level approach and often requires more work. Sure, share-storage is always an option, but for many reasons I'd rather not resort to such approach. Thanks so much for all the ideas and valuable discussions! Cheers, -- Sergio Fernández Partner Technology Manager Redlink GmbH m: +43 6602747925 e: sergio.fernan...@redlink.co w: http://redlink.co

Re: newbie question about beam

2016-06-16 Thread Sergio Fernández
er API documentation and experiment a bit with it. Thanks! On 06/15/2016 10:18 AM, Sergio Fernández wrote: > >> Hi Jean-Baptiste, >> >> On Tue, Jun 14, 2016 at 12:45 PM, Jean-Baptiste Onofré >> wrote: >> >>> >>> Welcome aboard, and good to disc

Re: newbie question about beam

2016-06-15 Thread Sergio Fernández
the next release :-) Thanks. > > On 06/14/2016 12:38 PM, Sergio Fernández wrote: > >> Hi guys, >> >> I'm newbie in the Beam community, but as someone who has used DataFlow in >> the past I've been following the podling since you came to ASK. I'

Re: newbie question about beam

2016-06-15 Thread Sergio Fernández
f the runner. Each > > runner/backend will implement their own logic. > > > > I don't know Keras enough to provide a strong advice. > > > > Regarding the Python SDK, we discussed about that last week: it's on the > > way. We should have the Python SDK ver

newbie question about beam

2016-06-14 Thread Sergio Fernández
ning, so I'd like to know if the Beam Model could natively support the distribution of the models (sometimes several GB). Thanks in advance. Cheers, -- Sergio Fernández Partner Technology Manager Redlink GmbH m: +43 6602747925 e: sergio.fernan...@redlink.co w: http://redlink.co