Re: machine learning API, common models

2016-05-16 Thread Simone Robutti
Hello, I'm Simone and I just began contributing to Flink ML (actually on the distributed linalg part). I already expressed my concerns about the idea of an high level API relying on specific frameworks' implementations: different implementations produce different results and may vary in quality. A

First Virtual Meeting Slides

2016-05-16 Thread Ismaël Mejía
Just a little remainder, we have not yet published the slides of the first virtual meeting in the website. https://beam.incubator.apache.org/public-meetings/ -Ismael

Re: machine learning API, common models

2016-05-16 Thread Kam Kasravi
Thanks Simone - yes I had read your concerns on dev and I think they're well founded. Thanks for the samsura reference - I've been looking at the spark/scala bindings http://mahout.apache.org/users/sparkbindings/ScalaSparkBindings.pdf. I think we should expand the document to include linear algebr

Re: [PROPOSAL] Writing More Expressive Beam Tests

2016-05-16 Thread Aljoscha Krettek
Hi, sorry for resurrecting such an old thread but are there already thoughts on how the quiescence handling will work for runner-independent tests? I was thinking about how to make the RunnableOnService tests work when executed in "true-streaming" mode, i.e. when the job would normally never finis

TypeDescriptors Example Code

2016-05-16 Thread Jesse Anderson
Does anyone have any thoughts or concerns with me changing the example code to use the new TypeDescriptors class from the inline creation of a TypeDescriptor? For example, MinimalWordCountJava8 would change from: p.apply(TextIO.Read.from("gs://dataflow-samples/shakespeare/*")) .apply(FlatMa

Re: First Virtual Meeting Slides

2016-05-16 Thread James Malone
Good catch - I will amend my current PR on the website to include it. For the time being, here's a direct link: https://drive.google.com/folderview?id=0B-IhJZh9Ab52NzFSaWJnemJrVVU&usp=sharing Cheers! James On Mon, May 16, 2016 at 7:57 AM, Ismaël Mejía wrote: > Just a little remainder, we have

Re: TypeDescriptors Example Code

2016-05-16 Thread Davor Bonaci
Sure -- go ahead. (I'd probably avoid static import, however. One word more, but more readable.) On Mon, May 16, 2016 at 9:05 AM, Jesse Anderson wrote: > Does anyone have any thoughts or concerns with me changing the example code > to use the new TypeDescriptors class from the inline creation of

Build failed in Jenkins: beam_Release_NightlySnapshot #43

2016-05-16 Thread Apache Jenkins Server
See -- [...truncated 91 lines...] [INFO] [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ sdks-parent -

Build failed in Jenkins: beam_Release_NightlySnapshot #42

2016-05-16 Thread Apache Jenkins Server
See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam2 (beam) in workspace > git

Re: Build failed in Jenkins: beam_Release_NightlySnapshot #43

2016-05-16 Thread Davor Bonaci
Build #42 and #43 failed due to a repository outage. No action needed. On Mon, May 16, 2016 at 12:07 AM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See > > -- > [...truncated

Re: Build failed in Jenkins: beam_Release_NightlySnapshot #43

2016-05-16 Thread Jean-Baptiste Onofré
Thanks for the update. Regards JB On 05/16/2016 06:54 PM, Davor Bonaci wrote: Build #42 and #43 failed due to a repository outage. No action needed. On Mon, May 16, 2016 at 12:07 AM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: See

RE: machine learning API, common models

2016-05-16 Thread Kavulya, Soila P
Thanks Simone, You have raised a valid concern about how different frameworks will have different implementations and parameter semantics for the same algorithm. I agree that it is important to keep this in mind. Hopefully, through this exercise, we will identify a good set of common ML abstrac