Re: What / Where / When / How questions in Spark 2.0 ?

2016-05-22 Thread Amit Sela
inria.fr>, "user @spark" > <user@spark.apache.org> > Cc: Ovidiu Cristian Marcu <ovidiu21ma...@gmail.com> > Subject: Re: What / Where / When / How questions in Spark 2.0 ? > > This is a “Technical Vision” paper for the Spark runner, which provides > ge

Re: What / Where / When / How questions in Spark 2.0 ?

2016-05-21 Thread Ovidiu-Cristian MARCU
ma...@inria.fr > <mailto:ovidiu-cristian.ma...@inria.fr>> > Date: Tuesday, May 17, 2016 at 12:11 AM > To: "user @spark" <user@spark.apache.org <mailto:user@spark.apache.org>> > Cc: Ovidiu Cristian Marcu <ovidiu21ma...@gmail.com > <mailto:o

Re: What / Where / When / How questions in Spark 2.0 ?

2016-05-21 Thread Sela, Amit
inria.fr>> Date: Tuesday, May 17, 2016 at 12:11 AM To: "user @spark" <user@spark.apache.org<mailto:user@spark.apache.org>> Cc: Ovidiu Cristian Marcu <ovidiu21ma...@gmail.com<mailto:ovidiu21ma...@gmail.com>> Subject: Re: What / Where / When / How questions in Spark 2.0 ?

Re: What / Where / When / How questions in Spark 2.0 ?

2016-05-21 Thread Sela, Amit
<user@spark.apache.org<mailto:user@spark.apache.org>> Cc: Ovidiu Cristian Marcu <ovidiu21ma...@gmail.com<mailto:ovidiu21ma...@gmail.com>> Subject: Re: What / Where / When / How questions in Spark 2.0 ? Could you please consider a short answer regarding the Apache Beam Capabili

Re: What / Where / When / How questions in Spark 2.0 ?

2016-05-16 Thread Ovidiu-Cristian MARCU
Could you please consider a short answer regarding the Apache Beam Capability Matrix todo’s for future Spark 2.0 release [4]? (some related references below [5][6]) Thanks [4] http://beam.incubator.apache.org/capability-matrix/#cap-full-what

What / Where / When / How questions in Spark 2.0 ?

2016-05-16 Thread Ovidiu-Cristian MARCU
Hi, We can see in [2] many interesting (and expected!) improvements (promises) like extended SQL support, unified API (DataFrames, DataSets), improved engine (Tungsten relates to ideas from modern compilers and MPP databases - similar to Flink [3]), structured streaming etc. It seems we