You probably read this benchmark at Yahoo, any comments from Spark? https://yahooeng.tumblr.com/post/135321837876/benchmarking-streaming-computation-engines-at <https://yahooeng.tumblr.com/post/135321837876/benchmarking-streaming-computation-engines-at>
> On 17 Apr 2016, at 12:41, andy petrella <andy.petre...@gmail.com> wrote: > > Just adding one thing to the mix: `that the latency for streaming data is > eliminated` is insane :-D > > On Sun, Apr 17, 2016 at 12:19 PM Mich Talebzadeh <mich.talebza...@gmail.com > <mailto:mich.talebza...@gmail.com>> wrote: > It seems that Flink argues that the latency for streaming data is eliminated > whereas with Spark RDD there is this latency. > > I noticed that Flink does not support interactive shell much like Spark shell > where you can add jars to it to do kafka testing. The advice was to add the > streaming Kafka jar file to CLASSPATH but that does not work. > > Most Flink documentation also rather sparce with the usual example of word > count which is not exactly what you want. > > Anyway I will have a look at it further. I have a Spark Scala streaming Kafka > program that works fine in Spark and I want to recode it using Scala for > Flink with Kafka but have difficulty importing and testing libraries. > > Cheers > > Dr Mich Talebzadeh > > LinkedIn > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw> > > http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/> > > > On 17 April 2016 at 02:41, Ascot Moss <ascot.m...@gmail.com > <mailto:ascot.m...@gmail.com>> wrote: > I compared both last month, seems to me that Flink's MLLib is not yet ready. > > On Sun, Apr 17, 2016 at 12:23 AM, Mich Talebzadeh <mich.talebza...@gmail.com > <mailto:mich.talebza...@gmail.com>> wrote: > Thanks Ted. I was wondering if someone is using both :) > > Dr Mich Talebzadeh > > LinkedIn > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw> > > http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/> > > > On 16 April 2016 at 17:08, Ted Yu <yuzhih...@gmail.com > <mailto:yuzhih...@gmail.com>> wrote: > Looks like this question is more relevant on flink mailing list :-) > > On Sat, Apr 16, 2016 at 8:52 AM, Mich Talebzadeh <mich.talebza...@gmail.com > <mailto:mich.talebza...@gmail.com>> wrote: > Hi, > > Has anyone used Apache Flink instead of Spark by any chance > > I am interested in its set of libraries for Complex Event Processing. > > Frankly I don't know if it offers far more than Spark offers. > > Thanks > > Dr Mich Talebzadeh > > LinkedIn > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw> > > http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/> > > > > > > -- > andy
