What is your exact set of requirements for algo trading? Is it react in
real-time or analysis over longer time? In the first case, I do not think a
framework such as Spark or Flink makes sense. They are generic, but in order to
compete with other usually custom developed highly - specialized
gt;> data is eliminated` is insane :-D
>>>>>>>>
>>>>>>>> On Sun, Apr 17, 2016 at 12:19 PM Mich Talebzadeh <
>>>>>>>> mich.talebza...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> It seems that Flink arg
Please forgive me for going in tangent
Well there may be many SQL engines but only 5-6 are in the league. Oracle
has Oracle and MySQL plus TimesTen from various acquisitions. SAP has Hana,
SAP ASE, SAP IQ and few others again from acquiring Sybase . So very few
big players.
Cars, Fiat owns many
Interesting tangent. I think there will never be a time when an
interesting area is covered only by one project, or product. Why are
there 30 SQL engines? or 50 car companies? it's a feature not a bug.
To the extent they provide different tradeoffs or functionality,
they're not entirely
data is
>>>>>>>> eliminated whereas with Spark RDD there is this latency.
>>>>>>>>
>>>>>>>> I noticed that Flink does not support interactive shell much like
>>>>>>>> Spark shell where you can add jars
nteractive shell much like
>>>>>>>> Spark shell where you can add jars to it to do kafka testing. The
>>>>>>>> advice
>>>>>>>> was to add the streaming Kafka jar file to CLASSPATH but that does not
>>>>>>>
of word count which is not exactly what you want.
>>>>>>>
>>>>>>> Anyway I will have a look at it further. I have a Spark Scala
>>>>>>> streaming Kafka program that works fine in Spark and I want to recode it
>>>>>>> us
010 USENIX paper on Spark. Nephele is the execution engine of
>> Stratosphere, which became Flink.
>>
>>
>> --
>> *From:* Mark Hamstra <m...@clearstorydata.com>
>> *To:* Mich Talebzadeh <mich.talebza...@gmail.com>
>> *Cc:* Corey Nolet &
Malak <michaelma...@yahoo.com>; "user @spark"
<user@spark.apache.org>
Sent: Sunday, April 17, 2016 3:55 PM
Subject: Re: Apache Flink
Assuming that both Spark and Flink are contemporaries what are the reasons that
Flink has not been adopted widely? (this may sound obviou
lebza...@gmail.com>
> *Cc:* Corey Nolet <cjno...@gmail.com>; "user @spark" <
> user@spark.apache.org>
> *Sent:* Sunday, April 17, 2016 3:30 PM
> *Subject:* Re: Apache Flink
>
> To be fair, the Stratosphere project from which Flink springs was started
>
nt: Sunday, April 17, 2016 3:48 PM
Subject: Re: Apache Flink
The problem is that the strength and wider acceptance of a typical Open source
project is its sizeable user and development community. When the community is
small like Flink, then it is not a viable solution to adopt
I am rather dis
;
Cc: Corey Nolet <cjno...@gmail.com>; "user @spark" <user@spark.apache.org>
Sent: Sunday, April 17, 2016 3:30 PM
Subject: Re: Apache Flink
To be fair, the Stratosphere project from which Flink springs was started as a
collaborative university research project in Germa
gt;
>>>>>>>> On 17 April 2016 at 12:47, Ovidiu-Cristian MARCU <
>>>>>>>> ovidiu-cristian.ma...@inria.fr> wrote:
>>>>>>>>
>>>>>>>>> You probably read this benchmark at Yahoo, any comments from Spark?
>
andy.petre...@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>> Just adding one thing to the mix: `that the latency for streaming
>>>>>>>> data is eliminated` is insane :-D
>>>>>>>>
>>>>>>>
es not support interactive shell much like
>>>>>>>> Spark shell where you can add jars to it to do kafka testing. The
>>>>>>>> advice
>>>>>>>> was to add the streaming Kafka jar file to CLASSPATH but that does
entation also rather sparce with the usual example
>>>>>>> of word count which is not exactly what you want.
>>>>>>>
>>>>>>> Anyway I will have a look at it further. I have a Spark Scala
>>>>>>> streaming Ka
program that works fine in Spark and I want to recode it
>>>>>> using Scala for Flink with Kafka but have difficulty importing and
>>>>>> testing
>>>>>> libraries.
>>>>>>
>>>>>> Cheers
>>>>>>
>>&
nrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>>
>>>>>
>>>>> http://talebzadehmich.wordpress.com
>>>>>
>>>>>
>>>>>
>>>>> On 17 April 2016 at 02:41, Ascot Moss <ascot.m...@gmail.com> wrote
16 at 12:23 AM, Mich Talebzadeh <mich.talebza...@gmail.com
>> <mailto:mich.talebza...@gmail.com>> wrote:
>> Thanks Ted. I was wondering if someone is using both :)
>>
>> Dr Mich Talebzadeh
>>
>> LinkedIn
>> https://www.linkedin.com/p
t; Dr Mich Talebzadeh
>>
>> LinkedIn
>> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>
>> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>
>>
>> http://talebzadehmich.wordpress.
UrV8Pw
>>
>> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>
>>
>> http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/>
>>
>>
>> On 16 April 2016 at 17:08, Ted Yu <yuzhih...@gmail.com
<mailto:ascot.m...@gmail.com>; Ted Yu <mailto:yuzhih...@gmail.com>; user
> @spark <mailto:user@spark.apache.org>
> Subject: Re: Apache Flink
>
> You probably read this benchmark at Yahoo, any comments from Spark?
> https://yahooeng.tumblr.com/post/135321837876
//talebzadehmich.wordpress.com
>>>>
>>>>
>>>>
>>>> On 17 April 2016 at 02:41, Ascot Moss <ascot.m...@gmail.com> wrote:
>>>>
>>>>> I compared both last month, seems to me that Flink's MLLib is not yet
>>>>
>>>
>>>>> Thanks Ted. I was wondering if someone is using both :)
>>>>>
>>>>> Dr Mich Talebzadeh
>>>>>
>>>>>
>>>>> LinkedIn *
>>>>> https://www.linkedin.com/profile/view?id=AAEWh2gBx
;>
>>>> LinkedIn *
>>>> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>>> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>
>>>>
>>>> http://tal
gmail.com>
Cc: Mich Talebzadeh<mailto:mich.talebza...@gmail.com>; Ascot
Moss<mailto:ascot.m...@gmail.com>; Ted Yu<mailto:yuzhih...@gmail.com>; user
@spark<mailto:user@spark.apache.org>
Subject: Re: Apache Flink
You probably read this benchmark at Yahoo, any comments fro
//www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>
>>>>
>>>> http://talebzadehmich.wordpress.com
>>>>
>>>>
>>>>
>>>> On 16 April 2016 at 17:08, Ted Yu <yuzhih...@gmail.
http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/>
>
>
> On 16 April 2016 at 17:08, Ted Yu <yuzhih...@gmail.com
> <mailto:yuzhih...@gmail.com>> wrote:
> Looks like this question is more relevant on flink mailing list :-)
>
> On
iew?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>
>>>
>>>
>>> http://talebzadehmich.wordpress.com
>>>
>>>
>>>
>>> On 16 April
//www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>>
>> On 16 April 2016 at 17:08, Ted Yu <yuzhih...@gmail.com> wrote:
>>
>>> Looks like this question is more relevant on
.@gmail.com> wrote:
>
>> Looks like this question is more relevant on flink mailing list :-)
>>
>> On Sat, Apr 16, 2016 at 8:52 AM, Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Has anyone used Apache Fli
ss.com
On 16 April 2016 at 17:08, Ted Yu <yuzhih...@gmail.com> wrote:
> Looks like this question is more relevant on flink mailing list :-)
>
> On Sat, Apr 16, 2016 at 8:52 AM, Mich Talebzadeh <
> mich.talebza...@gmail.com> wrote:
>
>> Hi,
>>
>> Has anyo
Looks like this question is more relevant on flink mailing list :-)
On Sat, Apr 16, 2016 at 8:52 AM, Mich Talebzadeh <mich.talebza...@gmail.com>
wrote:
> Hi,
>
> Has anyone used Apache Flink instead of Spark by any chance
>
> I am interested in its set of libraries for Com
Hi,
Has anyone used Apache Flink instead of Spark by any chance
I am interested in its set of libraries for Complex Event Processing.
Frankly I don't know if it offers far more than Spark offers.
Thanks
Dr Mich Talebzadeh
LinkedIn *
https://www.linkedin.com/profile/view?id
34 matches
Mail list logo
