Re: Is Spark the right tool for me?

2014-12-02 Thread andy petrella
this is ok? ~Ben Von: andy petrella andy.petre...@gmail.com Datum: Montag, 1. Dezember 2014 15:48 An: Benjamin Stadin benjamin.sta...@heidelberg-mobil.com, user@spark.apache.org user@spark.apache.org Betreff: Re: Is Spark the right tool for me? Indeed. However, I guess the important load

Re: Is Spark the right tool for me?

2014-12-02 Thread Stadin, Benjamin
user@spark.apache.orgmailto:user@spark.apache.org Betreff: Re: Is Spark the right tool for me? The point 4 looks weird to me, I mean if you intent to have such workflow to run in a single session (maybe consider sessionless arch) Is such process for each user? If it's the case, maybe finding a way

Re: Is Spark the right tool for me?

2014-12-02 Thread andy petrella
2014 10:00 An: Benjamin Stadin benjamin.sta...@heidelberg-mobil.com, user@spark.apache.org user@spark.apache.org Betreff: Re: Is Spark the right tool for me? The point 4 looks weird to me, I mean if you intent to have such workflow to run in a single session (maybe consider sessionless arch

Re: Is Spark the right tool for me?

2014-12-02 Thread Roger Hoover
of a user session. = Oozie Do you think this is ok? ~Ben Von: andy petrella andy.petre...@gmail.com Datum: Montag, 1. Dezember 2014 15:48 An: Benjamin Stadin benjamin.sta...@heidelberg-mobil.com, user@spark.apache.org user@spark.apache.org Betreff: Re: Is Spark the right tool for me

Is Spark the right tool for me?

2014-12-01 Thread Stadin, Benjamin
Hi all, I need some advise whether Spark is the right tool for my zoo. My requirements share commonalities with „big data“, workflow coordination and „reactive“ event driven data processing (as in for example Haskell Arrows), which doesn’t make it any easier to decide on a tool set. NB: I

Re: Is Spark the right tool for me?

2014-12-01 Thread andy petrella
Not quite sure which geo processing you're doing are they raster, vector? More info will be appreciated for me to help you further. Meanwhile I can try to give some hints, for instance, did you considered GeoMesa http://www.geomesa.org/2014/08/05/spark/? Since you need a WMS (or alike), did you

Re: Is Spark the right tool for me?

2014-12-01 Thread Stadin, Benjamin
2014 15:07 An: Benjamin Stadin benjamin.sta...@heidelberg-mobil.commailto:benjamin.sta...@heidelberg-mobil.com, user@spark.apache.orgmailto:user@spark.apache.org user@spark.apache.orgmailto:user@spark.apache.org Betreff: Re: Is Spark the right tool for me? Not quite sure which geo processing

Re: Is Spark the right tool for me?

2014-12-01 Thread Stadin, Benjamin
, user@spark.apache.orgmailto:user@spark.apache.org user@spark.apache.orgmailto:user@spark.apache.org Betreff: Re: Is Spark the right tool for me? Not quite sure which geo processing you're doing are they raster, vector? More info will be appreciated for me to help you further. Meanwhile I can

Re: Is Spark the right tool for me?

2014-12-01 Thread andy petrella
://www.deep-map.com Von: andy petrella andy.petre...@gmail.com Datum: Montag, 1. Dezember 2014 15:07 An: Benjamin Stadin benjamin.sta...@heidelberg-mobil.com, user@spark.apache.org user@spark.apache.org Betreff: Re: Is Spark the right tool for me? Not quite sure which geo processing you're