Re: Spark version for Mesos 0.27.0

2018-05-31 Thread Thodoris Zois
Ok! Thank you very much! - Thodoris On Thu, 2018-05-31 at 11:30 +0200, Szuromi Tamás wrote: > I see it in the Serenity docs. Anyway, I guess you are able to use > the newest version of Spark with the Mesos 0.27 without any issues so > don't have to dispense newer Spark features and fixes. >

Re: Spark version for Mesos 0.27.0

2018-05-31 Thread Szuromi Tamás
I see it in the Serenity docs. Anyway, I guess you are able to use the newest version of Spark with the Mesos 0.27 without any issues so don't have to dispense newer Spark features and fixes. Thodoris Zois ezt írta (időpont: 2018. máj. 31., Cs, 11:22): > Hello, > > The reason is that I want to

Re: Spark version for Mesos 0.27.0

2018-05-31 Thread Thodoris Zois
Hello, The reason is that I want to make some tests and use the oversubscription feature of Mesos along with Spark. Intel and Mesosphere have built a project, called Serenity that actually measures the usage slack on each Mesos agent and returns resources to the cluster. Unfortunately, Serenity

Re: Spark version for Mesos 0.27.0

2018-05-31 Thread Szuromi Tamás
Hey, I'm sure we used Spark 1.6 on Mesos 0.27 as well but at that time we used with fine-grained scheduling and not dynamic allocation. Also, newer Spark versions should work with older mesos versions like 0.27. Why do you have Mesos 0.27 btw? cheers, Tamas Thodoris Zois ezt írta (időpont:

Re: Spark version for Mesos 0.27.0

2018-05-30 Thread Thodoris Zois
Hello, I need Mesos 0.27 for specific purposes and unfortunately I can’t use a newer version. Did you find anything? Could it be Spark 1.6? Except that, from which version Spark supports dynamic allocation on Mesos? - Thodoris > On 25 May 2018, at 16:06, Jacek Laskowski wrote: > > Hi, >

Re: Spark version for Mesos 0.27.0

2018-05-25 Thread Jacek Laskowski
Hi, Mesos 0.27.0?! That's been a while. I'd search for the changes to pom.xml and see when the mesos dependency version changed. That'd give you the most precise answer. I think it could've been 1.5 or older. Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski Mastering Spark SQL

Spark version for Mesos 0.27.0

2018-05-25 Thread Thodoris Zois
Hello, Could you please tell me which version of Spark works with Apache Mesos version 0.27.0? (I cannot find anything on docs at github) Thank you very much, Thodoris Zois - To unsubscribe e-mail: