Re: Speeding up Anaconda deployment on executors

2018-05-29 Thread Yaniv Rodenski
Hi Nadav, First of all, a small correction, in Mesos Amaterasu chooses to reuse the same container if it makes sense (there is an existing container that makes sense to reuseon the node that gave us the offer, currently that's all of the time but will change shortly. With that in mind there are

Re: Speeding up Anaconda deployment on executors

2018-05-27 Thread Nadav Har Tzvi
I am kinda inclined towards a solution that could be performed at setup time. Let's try to explore in that direction. If we manage to nail this at setup time, it means that the runtime will be lightning fast (compared to what it is now :)) Cheers, Nadav On 28 May 2018 at 00:17, Nadav Har Tzvi