[mesos][docker] addFile doesn't work properly

2015-12-10 Thread PHELIPOT, REMY
Hello! I'm using Apache Spark with Mesos, and I've launched a job with coarse-mode=true. In my job, I must download a file from the internet, so I'm using: import org.apache.spark.SparkFiles sc.addFile("http://samplecsvs.s3.amazonaws.com/Sacramentorealestatetransactions.csv;) val path =

Spark driver, Docker, and Mesos

2015-11-04 Thread PHELIPOT, REMY
Hello, I’m trying to run a spark shell (or a spark notebook) connect to a mesos master inside a docker container. My goal is to give access to the mesos cluster for several user at the same time. It seems not possible to get it working with the container started in bridge mode, isn’t it? Is