Based on Jacob's suggestion, I started using --net=host which is a new
option in latest version of docker. I also set SPARK_LOCAL_IP to the host's
IP address and then AKKA does not use the hostname and I don't need the
Spark driver's hostname to be resolvable.
Thanks guys for your help!
On Tue,
with docker: errors with akka, NAT?
Hi Folks,
I am having trouble getting spark driver running in docker. If I run a
pyspark example on my mac it works but the same example on a docker image
(Via boot2docker) fails with following logs. I am pointing the spark driver
(which is running the example
I am using cutting edge code from git but doing my own sbt assembly.
On Mon, Jun 16, 2014 at 10:28 PM, Andre Schumacher
schum...@icsi.berkeley.edu wrote:
Hi,
are you using the amplab/spark-1.0.0 images from the global registry?
Andre
On 06/17/2014 01:36 AM, Mohit Jaggi wrote:
Hi
I remember having to do a similar thing in the spark docker scripts for
testing purposes. Were you able to modify the /etc/hosts directly? I
remember issues with that as docker apparently mounts it as part of its
read-only filesystem.
On Tue, Jun 17, 2014 at 4:36 PM, Mohit Jaggi
I used --privileged to start the container and then unmounted /etc/hosts.
Then I created a new /etc/hosts file
On Tue, Jun 17, 2014 at 4:58 PM, Aaron Davidson ilike...@gmail.com wrote:
I remember having to do a similar thing in the spark docker scripts for
testing purposes. Were you able to
Yup, alright, same solution then :)
On Tue, Jun 17, 2014 at 7:39 PM, Mohit Jaggi mohitja...@gmail.com wrote:
I used --privileged to start the container and then unmounted /etc/hosts.
Then I created a new /etc/hosts file
On Tue, Jun 17, 2014 at 4:58 PM, Aaron Davidson ilike...@gmail.com
Hi Folks,
I am having trouble getting spark driver running in docker. If I run a
pyspark example on my mac it works but the same example on a docker image
(Via boot2docker) fails with following logs. I am pointing the spark driver
(which is running the example) to a spark cluster (driver is not
Hi,
are you using the amplab/spark-1.0.0 images from the global registry?
Andre
On 06/17/2014 01:36 AM, Mohit Jaggi wrote:
Hi Folks,
I am having trouble getting spark driver running in docker. If I run a
pyspark example on my mac it works but the same example on a docker image
(Via
