Re: how to use SPARK_PUBLIC_DNS

2014-08-10 Thread Xuefeng Wu
there is docker script for spark 0.9 in spark git Yours, Xuefeng Wu 吴雪峰 敬上 > On 2014年8月10日, at 下午8:27, 诺铁 wrote: > > hi, all, > > I am playing with docker, trying to create a spark cluster with docker > containers. > > since spark master, worker, driver all need to visit each other, I confi

how to use SPARK_PUBLIC_DNS

2014-08-10 Thread 诺铁
hi, all, I am playing with docker, trying to create a spark cluster with docker containers. since spark master, worker, driver all need to visit each other, I configured a dns server, and set hostname and domain name of each node. but when spark master start up, it seems to be using hostname wit