Bug in DiskBlockManager subDirs logic?

2016-02-25 Thread Zee Chen
Hi, I am debugging a situation where SortShuffleWriter sometimes fail to create a file, with the following stack trace: 16/02/23 11:48:46 ERROR Executor: Exception in task 13.0 in stage 47827.0 (TID 1367089) java.io.FileNotFoundException: /tmp/spark-9dd8dca9-6803-4c6c-bb6a-0e9c0111837c/executor-1

Re: How to bind webui to localhost?

2016-01-14 Thread Zee Chen
sure will do. On Thu, Jan 14, 2016 at 3:19 PM, Shixiong(Ryan) Zhu wrote: > Yeah, it's hard code as "0.0.0.0". Could you send a PR to add a > configuration for it? > > On Thu, Jan 14, 2016 at 2:51 PM, Zee Chen wrote: >> >> Hi, what is the easiest way

How to bind webui to localhost?

2016-01-14 Thread Zee Chen
Hi, what is the easiest way to configure the Spark webui to bind to localhost or 127.0.0.1? I intend to use this with ssh socks proxy to provide a rudimentary "secured access". Unlike hadoop config options, Spark doesn't allow the user to directly specify the ip addr to bind services to. -