Bug in DiskBlockManager subDirs logic?

2016-02-25 Thread Zee Chen
Hi, I am debugging a situation where SortShuffleWriter sometimes fail to create a file, with the following stack trace: 16/02/23 11:48:46 ERROR Executor: Exception in task 13.0 in stage 47827.0 (TID 1367089) java.io.FileNotFoundException:

How to bind webui to localhost?

2016-01-14 Thread Zee Chen
Hi, what is the easiest way to configure the Spark webui to bind to localhost or 127.0.0.1? I intend to use this with ssh socks proxy to provide a rudimentary "secured access". Unlike hadoop config options, Spark doesn't allow the user to directly specify the ip addr to bind services to.

Re: How to bind webui to localhost?

2016-01-14 Thread Zee Chen
sure will do. On Thu, Jan 14, 2016 at 3:19 PM, Shixiong(Ryan) Zhu <shixi...@databricks.com> wrote: > Yeah, it's hard code as "0.0.0.0". Could you send a PR to add a > configuration for it? > > On Thu, Jan 14, 2016 at 2:51 PM, Zee Chen <zeo...@gmail.com> wrote: