code hangs in local master mode

2016-01-14 Thread Kai Wei
Hi list, I ran into an issue which I think could be a bug. I have a Hive table stored as parquet files. Let's say it's called testtable. I found the code below stuck forever in spark-shell with a local master or driver/executor: sqlContext.sql("select * from

Re: code hangs in local master mode

2016-01-14 Thread Kai Wei
Thanks for your reply, Ted. Below is the stack dump for all threads: Thread dump for executor driver Updated at 2016/01/14 20:35:41 Collapse All Thread 89: Executor task launch worker-0 (TIMED_WAITING) sun.misc.Unsafe.park(Native Method)

Re: code hangs in local master mode

2016-01-14 Thread Ted Yu
Can you capture one or two stack traces of the local master process and pastebin them ? Thanks On Thu, Jan 14, 2016 at 6:01 AM, Kai Wei wrote: > Hi list, > > I ran into an issue which I think could be a bug. > > I have a Hive table stored as parquet files. Let's say it's