Re: If you use Spark 1.5 and disabled Tungsten mode ...

2015-11-05 Thread Sjoerd Mulder
t version of > Janino brought in from somewhere else. > > This should fix your problem: https://github.com/apache/spark/pull/9372 > > Can you give it a try? > > > > On Tue, Oct 27, 2015 at 9:12 PM, Sjoerd Mulder <sjoerdmul...@gmail.com> > wrote: > >>

Re: If you use Spark 1.5 and disabled Tungsten mode ...

2015-10-27 Thread Sjoerd Mulder
> generate ordering, fallback to interpreted" in the error message). > > On Tue, Oct 27, 2015 at 12:56 PM Sjoerd Mulder <sjoerdmul...@gmail.com> > wrote: > >> I have disabled it because of it started generating ERROR's when >> upgrading from Spark 1.4 to 1.5.

Re: If you use Spark 1.5 and disabled Tungsten mode ...

2015-10-27 Thread Sjoerd Mulder
I have disabled it because of it started generating ERROR's when upgrading from Spark 1.4 to 1.5.1 2015-10-27T20:50:11.574+0100 ERROR TungstenSort.newOrdering() - Failed to generate ordering, fallback to interpreted java.util.concurrent.ExecutionException: java.lang.Exception: failed to compile:

Re: Spark driver hangs on start of job

2015-07-02 Thread Sjoerd Mulder
://gist.github.com/rmarsch/e5d298e582ab75957957 DAGScheduler gist: https://gist.github.com/rmarsch/ae8f5bb03b11e8d4f8f7 Regards, Richard On Fri, Jun 26, 2015 at 12:08 PM, Sjoerd Mulder sjoerdmul...@gmail.com wrote: Hi Richard, I would like to see how we can get a workaround to get out of the Zombie

Spark driver hangs on start of job

2015-06-26 Thread Sjoerd Mulder
Hi, I have a really annoying issue that i cannot replicate consistently, still it happens every +- 100 submissions. (it's a job that's running every 3 minutes). Already reported an issue for this: https://issues.apache.org/jira/browse/SPARK-8592 Here are the Thread dump of the Driver and the