Re: broadcast not working in yarn-cluster mode

2014-06-24 Thread Christophe Préaud
Hi again, I've finally solved the problem below, it was due to an old 1.0.0-rc3 spark jar lying around in my .m2 directory which was used when I compiled my spark applications (with maven). Christophe. On 20/06/2014 18:13, Christophe Préaud wrote: Hi, Since I migrated to spark 1.0.0, a

broadcast not working in yarn-cluster mode

2014-06-20 Thread Christophe Préaud
Hi, Since I migrated to spark 1.0.0, a couple of applications that used to work in 0.9.1 now fail when broadcasting a variable. Those applications are run on a YARN cluster in yarn-cluster mode (and used to run in yarn-standalone mode in 0.9.1) Here is an extract of the error log: Exception