Re: Build Spark 2.0 succeeded but could not run it on YARN

2016-06-21 Thread Wu Gang
Hi Ted, I didn't type any command, it just threw that exception after launched. Thanks! On Mon, Jun 20, 2016 at 7:18 PM, Ted Yu wrote: > What operations did you run in the Spark shell ? > > It would be easier for other people to reproduce using your code snippet. > >

Re: Build Spark 2.0 succeeded but could not run it on YARN

2016-06-20 Thread Ted Yu
What operations did you run in the Spark shell ? It would be easier for other people to reproduce using your code snippet. Thanks On Mon, Jun 20, 2016 at 6:20 PM, Jeff Zhang wrote: > Could you check the yarn app logs for details ? run command "yarn logs > -applicationId " to

Re: Build Spark 2.0 succeeded but could not run it on YARN

2016-06-20 Thread Jeff Zhang
Could you check the yarn app logs for details ? run command "yarn logs -applicationId " to get the yarn log On Tue, Jun 21, 2016 at 9:18 AM, wgtmac wrote: > I ran into problems in building Spark 2.0. The build process actually > succeeded but when I uploaded to cluster and

Build Spark 2.0 succeeded but could not run it on YARN

2016-06-20 Thread wgtmac
I ran into problems in building Spark 2.0. The build process actually succeeded but when I uploaded to cluster and launched the Spark shell on YARN, it reported following exceptions again and again: 16/06/17 03:32:00 WARN cluster.YarnSchedulerBackend$YarnSchedulerEndpoint: Container marked as