Hi Sandy, We have more than 20 nodes each with around 80GB of RAM and the memory usage across the cluster is low, <20GB. The FairScheduler is being used.
Thanks, Dave On Fri, May 30, 2014 at 12:42 PM, Sandy Ryza <sandy.r...@cloudera.com> wrote: > Hi Dave, > > How many nodes do you have in your cluster and how much memory on each? > If you go to the RM web UI at port 8088, how much memory is used? Which > YARN scheduler are you using? > > -Sandy > > > On Fri, May 30, 2014 at 12:38 PM, David Belling <davidbelling...@gmail.com > > wrote: > >> Hi, >> >> I'm running CDH5 and its bundled Spark (0.9.0). The Spark shell has been >> coming up fine over the last couple of weeks. However today it doesn't come >> up and I just see this message over and over: >> >> 14/05/30 12:06:05 INFO YarnClientSchedulerBackend: Application report >> from ASM: >> >> appMasterRpcPort: -1 >> >> appStartTime: 1401476259688 >> >> yarnAppState: ACCEPTED >> >> Are there any diagnostic steps I can take to figure out what the problem >> is? If I exit out of the client process the YARN application continues to >> exist in the ACCEPTED state, and I end up having to kill the YARN app on >> the CLI. >> >> Cheers, >> Dave >> >> > -- Cheers, Dave
