Re: Yarn web UI shows more memory used than actual

The RM page will show the combined container memory usage. If you have a significant difference between any or all of 1) actual process memory usage 2) JVM heap size 3) container maximum then you will have significant memory underutilization. -Ray On 20160813 6:31 AM, Suresh V wrote:

Re: YARN queues become unusable and jobs are stuck in ACCEPTED state

Just because you have sufficient resources doesn't mean another job should launch an AM. You might want to check maxAMShare and queueMaxAMShareDefault. Given that you have sufficient resources, you could be running into YARN-3491. I don't know whether you have the option, but CDH 5.3.3 is

Re: Default scheduler yarn

The YARN configuration file can be seen in yarn-default.xml . The property you're looking for is: yarn.resourcemanager.scheduler.class which has the property:

Re: Can't find logs in YARN

If you go to the RM UI (usually at http://RM Machine:8088/), then you can see the list of jobs run, click on the History link for your job run, then the Map link (the Map and Reduce entries won't necessarily look like links, but they are), then you can look at the logs for each specific task.

Re: Question about the QJM HA namenode

It looks like that's tied to the ipc.client.connect.* properties. You can adjust retries timeout values to something shorter and see if that works for you. Offhand, I'm not certain if that will affect other services besides HDFS. -Ray On Wed, Dec 3, 2014 at 2:51 AM, mail list

Re: Question about the QJM HA namenode

wrote: Hi ,Ray How can I know the standby name node become active and done the recovery job and can work in log? Is there some obvious mark in name node log? On Dec 5, 2014, at 9:55, mail list louis.hust...@gmail.com wrote: Thanks Ray, I will try this options. On Dec 5, 2014, at 5:50, Ray

Re: build hadoop-2.4.1 by mvn eclipse:eclipse fail in mac os x 10.9

FYI, for these sort of issues, I highly recommend reading the BUILDING.txt that comes in the Hadoop source code. Also, if you're going to use an IDE with Hadoop, I've found IntelliJ works well for me. The instructions here

Re: Building 1.2.1

Try the instructions for branch-1 at https://wiki.apache.org/hadoop/QwertyManiac/BuildingHadoopTrunk -Ray On Tue, Oct 14, 2014 at 11:08 AM, buddhika chamith chamibuddh...@gmail.com wrote: Hi All, Apologies if this has been addressed somewhere already. But I couldn't find relevant

Re: Hadoop 2.5.0 unit tests failures

Just as a quick follow up, you can also search the JIRAs to see which tests are already known to be on the flakier side (e.g. race conditions like Zhijie mentions, or some similar hard-to-replicate reason). -Ray On Sun, Aug 31, 2014 at 11:40 PM, Zhijie Shen zs...@hortonworks.com wrote: Hi

Re: Starting hadoop on reboot/start

Try taking a peek at the Cloudera distributions. Look in the tar file in the sbin directory for files like *-daemon.sh *-daemons.sh That might be a good starting point. -Ray On Wed, Aug 20, 2014 at 10:06 AM, Mohit Anchlia mohitanch...@gmail.com wrote: Any help would be appreciated. If not