Re: Wrong job tracking URL

Hey, Manoj: https://issues.apache.org/jira/browse/YARN-3526 may be related. Thanks Xuan Gong On Sep 13, 2015, at 10:01 PM, Naganarasimha G R (Naga) <garlanaganarasi...@huawei.com<mailto:garlanaganarasi...@huawei.com>> wrote: Hi Manoj, May be i dint get your query complet

Re: Hadoop Yarn UI not showing newest jobs first

This one might be related. https://issues.apache.org/jira/browse/YARN-3840 Thanks Xuan Gong From: Stephen Armstrong stephen.armstr...@linqia.commailto:stephen.armstr...@linqia.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org

Re: Large number of application attempts

/rmstore/ZKRMStateRoot and all the subdir/files) Thanks Xuan Gong On 7/8/15, 5:45 AM, Akmal Abbasov akmal.abba...@icloud.com wrote: But I¹ve noticed that there are ~4000 znodes in /hadoop-ha/testhbase1/rmstore/ZKRMStateRoot/RMAppRoot in Zookeeper. Can I manually remove this znodes, or do I need

Re: Large number of application attempts

Hey, Akmal: Are you running a lots of apps ? Or could you, maybe, share some of file names of those znodes, please ? Thanks Xuan Gong On 7/7/15, 1:23 AM, Akmal Abbasov akmal.abba...@icloud.com wrote: Hi all, I have HBase cluster. I run a cron job each hour to create a snapshot of tables

Re: Default address configuration of Yarn HA cluster

, the yarn.resourcemanager.resource-tracker.address in RM1 will be localhost1:8031. Also, if you set yarn.resourcemanager.resource-tracker.address.rm1 explicitly in yarn-site.xml, the resource-tracker.address used in rm1 will pick up the value you set for yarn.resourcemanager.resource-tracker.address.rm1. Thanks Xuan Gong

Re: Can't see logs of a finished job.

nameyarn.log.server.url/name valuehttp://localhost:19888/jobhistory/logs/value /property Thanks Xuan Gong From: xeonmailinglist-gmail xeonmailingl...@gmail.commailto:xeonmailingl...@gmail.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user

Re: TeraSort Decommissioning Nodes

What is the error message ? Any logs you could provide ? From: Telles Nobrega tellesnobr...@gmail.commailto:tellesnobr...@gmail.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org Date: Wednesday, March 11, 2015 at 10:01 AM To:

Re: Problems installing Hadoop on Windows 7 enterprise N

Hey, You might need to skip all the unit tests to finish your build. By doing that, you could add -DskipTests Thanks From: Daniël van Dam daniel.van...@ortec-finance.commailto:daniel.van...@ortec-finance.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org

Re: How to resolve--- Unauthorized request to start container. This token is expired.

. Thanks Xuan Gong From: Jan van Bemmelen j...@tokyoeye.netmailto:j...@tokyoeye.net Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org Date: Thursday, February 26, 2015 at 10:54 AM To: user@hadoop.apache.orgmailto:user

Re: No FileSystem for scheme: hdfs when submitting a remote job

Have you added hadoop-hdfs-.jar into your class path ? From: xeonmailinglist xeonmailingl...@gmail.commailto:xeonmailingl...@gmail.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org Date: Tuesday, February 24, 2015 at 10:57

Re: Yarn AM is abending job when submitting a remote job to cluster

Hey, Roland: Could you also check the RM logs for this application, please ? Maybe we could find something there. Thanks Xuan Gong From: Roland DePratti roland.depra...@cox.netmailto:roland.depra...@cox.net Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user

Re: Log Aggregation

Hey, could you check whether the logs appear in HDFS ? If not, could you check the NodeManager logs to find out when/whether the log aggregation for that applications started ? Thanks Xuan Gong On 2/13/15, 6:54 AM, Dmitry Sivachenko trtrmi...@gmail.com wrote: Hello! I am using hadoop-2.4.1

Re: Can not execute failover for RM HA

, you can use command “yarn rmadmin –transitionToActive --forcemanual rm2 Thanks Xuan Gong From: 郝东 donhof...@163.commailto:donhof...@163.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org Date: Tuesday, February 10, 2015 at 2:42

Re: Max Connect retries

That is for client connect retry in ipc level. You can decrease the max.retries by configuring ipc.client.connect.max.retries.on.timeouts in core-site.xml Thanks Xuan Gong From: Telles Nobrega tellesnobr...@gmail.commailto:tellesnobr...@gmail.com Reply-To: user@hadoop.apache.orgmailto:user

Re: Hadoop Node Failure Detection

Hey, Telles: You can simply decrease the NM expiry-interval. The default value is 5 mins. You can config nm.liveness-monitor.expiry-interval-ms (in millisecond)in yarn-site.xml Thanks Xuan Gong From: Telles Nobrega tellesnobr...@gmail.commailto:tellesnobr...@gmail.com Reply-To: user

Re: Application Master fails due to Invalid AMRM token

Hey, Rahul Can be related to: https://issues.apache.org/jira/browse/MAPREDUCE-6230 and https://issues.apache.org/jira/browse/YARN-3103 You can manually apply these two patches, and try again. Thanks Xuan Gong From: bharath vissapragada bharathvissapragada1

Re: a bug in MRAppMaster?

Hey, there are several issues which may cause this error. If you could attached the full RM/NM/AppMaster logs, that will be easier for us to do the debug. Thanks Xuan Gong On Tue, Dec 23, 2014 at 4:03 AM, foolbear foolbea...@gmail.com wrote: Hi all I'm using apache hadoop 2.2.0 with yarn

Re: Does MRv2 support the deprecated properties?

Hey sam: Please take a look at hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/util/ConfigUtil.java Thanks Xuan Gong On Mon, Dec 22, 2014 at 6:34 PM, sam liu samliuhad...@gmail.com wrote: Hi Experts, In Hadoop 2.x code, there are lots of deprecated properties

Re: Hadoop 2.4.1 Verifying Automatic Failover Failed: ResourceManager

Hey, Arthur: Could you show me the error message for rm2. please ? Thanks Xuan Gong On Mon, Aug 11, 2014 at 10:17 PM, arthur.hk.c...@gmail.com arthur.hk.c...@gmail.com wrote: Hi, Thank y very much! At the moment if I run ./sbin/start-yarn.sh in rm1, the standby STANDBY

Re: Hadoop 2.4.1 Verifying Automatic Failover Failed: ResourceManager

Hey, Arthur: Did you use single node cluster or multiple nodes cluster? Could you share your configuration file (yarn-site.xml) ? This looks like a configuration issue. Thanks Xuan Gong On Mon, Aug 11, 2014 at 9:45 AM, arthur.hk.c...@gmail.com arthur.hk.c...@gmail.com wrote: Hi, If I

Re: Hadoop 2.4.1 Verifying Automatic Failover Failed: ResourceManager

if the failover happens. We can monitor the status of RMs by using the command-line (you did previously) or from webUI/webService (rm_address:portnumber/cluster/cluster). We can get the current status from there. Thanks Xuan Gong On Mon, Aug 11, 2014 at 5:12 PM, arthur.hk.c...@gmail.com arthur.hk.c

Re: yarn REST api (controller for v1 not found)

Hey, Alex: Please try this http://rm host:8088/ws/v1/cluster/apps/ application_1401899005478_2241 You are using app instead of apps. Thanks Xuan Gong On Thu, Jul 3, 2014 at 1:21 PM, Alex Nastetsky anastet...@spryinc.com wrote: This is actually the link I was following: http

Re: Hadoop 2.2.0 not showing progress

Hey, Silvina: You may find more information about this application from RM web UI or Yarn Command Line (Type yarn application -help to find out commands). Thanks Xuan Gong On Mon, Mar 10, 2014 at 4:16 AM, Silvina Caíno Lores silvi.ca...@gmail.comwrote: Hi all, I've been noticing lately

Re: App Master issue.

The message means it can not connect to ResourceManager. Could you share your configuration ? It might be easier to figure out the real issue. Thanks Xuan Gong On Wed, Mar 5, 2014 at 11:29 AM, Sai Prasanna ansaiprasa...@gmail.comwrote: Hi, I have a five node cluster. One master and 4

Re: YARN -- Debug messages in logs

Hey, Kishore: you can change the log level from INFO to DEBUG in log4j.properties Thanks, Xuan Gong On Fri, Feb 28, 2014 at 10:09 AM, Krishna Kishore Bonagiri write2kish...@gmail.com wrote: Hi, How can I get the debug log messages from RM and other daemons? For example