Re: Access on HDFS

2015-05-08 Thread Matt Narrell
0(admin) groups=500(admin),498(hdfs) > > > Please suggest what should be the change for the permissions on / or if there > is any other way to resolve this. > > Thanks, > Pratik > From: Matt Narrell [mailto:matt.narr...@gmail.com] > Sent: Friday, May 08, 2015 9:

Re: Access on HDFS

2015-05-08 Thread Matt Narrell
It looks like the group permissions on / is set to prohibit writes. mn > On May 8, 2015, at 9:59 AM, Olivier Renault wrote: > > I meant did you check that user admin is part of the hdfs group on the > namenode. > > Olivier > > > From: Pratik Gadiya > Reply-To: "user@hadoop.apache.org

Re: YARN HA Active ResourceManager failover when machine is stopped

2015-04-27 Thread Matt Narrell
issues.apache.org/jira/i#browse/YARN-1061 > <https://issues.apache.org/jira/i#browse/YARN-1061> (Without HA) > https://issues.apache.org/jira/i#browse/YARN-2578 > <https://issues.apache.org/jira/i#browse/YARN-2578> (With HA) > > > Thanks & Regards > Rohith Sh

Re: YARN HA Active ResourceManager failover when machine is stopped

2015-04-24 Thread Matt Narrell
exR > > On Fri, Apr 24, 2015 at 11:39 AM, Matt Narrell <mailto:matt.narr...@gmail.com>> wrote: > Active ResourceManager: http://pastebin.com/hE0ppmnb > <http://pastebin.com/hE0ppmnb> > Standby ResourceManager: http://pastebin.com/DB8VjHqA > <http://pastebin.c

Re: YARN HA Active ResourceManager failover when machine is stopped

2015-04-24 Thread Matt Narrell
sourceManager HA documentation from Apache and Hortonworks. mn > On Apr 24, 2015, at 1:50 AM, Drake민영근 wrote: > > Hi, Matt > > The second log file looks like node manager's log, not the standby resource > manager. > > Thanks. > > Drake 민영근 P

Re: YARN HA Active ResourceManager failover when machine is stopped

2015-04-23 Thread Matt Narrell
mar Vavilapalli > wrote: > > I have run into this offline with someone else too but couldn't root-cause it. > > Will you be able to share your active/standby ResourceManager logs via > pastebin or something? > > +Vinod > > On Apr 23, 2015, at 9:41 AM, Ma

YARN HA Active ResourceManager failover when machine is stopped

2015-04-23 Thread Matt Narrell
I’m using Hadoop 2.6.0 from HDP 2.2.4 installed via Ambari 2.0 I’m testing the YARN HA ResourceManager failover. If I STOP the active ResourceManager (shut the machine off), the standby ResourceManager is elected to active, but the NodeManagers do not register themselves with the newly elected

Re: Failed to active namenode when config HA

2014-09-30 Thread Matt Narrell
what may cause these problem? > > Thanks, > Lucy > > -- Original -- > From: "Matt Narrell";; > Send time: Monday, Sep 29, 2014 6:28 AM > To: "user"; > Subject: Re: Failed to active namenode when config HA > > I’m

Re: Failed to active namenode when config HA

2014-09-28 Thread Matt Narrell
I’m pretty sure HDFS HA is relegated to two name nodes (not four), designated active and standby. Secondly, I believe these properties should be in hdfs-site.xml NOT core-site.xml. Furthermore, I think your HDFS nameservices are misconfigured. Consider the following: dfs.replication

Re: No space when running a hadoop job

2014-09-26 Thread Matt Narrell
You can add a comma separated list of paths to the “dfs.datanode.data.dir” property in your hdfs-site.xml mn On Sep 26, 2014, at 8:37 AM, Abdul Navaz wrote: > Hi > > I am facing some space issue when I saving file into HDFS and/or running map > reduce job. > > root@nn:~# df -h > Filesystem

Re: YARN ResourceManager Hostname in HA configuration

2014-09-18 Thread Matt Narrell
ies > > yarn.resourcemanager.hostname.rm-id1 > > yarn.resourcemanager.hostname.rm-id2 > > not yarn.resourcemanager.hostname. > > > > On 9/17/14, Matt Narrell wrote: >> How do I configure the “yarn.resourcemanager.hostname” property when in an >> HA conf

YARN ResourceManager Hostname in HA configuration

2014-09-17 Thread Matt Narrell
How do I configure the “yarn.resourcemanager.hostname” property when in an HA configuration? It seems that this property will configure how the UI knits together the node/application/timeline/etc UIs into a seamless experience. The issue I come across is that this property seems to only accept

Re: Starting hadoop on reboot/start

2014-08-20 Thread Matt Narrell
I have SysV scripts for HDFS and YARN services. I’ll gladly share them. What is a preferred sharing manner? GitHub? On Aug 20, 2014, at 11:06 AM, Mohit Anchlia wrote: > Any help would be appreciated. If not I'll go ahead and write these startup > scripts. > > > On Tue, Aug 19, 2014 at 5:4