Yaniv Kaul created HADOOP-10991: ----------------------------------- Summary: 'hadoop namenode -format' fails if user hadoop homedir is not under /home Key: HADOOP-10991 URL: https://issues.apache.org/jira/browse/HADOOP-10991 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 2.5.0 Environment: CentOS 6.5 Reporter: Yaniv Kaul Priority: Minor
Since my homedir is on shared NFS, I couldn't create a user for hadoop on /home. Therefore, I've used: useradd hadoop --home /hadoop which worked well. I've adjusted HADOOP_HOME and friends to match correctly. Running hdfs namenode -format failed: {noformat} 14/08/21 13:57:35 INFO namenode.NNConf: XAttrs enabled? true 14/08/21 13:57:35 INFO namenode.NNConf: Maximum size of an xattr: 16384 14/08/21 13:57:35 INFO namenode.FSImage: Allocated new BlockPoolId: BP-1696511243-10.103.234.197-1408618655940 14/08/21 13:57:35 WARN namenode.NameNode: Encountered exception during format: java.io.IOException: Cannot create directory /home/hadoop/hadoopdata/hdfs/namenode/current at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:334) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:546) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:567) at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:148) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:926) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1354) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1473) 14/08/21 13:57:35 FATAL namenode.NameNode: Exception in namenode join java.io.IOException: Cannot create directory /home/hadoop/hadoopdata/hdfs/namenode/current at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:334) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:546) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:567) at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:148) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:926) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1354) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1473) 14/08/21 13:57:35 INFO util.ExitUtil: Exiting with status 1 14/08/21 13:57:35 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at lgdrm432.xiodrm.lab.emc.com/10.103.234.197 {noformat} The error seems to be clear: {noformat} java.io.IOException: Cannot create directory /home/hadoop/hadoopdata/hdfs/namenode/current {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)