Trouble starting hadoop datanode with the bundle version of hadoop
(hadoop-0.20.2)
----------------------------------------------------------------------------------
Key: MESOS-27
URL: https://issues.apache.org/jira/browse/MESOS-27
Project: Mesos
Issue Type: Bug
Components: master
Environment: Mac OS X, Ubuntu Linux
Reporter: Bill Zhao
Not sure if this related to https://issues.apache.org/jira/browse/HADOOP-2345.
Summary:
I was trying to get hadoop to run on top of mesos. However, I am keep getting
error message when I try to start the datanode. The problem related to value
of layoutVersion in /current/VERSION. However, when I ran the Hadoop version
(0.20.203.0), I don't observe the same problem.
The full error looked like this:
11/07/14 15:58:05 ERROR datanode.DataNode:
org.apache.hadoop.hdfs.server.common.IncorrectVersionException: Unexpected
version of storage directory /app/hadoop/tmp/dfs/data. Reported: -31. Expecting
= -18.
at
org.apache.hadoop.hdfs.server.common.Storage.getFields(Storage.java:647)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.getFields(DataStorage.java:178)
at
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.read(Storage.java:227)
at
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.read(Storage.java:216)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:228)
at
org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:148)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:298)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:216)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1283)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1238)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1246)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1368)
My Workaround:
1. stop all hadoop process with "stop-all.sh"
2. edit the layoutVersion parameter in
${hadoop.tmp.dir}/dfs/data/current/VERSION
same as ${hadoop.tmp.dir}/dfs/name/current/VERSION
3. start namenode: bin/hadoop namenode
4. start datanode: bin/hadoop datanode
5. start jobtracker: bin/hadoop jobtracker
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
