It is not suggested to deploy hadoop on NFS, there will be conflict between data nodes, because NFS share the same namespace of file system.
On Thu, May 13, 2010 at 9:52 PM, Andrew Nguyen <and...@ucsfcti.org> wrote: > > Yes, in this deployment, I'm attempting to share the hadoop files via NFS. > The log and pid directories are local. > > Thanks! > > --Andrew > > On May 12, 2010, at 7:40 PM, Jeff Zhang wrote: > > > These 4 nodes share NFS ？ > > > > > > On Thu, May 13, 2010 at 8:19 AM, Andrew Nguyen > > <andrew-lists-had...@ucsfcti.org> wrote: > >> I'm working on bringing up a second test cluster and am getting these > >> intermittent errors on the DataNodes: > >> > >> 2010-05-12 17:17:15,094 ERROR > >> org.apache.hadoop.hdfs.server.datanode.DataNode: > >> java.io.FileNotFoundException: /srv/hadoop/dfs/1/current/VERSION (No such > >> file or directory) > >> at java.io.RandomAccessFile.open(Native Method) > >> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212) > >> at > >> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.write(Storage.java:249) > >> at > >> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.write(Storage.java:243) > >> at > >> org.apache.hadoop.hdfs.server.common.Storage.writeAll(Storage.java:689) > >> at > >> org.apache.hadoop.hdfs.server.datanode.DataNode.register(DataNode.java:560) > >> at > >> org.apache.hadoop.hdfs.server.datanode.DataNode.runDatanodeDaemon(DataNode.java:1230) > >> at > >> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1273) > >> at > >> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1394) > >> > >> > >> There are 4 slaves and sometimes 1 or 2 have the error but the specific > >> nodes change. Sometimes it's slave1, sometimes it's slave4, etc. > >> > >> Any thoughts? > >> > >> Thanks! > >> > >> --Andrew > > > > > > > > -- > > Best Regards > > > > Jeff Zhang > -- Best Regards Jeff Zhang
