Just to be clear, I'm only sharing the Hadoop binaries and config files via NFS. I don't see how this would cause a conflict - do you have any additional information?
The referenced path in the error below (/srv/hadoop/dfs/1) is not being shared via NFS... Thanks, Andrew On May 13, 2010, at 6:51 PM, Jeff Zhang wrote: > It is not suggested to deploy hadoop on NFS, there will be conflict > between data nodes, because NFS share the same namespace of file > system. > > > > On Thu, May 13, 2010 at 9:52 PM, Andrew Nguyen <and...@ucsfcti.org> wrote: >> >> Yes, in this deployment, I'm attempting to share the hadoop files via NFS. >> The log and pid directories are local. >> >> Thanks! >> >> --Andrew >> >> On May 12, 2010, at 7:40 PM, Jeff Zhang wrote: >> >>> These 4 nodes share NFS ？ >>> >>> >>> On Thu, May 13, 2010 at 8:19 AM, Andrew Nguyen >>> <andrew-lists-had...@ucsfcti.org> wrote: >>>> I'm working on bringing up a second test cluster and am getting these >>>> intermittent errors on the DataNodes: >>>> >>>> 2010-05-12 17:17:15,094 ERROR >>>> org.apache.hadoop.hdfs.server.datanode.DataNode: >>>> java.io.FileNotFoundException: /srv/hadoop/dfs/1/current/VERSION (No such >>>> file or directory) >>>> at java.io.RandomAccessFile.open(Native Method) >>>> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212) >>>> at >>>> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.write(Storage.java:249) >>>> at >>>> org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.write(Storage.java:243) >>>> at >>>> org.apache.hadoop.hdfs.server.common.Storage.writeAll(Storage.java:689) >>>> at >>>> org.apache.hadoop.hdfs.server.datanode.DataNode.register(DataNode.java:560) >>>> at >>>> org.apache.hadoop.hdfs.server.datanode.DataNode.runDatanodeDaemon(DataNode.java:1230) >>>> at >>>> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1273) >>>> at >>>> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1394) >>>> >>>> >>>> There are 4 slaves and sometimes 1 or 2 have the error but the specific >>>> nodes change. Sometimes it's slave1, sometimes it's slave4, etc. >>>> >>>> Any thoughts? >>>> >>>> Thanks! >>>> >>>> --Andrew >>> >>> >>> >>> -- >>> Best Regards >>> >>> Jeff Zhang >> > > > > -- > Best Regards > > Jeff Zhang
