I have the dfs.replication value set to 2 in my hadoop-site.xml Note that in hadoop-defaults.xml the value is 3, so it doesn't explain the 10 requested that I see in the logs. again, this only happens on the generate task.
The generate eventually finishes ~30 to 40 minutes to select out 5000 URL's since it's competing with the loop that generates these messages. I noticed that the hadoop.log rolled this morning and the logging of fs.FSNamesystem - Could not find any nodes with sufficient capacity seems to have stopped. Jason On Feb 2, 2007, at 5:49 AM, djames wrote: > > Hello > > I'm not sure, but there is a parameter in hadoop-site.xml conf file > that > could be a solution to your probleme: > > > <property> > <name>dfs.replication</name> > <value>2</value> > </property> > ------------------------------------------------------------------------- Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier. Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
