Pretty much everything in Nutch is 'a mapreduce' so it is not clear what you meant. Which step took most of the time, the udpate? BTW do you parse at the same time as you fetch?
On 25 May 2011 16:55, webdev1977 <[email protected]> wrote: > I sure have! And I cranked it up at one point sooo much that I crashed the > TNS listener on our DB!! > > The fetching part didn't take the longest, it was the mapreduce that took > forever.. > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Going-Beyond-the-Prototype-tp2923289p2984815.html > Sent from the Nutch - User mailing list archive at Nabble.com. > -- * *Open Source Solutions for Text Engineering http://digitalpebble.blogspot.com/ http://www.digitalpebble.com
