I'm crawling a static website on the same machine as Nutch (thus eliminating
bandwith restrictions).
stats:
99277 pages, 34 errors, 60.8 pages/s, 20410 kb/s
-----Original Message-----
From: Ian Holsman [mailto:[EMAIL PROTECTED]
Sent: Wed 6/20/2007 7:50
To: [EMAIL PROTECTED]
Subject: how fast can nutch fetch urls ?
I was wondering what kind of reqs/second people are achieving from a
single node in a hadoop cluster in the fetch phase.
-------------------------------------------------------------------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
