Hi everyone, Has anyone tried Fetcher2 from latest trunk? On our tests, Fetcher2 is always slower (by a large margin) that Fetcher.
For a segment with ~30000 urls, we ran Fetcher with 150 threads and Fetcher2 with 50 threads. Fetcher finishes around 1 hour, while Fetcher2 takes around 4 hours. We ran this test more than once and got similar results. Are we running Fetcher2 with too few/too many threads? I was under the impression that Fetcher2 doesn't need as many threads as Fetcher since threads do not block. Any suggestions? -- Doğacan Güney ------------------------------------------------------------------------- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
