hello
while fetching a certain fetchlist say about 2 - 3 million pages there are
some errors that might the fetcher process to stop
1: low disk space
2 : any severe error (like internet connection faliure for a long time )
3: some more like java heap space
these are some of the resons that i faced ..
now straight answer would be that i should be taking care of all those
before i start fetching ..
i agree but in case the fetcher stops ...
Is there any way to continue fetching from where it stopped ?
if not can we all contribute towards that ?
i have been through the re fetching threads but wud that help me in this
case
example :
if i have fetched around a million pages and still some 2 million pages a
left to be fetched and the fetcher stops due to low disk space is there any
way to continue from where i stopped after i organise everything (arrange
for another disk or free partition )
Thanks & Regards
Shrinivas Patwardhan
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
