Robin Haswell wrote: > On Wed, 2006-12-20 at 12:38 +0100, Andrzej Bialecki wrote: > >> This is the problem - you need to increase the heap space in your >> Tomcat. Since you expanded you index, the bigger index won't fit in the >> same heap space as before ... especially when you run searches that >> touch more of the index, parts of it need to be loaded into memory - so >> this problem may not occur for searches that return only few results. >> > > I see... so how come I can run searches with the NutchBean though? > Anyway.. how do I increase my heap size and approximately what should I > increase it to? My crawl directory is 41GB and this machine has only 1GB > of main memory and 3GB of swap >
As soon as you start swapping the performance will become abysmal ... so, you need to pick a size that still can hold your index but doesn't cause swapping. 512M? 768M? who knows ... Please check Tomcat documentation on how to set it properly - I usually don't bother with the "proper" way and hardcode this value in catalina.sh script ... ;) -- Best regards, Andrzej Bialecki <>< ___. ___ ___ ___ _ _ __________________________________ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
