I have 1.5 GB RAM but I can't update a segement with around 2.4 GB. I got a OutOfMemory Exception.
Is there any trick to update bigger segments I don't know?
I think you mean update the database, the updatedb command. This should not require a huge amount of memory. What size heap are you giving to Java (NUTCH_HEAPSIZE)? Which JVM are you using? What is the thread dump when you get this exception?
I think the only thing which should use a lot of memory when doing db updates is the file sorting code, which is limited by the io.sort.mb config parameter. You could try making this a bit smaller.
Doug
-------------------------------------------------------
This SF.Net email sponsored by Black Hat Briefings & Training.
Attend Black Hat Briefings & Training, Las Vegas July 24-29 - digital self defense, top technical experts, no vendor pitches, unmatched networking opportunities. Visit www.blackhat.com
_______________________________________________
Nutch-developers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
