Re: Out of Memory while fetching

2006-02-18 Thread Stefan Groschupf
Andrzej, Keren, don't get me wrong! Sorry I could be misunderstood. I never had seen such a problem and I guess users do not know the internals of mapfile. I just tried to answer: >Please let me know what you mean "you have one key two times". As mentioned in the previous mail - I do not know

Re: Out of Memory while fetching

2006-02-18 Thread Andrzej Bialecki
Stefan Groschupf wrote: The log says it: 060215 224057 SEVERE error writing output:java.io.IOException: key out of order: 391009 after 391009 In a ordered array of keys where each key is unique 391010 should come after 391009. Erhm... that's not that helpful... In my experience, I encoun

Re: Out of Memory while fetching

2006-02-18 Thread Stefan Groschupf
The log says it: 060215 224057 SEVERE error writing output:java.io.IOException: key out of order: 391009 after 391009 In a ordered array of keys where each key is unique 391010 should come after 391009. Am 17.02.2006 um 14:10 schrieb keren nutch: Hi Stefan, Thank you for reply. I did

Re: Out of Memory while fetching

2006-02-17 Thread keren nutch
Hi Stefan, Thank you for reply. I didn't create segment file by myself. It was created via "nutch generate". Please let me know what you mean "yuo have one key two times". Best regards, Keren Stefan Groschupf <[EMAIL PROTECTED]> wrote: I'm not sure if not the key problem is the real sour

Re: Out of Memory while fetching

2006-02-16 Thread Stefan Groschupf
I'm not sure if not the key problem is the real source of the problem. In general I suggest using nutch 0.8 that fix a set of issues. E.g. writes syncs to the files and creates checksums since people not problems with hdd's. At least a nutch map file require to have ordered keys and in your c

Out of Memory while fetching

2006-02-16 Thread keren nutch
Hi, We are running Nutch 0.7.1 on Mandrake (Linux). We have 2G memory and set NUTCH_HEAPSIZE=2000. When fetching, we got a severe error: out of memory, see below. 060215 224055 fetching http://www.edu.pe.ca/vrcs/grassroots/1998/chijnew/shipbu~1. htm 060215 224057 SEVERE error writing out