Re: [Nutch-dev] OOM error during parsing with nekohtml

2007-07-19 Thread Shailendra Mudgal
Hi , After replacing it with the Throwable, it safely parsed that page, but got the same OOM Error during the parse of http://lcweb2.loc.gov/ndlpcoop/nicmoas/livn-2/liv n0181.sgm. But this time it seems that the error occured at line 78 . Here is the stacktrace. (The same page we cant parse using

Re: [Nutch-dev] OOM error during parsing with nekohtml

2007-07-16 Thread Doğacan Güney
Hi, On 7/17/07, Shailendra Mudgal <[EMAIL PROTECTED]> wrote: > Hi all, > > Thanks for your suggestions. > > I am running parse on a single url ( > http://www.fotofinity.com/cgi-bin/homepages.cgi). For other urls, parse > works perfectly. we are getting this error because of the html of the page. >

Re: [Nutch-dev] OOM error during parsing with nekohtml

2007-07-16 Thread Shailendra Mudgal
Hi all, Thanks for your suggestions. I am running parse on a single url ( http://www.fotofinity.com/cgi-bin/homepages.cgi). For other urls, parse works perfectly. we are getting this error because of the html of the page. The page contains many anchor tags which are not closed properly. Hence ne

Re: [Nutch-dev] OOM error during parsing with nekohtml

2007-07-16 Thread Tsengtan A Shuy
Thank you for the info. The OOM exception in your previous email indicates that your system is running out of heap memory. You either have instantiated too many objects, or there are memory leaks in the source codes. Hope this will help you! Cheer!! Adam Shuy, President ePacific Web Design & Hos

Re: [Nutch-dev] OOM error during parsing with nekohtml

2007-07-16 Thread Kai_testing Middleton
You could try looking at these two discussions: http://www.mail-archive.com/[EMAIL PROTECTED]/msg06571.html http://www.mail-archive.com/[EMAIL PROTECTED]/msg06571.html --Kai - Original Message From: Tsengtan A Shuy <[EMAIL PROTECTED]> To: [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Monday

Re: [Nutch-dev] OOM error during parsing with nekohtml

2007-07-16 Thread Tsengtan A Shuy
I successfully run the whole-web crawl with the my new ubuntu OS, and I am ready to fix the bug. I need someone to guide me to get the most updated source code and the bug assignment. Thank you in advance!! Adam Shuy, President ePacific Web Design & Hosting Professional Web/Software developer T

[Nutch-dev] OOM error during parsing with nekohtml

2007-07-16 Thread Shailendra Mudgal
Hi All, We are getting an OOM Exception during the processing of http://www.fotofinity.com/cgi-bin/homepages.cgi . We have also applied Nutch-497 patch to our source code. But actually the error is coming during the parse method. Does anybody has any idea regarding this. Here is the complete sta