HI Piotr,
my configuration is
winxp,512 mb ram, nutch 7 ver, and jdk1.4.2
for -Xmx i pass 512m
my webdb contains like 15,000 urls only
i did change the io.sort.mb and io.sort.factor and has default values of 100
i can crawl using the nutch example but i filter the urls while indexing
using some custom plugins
Is there any options i have to change ?
Is the ram enough for my usage ?
i still have the "Out of memory error" while updating
any help would greatly help
Thanks in advance
regards
-Hussain.
----- Original Message -----
From: "Piotr Kosiorowski" <[EMAIL PROTECTED]>
To: <nutch-user@lucene.apache.org>
Sent: Monday, January 02, 2006 5:23 PM
Subject: Re: uses of 'io.sort.mb' and ' io.sort.factor' in nutch-default.xml
Hi Hussain,
I had no such problems during web db update.
Please report your OS, nutch version, JDK version you use.
What values do you pass for -Xmx param for JVM (or do you use nutch
default?)
Have you changed default values for io.sort.* properties?
How big is your WebDB?
In previous email it looked like you are updating WebDB with very small
segment - am I right?
Have you ever succeeded in updating this particular WebDB?
Can you perform example from nutch tutorial successfully in your
environment?
Regards
Piotr
K.A.Hussain Ali wrote:
Hi all
Could anyone tell the use of the 'io.sort.mb' and or 'io.sort.factor' in
the nutch-default.xml,
Do Minmizing the value will have any performance effect ?
Is that any way related to the "Out of Memory Error"? if so what should
be the minimum value for those entries.?
Any suggestions would greatly help
Thanks in advance
regards
-Hussain.
-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click
_______________________________________________
Nutch-general mailing list
Nutch-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-general
