RE: threads disminution when fetching page

2012-06-06 Thread Markus Jelsma
-Original message- > From:pepe3059 > Sent: Wed 06-Jun-2012 02:58 > To: user@nutch.apache.org > Subject: RE: threads disminution when fetching page > > me again :) > > at the end of fetch process, is the regex-urlfilter considered? No. At the end of the fe

RE: threads disminution when fetching page

2012-06-05 Thread pepe3059
me again :) at the end of fetch process, is the regex-urlfilter considered? because i have 16+ regular expressions but update process is not reached yet. is considered in updatedb? another datum; disk usage from the last segment: 21Gb are 20 threads heavy load for a six core xeon? (i assign the ru

RE: threads disminution when fetching page

2012-06-04 Thread Markus Jelsma
-Original message- > From:pepe3059 > Sent: Mon 04-Jun-2012 20:42 > To: user@nutch.apache.org > Subject: RE: threads disminution when fetching page > > thank you for your answer Markus Hi > > you mean, until the fetch process finishes, is information stor

RE: threads disminution when fetching page

2012-06-04 Thread pepe3059
thank you for your answer Markus you mean, until the fetch process finishes, is information stored using hdfs by nutch? meanwhile is in the defined tmp directory ? no change is presented in two days (and i think is so many time for writing). and the problem persists, could be some agent revisor f

RE: threads disminution when fetching page

2012-06-04 Thread Markus Jelsma
This is normal and means the fetcher is finishing all it's input URL's and writing stuff to disk. -Original message- > From:pepe3059 > Sent: Sat 02-Jun-2012 22:15 > To: user@nutch.apache.org > Subject: threads disminution when fetching page > > Hello, i hope you can help me > > > i a