Hi Markus,

Thank you for the reply.
yes I've set the required class to AdaptiveFetchSchedule in the nutch.xml.

I'm using Nutch 2.1.

Best Regards
Erwin
 

-----Original Message-----
From: Markus Jelsma [mailto:[email protected]] 
Sent: Monday, February 10, 2014 1:59 PM
To: [email protected]
Subject: RE: Question about fetch interval value

did you set

  <property>
   <name>db.fetch.schedule.class</name>
   <value>org.apache.nutch.crawl.AdaptiveFetchSchedule</value>
  </property>

as well? The other settings not mandatory, they have defaults.
 
 
-----Original message-----
> From:Erwin Gunadi <[email protected]>
> Sent: Monday 10th February 2014 13:05
> To: [email protected]
> Subject: Question about fetch interval value
> 
> Hi,
> 
>  
> 
> I have a question the behavior of using AdaptiveFetchSchedule in 
> combination of "db.fetch.interval.default".
> 
> I know that one should configure:
> 
> -          db.fetch.schedule.adaptive.min_interval
> 
> -          db.fetch.schedule.adaptive.max_interval
> 
> In order to use AdaptiveFetchSchedule.
> 
>  
> 
> But I've been having strange behavior during crawling, because it 
> always tried to re-fetch with the value of "db.fetch.interval.default".
> 
>  
> 
> Thank you for your help.
> 
>  
> 
> Best Regards
> 
> Erwin
> 
> 

Reply via email to