If you only wish to serve crawls to that one page, I'm sure this could easily be set up by writing a bash script specifying the -adddays arguement with your commands. This could then be set and run as a cron job?
Please someone correct me if I am wrong. On Fri, Aug 26, 2011 at 10:22 PM, Radim Kolar <h...@sendmail.cz> wrote: > It would be nice to have command which will alter database refetch times in > specified URLs. With configuration like that: > > ^http://www\.google\.com/?$ 1d # fetch google homepage daily > > I am willing to help with sponsoring development and testing of such thing. > -- *Lewis*
