Re: Setting different depths for different urls in seed.txt

2017-01-18 Thread Manav Bagai
Can you please elaborate the solution provided?

On Wed, Jan 18, 2017 at 4:23 PM, Julien Nioche <
lists.digitalpeb...@gmail.com> wrote:

> Yes, use the scoring-depth plugin and set _maxdepth_=X in the seeds file
>
> HTH
>
> Julien
>
> On 18 January 2017 at 10:40, Manav Bagai  wrote:
>
> > Is it possible to set different depths for different urls in seed.txt.
> For
> > example. there are two url 'A' and 'B'  in seed.txt, is it possible that
> > crawler crawls for depth 3 for url 'A' and depth 2 for url 'B'.
> >
>
>
>
> --
>
> *Open Source Solutions for Text Engineering*
>
> http://www.digitalpebble.com
> http://digitalpebble.blogspot.com/
> #digitalpebble 
>


Re: Setting different depths for different urls in seed.txt

2017-01-18 Thread Julien Nioche
Yes, use the scoring-depth plugin and set _maxdepth_=X in the seeds file

HTH

Julien

On 18 January 2017 at 10:40, Manav Bagai  wrote:

> Is it possible to set different depths for different urls in seed.txt. For
> example. there are two url 'A' and 'B'  in seed.txt, is it possible that
> crawler crawls for depth 3 for url 'A' and depth 2 for url 'B'.
>



-- 

*Open Source Solutions for Text Engineering*

http://www.digitalpebble.com
http://digitalpebble.blogspot.com/
#digitalpebble 


Setting different depths for different urls in seed.txt

2017-01-18 Thread Manav Bagai
Is it possible to set different depths for different urls in seed.txt. For
example. there are two url 'A' and 'B'  in seed.txt, is it possible that
crawler crawls for depth 3 for url 'A' and depth 2 for url 'B'.