Example : www.abc.com/brands/mobiles - will be my base url
a)After 1st crawl I get the available brands in the website,in the form of href 1.abc.com/apple 2.abc.com/blackberry 3.abc.com/samsung Now, I need to crawl into each of the links. Lets say there are variable number of items in each of the link 20 apple products 40 blackberry products 60 samsung products So the output should be www.abc.com/apple/1 www.abc.com/apple/2 www.abc.com/apple/3 www.abc.com/apple/4 and so on. -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/groups/opt_out.
