Hello. I'm newbie in scruppy.
My code: 
http://pastebin.com/fMuR0i5P

I am trying parsed all products from the site armani.com, but I can't 
understand why second rule not worked after first rule. If i comment first 
rule - second worked and call parse, but It does not go on all links on the 
site, only 'start_urls'.

I need to go through all the links within the site. If i have first rule - 
scrapy walking goes on all links. Sample:

2016-12-21 23:17:46 [scrapy] DEBUG: Crawled (200) <GET 
http://www.armani.com/us/giorgioarmani/suit_cod49215969fb.html> (referer: 
http://www.armani.com/us/giorgioarmani/women/onlinestore/suits-and-jackets)
2016-12-21 23:17:46 [scrapy] DEBUG: Crawled (200) <GET 
http://www.armani.com/us/giorgioarmani/suit_cod49215968kj.html> (referer: 
http://www.armani.com/us/giorgioarmani/women/onlinestore/suits-and-jackets)
2016-12-21 23:17:47 [scrapy] DEBUG: Crawled (200) <GET 
http://www.armani.com/us/giorgioarmani/blazer_cod41664442ef.html> (referer: 
http://www.armani.com/us/giorgioarmani/women/onlinestore/suits-and-jackets)
2016-12-21 23:17:47 [scrapy] DEBUG: Crawled (200) <GET 
http://www.armani.com/us/giorgioarmani/women/onlinestore/suits-and-jackets/blazers>
 
(referer: 
http://www.armani.com/us/giorgioarmani/women/onlinestore/suits-and-jackets)
2016-12-21 23:17:47 [scrapy] DEBUG: Crawled (200) <GET 
http://www.armani.com/us/giorgioarmani/blazer_cod41667734nj.html> (referer: 
http://www.armani.com/us/giorgioarmani/women/onlinestore/suits-and-jackets)


What am I doing wrong? sorry for my English

-- 
You received this message because you are subscribed to the Google Groups 
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
  • scrapy rules Игорь Горобец

Reply via email to