I think your problem is JS. But you can use Firebug and FirePath on Firefox, then try the xpath on scrapy shell.
El domingo, 24 de agosto de 2014 19:28:29 UTC-3, Jaspal Singh escribió: > > I am very new at this and have been trying to get my head around my first > selector can somebody help? i am trying to extract data from page > http://groceries.asda.com/asda-webstore/landing/home.shtml?cmpid=ahc- > *-ghs-d1-*-asdacom-dsk-_-hp#/shelf/1215337195041/1/so_false > <http://groceries.asda.com/asda-webstore/landing/home.shtml?cmpid=ahc-_-ghs-d1-_-asdacom-dsk-_-hp#/shelf/1215337195041/1/so_false> > . > > all the info under div class = listing clearfix shelfListing but i cant > seem to figure out how to format response.xpath(). > > I have managed to launch scrapy console but no matter what I type in > response.xpath() i cant seem to select the right node. I know it works > because when I type >>>response.xpath('//div[@class="container"]') I get a > response but don't know how to navigate to the listsing cleardix > shelflisting. I am hoping that once i get this bit I can continue working > my way through the spider. > > I am wondering if the website itself may be blocking scrapy? > > Thank you in advance! > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
