I am very new at this and have been trying to get my head around my first
selector can somebody help? i am trying to extract data from page
http://groceries.asda.com/asda-webstore/landing/home.shtml?cmpid=ahc-
*-ghs-d1-*-asdacom-dsk-_-hp#/shelf/1215337195041/1/so_false
<http://groceries.asda.com/asda-webstore/landing/home.shtml?cmpid=ahc-_-ghs-d1-_-asdacom-dsk-_-hp#/shelf/1215337195041/1/so_false>
.
all the info under div class = listing clearfix shelfListing but i cant
seem to figure out how to format response.xpath().
I have managed to launch scrapy console but no matter what I type in
response.xpath() i cant seem to select the right node. I know it works
because when I type >>>response.xpath('//div[@class="container"]') I get a
response but don't know how to navigate to the listsing cleardix
shelflisting. I am hoping that once i get this bit I can continue working
my way through the spider.
I am wondering if the website itself may be blocking scrapy?
Thank you in advance!
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.