Hi all, Here is my link which i have posted in stack overflow. http://stackoverflow.com/questions/27142968/why-scrapy-crawler-stoped <http://stackoverflow.com/questions/27142968/why-scrapy-crawler-stoped#>
I have written a crawler using scrapy framework to parse a products site. The crawler stops in between suddenly without completing the full parsing process. Below is last part of debug level entry in log file before spider is closed: Still there are pages remaining to be parsed, but the spider stops. Thanks. James -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
