The website I was crawling was the asx.com.au. So change example.com.au with asx. When a run the spider I get the following in the console window. Why does it not any pages.
2016-11-06 16:12:20 [scrapy] INFO: Spider opened 2016-11-06 16:12:20 [scrapy] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2016-11-06 16:12:20 [scrapy] DEBUG: Telnet console listening on 127.0.0.1:6023 2016-11-06 16:12:20 [scrapy] DEBUG: Crawled (200) <GET http://www.asx.com.au/robots.txt> (referer: None) 2016-11-06 16:12:20 [scrapy] DEBUG: Crawled (200) <GET http://www.asx.com.au/> (referer: None) 2016-11-06 16:12:20 [scrapy] INFO: Closing spider (finished) 2016-11-06 16:12:20 [scrapy] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 434, 'downloader/request_count': 2, 'downloader/request_method_count/GET': 2, 'downloader/response_bytes': 41080, 'downloader/response_count': 2, 'downloader/response_status_count/200': 2, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2016, 11, 6, 5, 12, 20, 752027), 'log_count/DEBUG': 3, 'log_count/INFO': 7, 'response_received_count': 2, 'scheduler/dequeued': 1, 'scheduler/dequeued/memory': 1, 'scheduler/enqueued': 1, 'scheduler/enqueued/memory': 1, 'start_time': datetime.datetime(2016, 11, 6, 5, 12, 20, 329100)} 2016-11-06 16:12:20 [scrapy] INFO: Spider closed (finished) On Monday, November 7, 2016 at 8:40:39 PM UTC+11, Sayth Renshaw wrote: > > What is the error you receive? > > Sayth > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
