I'm trying to crawl www.wegmans.com and had to follow these instructions to not get a twisted error: http://stackoverflow.com/questions/19578688/crawling-on-uncerficated-website
Now I'm getting this instead: 2014-01-21 07:56:24-0500 [scrapy] INFO: Scrapy 0.18.2 started (bot: scrapybot) 2014-01-21 07:56:24-0500 [Wegmans] INFO: Spider opened 2014-01-21 07:56:24-0500 [Wegmans] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2014-01-21 07:56:24-0500 [Wegmans] ERROR: Error downloading <GET https://www.wegmans.com> Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/twisted/web/client.py", line 1309, in request parsedURI.originForm) File "/usr/local/lib/python2.7/dist-packages/twisted/web/client.py", line 1186, in _requestWithEndpoint d = self._pool.getConnection(key, endpoint) File "/usr/local/lib/python2.7/dist-packages/twisted/web/client.py", line 1075, in getConnection return self._newConnection(key, endpoint) File "/usr/local/lib/python2.7/dist-packages/twisted/web/client.py", line 1087, in _newConnection return endpoint.connect(factory) --- <exception caught here> --- File "/usr/local/lib/python2.7/dist-packages/twisted/internet/endpoints.py", line 714, in connect timeout=self._timeout, bindAddress=self._bindAddress) File "/usr/local/lib/python2.7/dist-packages/twisted/internet/posixbase.py", line 494, in connectSSL tlsFactory = tls.TLSMemoryBIOFactory(contextFactory, True, factory) File "/usr/local/lib/python2.7/dist-packages/twisted/protocols/tls.py", line 608, in __init__ contextFactory.getContext() File "/usr/local/lib/python2.7/dist-packages/twisted/web/client.py", line 794, in getContext return self._webContext.getContext(self._hostname, self._port) exceptions.TypeError: getContext() takes exactly 1 argument (3 given) Anyone know what to do about this? I'm hoping this isn't because I'm still on 0.18! Thanks, Bill -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/groups/opt_out.
