I've generally seen this error on sites that are using SSL. I'm not sure about the specifics, but it's because the SSL handler in Scrapy can't manage the connection with whatever site you are working with.
On Tuesday, March 31, 2015 at 2:26:35 PM UTC-7, Landon Campbell wrote: > > Hi, > > Pretty new to Scrapy, so forgive me if this is obvious. We're running > Scrapy 0.24.2 (under Portia/Slybot), with ProxyMiddleware enabled and a > fairly large pool of proxies. Any time I request an HTTPS URL, I recieve a > "Could not open CONNECT tunnel" error, which ultimately causes the spider > to close. In my development environment, I'm running Scrapy 0.24.4 > (Portia/Slybot), through the same proxies, and I do NOT have this problem. > Is this simply a Scrapy version issue, or is it something else? Can't > figure out why it's OK one place but not the other. Any thoughts would be > appreciated. > > Thanks, > Landon > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
