Dear Guys,
I use scrapy for crawler a https site, but i match error :
Traceback (most recent call last):
File
"/home/vmintam/.virtualenvs/crawler/local/lib/python2.7/site-packages/twisted/web/client.py",
line 1291, in request
parsedURI.originForm)
File
"/home/vmintam/.virtualenvs/crawler/local/lib/python2.7/site-packages/twisted/web/client.py",
line 1182, in _requestWithEndpoint
d = self._pool.getConnection(key, endpoint)
File
"/home/vmintam/.virtualenvs/crawler/local/lib/python2.7/site-packages/twisted/web/client.py",
line 1071, in getConnection
return self._newConnection(key, endpoint)
File
"/home/vmintam/.virtualenvs/crawler/local/lib/python2.7/site-packages/twisted/web/client.py",
line 1083, in _newConnection
return endpoint.connect(factory)
--- <exception caught here> ---
File
"/home/vmintam/.virtualenvs/crawler/local/lib/python2.7/site-packages/twisted/internet/endpoints.py",
line 869, in connect
timeout=self._timeout, bindAddress=self._bindAddress)
File
"/home/vmintam/.virtualenvs/crawler/local/lib/python2.7/site-packages/twisted/internet/posixbase.py",
line 507, in connectSSL
tlsFactory = tls.TLSMemoryBIOFactory(contextFactory, True, factory)
File
"/home/vmintam/.virtualenvs/crawler/local/lib/python2.7/site-packages/twisted/protocols/tls.py",
line 608, in __init__
contextFactory.getContext()
File
"/home/vmintam/.virtualenvs/crawler/local/lib/python2.7/site-packages/twisted/web/client.py",
line 794, in getContext
return self._webContext.getContext(self._hostname, self._port)
File
"/home/vmintam/.virtualenvs/crawler/local/lib/python2.7/site-packages/Scrapy-0.22.2-py2.7.egg/scrapy/core/downloader/contextfactory.py",
line 19, in getContext
ctx.set_options(SSL.OP_ALL)
* File "build/bdist.linux-i686/egg/OpenSSL/SSL.py", line 753, in
set_options*
* exceptions.OverflowError: integer 2147486719 does not fit '32-bit int'*
I'm using : scrapy 0.22, cryptography 0.3, pyopenssl 0.14 ,......
in this link : https://github.com/pyca/cryptography/issues/773
have error, and this fix
:
https://github.com/pyca/cryptography/commit/a4796a7710215bdae5828cb62fde3b95c293b546
*static const long SSL_OP_ALL;*
but still error. :(
anybody help me, please!!!
thanks!
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
