Re: Help, Can't find the default proxy in requests by config
On Thursday, February 21, 2019 at 7:12:40 AM UTC-5, Evi1 T1me wrote: > ```bash > ~ python3 > Python 3.7.0 (default, Oct 22 2018, 14:54:27) > [Clang 10.0.0 (clang-1000.11.45.2)] on darwin > Type "help", "copyright", "credits" or "license" for more information. > >>> import requests > >>> r = requests.get('https://www.baidu.com') > Traceback (most recent call last): > File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line > 159, in _new_conn > (self._dns_host, self.port), self.timeout, **extra_kw) > File "/usr/local/lib/python3.7/site-packages/urllib3/util/connection.py", > line 80, in create_connection > raise err > File "/usr/local/lib/python3.7/site-packages/urllib3/util/connection.py", > line 70, in create_connection > sock.connect(sa) > ConnectionRefusedError: [Errno 61] Connection refused > > During handling of the above exception, another exception occurred: > > Traceback (most recent call last): > File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", > line 594, in urlopen > self._prepare_proxy(conn) > File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", > line 805, in _prepare_proxy > conn.connect() > File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line > 301, in connect > conn = self._new_conn() > File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line > 168, in _new_conn > self, "Failed to establish a new connection: %s" % e) > urllib3.exceptions.NewConnectionError: > : Failed to > establish a new connection: [Errno 61] Connection refused > > During handling of the above exception, another exception occurred: > > Traceback (most recent call last): > File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line > 449, in send > timeout=timeout > File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", > line 638, in urlopen > _stacktrace=sys.exc_info()[2]) > File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line > 398, in increment > raise MaxRetryError(_pool, url, error or ResponseError(cause)) > urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='www.baidu.com', > port=443): Max retries exceeded with url: / (Caused by ProxyError('Cannot > connect to proxy.', > NewConnectionError(' 0x10e3ce550>: Failed to establish a new connection: [Errno 61] Connection > refused'))) > > During handling of the above exception, another exception occurred: > > Traceback (most recent call last): > File "", line 1, in > File "/usr/local/lib/python3.7/site-packages/requests/api.py", line 75, in > get > return request('get', url, params=params, **kwargs) > File "/usr/local/lib/python3.7/site-packages/requests/api.py", line 60, in > request > return session.request(method=method, url=url, **kwargs) > File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line > 533, in request > resp = self.send(prep, **send_kwargs) > File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line > 646, in send > r = adapter.send(request, **kwargs) > File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line > 510, in send > raise ProxyError(e, request=request) > requests.exceptions.ProxyError: HTTPSConnectionPool(host='www.baidu.com', > port=443): Max retries exceeded with url: / (Caused by ProxyError('Cannot > connect to proxy.', > NewConnectionError(' 0x10e3ce550>: Failed to establish a new connection: [Errno 61] Connection > refused'))) > ``` > > Check the proxy > > ```bash > >>> print(requests.utils.get_environ_proxies('https://www.baidu.com')) > {'http': 'http://127.0.0.1:', 'https': 'http://127.0.0.1:'} > ``` > > Check bash environment > > ```bash > ~ set | grep proxy > ``` > Nothing output. > > ```bash > ➜ ~ netstat -ant | grep > tcp4 5 0 127.0.0.1.54437127.0.0.1. CLOSE_WAIT > tcp4 653 0 127.0.0.1.54436127.0.0.1. CLOSE_WAIT > tcp4 5 0 127.0.0.1.54434127.0.0.1. CLOSE_WAIT > ``` > > ```bash > ➜ ~ lsof -i: > COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME > JavaAppli 77714 zerop 54u IPv6 0x975257a323b5690f 0t0 TCP > localhost:54434->localhost:ddi-tcp-1 (CLOSE_WAIT) > JavaAppli 77714 zerop 55u IPv6 0x975257a
Help, Can't find the default proxy in requests by config
```bash ~ python3 Python 3.7.0 (default, Oct 22 2018, 14:54:27) [Clang 10.0.0 (clang-1000.11.45.2)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> import requests >>> r = requests.get('https://www.baidu.com') Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 159, in _new_conn (self._dns_host, self.port), self.timeout, **extra_kw) File "/usr/local/lib/python3.7/site-packages/urllib3/util/connection.py", line 80, in create_connection raise err File "/usr/local/lib/python3.7/site-packages/urllib3/util/connection.py", line 70, in create_connection sock.connect(sa) ConnectionRefusedError: [Errno 61] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 594, in urlopen self._prepare_proxy(conn) File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 805, in _prepare_proxy conn.connect() File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 301, in connect conn = self._new_conn() File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 168, in _new_conn self, "Failed to establish a new connection: %s" % e) urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 61] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 449, in send timeout=timeout File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 638, in urlopen _stacktrace=sys.exc_info()[2]) File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 398, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='www.baidu.com', port=443): Max retries exceeded with url: / (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError(': Failed to establish a new connection: [Errno 61] Connection refused'))) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "", line 1, in File "/usr/local/lib/python3.7/site-packages/requests/api.py", line 75, in get return request('get', url, params=params, **kwargs) File "/usr/local/lib/python3.7/site-packages/requests/api.py", line 60, in request return session.request(method=method, url=url, **kwargs) File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 533, in request resp = self.send(prep, **send_kwargs) File "/usr/local/lib/python3.7/site-packages/requests/sessions.py", line 646, in send r = adapter.send(request, **kwargs) File "/usr/local/lib/python3.7/site-packages/requests/adapters.py", line 510, in send raise ProxyError(e, request=request) requests.exceptions.ProxyError: HTTPSConnectionPool(host='www.baidu.com', port=443): Max retries exceeded with url: / (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError(': Failed to establish a new connection: [Errno 61] Connection refused'))) ``` Check the proxy ```bash >>> print(requests.utils.get_environ_proxies('https://www.baidu.com')) {'http': 'http://127.0.0.1:', 'https': 'http://127.0.0.1:'} ``` Check bash environment ```bash ~ set | grep proxy ``` Nothing output. ```bash ➜ ~ netstat -ant | grep tcp4 5 0 127.0.0.1.54437127.0.0.1. CLOSE_WAIT tcp4 653 0 127.0.0.1.54436127.0.0.1. CLOSE_WAIT tcp4 5 0 127.0.0.1.54434127.0.0.1. CLOSE_WAIT ``` ```bash ➜ ~ lsof -i: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME JavaAppli 77714 zerop 54u IPv6 0x975257a323b5690f 0t0 TCP localhost:54434->localhost:ddi-tcp-1 (CLOSE_WAIT) JavaAppli 77714 zerop 55u IPv6 0x975257a33daa290f 0t0 TCP localhost:54436->localhost:ddi-tcp-1 (CLOSE_WAIT) JavaAppli 77714 zerop 56u IPv6 0x975257a3366b600f 0t0 TCP localhost:54437->localhost:ddi-tcp-1 (CLOSE_WAIT) ``` ```bash ➜ ~ ps -ef | grep 77714 501 77714 1 0 11:17AM ?? 3:33.55 /Applications/Burp Suite Community Edition.app/Contents/MacOS/JavaApplicationStub 501 84408 82855 0 5:54AM ttys0020:00.00 grep --color=auto --exclude-dir=.bzr --exclude-dir=CVS --exclude-dir=.git --exclude-dir=.hg --exclude-dir=.svn 77714 ``` Restart the application BurpSuite Community and then run the command `lsof -i:`, nothing out ```bash ➜ ~ lsof -i: ``` Check `HTTP_SERVER` and `HTTP_PROXY` ```bash ➜ ~ echo $HTTP_SERVER ➜ ~ echo $HTTP_PROXY ➜ ~ echo $HTTPS_SERVER ``` Restart the computer and try to access Baidu as the following. ```bash >>> r =