sahil1105 opened a new pull request #9996:
URL: https://github.com/apache/arrow/pull/9996


   As discussed in the comments on the JIRA issue, I've added a simple struct 
called `S3ProxyOptions` which holds the fields for proxy-related information to 
pass to the AWS SDK when building the S3 client.
   I added a simple `FromUri` helper function since these options can be 
derived from environment variables like `http_proxy`, `HTTP_PROXY`, 
`HTTPS_PROXY`, etc. I didn't automatically honor these environment variables, 
but that is something we could do in a follow-up PR (or leave it for the users 
to do).
   Also added the options to the pyarrow interface for the file-system.
   
   I tested the proxy functionality by setting up a simple proxy on my local 
machine and checking the logs to ensure that the traffic from the file-system 
was flowing through it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to