Hi Tyler,
The Hadoop-AWS module provides settings for proxy setup. You may try setting these configs in $DRILL_CONF/core-site.xml and restart drill-bits. I have not tested it though. https://hadoop.apache.org/docs/r2.7.1/hadoop-aws/tools/hadoop-aws/index.html <property> <name>fs.s3a.proxy.host</name> <description>Hostname of the (optional) proxy server for S3 connections.</description> </property> <property> <name>fs.s3a.proxy.port</name> <description>Proxy server port. If this property is not set but fs.s3a.proxy.host is, port 80 or 443 is assumed (consistent with the value of fs.s3a.connection.ssl.enabled).</description> </property> <property> <name>fs.s3a.proxy.username</name> <description>Username for authenticating with proxy server.</description> </property> <property> <name>fs.s3a.proxy.password</name> <description>Password for authenticating with proxy server.</description> </property> <property> <name>fs.s3a.proxy.domain</name> <description>Domain for authenticating with proxy server.</description> </property> <property> <name>fs.s3a.proxy.workstation</name> <description>Workstation for authenticating with proxy server.</description> </property> Thanks, Arjun ________________________________ From: Padma Penumarthy <ppenumar...@mapr.com> Sent: Tuesday, March 13, 2018 2:56 AM To: user@drill.apache.org Subject: Re: Setting up drill to query AWS S3 behind a proxy Not sure what exactly you mean by proxy settings. But, here is what you can do to access files on S3. Enable S3 storage plugin, update the connection string, access key and secret key in the config. If it is able to connect fine, you should see s3.root when you do show databases. Thanks Padma > On Mar 12, 2018, at 12:43 PM, Edelman, Tyler <tyler.edel...@capitalone.com> > wrote: > > Hello, > > I am currently trying to set up drill locally to query a JSON file in > Amazon’s AWS S3. I have not been able to configure proxy settings for drill. > Could you send me a configuration example of this? > > Thank you, > Tyler Edelman > ________________________________________________________ > > The information contained in this e-mail is confidential and/or proprietary > to Capital One and/or its affiliates and may only be used solely in > performance of work or services for Capital One. The information transmitted > herewith is intended only for use by the individual or entity to which it is > addressed. If the reader of this message is not the intended recipient, you > are hereby notified that any review, retransmission, dissemination, > distribution, copying or other use of, or taking of any action in reliance > upon this information is strictly prohibited. If you have received this > communication in error, please contact the sender and delete the material > from your computer.
