[ https://issues.apache.org/jira/browse/HADOOP-16288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16832704#comment-16832704 ]
Steve Loughran commented on HADOOP-16288: ----------------------------------------- S3A settings are via fs.s3a.proxy options in the docs there. ADLS and ABFS just use the JDK classes/settings so probably need this. * The best place for a comparator will be hadoop-common, in the package org.apache.hadoop.security.http * If you can think of a unit test for this, it'd be great * otherwise, you will need to (a) provide docs for this in either the adls/abfs files (and link from the other) * and run the entire ADLS test suite through such a proxy, declaring which adls store you ran against. > Using an authenticated proxy server to access cloud storage from a cluster > -------------------------------------------------------------------------- > > Key: HADOOP-16288 > URL: https://issues.apache.org/jira/browse/HADOOP-16288 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/adl, fs/azure > Affects Versions: 3.2.0 > Reporter: Istvan Fajth > Priority: Minor > > Given an environment which does not have direct access to the internet, but > has to route all requests through a Proxy that requires authentication Hadoop > filesystem commands can not go through. > My understanding of an [Official Java > blog|https://blogs.oracle.com/wssfc/handling-proxy-server-authentication-requests-in-java], > is that this requires a special Authenticator class to be used, which I do > not see anywhere in the code, neither I could find any relevant parameter to > set the proxy authentication credentials. > I tried to specify the proxy in a form of > username:[passw...@host.fqdn|mailto:passw...@host.fqdn] and the port via java > system properties, but that did not work either. > My use case is to connect to ADLS, but I have not seen relevant properties > either for S3. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org