[ https://issues.apache.org/jira/browse/HADOOP-14383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mingliang Liu updated HADOOP-14383: ----------------------------------- Fix Version/s: 3.0.0-alpha3 Component/s: fs Nice work. Updated the components and "Fix Versions". > Implement FileSystem that reads from HTTP / HTTPS endpoints > ----------------------------------------------------------- > > Key: HADOOP-14383 > URL: https://issues.apache.org/jira/browse/HADOOP-14383 > Project: Hadoop Common > Issue Type: Improvement > Components: fs > Reporter: Haohui Mai > Assignee: Haohui Mai > Fix For: 2.9.0, 3.0.0-alpha3 > > Attachments: HADOOP-14383.000.patch, HADOOP-14383.001.patch, > HADOOP-14383.002.patch > > > We have a use case where YARN applications would like to localize resources > from Artifactory. Putting the resources on HDFS itself might not be ideal as > we would like to leverage Artifactory to manage different versions of the > resources. > It would be nice to have something like {{HttpFileSystem}} that implements > the Hadoop filesystem API and reads from a HTTP endpoint. > Note that Samza has implemented the proposal by themselves: > https://github.com/apache/samza/blob/master/samza-yarn/src/main/scala/org/apache/samza/util/hadoop/HttpFileSystem.scala > The downside of this approach is that it requires the YARN cluster to put the > Samza jar into the classpath for each NM. > It would be much nicer for Hadoop to have this feature built-in. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org