[ https://issues.apache.org/jira/browse/HADOOP-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986408#comment-14986408 ]
Chris Nauroth commented on HADOOP-11262: ---------------------------------------- Hi [~eddyxu]. Thanks for joining the code review. The reason this JIRA mentions enabling YARN to use S3A is that various points in the YARN codebase rely on the {{FileContext}} API instead of {{FileSystem}}. An example of this is storing container logs. It is possible to specify an HDFS URL in {{yarn.nodemanager.log-dirs}}, because HDFS provides a subclass of {{AbstractFileSystem}}. This is currently not possible with a S3A URL, because S3A does not provide a subclass of {{AbstractFileSystem}}. > Enable YARN to use S3A > ----------------------- > > Key: HADOOP-11262 > URL: https://issues.apache.org/jira/browse/HADOOP-11262 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 > Reporter: Thomas Demoor > Assignee: Pieter Reuse > Labels: amazon, s3 > Attachments: HADOOP-11262-2.patch, HADOOP-11262-3.patch, > HADOOP-11262-4.patch, HADOOP-11262-5.patch, HADOOP-11262-6.patch, > HADOOP-11262-7.patch, HADOOP-11262.patch > > > Uses DelegateToFileSystem to expose S3A as an AbstractFileSystem. -- This message was sent by Atlassian JIRA (v6.3.4#6332)