[
https://issues.apache.org/jira/browse/HADOOP-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14986408#comment-14986408
]
Chris Nauroth commented on HADOOP-11262:
----------------------------------------
Hi [~eddyxu]. Thanks for joining the code review.
The reason this JIRA mentions enabling YARN to use S3A is that various points
in the YARN codebase rely on the {{FileContext}} API instead of {{FileSystem}}.
An example of this is storing container logs. It is possible to specify an
HDFS URL in {{yarn.nodemanager.log-dirs}}, because HDFS provides a subclass of
{{AbstractFileSystem}}. This is currently not possible with a S3A URL, because
S3A does not provide a subclass of {{AbstractFileSystem}}.
> Enable YARN to use S3A
> -----------------------
>
> Key: HADOOP-11262
> URL: https://issues.apache.org/jira/browse/HADOOP-11262
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Thomas Demoor
> Assignee: Pieter Reuse
> Labels: amazon, s3
> Attachments: HADOOP-11262-2.patch, HADOOP-11262-3.patch,
> HADOOP-11262-4.patch, HADOOP-11262-5.patch, HADOOP-11262-6.patch,
> HADOOP-11262-7.patch, HADOOP-11262.patch
>
>
> Uses DelegateToFileSystem to expose S3A as an AbstractFileSystem.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
