[ https://issues.apache.org/jira/browse/YARN-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14260555#comment-14260555 ]
Varun Saxena commented on YARN-2748: ------------------------------------ bq. To differentiate log files which may have same file names(due to subfolders), I think we can write file path relative to container log directory instead. Your views on this. bq. Given Log Root Dir/sub-dir1/sub-dir2/.../xxxx.log, we can use the relative path sub-dir1/sub-dir2/.../xxxx.log to uniquely identify a log. [~zjshen], latest patch uses relative path to identify log in aggregated log file. Kindly review. > Upload logs in the sub-folders under the local log dir when aggregating logs > ---------------------------------------------------------------------------- > > Key: YARN-2748 > URL: https://issues.apache.org/jira/browse/YARN-2748 > Project: Hadoop YARN > Issue Type: Sub-task > Components: log-aggregation > Affects Versions: 2.6.0 > Reporter: Zhijie Shen > Assignee: Varun Saxena > Attachments: YARN-2748.001.patch, YARN-2748.002.patch > > > YARN-2734 has a temporal fix to skip sub folders to avoid exception. Ideally, > if the app is creating a sub folder and putting its rolling logs there, we > need to upload these logs as well. -- This message was sent by Atlassian JIRA (v6.3.4#6332)