[ https://issues.apache.org/jira/browse/YARN-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795391#comment-13795391 ]
Vinod Kumar Vavilapalli commented on YARN-975: ---------------------------------------------- Looks good overall. One file per app is reasonable. We already use TFile for log-aggregation, so yeah it is good to pick that up too. Regarding the implementation, see JobHistoryEventHandler. There we flush based on two triggers: An upper limit on unflushed records and a time-based trigger. We can add one more trigger: Application state change. > Add a file-system implementation for history-storage > ---------------------------------------------------- > > Key: YARN-975 > URL: https://issues.apache.org/jira/browse/YARN-975 > Project: Hadoop YARN > Issue Type: Sub-task > Reporter: Zhijie Shen > Assignee: Zhijie Shen > Attachments: YARN-975.1.patch, YARN-975.2.patch, YARN-975.3.patch, > YARN-975.4.patch, YARN-975.5.patch > > > HDFS implementation should be a standard persistence strategy of history > storage -- This message was sent by Atlassian JIRA (v6.1#6144)