[ 
https://issues.apache.org/jira/browse/YARN-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13795391#comment-13795391
 ] 

Vinod Kumar Vavilapalli commented on YARN-975:
----------------------------------------------

Looks good overall. One file per app is reasonable. We already use TFile for 
log-aggregation, so yeah it is good to pick that up too.

Regarding the implementation, see JobHistoryEventHandler. There we flush based 
on two triggers: An upper limit on unflushed records and a time-based trigger. 
We can add one more trigger: Application state change.

> Add a file-system implementation for history-storage
> ----------------------------------------------------
>
>                 Key: YARN-975
>                 URL: https://issues.apache.org/jira/browse/YARN-975
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Zhijie Shen
>            Assignee: Zhijie Shen
>         Attachments: YARN-975.1.patch, YARN-975.2.patch, YARN-975.3.patch, 
> YARN-975.4.patch, YARN-975.5.patch
>
>
> HDFS implementation should be a standard persistence strategy of history 
> storage



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to