[ https://issues.apache.org/jira/browse/HDFS-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13009291#comment-13009291 ]
Todd Lipcon commented on HDFS-1580: ----------------------------------- I'm not sure I agree with your point that rolling should be a concern of the JournalManager and not of the higher-level frameworks. In HDFS-1073, Sanjay and I had come to the conclusion that we should maintain the invariant that different edits logs should roll at the same time. This makes it possible to take two edits directories (even across the BN and NN) and the files inside should be md5sum-identical to each other -- very important for ops and peace of mind. Perhaps some WAL implementions may want to ignore the roll boundaries, but we at least need coordination between different File logs. > Add interface for generic Write Ahead Logging mechanisms > -------------------------------------------------------- > > Key: HDFS-1580 > URL: https://issues.apache.org/jira/browse/HDFS-1580 > Project: Hadoop HDFS > Issue Type: Improvement > Reporter: Ivan Kelly > Attachments: HDFS-1580+1521.diff, HDFS-1580.diff, > generic_wal_iface.pdf, generic_wal_iface.pdf, generic_wal_iface.txt > > -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira