[ https://issues.apache.org/jira/browse/ZOOKEEPER-1016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008649#comment-13008649 ]
Jitendra Nath Pandey commented on ZOOKEEPER-1016: ------------------------------------------------- +1 for storing edit logs in book-keeper. >... However, systems such as the HDFS namenode, this delay can be unacceptable. Suppose we limit the ledger size to a few thousand transactions. How much read throughput can Book-keeper provide? If it is only a matter of a few seconds, it might be an acceptable delay. HDFS-1073 is making changes such that image and edit logs will be named with the transaction ids. Does Book-keeper support named ledgers? An API which can give all the ledgers starting from a given transaction id would be important. > TeaKeeper: Hot standby support using bookkeeper > ----------------------------------------------- > > Key: ZOOKEEPER-1016 > URL: https://issues.apache.org/jira/browse/ZOOKEEPER-1016 > Project: ZooKeeper > Issue Type: Improvement > Reporter: Ivan Kelly > Assignee: Ivan Kelly > Priority: Minor > Attachments: tledger.pdf > > > Currently Bookkeeper provides functionality for cold backups. If the entity > logging to bookkeeper fails, its replacement must recover the ledgers which > had been used for backup before becoming available. This is acceptable in > some cases, such as HBase Wals where a small delay in recovery only results > in a small percentage of data being unavailable. > However, systems such as the HDFS namenode, this delay can be unacceptable, > such as cases where data is being served to customers. Secondary namenodes > should be ready to go the instant the primary goes down. > TeaKeeper proposes a wrapper library around Bookkeeper providing T-Junction > like functionality for logging. It also provides for primary/secondary > election and automated hot failover. > HDFS namenode is primary target of this work. > The attached design doc contains more details. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira