[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Zhou updated HDFS-3077: - Assignee: (was: Jiayi Zhou) > Quorum-based protocol for reading and writing edit logs >

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-3077: --- Fix Version/s: (was: 3.0.0) Quorum-based protocol for reading and writing edit logs

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077-branch-2.txt This patch consists of the full merge for branch-2. There were a few

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: qjournal-design.pdf New rev of PDF addresses the above comments: - Clarifies the mapping to

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: qjournal-design.pdf Updated rev per above Quorum-based protocol for

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: qjournal-design.pdf qjournal-design.tex Attached new rev of design doc per

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Status: Open (was: Patch Available) Quorum-based protocol for reading and writing edit logs

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: qjournal-design.tex qjournal-design.pdf Attaching new rev of the design

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077-test-merge.txt Attaching a merge patch vs trunk to run through the automated QA

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Status: Patch Available (was: Open) Quorum-based protocol for reading and writing edit logs

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077.txt I've been testing this on a couple different clusters locally and mostly

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077.txt TestNNWithQJM failed because the edit log manifest had an out-of-order log

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077.txt Attached patch addresses ATM's comments above. I'm going to create a branch

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Target Version/s: QuorumJournalManager (HDFS-3077) (was: 0.24.0) Fix Version/s:

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077.txt New rev that addresses much of the commentary above. Still more work to do,

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Status: Patch Available (was: Open) Quorum-based protocol for reading and writing edit logs

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077.txt bq. If the following is supposed to be a list of host:port pairs, I suggest

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077.txt Updated patch with some improvements: - Move some logic back from

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077.txt Here is an initial patch with the implementation of this design. It is not

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: qjournal-design.pdf Attaching new rev of the design doc. This has more detail on the

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: qjournal-design.pdf Attached a design doc draft. Look forward to your comments.

[jira] [Updated] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3077: -- Attachment: hdfs-3077-partial.txt Here's a WIP patch. The recovery synchronization bits (admittedly the