[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-08-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: recovery-mode.pdf Here is an updated Recovery Mode design document.

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-12 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Release Note: This is a new feature. It is documented in hdfs_user_guide.xml. >

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-09 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3004: -- Resolution: Fixed Fix Version/s: 2.0.0 Hadoop Flags: Reviewed Status: Resolved (w

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-07 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.043.patch * remove many unecessary calls to toString * move FSE

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.042.patch * reposting so jenkins will test > Im

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3004: -- Attachment: HDFS-3004.042.patch Same patch for jenkins. > Implement Recovery Mode > ---

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.042.patch * always prompt about possible data loss, even when -f

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004__namenode_recovery_tool.txt * update design document

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: (was: HDFS-3004__namenode_recovery_tool.txt) > Implement Recovery

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-05 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.041.patch * implement -force > Implement Recove

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-05 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.040.patch * update findbugsExcludeFile.xml to reflect the fact t

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-05 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.039.patch * rebase on trunk * rename RecoveryContext to MetaRec

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-04 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.038.patch * rebase > Implement Recovery Mode >

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-04-02 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.037.patch * style fixes > Implement Recovery Mo

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-30 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.036.patch * rebase on trunk * slight cleanup of EditLogBackupIn

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-29 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.035.patch * TestNameNodeRecovery: don't need data nodes for this

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-28 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.034.patch * address Todd's suggestions > Implem

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-26 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.033.patch * rebase on trunk * fix some resource leaks in TestNa

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-23 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.032.patch * hdfs_user_guide.xml: fix paragraph breaks

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-22 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.031.patch testing done: manually corrupted an edit log, recovere

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-22 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.030.patch fix bug in prompting > Implement Reco

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-22 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.029.patch * rebase on trunk * fix findbugs suppression

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-22 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.027.patch * fix bug uncovered by jenkins * add a little more de

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-21 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.026.patch rebase on latest trunk > Implement Re

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-21 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.024.patch * HdfsServerConstants: use equals for string equality

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-20 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Status: Patch Available (was: Open) > Implement Recovery Mode > -

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-20 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Status: Open (was: Patch Available) > Implement Recovery Mode > -

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-20 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.023.patch * OpInstanceCache needs to be thread-local to work cor

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-20 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.022.patch * remove some unecessary whitespace changes * re-intr

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-20 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Status: Patch Available (was: Open) > Implement Recovery Mode > -

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-20 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Status: Open (was: Patch Available) > Implement Recovery Mode > -

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-20 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.020.patch > Implement Recovery Mode > --

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-19 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3004: -- Status: Patch Available (was: Open) > Implement Recovery Mode > --- > >

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-16 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.019.patch * remove obsolete references to JournalStream in comme

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-16 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.018.patch * move to using a per-Reader or per-FSEditLog operatio

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-16 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.017.patch add a section about recovery to hdfs_user_guide.xml

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-16 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.016.patch * rebase on latest trunk * make nextOp protected in a

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-15 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.015.patch fix small bug in opcode skipping > Im

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-15 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.013.patch * remove SkippableEditLogException, as it turned out n

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-15 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.012.patch * make more exceptions skippable * rename StartupOpti

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-14 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.011.patch implement skipping bad data in the edit log. TODO: mo

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-09 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: (was: HDFS-3004.009.patch) > Implement Recovery Mode > ---

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-09 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.010.patch fix diff again, sigh > Implement Reco

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-09 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.009.patch diff against correct change > Impleme

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-09 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: (was: HDFS-3004.008.patch) > Implement Recovery Mode > ---

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-09 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.008.patch regenerate patch with diff --no-prefix (d'oh!)

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-09 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: (was: HDFS-3004.007.patch) > Implement Recovery Mode > ---

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-07 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.007.patch HDFS-3004.007.patch * rename "yesToAll

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-07 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: (was: HDFS-3004.007.patch) > Implement Recovery Mode > ---

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-07 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: (was: HDFS-3004.006.patch) > Implement Recovery Mode > ---

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-07 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.006.patch > Implement Recovery Mode > --

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-07 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: (was: HDFS-3004.patch) > Implement Recovery Mode > ---

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-07 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: (was: HDFS-3004.005.patch) > Implement Recovery Mode > ---

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Attachment: HDFS-3004.005.patch * rewrite the FSEditLogLoader changes to handle the HA

[jira] [Updated] (HDFS-3004) Implement Recovery Mode

2012-03-06 Thread Colin Patrick McCabe (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3004: --- Description: When the NameNode metadata is corrupt for some reason, we want to be able