[Updated] RE: current direction in namenode HA

2012-09-04 Thread Uma Maheswara Rao G
My previous reply messed up the options numbering, It may confuse some people. I am resending it again by correcting that. Appologies for confusions. >>>1) rely on external HA filer If you can invest on NFS filers, it is one option in HA. If you want to try this, you can use released Hadoop

[jira] [Resolved] (HDFS-1490) TransferFSImage should timeout

2012-09-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-1490. --- Resolution: Fixed Hadoop Flags: Reviewed > TransferFSImage should timeout >

[jira] [Resolved] (HDFS-3870) QJM: add metrics to JournalNode

2012-09-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3870. --- Resolution: Fixed Fix Version/s: QuorumJournalManager (HDFS-3077) Hadoop Flags: Reviewed C

[jira] [Resolved] (HDFS-3884) QJM: Journal format() should reset cached values

2012-09-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3884. --- Resolution: Fixed Target Version/s: QuorumJournalManager (HDFS-3077) Hadoop Flags: Re

[jira] [Resolved] (HDFS-3869) QJM: expose non-file journal manager details in web UI

2012-09-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3869. --- Resolution: Fixed Fix Version/s: QuorumJournalManager (HDFS-3077) Hadoop Flags: Reviewed C

[jira] [Resolved] (HDFS-3863) QJM: track last "committed" txid

2012-09-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3863. --- Resolution: Fixed Fix Version/s: QuorumJournalManager (HDFS-3077) Hadoop Flags: Reviewed C

[jira] [Created] (HDFS-3889) distcp silently ignores missing checksums

2012-09-04 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-3889: -- Summary: distcp silently ignores missing checksums Key: HDFS-3889 URL: https://issues.apache.org/jira/browse/HDFS-3889 Project: Hadoop HDFS Issue

Re: current direction in namenode HA

2012-09-04 Thread Uma Maheswara Rao G
small correction: This is for your Option 4: you can take a look at HDFS-3077 In this umbrella JIRA, work is going actively. @Ted, thanks for adding the link. Regards, Uma On Wed, Sep 5, 2012 at 4:39 AM, Uma Maheswara Rao G wrote: > Hi Sujee, > > Thanks a lot for your interest on HA. >

Re: current direction in namenode HA

2012-09-04 Thread Ted Yu
Uma: Attachment is stripped in this mailing list. I guess you were trying to attach this file: https://issues.apache.org/jira/secure/attachment/12538911/BKTestDoc.pdf On Tue, Sep 4, 2012 at 4:09 PM, Uma Maheswara Rao G wrote: > Hi Sujee, > > Thanks a lot for your interest on HA. > > for #1 > If y

Re: current direction in namenode HA

2012-09-04 Thread Uma Maheswara Rao G
Hi Sujee, Thanks a lot for your interest on HA. for #1 If you can invest on NFS filers, it is another option. If you want to try this, you can use released Hadoop-2 version and try. but above #2 and #3 will avoid this external hardware dependency. for #2 you can take a look at HDFS-3399 We

Re: current direction in namenode HA

2012-09-04 Thread Aaron T. Myers
Hi Sujee, On Tue, Sep 4, 2012 at 3:37 PM, Sujee Maniyam wrote: > I am trying to understand the current state / direction of namenode > HA implementation. > Thanks for the interest. > > For using shared directory, I see the following options > (from > http://www.cloudera.com/blog/2012/03/high

current direction in namenode HA

2012-09-04 Thread Sujee Maniyam
Hello devs, I am trying to understand the current state / direction of namenode HA implementation. For using shared directory, I see the following options (from http://www.cloudera.com/blog/2012/03/high-availability-for-the-hadoop-distributed-file-system-hdfs/ and https://issues.apache.org/j

[jira] [Created] (HDFS-3888) BlockPlacementPolicyDefault#LOG should be removed

2012-09-04 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-3888: --- Summary: BlockPlacementPolicyDefault#LOG should be removed Key: HDFS-3888 URL: https://issues.apache.org/jira/browse/HDFS-3888 Project: Hadoop HDFS Issue Type: Bug

Jenkins build is back to normal : Hadoop-Hdfs-trunk #1155

2012-09-04 Thread Apache Jenkins Server
See

Hadoop-Hdfs-0.23-Build - Build # 364 - Still Unstable

2012-09-04 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/364/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 13218 lines...] [mkdir] Created dir: /home/jenki

Jenkins build is still unstable: Hadoop-Hdfs-0.23-Build #364

2012-09-04 Thread Apache Jenkins Server
See