[jira] [Updated] (HDFS-2906) NullPointerExeception in BlockReceiver on DataNode restart.

2012-02-07 Thread Uma Maheswara Rao G (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-2906: -- Description: Scenario: 1) Start the cluster with one NN and two DN's. 2) Keep restart on

[jira] [Commented] (HDFS-2906) NullPointerExeception in BlockReceiver on DataNode restart.

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202162#comment-13202162 ] Uma Maheswara Rao G commented on HDFS-2906: --- As per my understanding there should

[jira] [Commented] (HDFS-2906) NullPointerExeception in BlockReceiver on DataNode restart.

2012-02-07 Thread Brahma Reddy Battula (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202168#comment-13202168 ] Brahma Reddy Battula commented on HDFS-2906: HI Uma, Thanks for analysis.Seems

[jira] [Updated] (HDFS-2906) NullPointerExeception in BlockReceiver on DataNode restart.

2012-02-07 Thread Brahma Reddy Battula (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-2906: --- Priority: Minor (was: Major) > NullPointerExeception in BlockReceiver on DataNode

[jira] [Commented] (HDFS-2839) Nameservice id in file uri could cause issues

2012-02-07 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202172#comment-13202172 ] Aaron T. Myers commented on HDFS-2839: -- bq. But #2 is still open and needs discussion.

[jira] [Updated] (HDFS-2510) Add HA-related metrics

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2510: - Attachment: HDFS-2510.HDFS-1623.patch Here's a patch which addresses the issue. In addition to the

[jira] [Commented] (HDFS-2486) Review issues with UnderReplicatedBlocks

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202247#comment-13202247 ] Uma Maheswara Rao G commented on HDFS-2486: --- Could some one please check this poi

[jira] [Commented] (HDFS-2886) CreateEditLogs should generate a realistic edit log.

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202256#comment-13202256 ] Hudson commented on HDFS-2886: -- Integrated in Hadoop-Hdfs-22-branch #126 (See [https://builds

[jira] [Commented] (HDFS-2901) HA: Improvements for SBN web UI - not show under-replicated/missing blocks

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202267#comment-13202267 ] Uma Maheswara Rao G commented on HDFS-2901: --- Adding to Aaron comments. {code} +

[jira] [Commented] (HDFS-2901) HA: Improvements for SBN web UI - not show under-replicated/missing blocks

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202268#comment-13202268 ] Uma Maheswara Rao G commented on HDFS-2901: --- @Jitendra, sorry, i did not see your

[jira] [Updated] (HDFS-2903) NPE if shared edits directory is not available during failover

2012-02-07 Thread Uma Maheswara Rao G (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-2903: -- Issue Type: Sub-task (was: Bug) Parent: HDFS-1623 > NPE if shared edits dir

[jira] [Commented] (HDFS-2903) NPE if shared edits directory is not available during failover

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202273#comment-13202273 ] Uma Maheswara Rao G commented on HDFS-2903: --- As this bug found against to HA bran

[jira] [Commented] (HDFS-2905) Standby NN NPE when shared edits dir is deleted

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202282#comment-13202282 ] Uma Maheswara Rao G commented on HDFS-2905: --- HDFS-2903 and HDFS-2905 are seems to

[jira] [Commented] (HDFS-2895) Remove Writable wire protocol related code that is no longer necessary

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202302#comment-13202302 ] Hudson commented on HDFS-2895: -- Integrated in Hadoop-Hdfs-trunk #949 (See [https://builds.apa

[jira] [Commented] (HDFS-2886) CreateEditLogs should generate a realistic edit log.

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202299#comment-13202299 ] Hudson commented on HDFS-2886: -- Integrated in Hadoop-Hdfs-trunk #949 (See [https://builds.apa

[jira] [Commented] (HDFS-2886) CreateEditLogs should generate a realistic edit log.

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202318#comment-13202318 ] Hudson commented on HDFS-2886: -- Integrated in Hadoop-Hdfs-0.23-Build #162 (See [https://build

[jira] [Commented] (HDFS-2733) Document HA configuration and CLI

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202337#comment-13202337 ] Hudson commented on HDFS-2733: -- Integrated in Hadoop-Hdfs-HAbranch-build #71 (See [https://bu

[jira] [Commented] (HDFS-2794) HA: Active NN may purge edit log files before standby NN has a chance to read them

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202336#comment-13202336 ] Hudson commented on HDFS-2794: -- Integrated in Hadoop-Hdfs-HAbranch-build #71 (See [https://bu

[jira] [Commented] (HDFS-2886) CreateEditLogs should generate a realistic edit log.

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202345#comment-13202345 ] Hudson commented on HDFS-2886: -- Integrated in Hadoop-Mapreduce-0.23-Build #184 (See [https://

[jira] [Commented] (HDFS-2895) Remove Writable wire protocol related code that is no longer necessary

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202383#comment-13202383 ] Hudson commented on HDFS-2895: -- Integrated in Hadoop-Mapreduce-trunk #982 (See [https://build

[jira] [Commented] (HDFS-2886) CreateEditLogs should generate a realistic edit log.

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202380#comment-13202380 ] Hudson commented on HDFS-2886: -- Integrated in Hadoop-Mapreduce-trunk #982 (See [https://build

[jira] [Updated] (HDFS-2492) BlockManager cross-rack replication checks only work for ScriptBasedMapping

2012-02-07 Thread Steve Loughran (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-2492: - Priority: Minor (was: Blocker) > BlockManager cross-rack replication checks only work for Scr

[jira] [Updated] (HDFS-2899) Service protocol change to support multiple storages added in HDFS-2880

2012-02-07 Thread Suresh Srinivas (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2899: -- Attachment: HDFS-2899.txt Thanks for the comments Jitendra. Reverted the accidental proto change

[jira] [Created] (HDFS-2907) Make FSDataset in Datanode Pluggable

2012-02-07 Thread Sanjay Radia (Created) (JIRA)
Make FSDataset in Datanode Pluggable Key: HDFS-2907 URL: https://issues.apache.org/jira/browse/HDFS-2907 Project: Hadoop HDFS Issue Type: Improvement Reporter: Sanjay Radia Assigne

[jira] [Commented] (HDFS-2899) Service protocol change to support multiple storages added in HDFS-2880

2012-02-07 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202519#comment-13202519 ] Hadoop QA commented on HDFS-2899: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-2899) Service protocol change to support multiple storages added in HDFS-2880

2012-02-07 Thread Suresh Srinivas (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2899: -- Resolution: Fixed Fix Version/s: 0.24.0 Hadoop Flags: Reviewed Status: Res

[jira] [Commented] (HDFS-2899) Service protocol change to support multiple storages added in HDFS-2880

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202540#comment-13202540 ] Hudson commented on HDFS-2899: -- Integrated in Hadoop-Common-trunk-Commit #1681 (See [https://

[jira] [Commented] (HDFS-2899) Service protocol change to support multiple storages added in HDFS-2880

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202539#comment-13202539 ] Hudson commented on HDFS-2899: -- Integrated in Hadoop-Hdfs-trunk-Commit #1754 (See [https://bu

[jira] [Commented] (HDFS-2899) Service protocol change to support multiple storages added in HDFS-2880

2012-02-07 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202569#comment-13202569 ] Hudson commented on HDFS-2899: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1693 (See [https

[jira] [Created] (HDFS-2908) Add apache license header for StorageReport.java

2012-02-07 Thread Suresh Srinivas (Created) (JIRA)
Add apache license header for StorageReport.java Key: HDFS-2908 URL: https://issues.apache.org/jira/browse/HDFS-2908 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions: 0.24.0

[jira] [Assigned] (HDFS-2908) Add apache license header for StorageReport.java

2012-02-07 Thread Brandon Li (Assigned) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li reassigned HDFS-2908: Assignee: Brandon Li > Add apache license header for StorageReport.java > --

[jira] [Commented] (HDFS-2905) Standby NN NPE when shared edits dir is deleted

2012-02-07 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202575#comment-13202575 ] Hari Mankude commented on HDFS-2905: Yep, even though trace looks different till matchE

[jira] [Updated] (HDFS-2901) HA: Improvements for SBN web UI - not show under-replicated/missing blocks

2012-02-07 Thread Brandon Li (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-2901: - Attachment: HDFS-2901.HDFS-1623.patch Thanks folks for the review and comments. I updated the change and

[jira] [Commented] (HDFS-2905) Standby NN NPE when shared edits dir is deleted

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202578#comment-13202578 ] Todd Lipcon commented on HDFS-2905: --- Probably just need to replace currentDir.listFiles()

[jira] [Updated] (HDFS-2908) Add apache license header for StorageReport.java

2012-02-07 Thread Brandon Li (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-2908: - Attachment: HDFS-2908.patch Apache license header is added. > Add apache license header f

[jira] [Commented] (HDFS-2905) Standby NN NPE when shared edits dir is deleted

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202592#comment-13202592 ] Uma Maheswara Rao G commented on HDFS-2905: --- Yes, two places we need to handle fo

[jira] [Commented] (HDFS-2901) HA: Improvements for SBN web UI - not show under-replicated/missing blocks

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202615#comment-13202615 ] Uma Maheswara Rao G commented on HDFS-2901: --- Thanks Brandon, for addressing the c

[jira] [Created] (HDFS-2909) Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error

2012-02-07 Thread Bikas Saha (Created) (JIRA)
Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error -- Key: HDFS-2909 URL: https://issues.apache.org/jira/browse/HDFS-2909 Project:

[jira] [Updated] (HDFS-2909) HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2909: - Component/s: name-node ha Target Version/s: HA branch (HDFS-1623)

[jira] [Commented] (HDFS-2909) HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error

2012-02-07 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202644#comment-13202644 ] Bikas Saha commented on HDFS-2909: -- Repro steps 1) Start 2 NN's in active standby mode 2)

[jira] [Commented] (HDFS-2901) HA: Improvements for SBN web UI - not show under-replicated/missing blocks

2012-02-07 Thread Jitendra Nath Pandey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202653#comment-13202653 ] Jitendra Nath Pandey commented on HDFS-2901: +1 > HA: Improvem

[jira] [Updated] (HDFS-2905) Standby NN NPE when shared edits dir is deleted

2012-02-07 Thread Bikas Saha (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated HDFS-2905: - Attachment: HDFS-2905.HDFS-1623.patch Simple patch for the NPE added to both places where java.io.listFile

[jira] [Resolved] (HDFS-2901) HA: Improvements for SBN web UI - not show under-replicated/missing blocks

2012-02-07 Thread Jitendra Nath Pandey (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey resolved HDFS-2901. Resolution: Fixed Committed. Thanks Brandon! > HA: Improvements for

[jira] [Resolved] (HDFS-2632) existing in_use.lock file is removed after failing to lock this file

2012-02-07 Thread Todd Lipcon (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2632. --- Resolution: Duplicate > existing in_use.lock file is removed after failing to lock this file > ---

[jira] [Created] (HDFS-2910) Active NN reports Bad state: BETWEEN_LOG_SEGMENTS when shared edits dir is inaccessible during log roll

2012-02-07 Thread Bikas Saha (Created) (JIRA)
Active NN reports Bad state: BETWEEN_LOG_SEGMENTS when shared edits dir is inaccessible during log roll --- Key: HDFS-2910 URL: https://issues.apache.org/jira/brow

[jira] [Updated] (HDFS-2901) HA: Improvements for SBN web UI - not show under-replicated/missing blocks

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2901: - Component/s: name-node ha Target Version/s: HA branch (HDFS-1623)

[jira] [Commented] (HDFS-2905) Standby NN NPE when shared edits dir is deleted

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202669#comment-13202669 ] Todd Lipcon commented on HDFS-2905: --- Can you add a unit test for this in TestFileJournalM

[jira] [Commented] (HDFS-2910) Active NN reports Bad state: BETWEEN_LOG_SEGMENTS when shared edits dir is inaccessible during log roll

2012-02-07 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202676#comment-13202676 ] Bikas Saha commented on HDFS-2910: -- Repro steps 1) Start 2 NN's in active standby mode 2)

[jira] [Commented] (HDFS-2909) HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202675#comment-13202675 ] Todd Lipcon commented on HDFS-2909: --- It seems that, when rollEditLogs fails in the shared

[jira] [Commented] (HDFS-2839) Nameservice id in file uri could cause issues

2012-02-07 Thread Jitendra Nath Pandey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202692#comment-13202692 ] Jitendra Nath Pandey commented on HDFS-2839: There could be ways around it fo

[jira] [Commented] (HDFS-2617) Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution

2012-02-07 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202698#comment-13202698 ] Tsz Wo (Nicholas), SZE commented on HDFS-2617: -- > ... Has distcp been updated

[jira] [Commented] (HDFS-2907) Make FSDataset in Datanode Pluggable

2012-02-07 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202738#comment-13202738 ] Aaron T. Myers commented on HDFS-2907: -- Hey Sanjay, could you please add a description

[jira] [Commented] (HDFS-2903) NPE if shared edits directory is not available during failover

2012-02-07 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202743#comment-13202743 ] Hari Mankude commented on HDFS-2903: closing as a dup of hdfs-2905 > N

[jira] [Resolved] (HDFS-2903) NPE if shared edits directory is not available during failover

2012-02-07 Thread Hari Mankude (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Mankude resolved HDFS-2903. Resolution: Duplicate Dup of HDFS-2905 > NPE if shared edits directory is not avail

[jira] [Updated] (HDFS-2839) HA: Remove need for client configuration of nameservice ID

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2839: - Description: The fully qualified path from an ha cluster, won't be usable from a different cluste

[jira] [Updated] (HDFS-2910) HA: Active NN reports Bad state: BETWEEN_LOG_SEGMENTS when shared edits dir is inaccessible during log roll

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2910: - Component/s: name-node ha Target Version/s: HA branch (HDFS-1623)

[jira] [Updated] (HDFS-2905) Standby NN NPE when shared edits dir is deleted

2012-02-07 Thread Bikas Saha (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated HDFS-2905: - Attachment: HDFS-2905.HDFS-1623.patch I added a helper wrapper around matchEditLogs (File) that takes the

[jira] [Commented] (HDFS-2839) HA: Remove need for client configuration of nameservice ID

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202821#comment-13202821 ] Todd Lipcon commented on HDFS-2839: --- One possibility we'd discussed last year is to use D

[jira] [Created] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-02-07 Thread Eli Collins (Created) (JIRA)
Gracefully handle OutOfMemoryErrors --- Key: HDFS-2911 URL: https://issues.apache.org/jira/browse/HDFS-2911 Project: Hadoop HDFS Issue Type: Improvement Components: data-node, name-node Affects V

[jira] [Commented] (HDFS-2909) HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error

2012-02-07 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202846#comment-13202846 ] Bikas Saha commented on HDFS-2909: -- This is happening because JournalSet.mapJournalsAndRep

[jira] [Updated] (HDFS-2902) HA: Allow new shared edit logs dir to be configured while NN is running

2012-02-07 Thread Bikas Saha (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated HDFS-2902: - Summary: HA: Allow new shared edit logs dir to be configured while NN is running (was: Allow new shared e

[jira] [Updated] (HDFS-2905) HA: Standby NN NPE when shared edits dir is deleted

2012-02-07 Thread Bikas Saha (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated HDFS-2905: - Summary: HA: Standby NN NPE when shared edits dir is deleted (was: Standby NN NPE when shared edits dir i

[jira] [Commented] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202860#comment-13202860 ] Todd Lipcon commented on HDFS-2911: --- One option we use in HBase is to set the JVM to kill

[jira] [Commented] (HDFS-2909) HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error

2012-02-07 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202884#comment-13202884 ] Bikas Saha commented on HDFS-2909: -- The NN did not abort because it simply threw an IOExce

[jira] [Commented] (HDFS-2579) Starting delegation token manager during safemode fails

2012-02-07 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202913#comment-13202913 ] Eli Collins commented on HDFS-2579: --- +1 updated patch lgtm Jitendra, if you're going to

[jira] [Commented] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-02-07 Thread Shaneal Manek (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202933#comment-13202933 ] Shaneal Manek commented on HDFS-2911: - Incidentally, I worked with a jvmti agent a whil

[jira] [Commented] (HDFS-2510) Add HA-related metrics

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202950#comment-13202950 ] Todd Lipcon commented on HDFS-2510: --- {code} + public long getMillisSinceLastLoadedEdits(

[jira] [Created] (HDFS-2912) HA: Namenode not shutting down when shared edits dir is inaccessible

2012-02-07 Thread Bikas Saha (Created) (JIRA)
HA: Namenode not shutting down when shared edits dir is inaccessible Key: HDFS-2912 URL: https://issues.apache.org/jira/browse/HDFS-2912 Project: Hadoop HDFS Issue Type: Su

[jira] [Created] (HDFS-2913) HA: Need a way to shutdown the Name Node

2012-02-07 Thread Bikas Saha (Created) (JIRA)
HA: Need a way to shutdown the Name Node Key: HDFS-2913 URL: https://issues.apache.org/jira/browse/HDFS-2913 Project: Hadoop HDFS Issue Type: Sub-task Components: name-node Affects Versi

[jira] [Updated] (HDFS-2907) Make FSDataset in Datanode Pluggable

2012-02-07 Thread Suresh Srinivas (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2907: -- Target Version/s: 0.24.0 Fix Version/s: (was: 0.24.0) > Make FSDataset in Datanod

[jira] [Commented] (HDFS-2909) HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error

2012-02-07 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202990#comment-13202990 ] Bikas Saha commented on HDFS-2909: -- Aside from all the above I see some other issues. Say

[jira] [Commented] (HDFS-2910) HA: Active NN reports Bad state: BETWEEN_LOG_SEGMENTS when shared edits dir is inaccessible during log roll

2012-02-07 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202991#comment-13202991 ] Bikas Saha commented on HDFS-2910: -- I think FSEditLog should not be starting a new segment

[jira] [Commented] (HDFS-2913) HA: Need a way to shutdown the Name Node

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202997#comment-13202997 ] Todd Lipcon commented on HDFS-2913: --- Currently it is meant to do a "fail fast" shutdown -

[jira] [Commented] (HDFS-2910) HA: Active NN reports Bad state: BETWEEN_LOG_SEGMENTS when shared edits dir is inaccessible during log roll

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203000#comment-13203000 ] Todd Lipcon commented on HDFS-2910: --- We should just do a hard exit here -- upon restart o

[jira] [Updated] (HDFS-2510) Add HA-related metrics

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2510: - Attachment: HDFS-2510-HDFS-1623.patch Thanks a lot for the review, Todd. Here's a patch which addr

[jira] [Commented] (HDFS-2902) HA: Allow new shared edit logs dir to be configured while NN is running

2012-02-07 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203002#comment-13203002 ] Bikas Saha commented on HDFS-2902: -- Reading the code shows a possible inconsistency issue.

[jira] [Commented] (HDFS-2579) Starting delegation token manager during safemode fails

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203006#comment-13203006 ] Todd Lipcon commented on HDFS-2579: --- We've found one bug during stress testing - there's

[jira] [Updated] (HDFS-2912) HA: Namenode not shutting down when shared edits dir is inaccessible

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2912: - Component/s: ha > HA: Namenode not shutting down when shared edits dir is inaccessible > -

[jira] [Updated] (HDFS-2913) HA: Need a way to shutdown the Name Node

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2913: - Component/s: ha > HA: Need a way to shutdown the Name Node > -

[jira] [Commented] (HDFS-2905) HA: Standby NN NPE when shared edits dir is deleted

2012-02-07 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203036#comment-13203036 ] Hari Mankude commented on HDFS-2905: Looks good. +1 from my side. > HA

[jira] [Commented] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-02-07 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203037#comment-13203037 ] Tsz Wo (Nicholas), SZE commented on HDFS-2911: -- OutOfMemoryError is a subclass

[jira] [Updated] (HDFS-2819) Document new HA-related configs in hdfs-default.xml

2012-02-07 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2819: -- Attachment: hdfs-2819-ammend.txt Thanks for the review Suresh. Comments below and updated patch attached

[jira] [Commented] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-02-07 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203064#comment-13203064 ] Eli Collins commented on HDFS-2911: --- HDFS isn't really an application. If we labor on sub

[jira] [Commented] (HDFS-2911) Gracefully handle OutOfMemoryErrors

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203081#comment-13203081 ] Uma Maheswara Rao G commented on HDFS-2911: --- I too agree. Recently i have debugge

[jira] [Commented] (HDFS-2362) More Improvements on NameNode Scalability

2012-02-07 Thread Uma Maheswara Rao G (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203089#comment-13203089 ] Uma Maheswara Rao G commented on HDFS-2362: --- Recently I remember Eli's and Dhruba

[jira] [Commented] (HDFS-2912) HA: Namenode not shutting down when shared edits dir is inaccessible

2012-02-07 Thread Bikas Saha (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203092#comment-13203092 ] Bikas Saha commented on HDFS-2912: -- For some reason the LOG.FATAL statements is not termin

[jira] [Created] (HDFS-2914) HA Standby stuck in safemode when shared edits directory is bounced

2012-02-07 Thread Hari Mankude (Created) (JIRA)
HA Standby stuck in safemode when shared edits directory is bounced --- Key: HDFS-2914 URL: https://issues.apache.org/jira/browse/HDFS-2914 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-2764) TestBackupNode is failing

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2764: - Attachment: HDFS-2764.patch Here's a patch which addresses the issue. The trouble was that a help

[jira] [Updated] (HDFS-2764) TestBackupNode is failing

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2764: - Status: Patch Available (was: Reopened) > TestBackupNode is failing > ---

[jira] [Updated] (HDFS-2764) TestBackupNode is failing

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2764: - Component/s: test > TestBackupNode is failing > - > >

[jira] [Updated] (HDFS-2764) TestBackupNode is failing

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2764: - Target Version/s: 0.24.0 > TestBackupNode is failing > - > >

[jira] [Updated] (HDFS-2764) TestBackupNode is racy

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2764: - Description: TestBackupNode#waitCheckpointDone can spuriously fail because of a race. (was: Looks

[jira] [Commented] (HDFS-2914) HA Standby stuck in safemode when shared edits directory is bounced

2012-02-07 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203099#comment-13203099 ] Hari Mankude commented on HDFS-2914: When shared edits dir is bounced, df will return s

[jira] [Commented] (HDFS-2912) HA: Namenode not shutting down when shared edits dir is inaccessible

2012-02-07 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203106#comment-13203106 ] Todd Lipcon commented on HDFS-2912: --- In log4j, LOG.fatal doesn't actually terminate the N

[jira] [Commented] (HDFS-2914) HA Standby stuck in safemode when shared edits directory is bounced

2012-02-07 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203109#comment-13203109 ] Aaron T. Myers commented on HDFS-2914: -- Hey Hari, per the discussion on HDFS-1594, it

[jira] [Updated] (HDFS-2914) HA Standby stuck in safemode when shared edits directory is bounced

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2914: - Issue Type: Sub-task (was: Bug) Parent: HDFS-1623 > HA Standby stuck in safemode when

[jira] [Updated] (HDFS-2914) HA: Standby stuck in safemode when shared edits directory is bounced

2012-02-07 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2914: - Summary: HA: Standby stuck in safemode when shared edits directory is bounced (was: HA Standby st

[jira] [Commented] (HDFS-2362) More Improvements on NameNode Scalability

2012-02-07 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203121#comment-13203121 ] Eli Collins commented on HDFS-2362: --- Not for 23.1, which is getting cut soon. We'll merge

[jira] [Commented] (HDFS-2914) HA: Standby stuck in safemode when shared edits directory is bounced

2012-02-07 Thread Hari Mankude (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203124#comment-13203124 ] Hari Mankude commented on HDFS-2914: Hi Aaron, The issue I see is that even if this st

[jira] [Updated] (HDFS-2594) webhdfs HTTP API should implement getDelegationTokens() instead getDelegationToken()

2012-02-07 Thread Suresh Srinivas (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2594: -- Fix Version/s: 0.24.0 > webhdfs HTTP API should implement getDelegationTokens() instead > g

  1   2   >