[jira] [Commented] (HDFS-4022) Replication not happening for appended block

2012-10-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478726#comment-13478726 ] Uma Maheswara Rao G commented on HDFS-4022: --- HDFS-4072 patch incorporated to add

[jira] [Commented] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478722#comment-13478722 ] Uma Maheswara Rao G commented on HDFS-4072: --- {quote} I think the existing names a

[jira] [Commented] (HDFS-3980) NPE in HttpURLConnection.java while starting SecondaryNameNode.

2012-10-17 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478710#comment-13478710 ] Aaron T. Myers commented on HDFS-3980: -- Hi Brahma, that keytab config looks fine. Rega

[jira] [Commented] (HDFS-3980) NPE in HttpURLConnection.java while starting SecondaryNameNode.

2012-10-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478684#comment-13478684 ] Brahma Reddy Battula commented on HDFS-3980: [~atm] Thanks a lot for reply..

[jira] [Resolved] (HDFS-4069) File mode bits of some scripts in rpm package are incorrect

2012-10-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-4069. --- Resolution: Won't Fix > File mode bits of some scripts in rpm package are incorrect >

[jira] [Commented] (HDFS-4069) File mode bits of some scripts in rpm package are incorrect

2012-10-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478682#comment-13478682 ] Harsh J commented on HDFS-4069: --- Hi, Thanks for the notes and the temp-resolution bits. Goi

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: HDFS-4072.trunk.003.patch Updated patch. > When deleting a file, it would be be

[jira] [Commented] (HDFS-4043) Namenode Kerberos Login does not use proper hostname for host qualified hdfs principal name.

2012-10-17 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478670#comment-13478670 ] Brahma Reddy Battula commented on HDFS-4043: HI Ahad thanks a lot for reply..

[jira] [Commented] (HDFS-4046) ChecksumTypeProto use NULL as enum value which is illegal in C/C++

2012-10-17 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478661#comment-13478661 ] Binglin Chang commented on HDFS-4046: - I thought DataChecksum.Type.NULL was used by man

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478650#comment-13478650 ] Hadoop QA commented on HDFS-3990: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478642#comment-13478642 ] Suresh Srinivas commented on HDFS-4072: --- bq. Adding pendingReplications.remove(block)

[jira] [Commented] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478640#comment-13478640 ] Jing Zhao commented on HDFS-4072: - Thanks for the comment Eli! I think you're right: the P

[jira] [Commented] (HDFS-2064) Warm HA NameNode going Hot

2012-10-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478637#comment-13478637 ] Konstantin Shvachko commented on HDFS-2064: --- I think this jira still makes sense.

[jira] [Commented] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478629#comment-13478629 ] Eli Collins commented on HDFS-4072: --- Adding pendingReplications.remove(block) to removeBl

[jira] [Commented] (HDFS-4073) Two minor improvements to FSDirectory

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478625#comment-13478625 ] Hadoop QA commented on HDFS-4073: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478603#comment-13478603 ] Tsz Wo (Nicholas), SZE commented on HDFS-3540: -- {noformat} [exec] -1 over

[jira] [Commented] (HDFS-3593) Throughput Metrics

2012-10-17 Thread Xiaoding Bian (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478595#comment-13478595 ] Xiaoding Bian commented on HDFS-3593: - Sorry, I made a mistake of click the "submit pat

[jira] [Updated] (HDFS-3593) Throughput Metrics

2012-10-17 Thread Xiaoding Bian (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoding Bian updated HDFS-3593: Labels: newbie (was: ) Target Version/s: trunk-win Affects Version/s: trunk-win

[jira] [Updated] (HDFS-4073) Two minor improvements to FSDirectory

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4073: Affects Version/s: 3.0.0 Status: Patch Available (was: Open) > Two minor improvements to

[jira] [Updated] (HDFS-4073) Two minor improvements to FSDirectory

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4073: Attachment: HDFS-4073.trunk.001.patch Patch uploaded. > Two minor improvements to FSDirecto

[jira] [Updated] (HDFS-4073) Two minor improvements to FSDirectory

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4073: - Component/s: name-node > Two minor improvements to FSDirectory > -

[jira] [Commented] (HDFS-4036) FSDirectory.unprotectedAddFile(..) should not throw UnresolvedLinkException

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478570#comment-13478570 ] Tsz Wo (Nicholas), SZE commented on HDFS-4036: -- Hey Eil, I just have filed HDF

[jira] [Created] (HDFS-4073) Two minor improvements to FSDirectory

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-4073: Summary: Two minor improvements to FSDirectory Key: HDFS-4073 URL: https://issues.apache.org/jira/browse/HDFS-4073 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-4014) Fix warnings found by findbugs2

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478562#comment-13478562 ] Eli Collins commented on HDFS-4014: --- Nicholas, checkout the patches, eg for HDFS-4035, no

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478557#comment-13478557 ] Eli Collins commented on HDFS-3990: --- Two small comments, +1 otherwise! - Let's remove th

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: HDFS-4072.trunk.002.patch Thanks for the comments Suresh. The modified patch uploaded.

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Attachment: HDFS-3990.branch-0.23.patch 23's host & ip handling is very bizarre but I think I preserved

[jira] [Commented] (HDFS-3402) Fix hdfs script for for secure datanodes

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478520#comment-13478520 ] Suresh Srinivas commented on HDFS-3402: --- Benoy, you just need this right: > HADOOP_OP

[jira] [Resolved] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-4065. --- Resolution: Fixed Fix Version/s: 1-win Hadoop Flags: Reviewed I committed the patc

[jira] [Commented] (HDFS-3402) Fix hdfs script for for secure datanodes

2012-10-17 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478513#comment-13478513 ] Benoy Antony commented on HDFS-3402: I think, you are right. That was not intended. I'

[jira] [Commented] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478507#comment-13478507 ] Suresh Srinivas commented on HDFS-4065: --- I think we need to look at changing tests no

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478492#comment-13478492 ] Hadoop QA commented on HDFS-3990: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4014) Fix warnings found by findbugs2

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478483#comment-13478483 ] Tsz Wo (Nicholas), SZE commented on HDFS-4014: -- This findbugs 2 warnings for G

[jira] [Commented] (HDFS-4057) NameNode.namesystem should be private. Use getNamesystem() instead.

2012-10-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478476#comment-13478476 ] Brandon Li commented on HDFS-4057: -- test-patch result: {noformat} -1 overall. +1 @au

[jira] [Reopened] (HDFS-3553) Hftp proxy tokens are broken

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-3553: -- 1.1.0 was released without this patch. Changing the Target Version to 1.1.1. However, is this really still

[jira] [Commented] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478455#comment-13478455 ] Hadoop QA commented on HDFS-4072: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-3553) Hftp proxy tokens are broken

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-3553: - Target Version/s: 0.23.4, 1.1.1, 3.0.0, 2.0.3-alpha (was: 1.1.0) > Hftp proxy tokens are broken > ---

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478451#comment-13478451 ] Kan Zhang commented on HDFS-4056: - What combinations of initial and subsequent auth modes a

[jira] [Closed] (HDFS-3162) BlockMap's corruptNodes count and CorruptReplicas map count is not matching.

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley closed HDFS-3162. > BlockMap's corruptNodes count and CorruptReplicas map count is not matching. > ---

[jira] [Updated] (HDFS-4057) NameNode.namesystem should be private. Use getNamesystem() instead.

2012-10-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-4057: - Attachment: HDFS-4057.branch-1.patch Re-based the patch and fixed the compilation problem. Sorry. Running

[jira] [Updated] (HDFS-1108) Log newly allocated blocks

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1108: - Target Version/s: 1.2.0 (was: 1.1.0) > Log newly allocated blocks > -- > >

[jira] [Updated] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-4063: - Target Version/s: 1.1.1, 2.0.3-alpha (was: 1.0.4, 1.1.1, 2.0.3-alpha) 1.0.4 was released without this pat

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Attachment: HDFS-3990.patch Will upload 23 patch shortly. > NN's health report has seve

[jira] [Commented] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478435#comment-13478435 ] Suresh Srinivas commented on HDFS-4072: --- Patch looks good. Can you combine the test a

[jira] [Commented] (HDFS-4036) FSDirectory.unprotectedAddFile(..) should not throw UnresolvedLinkException

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478433#comment-13478433 ] Eli Collins commented on HDFS-4036: --- Right, hence the suggestion to either fix it here (o

[jira] [Updated] (HDFS-4071) Add number of stale DataNodes to metrics for Branch-1

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-4071: - Target Version/s: 1.1.1, 3.0.0, 2.0.3-alpha Fix Version/s: (was: 2.0.3-alpha)

[jira] [Closed] (HDFS-3461) HFTP should use the same port & protocol for getting the delegation token

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley closed HDFS-3461. Closed upon release of Hadoop-1.1.0. > HFTP should use the same port & protocol for getting the

[jira] [Resolved] (HDFS-3461) HFTP should use the same port & protocol for getting the delegation token

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-3461. -- Resolution: Fixed Fix was committed by Owen on 10/1/2012. > HFTP should use the same po

[jira] [Commented] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478425#comment-13478425 ] Hudson commented on HDFS-4068: -- Integrated in Hadoop-trunk-Commit #2884 (See [https://builds.

[jira] [Commented] (HDFS-4046) ChecksumTypeProto use NULL as enum value which is illegal in C/C++

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478423#comment-13478423 ] Suresh Srinivas commented on HDFS-4046: --- bq. 1. refactor all DataChecksum.Type.NULL r

[jira] [Commented] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478422#comment-13478422 ] Eli Collins commented on HDFS-4068: --- Forgot to mention, I've committed this to trunk and

[jira] [Updated] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4068: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 0.23.4, 2.0.3-alp

[jira] [Commented] (HDFS-4036) FSDirectory.unprotectedAddFile(..) should not throw UnresolvedLinkException

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478418#comment-13478418 ] Tsz Wo (Nicholas), SZE commented on HDFS-4036: -- > Nicholas, but why is it unpr

[jira] [Commented] (HDFS-4053) Increase the default block size

2012-10-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478407#comment-13478407 ] Harsh J commented on HDFS-4053: --- bq. I'm sure we have a conversion method lurking somewhere i

[jira] [Commented] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478378#comment-13478378 ] Chris Nauroth commented on HDFS-4065: - Hello, Daryn. My measurements show that stoppin

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Status: Patch Available (was: Open) > When deleting a file, it would be better to also remove correspon

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478360#comment-13478360 ] Daryn Sharp commented on HDFS-4056: --- Yes, I do understand exactly what you are saying, ho

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: HDFS-4072.trunk.001.patch And a simple patch uploaded. > When deleting a file,

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: TestPendingAndDelete.java The attached test may generate the scenario where a pendingReplication

[jira] [Created] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4072: --- Summary: When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications Key: HDFS-4072 URL: https://issues.apache.org/jira/browse/

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478350#comment-13478350 ] Daryn Sharp commented on HDFS-3990: --- I'm making the changes, but I found that I cannot re

[jira] [Commented] (HDFS-4057) NameNode.namesystem should be private. Use getNamesystem() instead.

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478337#comment-13478337 ] Suresh Srinivas commented on HDFS-4057: --- This patch needs more work. Tests do not com

[jira] [Commented] (HDFS-4053) Increase the default block size

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478335#comment-13478335 ] Hadoop QA commented on HDFS-4053: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-4057) NameNode.namesystem should be private. Use getNamesystem() instead.

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4057: - Hadoop Flags: Reviewed +1 Patch looks good. Could you run test-patch and unit tes

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478324#comment-13478324 ] Kan Zhang commented on HDFS-4056: - I think it's more appropriate for me to add this comment

[jira] [Commented] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478282#comment-13478282 ] Daryn Sharp commented on HDFS-4068: --- +1 Looks good. Thanks for breaking this out of HDFS

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478279#comment-13478279 ] Daryn Sharp commented on HDFS-4056: --- bq. the job client will always fetch a NN delegation

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478271#comment-13478271 ] Eli Collins commented on HDFS-3990: --- Think the approach in the latest patch should work.

[jira] [Updated] (HDFS-4053) Increase the default block size

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4053: -- Attachment: hdfs-4053.txt Updated to 128*1024*1024. The TestBalancer timeout is unrelated (HDFS-4061).

[jira] [Commented] (HDFS-4022) Replication not happening for appended block

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478102#comment-13478102 ] Tsz Wo (Nicholas), SZE commented on HDFS-4022: -- > replication change flow is a

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument & always performs small writes

2012-10-17 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478094#comment-13478094 ] Andy Isaacson commented on HDFS-4070: - I'm a little surprised that increasing buffer si

[jira] [Resolved] (HDFS-3953) DFSOutputStream constructor does not use bufferSize parameter

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-3953. - Resolution: Duplicate Duplicated with HDFS-4070 > DFSOutputStream constructor does not us

[jira] [Updated] (HDFS-4071) Add number of stale DataNodes to metrics for Branch-1

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4071: Attachment: HDFS-4059-backport-branch-1.001.patch To avoid bringing extra complexity to TestNameNodeMetrics

[jira] [Created] (HDFS-4071) Add number of stale DataNodes to metrics for Branch-1

2012-10-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4071: --- Summary: Add number of stale DataNodes to metrics for Branch-1 Key: HDFS-4071 URL: https://issues.apache.org/jira/browse/HDFS-4071 Project: Hadoop HDFS Issue Type: Sub

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478076#comment-13478076 ] Jing Zhao commented on HDFS-4059: - I backport the patch to branch-1. Since the code is diff

[jira] [Commented] (HDFS-4043) Namenode Kerberos Login does not use proper hostname for host qualified hdfs principal name.

2012-10-17 Thread Ahad Rana (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478067#comment-13478067 ] Ahad Rana commented on HDFS-4043: - Hi, Can you explicitly set the namenode principal name

[jira] [Commented] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478057#comment-13478057 ] Eli Collins commented on HDFS-4068: --- Test failure is HDFS-3806, since this is just clean

[jira] [Comment Edited] (HDFS-3402) Fix hdfs script for for secure datanodes

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478040#comment-13478040 ] Suresh Srinivas edited comment on HDFS-3402 at 10/17/12 5:15 PM:

[jira] [Commented] (HDFS-3402) Fix hdfs script for for secure datanodes

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478040#comment-13478040 ] Suresh Srinivas commented on HDFS-3402: --- Ok foudn the answer in bash parameter expans

[jira] [Commented] (HDFS-3402) Fix hdfs script for for secure datanodes

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478027#comment-13478027 ] Suresh Srinivas commented on HDFS-3402: --- Benoy, quick question - what does the follow

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478000#comment-13478000 ] Daryn Sharp commented on HDFS-3990: --- The balancer test seems to randomly fail. It passes

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument & always performs small writes

2012-10-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477998#comment-13477998 ] Uma Maheswara Rao G commented on HDFS-4070: --- Ok, make sense. Thanks for working o

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477996#comment-13477996 ] Kan Zhang commented on HDFS-4056: - Let's use an example to explain. Suppose security is con

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument & always performs small writes

2012-10-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477984#comment-13477984 ] Gopal V commented on HDFS-4070: --- The property is global, which makes it impossible for a clie

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477975#comment-13477975 ] Hadoop QA commented on HDFS-3990: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-4069) File mode bits of some scripts in rpm package are incorrect

2012-10-17 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477962#comment-13477962 ] Haoquan Wang commented on HDFS-4069: Temporarily resolution: chmod +x /usr/sbin/s*.sh /

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument & always performs small writes

2012-10-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477963#comment-13477963 ] Uma Maheswara Rao G commented on HDFS-4070: --- Gopal, I agree, we are ignoring the

[jira] [Commented] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477942#comment-13477942 ] Daryn Sharp commented on HDFS-4065: --- Could you do something like sync or flush? The test

[jira] [Commented] (HDFS-4053) Increase the default block size

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477935#comment-13477935 ] Daryn Sharp commented on HDFS-4053: --- +1 Assuming test failure is unrelated. I'd suggest

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument & always performs small writes

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477923#comment-13477923 ] Suresh Srinivas commented on HDFS-4070: --- Gopal, perhaps we can also revisit the defau

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Status: Patch Available (was: Open) > NN's health report has severe performance problems >

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Attachment: HDFS-3990.patch Sorry, I accidentally re-submitted the wrong patch (same as prior) yesterday

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477909#comment-13477909 ] Daryn Sharp commented on HDFS-3990: --- In your patch, it's not necessary for the NN to do a

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477902#comment-13477902 ] Daryn Sharp commented on HDFS-4056: --- SIMPLE is still supported as it currently is today.

[jira] [Commented] (HDFS-2946) HA: Put a cap on the number of completed edits files retained by the NN

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477876#comment-13477876 ] Hudson commented on HDFS-2946: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See [https://buil

[jira] [Commented] (HDFS-3997) OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477875#comment-13477875 ] Hudson commented on HDFS-3997: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See [https://buil

[jira] [Commented] (HDFS-3985) Add timeouts to TestMulitipleNNDataBlockScanner

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477873#comment-13477873 ] Hudson commented on HDFS-3985: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See [https://buil

[jira] [Commented] (HDFS-4052) BlockManager#invalidateWork should print logs outside the lock

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477871#comment-13477871 ] Hudson commented on HDFS-4052: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See [https://buil

[jira] [Commented] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477870#comment-13477870 ] Hudson commented on HDFS-4061: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See [https://buil

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13477868#comment-13477868 ] Hudson commented on HDFS-4059: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See [https://buil

  1   2   >