[jira] [Commented] (HDFS-3916) libwebhdfs (C client) code cleanups

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487591#comment-13487591 ] Hudson commented on HDFS-3916: -- Integrated in Hadoop-trunk-Commit #2945 (See [https://builds.

[jira] [Commented] (HDFS-4129) Add utility methods to dump NameNode in memory tree for testing

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487590#comment-13487590 ] Hudson commented on HDFS-4129: -- Integrated in Hadoop-trunk-Commit #2945 (See [https://builds.

[jira] [Updated] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-10-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4047: -- Status: Patch Available (was: Open) > BPServiceActor has nested shouldRun loops > -

[jira] [Updated] (HDFS-4047) BPServiceActor has nested shouldRun loops

2012-10-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated HDFS-4047: -- Attachment: HADOOP-4047.patch Just like the description, we hoist the info log from offerService() out t

[jira] [Commented] (HDFS-3507) DFS#isInSafeMode needs to execute only on Active NameNode

2012-10-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487583#comment-13487583 ] Aaron T. Myers commented on HDFS-3507: -- Hi Vinay, the config "dfs.ha.allow.stale.reads

[jira] [Updated] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2012-10-30 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2882: -- Affects Version/s: (was: 0.24.0) 2.0.2-alpha > DN continues to start up, even if

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487547#comment-13487547 ] Konstantin Shvachko commented on HDFS-2802: --- I propose to divide this discussion

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487496#comment-13487496 ] Suresh Srinivas commented on HDFS-2802: --- bq. From my quick look, this seems to clarif

[jira] [Commented] (HDFS-4128) 2NN gets stuck in inconsistent state if edit log replay fails in the middle

2012-10-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487495#comment-13487495 ] Todd Lipcon commented on HDFS-4128: --- Good point, Colin. I definitely don't think that's a

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487489#comment-13487489 ] Aaron T. Myers commented on HDFS-2802: -- Hi Suresh, thanks a lot for posting an updated

[jira] [Resolved] (HDFS-4118) Change INodeDirectory.getExistingPathINodes(..) to work with snapshots

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-4118. --- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) Hadoop Flags: Reviewed I com

[jira] [Updated] (HDFS-4118) Change INodeDirectory.getExistingPathINodes(..) to work with snapshots

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4118: -- Affects Version/s: Snapshot (HDFS-2802) > Change INodeDirectory.getExistingPathINodes(..) to

[jira] [Commented] (HDFS-4118) Change INodeDirectory.getExistingPathINodes(..) to work with snapshots

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487477#comment-13487477 ] Suresh Srinivas commented on HDFS-4118: --- +1 for the patch. Nice set of tests.

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-30 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487475#comment-13487475 ] Kan Zhang commented on HDFS-4056: - bq. "Newer" clients can however request and use tokens,

[jira] [Updated] (HDFS-4129) Add utility methods to dump NameNode in memory tree for testing

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4129: -- Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Reso

[jira] [Commented] (HDFS-4129) Add utility methods to dump NameNode in memory tree for testing

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487461#comment-13487461 ] Suresh Srinivas commented on HDFS-4129: --- +1 for the patch. > Add uti

[jira] [Commented] (HDFS-4125) Use a persistent data structure for snapshots

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487450#comment-13487450 ] Suresh Srinivas commented on HDFS-4125: --- Todd, please look at the latest design docum

[jira] [Updated] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2802: -- Attachment: Snapshots20121030.pdf Attaching the updated design document. Hopefully it addresses

[jira] [Commented] (HDFS-4129) Add utility methods to dump NameNode in memory tree for testing

2012-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487429#comment-13487429 ] Hadoop QA commented on HDFS-4129: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4128) 2NN gets stuck in inconsistent state if edit log replay fails in the middle

2012-10-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487392#comment-13487392 ] Colin Patrick McCabe commented on HDFS-4128: Aborting definitely seems like the

[jira] [Updated] (HDFS-4129) Add utility methods to dump NameNode in memory tree for testing

2012-10-30 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4129: - Attachment: h4129_20121030.patch h4129_20121030.patch: add some format checks.

[jira] [Resolved] (HDFS-3923) libwebhdfs testing code cleanup

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-3923. --- Resolution: Fixed Fix Version/s: 2.0.3-alpha 3.0.0 Hadoop Flags:

[jira] [Commented] (HDFS-3923) libwebhdfs testing code cleanup

2012-10-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487358#comment-13487358 ] Suresh Srinivas commented on HDFS-3923: --- +1 for the patch. I committed it to trunk.

[jira] [Commented] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487304#comment-13487304 ] Hadoop QA commented on HDFS-3804: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-1331) dfs -test should work like /bin/test

2012-10-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-1331: Attachment: hdfs1331-2.txt New patch: Update usage message, remove debug println.

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-30 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487247#comment-13487247 ] Eli Collins commented on HDFS-3990: --- I missed that you switched to a List because we're c

[jira] [Created] (HDFS-4131) Add a tool to print the diff between two snapshots and diff of a snapshot from the current tree

2012-10-30 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-4131: - Summary: Add a tool to print the diff between two snapshots and diff of a snapshot from the current tree Key: HDFS-4131 URL: https://issues.apache.org/jira/browse/HDFS-4131

[jira] [Commented] (HDFS-4105) the SPNEGO user for secondary namenode should use the web keytab

2012-10-30 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487237#comment-13487237 ] Arpit Gupta commented on HDFS-4105: --- patched a secure hadoop 1.1.0 deploy with the patch

[jira] [Commented] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487233#comment-13487233 ] Hudson commented on HDFS-3809: -- Integrated in Hadoop-trunk-Commit #2944 (See [https://builds.

[jira] [Commented] (HDFS-3789) JournalManager#format() should be able to throw IOException

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487232#comment-13487232 ] Hudson commented on HDFS-3789: -- Integrated in Hadoop-trunk-Commit #2944 (See [https://builds.

[jira] [Commented] (HDFS-3923) libwebhdfs testing code cleanup

2012-10-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487231#comment-13487231 ] Andy Isaacson commented on HDFS-3923: - The .002.patch looks good to me. In the spirit

[jira] [Commented] (HDFS-3923) libwebhdfs testing code cleanup

2012-10-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487227#comment-13487227 ] Andy Isaacson commented on HDFS-3923: - Sorry, user error on my part -- the files are di

[jira] [Commented] (HDFS-3923) libwebhdfs testing code cleanup

2012-10-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487223#comment-13487223 ] Andy Isaacson commented on HDFS-3923: - The new .002.patch seems to be the same file as

[jira] [Commented] (HDFS-4104) dfs -test -d prints inappropriate error on nonexistent directory

2012-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487218#comment-13487218 ] Hadoop QA commented on HDFS-4104: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-3809: - Attachment: 0001-HDFS-3809.-Make-BKJM-use-protobufs-for-all-serializa.patch ah, I had generated from what

[jira] [Resolved] (HDFS-3822) TestWebHDFS fails intermittently with NullPointerException

2012-10-30 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trevor Robinson resolved HDFS-3822. --- Resolution: Duplicate Release Note: Yes, this probably is a duplicate of HDFS-3664. The s

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-3809: -- Resolution: Fixed Target Version/s: 2.0.1-alpha, 3.0.0 (was: 3.0.0, 2.0.1-alph

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487171#comment-13487171 ] Sanjay Radia commented on HDFS-3960: I assumed that it was an optional parameter. In a

[jira] [Commented] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487160#comment-13487160 ] Uma Maheswara Rao G commented on HDFS-3809: --- ok, Adding '+package hadoop.hdfs;' f

[jira] [Updated] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-10-30 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trevor Robinson updated HDFS-3804: -- Attachment: HDFS-3804-3.patch Works for me, though I'd also make {{hdfs}} non-static.

[jira] [Updated] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-10-30 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trevor Robinson updated HDFS-3804: -- Status: Patch Available (was: Open) > TestHftpFileSystem fails intermittently with JDK7 > -

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487155#comment-13487155 ] Todd Lipcon commented on HDFS-3960: --- We can't pass the length (ie call fsync()) on every

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487141#comment-13487141 ] Sanjay Radia commented on HDFS-3960: bq. Would it be useful to pass file length from t

[jira] [Commented] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487137#comment-13487137 ] Ivan Kelly commented on HDFS-3809: -- HDFS-4121 caused this. New patch attached.

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-3809: - Target Version/s: 2.0.1-alpha, 3.0.0 (was: 3.0.0, 2.0.1-alpha) Status: Patch Available (was

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-3809: - Attachment: 0001-HDFS-3809.-Make-BKJM-use-protobufs-for-all-serializa.patch > Make BKJM use protobufs

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487135#comment-13487135 ] Hadoop QA commented on HDFS-3990: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4104) dfs -test -d prints inappropriate error on nonexistent directory

2012-10-30 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4104: Attachment: hdfs4104-3.txt Update TestHDFSCLI for new -test output semantics. > dfs

[jira] [Commented] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487100#comment-13487100 ] Uma Maheswara Rao G commented on HDFS-3809: --- Yes, Robert I just compared, they bo

[jira] [Commented] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487094#comment-13487094 ] Robert Joseph Evans commented on HDFS-3809: --- Thanks for doing that Uma. It looks

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487085#comment-13487085 ] Konstantin Shvachko commented on HDFS-3960: --- More strongly I consider it a bug th

[jira] [Commented] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487075#comment-13487075 ] Uma Maheswara Rao G commented on HDFS-3809: --- Thanks Robert. I will check this for

[jira] [Updated] (HDFS-3923) libwebhdfs testing code cleanup

2012-10-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3923: Attachment: HDFS-3923.002.patch Updated the patch. > libwebhdfs testing code cleanup >

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487060#comment-13487060 ] Aaron T. Myers commented on HDFS-3960: -- bq. The document proposes to add new functiona

[jira] [Reopened] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans reopened HDFS-3809: --- Branch-2 is failing with {noformat} main: [exec] bkjournal.proto:30:12: "NamespaceIn

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Attachment: HDFS-3990.patch > NN's health report has severe performance problems > -

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Status: Patch Available (was: Open) I reverted method signature to returning an array instead of a list

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Attachment: HDFS-3990.branch-0.23.patch > NN's health report has severe performance problems > -

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487033#comment-13487033 ] Konstantin Shvachko commented on HDFS-3960: --- The document proposes to add new fun

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Status: Open (was: Patch Available) > NN's health report has severe performance problems >

[jira] [Commented] (HDFS-3810) Implement format() for BKJM

2012-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487027#comment-13487027 ] Hadoop QA commented on HDFS-3810: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487023#comment-13487023 ] Konstantin Shvachko commented on HDFS-2802: --- By rolling version on demand I just

[jira] [Updated] (HDFS-3810) Implement format() for BKJM

2012-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-3810: -- Attachment: HDFS-3810.diff +1 for the patch. re-attaching it for clean jenkins report.

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-3809: -- Resolution: Fixed Target Version/s: 2.0.1-alpha, 3.0.0 (was: 3.0.0, 2.0.1-alph

[jira] [Commented] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486998#comment-13486998 ] Uma Maheswara Rao G commented on HDFS-3809: --- I have just updated CHANGES.txt for

[jira] [Commented] (HDFS-3695) Genericize format() to non-file JournalManagers

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486981#comment-13486981 ] Hudson commented on HDFS-3695: -- Integrated in Hadoop-trunk-Commit #2943 (See [https://builds.

[jira] [Commented] (HDFS-3573) Supply NamespaceInfo when instantiating JournalManagers

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486979#comment-13486979 ] Hudson commented on HDFS-3573: -- Integrated in Hadoop-trunk-Commit #2943 (See [https://builds.

[jira] [Commented] (HDFS-4013) TestHftpURLTimeouts throws NPE

2012-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486941#comment-13486941 ] Hadoop QA commented on HDFS-4013: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-10-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3804: -- Attachment: HDFS-3804.patch Could you please test this minimal patch? > TestHftpFileSys

[jira] [Updated] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-10-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3804: -- Status: Open (was: Patch Available) > TestHftpFileSystem fails intermittently with JDK7 > -

[jira] [Commented] (HDFS-1331) dfs -test should work like /bin/test

2012-10-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486907#comment-13486907 ] Daryn Sharp commented on HDFS-1331: --- Looks good, but please update the usage and remove t

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-30 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486894#comment-13486894 ] Daryn Sharp commented on HDFS-4056: --- A few clarifications: Starting the daemon thread doe

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486885#comment-13486885 ] Hudson commented on HDFS-4127: -- Integrated in Hadoop-Mapreduce-trunk #1241 (See [https://buil

[jira] [Commented] (HDFS-4122) Cleanup HDFS logs and reduce the size of logged messages

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486883#comment-13486883 ] Hudson commented on HDFS-4122: -- Integrated in Hadoop-Mapreduce-trunk #1241 (See [https://buil

[jira] [Commented] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486884#comment-13486884 ] Hudson commented on HDFS-4124: -- Integrated in Hadoop-Mapreduce-trunk #1241 (See [https://buil

[jira] [Updated] (HDFS-4013) TestHftpURLTimeouts throws NPE

2012-10-30 Thread Chao Shi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Shi updated HDFS-4013: --- Assignee: Chao Shi Status: Patch Available (was: Open) > TestHftpURLTimeouts throws NPE > -

[jira] [Updated] (HDFS-4013) TestHftpURLTimeouts throws NPE

2012-10-30 Thread Chao Shi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Shi updated HDFS-4013: --- Attachment: hdfs-4013.patch add assertNotNull to prevent throwing NPE on failure > TestHftpUR

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486847#comment-13486847 ] Hudson commented on HDFS-4127: -- Integrated in Hadoop-Hdfs-trunk #1211 (See [https://builds.ap

[jira] [Commented] (HDFS-4122) Cleanup HDFS logs and reduce the size of logged messages

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486845#comment-13486845 ] Hudson commented on HDFS-4122: -- Integrated in Hadoop-Hdfs-trunk #1211 (See [https://builds.ap

[jira] [Commented] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486846#comment-13486846 ] Hudson commented on HDFS-4124: -- Integrated in Hadoop-Hdfs-trunk #1211 (See [https://builds.ap

[jira] [Commented] (HDFS-4127) Log message is not correct in case of short of replica

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486794#comment-13486794 ] Hudson commented on HDFS-4127: -- Integrated in Hadoop-Yarn-trunk #21 (See [https://builds.apac

[jira] [Commented] (HDFS-4124) Refactor INodeDirectory#getExistingPathINodes() to enable returning more than INode array

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486793#comment-13486793 ] Hudson commented on HDFS-4124: -- Integrated in Hadoop-Yarn-trunk #21 (See [https://builds.apac

[jira] [Commented] (HDFS-4122) Cleanup HDFS logs and reduce the size of logged messages

2012-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486792#comment-13486792 ] Hudson commented on HDFS-4122: -- Integrated in Hadoop-Yarn-trunk #21 (See [https://builds.apac

[jira] [Commented] (HDFS-3908) In HA mode, when there is a ledger in BK missing, which is generated after the last checkpoint, NN can not restore it.

2012-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486781#comment-13486781 ] Uma Maheswara Rao G commented on HDFS-3908: --- I think this is general problem in H

[jira] [Commented] (HDFS-4101) ZKFC should implement zookeeper.recovery.retry like HBase to connect to ZooKeeper

2012-10-30 Thread Damien Hardy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486767#comment-13486767 ] Damien Hardy commented on HDFS-4101: I tried something like that but as an non java dev

[jira] [Updated] (HDFS-4130) The reading for editlog at NN starting using bkjm is not efficient

2012-10-30 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-4130: -- Issue Type: Sub-task (was: Improvement) Parent: HDFS-3399 > The reading for

[jira] [Updated] (HDFS-4130) The reading for editlog at NN starting using bkjm is not efficient

2012-10-30 Thread Han Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Han Xiao updated HDFS-4130: --- Description: Now, the method of BookKeeperJournalManager.selectInputStreams is written like: while (true)

[jira] [Updated] (HDFS-4130) The reading for editlog at NN starting using bkjm is not efficient

2012-10-30 Thread Han Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Han Xiao updated HDFS-4130: --- Description: Now, the method of BookKeeperJournalManager.selectInputStreams is written like: while (true)

[jira] [Updated] (HDFS-4130) The reading for editlog at NN starting using bkjm is not efficient

2012-10-30 Thread Han Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Han Xiao updated HDFS-4130: --- Attachment: HDFS-4130.patch patch available > The reading for editlog at NN starting using bk

[jira] [Updated] (HDFS-4130) The reading for editlog at NN starting using bkjm is not efficient

2012-10-30 Thread Han Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Han Xiao updated HDFS-4130: --- Status: Open (was: Patch Available) Not find the option to submit the patch? > The reading f

[jira] [Updated] (HDFS-4130) The reading for editlog at NN starting using bkjm is not efficient

2012-10-30 Thread Han Xiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Han Xiao updated HDFS-4130: --- Target Version/s: 2.0.2-alpha Status: Patch Available (was: Open) > The reading for editlog

[jira] [Created] (HDFS-4130) The reading for editlog at NN starting using bkjm is not efficient

2012-10-30 Thread Han Xiao (JIRA)
Han Xiao created HDFS-4130: -- Summary: The reading for editlog at NN starting using bkjm is not efficient Key: HDFS-4130 URL: https://issues.apache.org/jira/browse/HDFS-4130 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-3507) DFS#isInSafeMode needs to execute only on Active NameNode

2012-10-30 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486751#comment-13486751 ] Vinay commented on HDFS-3507: - Ah! I just realize that, intention of this Jira is to get safemo

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486723#comment-13486723 ] Konstantin Shvachko commented on HDFS-4114: --- Yes I do use BackupNode. -1 on this

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486705#comment-13486705 ] Aaron T. Myers commented on HDFS-3960: -- Hi Konstantin, I agree that a solution like yo

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486701#comment-13486701 ] Aaron T. Myers commented on HDFS-2802: -- Hi Konstantin, if I correctly understand what

[jira] [Commented] (HDFS-3980) NPE in HttpURLConnection.java while starting SecondaryNameNode.

2012-10-30 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486702#comment-13486702 ] Aaron T. Myers commented on HDFS-3980: -- bq. i) Even If we configure IP, It should be r

[jira] [Updated] (HDFS-4118) Change INodeDirectory.getExistingPathINodes(..) to work with snapshots

2012-10-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4118: Attachment: HDFS-4118.001.patch Patch uploaded. The current patch also contains several testcases to test g

[jira] [Commented] (HDFS-3507) DFS#isInSafeMode needs to execute only on Active NameNode

2012-10-30 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13486697#comment-13486697 ] Vinay commented on HDFS-3507: - Thanks aaron, Your suggestion looks good. I will post a patch so