[jira] [Commented] (HDFS-4504) DFSOutputStream#close doesn't always release resources (such as leases)

2013-08-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739288#comment-13739288 ] Vinay commented on HDFS-4504: - bq. It seems to me like it would be better to call

[jira] [Commented] (HDFS-4504) DFSOutputStream#close doesn't always release resources (such as leases)

2013-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739293#comment-13739293 ] Colin Patrick McCabe commented on HDFS-4504: I don't think adding a new RPC

[jira] [Updated] (HDFS-3618) SSH fencing option may incorrectly succeed if nc (netcat) command not present

2013-08-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-3618: Attachment: HDFS-3618.patch Updated test SSH fencing option may incorrectly succeed if nc

[jira] [Commented] (HDFS-3618) SSH fencing option may incorrectly succeed if nc (netcat) command not present

2013-08-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739326#comment-13739326 ] Vinay commented on HDFS-3618: - Findbug and javadoc warnings are unrelated. I am seeing these on

[jira] [Commented] (HDFS-5051) Propagate cache status information from the DataNode to the NameNode

2013-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739343#comment-13739343 ] Colin Patrick McCabe commented on HDFS-5051: The random jitter code was taken

[jira] [Commented] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2013-08-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739356#comment-13739356 ] Vinay commented on HDFS-2882: - bq. Did you reproduce the problem? If so, what were the steps to

[jira] [Created] (HDFS-5094) Add Metrics in DFSClient

2013-08-14 Thread LiuLei (JIRA)
LiuLei created HDFS-5094: Summary: Add Metrics in DFSClient Key: HDFS-5094 URL: https://issues.apache.org/jira/browse/HDFS-5094 Project: Hadoop HDFS Issue Type: Task Components:

[jira] [Updated] (HDFS-5094) Add Metrics in DFSClient

2013-08-14 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiuLei updated HDFS-5094: - Attachment: DFSCLientMetrics.patch Add Metrics in DFSClient Key:

[jira] [Commented] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

2013-08-14 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739367#comment-13739367 ] Tao Luo commented on HDFS-5079: --- Replacing NNHAStatusHeartbeat.State with HAServiceState

[jira] [Updated] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

2013-08-14 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo updated HDFS-5079: -- Attachment: HDFS-5079.patch Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

[jira] [Assigned] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

2013-08-14 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo reassigned HDFS-5079: - Assignee: Tao Luo Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

[jira] [Created] (HDFS-5095) Using JournalNode IP as name of IPCLoggerChannel metrics record

2013-08-14 Thread LiuLei (JIRA)
LiuLei created HDFS-5095: Summary: Using JournalNode IP as name of IPCLoggerChannel metrics record Key: HDFS-5095 URL: https://issues.apache.org/jira/browse/HDFS-5095 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-5094) Add Metrics in DFSClient

2013-08-14 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiuLei updated HDFS-5094: - Attachment: IPCLoggerChannelMetrics.java.patch Add Metrics in DFSClient

[jira] [Updated] (HDFS-5094) Add Metrics in DFSClient

2013-08-14 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiuLei updated HDFS-5094: - Attachment: (was: IPCLoggerChannelMetrics.java.patch) Add Metrics in DFSClient

[jira] [Updated] (HDFS-5095) Using JournalNode IP as name of IPCLoggerChannel metrics record

2013-08-14 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiuLei updated HDFS-5095: - Attachment: IPCLoggerChannelMetrics.java.patch Using JournalNode IP as name of IPCLoggerChannel metrics

[jira] [Updated] (HDFS-5095) Using JournalNode IP as name of IPCLoggerChannel metrics record

2013-08-14 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiuLei updated HDFS-5095: - Attachment: metrics.jpg Diagram of one JournalNode in ganglia Using JournalNode IP as name of

[jira] [Updated] (HDFS-5095) Using JournalNode IP as name of IPCLoggerChannel metrics record

2013-08-14 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiuLei updated HDFS-5095: - Attachment: metrics.jpg Using JournalNode IP as name of IPCLoggerChannel metrics record

[jira] [Updated] (HDFS-5095) Using JournalNode IP as name of IPCLoggerChannel metrics record

2013-08-14 Thread LiuLei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LiuLei updated HDFS-5095: - Attachment: (was: metrics.jpg) Using JournalNode IP as name of IPCLoggerChannel metrics record

[jira] [Commented] (HDFS-3618) SSH fencing option may incorrectly succeed if nc (netcat) command not present

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739442#comment-13739442 ] Hadoop QA commented on HDFS-3618: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (HDFS-2933) Datanode index page on debug port not useful

2013-08-14 Thread Vivek Ganesan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ganesan reassigned HDFS-2933: --- Assignee: Vivek Ganesan Datanode index page on debug port not useful

[jira] [Commented] (HDFS-5091) Support for spnego keytab separate from the JournalNode keytab for secure HA

2013-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739519#comment-13739519 ] Hudson commented on HDFS-5091: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #301 (See

[jira] [Commented] (HDFS-5091) Support for spnego keytab separate from the JournalNode keytab for secure HA

2013-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739654#comment-13739654 ] Hudson commented on HDFS-5091: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1491 (See

[jira] [Commented] (HDFS-5091) Support for spnego keytab separate from the JournalNode keytab for secure HA

2013-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739709#comment-13739709 ] Hudson commented on HDFS-5091: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1518 (See

[jira] [Commented] (HDFS-5051) Propagate cache status information from the DataNode to the NameNode

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739707#comment-13739707 ] Suresh Srinivas commented on HDFS-5051: --- bq. The random jitter code was taken from

[jira] [Comment Edited] (HDFS-3755) Creating an already-open-for-write file with overwrite=true fails

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739199#comment-13739199 ] Suresh Srinivas edited comment on HDFS-3755 at 8/14/13 2:33 PM:

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-08-14 Thread John George (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739734#comment-13739734 ] John George commented on HDFS-2832: --- To support Storage Types, each DataNode must be

[jira] [Commented] (HDFS-2882) DN continues to start up, even if block pool fails to initialize

2013-08-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739738#comment-13739738 ] Vinay commented on HDFS-2882: - Hi [~tlipcon], could you take a look at the patch, as the patch

[jira] [Commented] (HDFS-5095) Using JournalNode IP as name of IPCLoggerChannel metrics record

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739744#comment-13739744 ] Suresh Srinivas commented on HDFS-5095: --- Before this change the metrics name is

[jira] [Comment Edited] (HDFS-5095) Using JournalNode IP as name of IPCLoggerChannel metrics record

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739744#comment-13739744 ] Suresh Srinivas edited comment on HDFS-5095 at 8/14/13 3:00 PM:

[jira] [Commented] (HDFS-5076) Create http servlets to enable querying NN's last applied transaction ID and most recent checkpoint's transaction ID

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739767#comment-13739767 ] Suresh Srinivas commented on HDFS-5076: --- Jing, some comments: # In journal status

[jira] [Commented] (HDFS-4946) Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable

2013-08-14 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739790#comment-13739790 ] Harsh J commented on HDFS-4946: --- bq. Allow preferLocalNode in BlockPlacementPolicyDefault to

[jira] [Updated] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

2013-08-14 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo updated HDFS-5079: -- Status: Patch Available (was: Open) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

[jira] [Updated] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

2013-08-14 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5079: - Hadoop Flags: Incompatible change Cleaning up NNHAStatusHeartbeat.State

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-08-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739884#comment-13739884 ] Arpit Agarwal commented on HDFS-2832: - John, {quote}Can the user still specify storage

[jira] [Commented] (HDFS-5087) Allowing specific JAVA heap max setting for HDFS related services

2013-08-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739894#comment-13739894 ] Allen Wittenauer commented on HDFS-5087: Is there a reason this is preferred over

[jira] [Commented] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739961#comment-13739961 ] Hadoop QA commented on HDFS-5079: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

2013-08-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740054#comment-13740054 ] Tsz Wo (Nicholas), SZE commented on HDFS-4898: -- The failure of

[jira] [Commented] (HDFS-5087) Allowing specific JAVA heap max setting for HDFS related services

2013-08-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740103#comment-13740103 ] Kai Zheng commented on HDFS-5087: - In hdfs script, with the following line {code} exec

[jira] [Commented] (HDFS-4949) Centralized cache management in HDFS

2013-08-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740145#comment-13740145 ] Andrew Wang commented on HDFS-4949: --- Hi Arun, On the read path comments, it might be

[jira] [Updated] (HDFS-5076) Create http servlets to enable querying NN's last applied transaction ID and most recent checkpoint's transaction ID

2013-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5076: Attachment: HDFS-5076.004.patch Update the patch to address Suresh's comments: add a new method which takes

[jira] [Updated] (HDFS-5076) Add MXBean methods to query NN's transaction information and JournalNode's journal status

2013-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5076: Description: Currently NameNode already provides RPC calls to get its last applied transaction ID and most

[jira] [Updated] (HDFS-5076) Add MXBean methods to query NN's transaction information and JournalNode's journal status

2013-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5076: Summary: Add MXBean methods to query NN's transaction information and JournalNode's journal status (was:

[jira] [Commented] (HDFS-5051) Propagate cache status information from the DataNode to the NameNode

2013-08-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740166#comment-13740166 ] Andrew Wang commented on HDFS-5051: --- I included the gen stamp and length in the

[jira] [Commented] (HDFS-5055) nn-2nn ignores dfs.namenode.secondary.http-address

2013-08-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740172#comment-13740172 ] Allen Wittenauer commented on HDFS-5055: new patch appears to be working for me as

[jira] [Commented] (HDFS-5051) Propagate cache status information from the DataNode to the NameNode

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740174#comment-13740174 ] Suresh Srinivas commented on HDFS-5051: --- bq. I included the gen stamp and length in

[jira] [Updated] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-08-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4985: Attachment: h4985.02.patch Updated patch per design doc on 2832. Add storage type

[jira] [Commented] (HDFS-5051) Propagate cache status information from the DataNode to the NameNode

2013-08-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740200#comment-13740200 ] Andrew Wang commented on HDFS-5051: --- Gotcha, makes sense. I definitely only wanted to

[jira] [Created] (HDFS-5096) Automatically cache new data added to a cached path

2013-08-14 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-5096: - Summary: Automatically cache new data added to a cached path Key: HDFS-5096 URL: https://issues.apache.org/jira/browse/HDFS-5096 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-3656) ZKFC may write a null breadcrumb znode

2013-08-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3656. --- Resolution: Duplicate Target Version/s: (was: ) Yep, I think you're right. Thanks.

[jira] [Updated] (HDFS-5092) Add support for incremental cache reports

2013-08-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5092: -- Description: The initial {{cacheReport}} patch at HDFS-5051 does frequent full reports of DN cache

[jira] [Commented] (HDFS-2994) If lease is recovered successfully inline with create, create can fail

2013-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740240#comment-13740240 ] Konstantin Shvachko commented on HDFS-2994: --- Liked the approach of the last

[jira] [Commented] (HDFS-4898) BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740247#comment-13740247 ] Suresh Srinivas commented on HDFS-4898: --- +1 for the patch. We should add a unit test

[jira] [Updated] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-08-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4985: Attachment: (was: HDFS-4985.001.patch) Add storage type to the protocol and expose it in

[jira] [Commented] (HDFS-2994) If lease is recovered successfully inline with create, create can fail

2013-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740261#comment-13740261 ] Konstantin Shvachko commented on HDFS-2994: --- I checked your new test case. It

[jira] [Commented] (HDFS-5055) nn-2nn ignores dfs.namenode.secondary.http-address

2013-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740275#comment-13740275 ] Jing Zhao commented on HDFS-5055: - {code} String machine =

[jira] [Assigned] (HDFS-5050) Add DataNode support for mlock and munlock

2013-08-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-5050: - Assignee: Andrew Wang Add DataNode support for mlock and munlock

[jira] [Commented] (HDFS-5076) Add MXBean methods to query NN's transaction information and JournalNode's journal status

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740297#comment-13740297 ] Hadoop QA commented on HDFS-5076: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-2994) If lease is recovered successfully inline with create, create can fail

2013-08-14 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo updated HDFS-2994: -- Attachment: HDFS-2994_4.patch Thanks Konstantin. The newest patch addresses the above two comments.

[jira] [Updated] (HDFS-5055) nn-2nn ignores dfs.namenode.secondary.http-address

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-5055: -- Attachment: HDFS-5055.1.patch Thanks Jing. Here is the updated patch. nn-2nn

[jira] [Commented] (HDFS-5087) Allowing specific JAVA heap max setting for HDFS related services

2013-08-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740337#comment-13740337 ] Allen Wittenauer commented on HDFS-5087: Rather than make something custom for

[jira] [Commented] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740377#comment-13740377 ] Hadoop QA commented on HDFS-4985: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4994) Audit log getContentSummary() calls

2013-08-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740385#comment-13740385 ] Kihwal Lee commented on HDFS-4994: -- I know getListingInt() does it too, but it will be

[jira] [Commented] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-08-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740388#comment-13740388 ] Arpit Agarwal commented on HDFS-4985: - Reattaching correct patch file.

[jira] [Updated] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-08-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4985: Attachment: h4985.02.patch Add storage type to the protocol and expose it in block report and

[jira] [Updated] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-08-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4985: Attachment: (was: h4985.02.patch) Add storage type to the protocol and expose it in block

[jira] [Commented] (HDFS-5087) Allowing specific JAVA heap max setting for HDFS related services

2013-08-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740414#comment-13740414 ] Kai Zheng commented on HDFS-5087: - bq.just process the command line parameters and strip

[jira] [Updated] (HDFS-4816) transitionToActive blocks if the SBN is doing checkpoint image transfer

2013-08-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4816: -- Resolution: Fixed Fix Version/s: 2.3.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-4816) transitionToActive blocks if the SBN is doing checkpoint image transfer

2013-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740428#comment-13740428 ] Hudson commented on HDFS-4816: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4261 (See

[jira] [Updated] (HDFS-4504) DFSOutputStream#close doesn't always release resources (such as leases)

2013-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4504: --- Attachment: HDFS-4504.014.patch DFSOutputStream#close doesn't always release

[jira] [Commented] (HDFS-4504) DFSOutputStream#close doesn't always release resources (such as leases)

2013-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740434#comment-13740434 ] Colin Patrick McCabe commented on HDFS-4504: The latest patch: * when reaping

[jira] [Commented] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

2013-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740453#comment-13740453 ] Konstantin Shvachko commented on HDFS-5079: --- +1 Looks good. No test needed for

[jira] [Commented] (HDFS-5055) nn-2nn ignores dfs.namenode.secondary.http-address

2013-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740452#comment-13740452 ] Jing Zhao commented on HDFS-5055: - The new patch looks pretty good to me. +1.

[jira] [Updated] (HDFS-5076) Add MXBean methods to query NN's transaction information and JournalNode's journal status

2013-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5076: Attachment: HDFS-5076.005.patch After some offline discussion with Suresh, we think a MXBean method

[jira] [Commented] (HDFS-2994) If lease is recovered successfully inline with create, create can fail

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740494#comment-13740494 ] Hadoop QA commented on HDFS-2994: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5055) nn-2nn ignores dfs.namenode.secondary.http-address

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740493#comment-13740493 ] Hadoop QA commented on HDFS-5055: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5055) nn fails to download checkpointed image from snn in some setups

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-5055: -- Summary: nn fails to download checkpointed image from snn in some setups (was: nn-2nn ignores

[jira] [Updated] (HDFS-5055) nn fails to download checkpointed image from snn in some setups

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-5055: -- Resolution: Fixed Fix Version/s: 2.1.1-beta Status: Resolved (was: Patch

[jira] [Created] (HDFS-5097) TestDoAsEffectiveUser can fail on JDK 7

2013-08-14 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5097: Summary: TestDoAsEffectiveUser can fail on JDK 7 Key: HDFS-5097 URL: https://issues.apache.org/jira/browse/HDFS-5097 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-5077) NPE in FSNamesystem.commitBlockSynchronization()

2013-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740512#comment-13740512 ] Konstantin Shvachko commented on HDFS-5077: --- Yes this is pretty rare, but if I

[jira] [Created] (HDFS-5098) Enhance FileSystem.Statistics to have locality information

2013-08-14 Thread Bikas Saha (JIRA)
Bikas Saha created HDFS-5098: Summary: Enhance FileSystem.Statistics to have locality information Key: HDFS-5098 URL: https://issues.apache.org/jira/browse/HDFS-5098 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-5004) Add additional JMX bean for NameNode status data

2013-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740532#comment-13740532 ] Konstantin Shvachko commented on HDFS-5004: --- Cos, you need to move the record

[jira] [Commented] (HDFS-5080) BootstrapStandby not working with QJM when the existing NN is active

2013-08-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740531#comment-13740531 ] Suresh Srinivas commented on HDFS-5080: --- +1 for the patch.

[jira] [Updated] (HDFS-5068) Convert NNThroughputBenchmark to a Tool to allow generic options.

2013-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-5068: -- Resolution: Fixed Fix Version/s: 2.3.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-5080) BootstrapStandby not working with QJM when the existing NN is active

2013-08-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740542#comment-13740542 ] Jing Zhao commented on HDFS-5080: - Thanks for the review, Suresh! I plan to commit this

[jira] [Updated] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

2013-08-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-5079: -- Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Incompatible

[jira] [Commented] (HDFS-4504) DFSOutputStream#close doesn't always release resources (such as leases)

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740546#comment-13740546 ] Hadoop QA commented on HDFS-4504: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4953) enable HDFS local reads via mmap

2013-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740551#comment-13740551 ] Colin Patrick McCabe commented on HDFS-4953: bq. brandon wrote: 1. DFSClient:

[jira] [Commented] (HDFS-5068) Convert NNThroughputBenchmark to a Tool to allow generic options.

2013-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740554#comment-13740554 ] Hudson commented on HDFS-5068: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4262 (See

[jira] [Commented] (HDFS-5051) Propagate cache status information from the DataNode to the NameNode

2013-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740555#comment-13740555 ] Hudson commented on HDFS-5051: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4262 (See

[jira] [Commented] (HDFS-5079) Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos.

2013-08-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740556#comment-13740556 ] Hudson commented on HDFS-5079: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4262 (See

[jira] [Commented] (HDFS-4985) Add storage type to the protocol and expose it in block report and block locations

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740564#comment-13740564 ] Hadoop QA commented on HDFS-4985: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-5099) Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing

2013-08-14 Thread Chuan Liu (JIRA)
Chuan Liu created HDFS-5099: --- Summary: Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing Key: HDFS-5099 URL: https://issues.apache.org/jira/browse/HDFS-5099 Project:

[jira] [Updated] (HDFS-5099) Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing

2013-08-14 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu updated HDFS-5099: Status: Patch Available (was: Open) Namenode#copyEditLogSegmentsToSharedDir should close

[jira] [Updated] (HDFS-5099) Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing

2013-08-14 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu updated HDFS-5099: Attachment: HDFS-5099-trunk.patch Attaching the patch that closes all the streams in the finally clause.

[jira] [Updated] (HDFS-2994) If lease is recovered successfully inline with create, create can fail

2013-08-14 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo updated HDFS-2994: -- Attachment: HDFS-2994_4.patch If lease is recovered successfully inline with create, create can fail

[jira] [Updated] (HDFS-2994) If lease is recovered successfully inline with create, create can fail

2013-08-14 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo updated HDFS-2994: -- Attachment: (was: HDFS-2994_4.patch) If lease is recovered successfully inline with create, create can

[jira] [Commented] (HDFS-5076) Add MXBean methods to query NN's transaction information and JournalNode's journal status

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740602#comment-13740602 ] Hadoop QA commented on HDFS-5076: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4953) enable HDFS local reads via mmap

2013-08-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4953: --- Attachment: HDFS-4953.007.patch new patch version. I added the tests for the cache,

[jira] [Commented] (HDFS-5099) Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing

2013-08-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740644#comment-13740644 ] Hadoop QA commented on HDFS-5099: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5099) Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing

2013-08-14 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740649#comment-13740649 ] Chuan Liu commented on HDFS-5099: - bq. -1 tests included. The patch doesn't appear to

  1   2   >