[jira] [Commented] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2015-05-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529313#comment-14529313 ] Chris Nauroth commented on HDFS-5223: - Hi [~atm]. bq. Seems like this approach would c

[jira] [Updated] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2015-05-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5223: Attachment: HDFS-5223.005.patch > Allow edit log/fsimage format changes without changing layout versi

[jira] [Updated] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2015-05-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5223: Attachment: HDFS-5223-HDFS-Downgrade-Extended-Support.pdf I've been testing a patch based on Sanjay's

[jira] [Updated] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-05-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8290: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-4368) Backport HDFS-3553 (hftp proxy tokens) to branch-1

2015-05-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4368: Assignee: (was: Chris Nauroth) I'm unassigning the issue since I'm no longer actively working on

[jira] [Commented] (HDFS-7739) ZKFC - transitionToActive is indefinitely waiting to complete fenceOldActive

2015-04-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522710#comment-14522710 ] Chris Nauroth commented on HDFS-7739: - Hi [~brahmareddy]. From the stack trace, it loo

[jira] [Commented] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-04-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522700#comment-14522700 ] Chris Nauroth commented on HDFS-8290: - The test failures and findbugs warning have been

[jira] [Commented] (HDFS-8161) Both Namenodes are in standby State

2015-04-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521718#comment-14521718 ] Chris Nauroth commented on HDFS-8161: - [~brahmareddy], this is excellent debugging. Th

[jira] [Commented] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520990#comment-14520990 ] Chris Nauroth commented on HDFS-8290: - The Findbugs warning is in an unrelated part of

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520986#comment-14520986 ] Chris Nauroth commented on HDFS-8283: - These test failures might be related too: https

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520934#comment-14520934 ] Chris Nauroth commented on HDFS-8283: - It seems this patch introduced a findbugs warnin

[jira] [Updated] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8290: Status: Patch Available (was: Open) > WebHDFS calls before namesystem initialization can cause NullP

[jira] [Updated] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8290: Attachment: HDFS-8290.001.patch I'm attaching a patch that adds a null check and a test. > WebHDFS c

[jira] [Created] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-04-29 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-8290: --- Summary: WebHDFS calls before namesystem initialization can cause NullPointerException. Key: HDFS-8290 URL: https://issues.apache.org/jira/browse/HDFS-8290 Project: Had

[jira] [Updated] (HDFS-8232) Missing datanode counters when using Metrics2 sink interface

2015-04-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8232: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8232) Missing datanode counters when using Metrics2 sink interface

2015-04-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514859#comment-14514859 ] Chris Nauroth commented on HDFS-8232: - Thank you, Anu. +1 for patch v002 pending Jenki

[jira] [Commented] (HDFS-8232) Missing datanode counters when using Metrics2 sink interface

2015-04-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514470#comment-14514470 ] Chris Nauroth commented on HDFS-8232: - Hi [~anu]. The patch looks great. I have just

[jira] [Updated] (HDFS-8247) TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing

2015-04-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8247: Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 (was: 2.7.1)

[jira] [Commented] (HDFS-8231) StackTrace displayed at client while QuotaByStorageType exceeds

2015-04-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512647#comment-14512647 ] Chris Nauroth commented on HDFS-8231: - For some reason, this patch didn't get a Jenkins

[jira] [Resolved] (HDFS-8252) Fix test case failure in org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate.testAppendOverTypeQuota

2015-04-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-8252. - Resolution: Duplicate > Fix test case failure in > org.apache.hadoop.hdfs.server.namenode.TestDisk

[jira] [Commented] (HDFS-8252) Fix test case failure in org.apache.hadoop.hdfs.server.namenode.TestDiskspaceQuotaUpdate.testAppendOverTypeQuota

2015-04-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512646#comment-14512646 ] Chris Nauroth commented on HDFS-8252: - HDFS-8247 was filed yesterday to track this fail

[jira] [Commented] (HDFS-8232) Missing datanode counters when using Metrics2 sink interface

2015-04-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512644#comment-14512644 ] Chris Nauroth commented on HDFS-8232: - I've submitted a new Jenkins run. https://build

[jira] [Updated] (HDFS-8232) Missing datanode counters when using Metrics2 sink interface

2015-04-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8232: Component/s: (was: HDFS) datanode Target Version/s: 2.8.0 (was: 2.

[jira] [Updated] (HDFS-8250) Create HDFS bindings for java.nio.file.FileSystem

2015-04-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8250: Component/s: hdfs-client Target Version/s: 2.8.0 Issue Type: New Feature (was: Imp

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

2015-04-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14511949#comment-14511949 ] Chris Nauroth commented on HDFS-7858: - This is very interesting. Thanks for working on

[jira] [Commented] (HDFS-8231) StackTrace displayed at client while QuotaByStorageType exceeds

2015-04-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510591#comment-14510591 ] Chris Nauroth commented on HDFS-8231: - +1 from me also. [~andreina], thank you for rep

[jira] [Commented] (HDFS-8231) StackTrace displayed at client while QuotaByStorageType exceeds

2015-04-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509383#comment-14509383 ] Chris Nauroth commented on HDFS-8231: - [~andreina], thank you for reporting the bug. T

[jira] [Issue Comment Deleted] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8211: Comment: was deleted (was: [~aw] would you like to take a look at this to see if this is related to

[jira] [Commented] (HDFS-8194) Add administrative tool to be able to examine the NN's view of DN storages

2015-04-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505748#comment-14505748 ] Chris Nauroth commented on HDFS-8194: - There could be some potential overlap here with

[jira] [Commented] (HDFS-7005) DFS input streams do not timeout

2015-04-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505722#comment-14505722 ] Chris Nauroth commented on HDFS-7005: - Hi [~ndimiduk]. I'm not aware of any plans for

[jira] [Commented] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-04-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505402#comment-14505402 ] Chris Nauroth commented on HDFS-8193: - bq. Seems to me these metrics differ for each DN

[jira] [Commented] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-04-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505364#comment-14505364 ] Chris Nauroth commented on HDFS-8193: - Thank you for the response. That clarifies it f

[jira] [Commented] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-04-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504269#comment-14504269 ] Chris Nauroth commented on HDFS-8193: - Hello [~atm] and [~zhz]. HDFS-6186 added the {

[jira] [Updated] (HDFS-5995) TestFSEditLogLoader#testValidateEditLogWithCorruptBody gets OutOfMemoryError and dumps heap.

2015-04-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5995: Resolution: Duplicate Status: Resolved (was: Patch Available) > TestFSEditLogLoader#testVali

[jira] [Commented] (HDFS-5995) TestFSEditLogLoader#testValidateEditLogWithCorruptBody gets OutOfMemoryError and dumps heap.

2015-04-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498597#comment-14498597 ] Chris Nauroth commented on HDFS-5995: - This is no longer happening. I'm resolving this

[jira] [Commented] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-04-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498544#comment-14498544 ] Chris Nauroth commented on HDFS-8164: - I don't think this bug causes any significant im

[jira] [Updated] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-04-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8164: Description: After formatting a NameNode and inspecting its VERSION file, the cTime property shows 0.

[jira] [Created] (HDFS-8164) cTime is 0 in VERSION file for newly formatted NameNode.

2015-04-16 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-8164: --- Summary: cTime is 0 in VERSION file for newly formatted NameNode. Key: HDFS-8164 URL: https://issues.apache.org/jira/browse/HDFS-8164 Project: Hadoop HDFS Issu

[jira] [Commented] (HDFS-8132) Namenode Startup Failing When we add Jcarder.jar in class Path

2015-04-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14494847#comment-14494847 ] Chris Nauroth commented on HDFS-8132: - Hello [~brahmareddy]. I don't really know anyth

[jira] [Updated] (HDFS-8055) NullPointerException when topology script is missing.

2015-04-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8055: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-: Release Note: NameNode and DataNode now abort during startup if attempting to run in secure mode, but

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-: Affects Version/s: (was: 2.5.0) (was: 3.0.0) 2.7

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-: Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 (was: 3.0.0, 2.6.0)

[jira] [Updated] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-: Target Version/s: 2.6.0, 3.0.0 (was: 3.0.0, 2.6.0) Hadoop Flags: Reviewed +1 for patch v005.

[jira] [Commented] (HDFS-8055) NullPointerException when topology script is missing.

2015-04-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491194#comment-14491194 ] Chris Nauroth commented on HDFS-8055: - Patch v002 looks good. I have just one more sma

[jira] [Updated] (HDFS-7933) fsck should also report decommissioning replicas.

2015-04-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7933: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7933) fsck should also report decommissioning replicas.

2015-04-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7933: Issue Type: Improvement (was: Bug) > fsck should also report decommissioning replicas. > --

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491182#comment-14491182 ] Chris Nauroth commented on HDFS-: - Thanks for the update, Vijay. I have just a few

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14488282#comment-14488282 ] Chris Nauroth commented on HDFS-: - Thank you for making the suggested changes in th

[jira] [Commented] (HDFS-7933) fsck should also report decommissioning replicas.

2015-04-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14488277#comment-14488277 ] Chris Nauroth commented on HDFS-7933: - It looks like that test run got hurt by some of

[jira] [Updated] (HDFS-7933) fsck should also report decommissioning replicas.

2015-04-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7933: Target Version/s: 2.8.0 +1 for patch v03 pending Jenkins. Thanks for incorporating the feedback. I'

[jira] [Commented] (HDFS-8055) NullPointerException when topology script is missing.

2015-04-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14488202#comment-14488202 ] Chris Nauroth commented on HDFS-8055: - Hi Anu. Nice work tracking down this bug. The

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486180#comment-14486180 ] Chris Nauroth commented on HDFS-: - Thank you for the patch, [~vijaysbhat]. It's no

[jira] [Commented] (HDFS-7933) fsck should also report decommissioning replicas.

2015-04-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14485837#comment-14485837 ] Chris Nauroth commented on HDFS-7933: - Hi Xiaoyu. This patch looks good. Here are a f

[jira] [Updated] (HDFS-8072) Reserved RBW space is not released if client terminates while writing block

2015-04-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8072: Hadoop Flags: Reviewed +1 for the patch. I confirmed that the new test fails before applying the bug

[jira] [Updated] (HDFS-8038) PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format.

2015-04-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8038: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8038) PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format.

2015-04-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14481379#comment-14481379 ] Chris Nauroth commented on HDFS-8038: - Yes, I see your point about root. Can we please

[jira] [Commented] (HDFS-8038) PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format.

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14395142#comment-14395142 ] Chris Nauroth commented on HDFS-8038: - Thanks for the updated patch, Xiaoyu. I was thi

[jira] [Commented] (HDFS-6917) Add an hdfs debug command to validate blocks, call recoverlease, etc.

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394774#comment-14394774 ] Chris Nauroth commented on HDFS-6917: - I just committed HDFS-8039, which is a follow-on

[jira] [Updated] (HDFS-8039) Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8039: Component/s: test > Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on > Wind

[jira] [Updated] (HDFS-8039) Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8039: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8038: Component/s: tools Target Version/s: 2.7.0 > Fix TestOfflineImageViewer#testPBDelimitedWrite

[jira] [Commented] (HDFS-6673) Add delimited format support to PB OIV tool

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394742#comment-14394742 ] Chris Nauroth commented on HDFS-6673: - I suspect this does not work correctly on Window

[jira] [Commented] (HDFS-8038) Fix TestOfflineImageViewer#testPBDelimitedWriter on Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394737#comment-14394737 ] Chris Nauroth commented on HDFS-8038: - Hi Xiaoyu. I wonder if this one is actually a p

[jira] [Updated] (HDFS-8034) Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8034: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) +1

[jira] [Updated] (HDFS-8034) Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8034: Target Version/s: 2.8.0 (was: 2.7.0) > Fix > TestDFSClientRetries#testDFSClientConfigurationLocateF

[jira] [Updated] (HDFS-8034) Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8034: Component/s: test Target Version/s: 2.7.0 Hadoop Flags: Reviewed > Fix > TestDFSCli

[jira] [Commented] (HDFS-8060) org.apache.hadoop.fs.FileUtil.copyMerge should merge all files in recursive sub directories

2015-04-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14394591#comment-14394591 ] Chris Nauroth commented on HDFS-8060: - Hello, [~kachau]. Thank you for filing the issu

[jira] [Comment Edited] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391651#comment-14391651 ] Chris Nauroth edited comment on HDFS-8008 at 4/1/15 10:45 PM: --

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391651#comment-14391651 ] Chris Nauroth commented on HDFS-8008: - The test failure is unrelated and tracked separa

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391350#comment-14391350 ] Chris Nauroth commented on HDFS-8008: - +1 for patch v003 pending Jenkins. Thanks again

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391216#comment-14391216 ] Chris Nauroth commented on HDFS-8008: - v2 looks good. There is just one more little pr

[jira] [Commented] (HDFS-8008) Support client-side back off when the datanodes are congested

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391137#comment-14391137 ] Chris Nauroth commented on HDFS-8008: - This patch looks good, Haohui. I have just a fe

[jira] [Commented] (HDFS-8009) Signal congestion on the DataNode

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391066#comment-14391066 ] Chris Nauroth commented on HDFS-8009: - The test failure appears to be unrelated. It pa

[jira] [Updated] (HDFS-8009) Signal congestion on the DataNode

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8009: Component/s: datanode Hadoop Flags: Reviewed +1 for the patch. Thank you, Haohui. > Signal con

[jira] [Commented] (HDFS-6666) Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.

2015-04-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391003#comment-14391003 ] Chris Nauroth commented on HDFS-: - Actually, I've been meaning to propose that we r

[jira] [Commented] (HDFS-8011) standby nn can't started

2015-03-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386886#comment-14386886 ] Chris Nauroth commented on HDFS-8011: - Hello [~yzhangal]. Do you think this looks like

[jira] [Commented] (HDFS-8000) Potential deadlock #HeartbeatManager

2015-03-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14384225#comment-14384225 ] Chris Nauroth commented on HDFS-8000: - Hi [~brahmareddy]. I looked at the jstack outpu

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-03-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14380738#comment-14380738 ] Chris Nauroth commented on HDFS-7984: - Hi Allen. It's unclear to me what this issue is

[jira] [Created] (HDFS-7988) Replace usage of ExactSizeInputStream with LimitInputStream.

2015-03-24 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7988: --- Summary: Replace usage of ExactSizeInputStream with LimitInputStream. Key: HDFS-7988 URL: https://issues.apache.org/jira/browse/HDFS-7988 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7917) Use file to replace data dirs in test to simulate a disk failure.

2015-03-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7917: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-7917) Use file to replace data dirs in test to simulate a disk failure.

2015-03-23 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14376246#comment-14376246 ] Chris Nauroth commented on HDFS-7917: - Hi [~eddyxu]. Thank you for the patch. Unfortu

[jira] [Commented] (HDFS-7917) Use file to replace data dirs in test to simulate a disk failure.

2015-03-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371860#comment-14371860 ] Chris Nauroth commented on HDFS-7917: - Hi [~eddyxu]. I think this patch needs to be re

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14371675#comment-14371675 ] Chris Nauroth commented on HDFS-7748: - Thanks for the revised patch, Anu. I have just

[jira] [Commented] (HDFS-7833) DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370321#comment-14370321 ] Chris Nauroth commented on HDFS-7833: - Hi [~eddyxu]. Thank you for the patch. Overall

[jira] [Commented] (HDFS-7453) Namenode does not recognize block is missing on a datanode

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369864#comment-14369864 ] Chris Nauroth commented on HDFS-7453: - HDFS-7208 does look like a plausible explanation

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369852#comment-14369852 ] Chris Nauroth commented on HDFS-7748: - Oops, I meant to say that the indentation needs

[jira] [Commented] (HDFS-7815) Loop on 'blocks does not belong to any file'

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369836#comment-14369836 ] Chris Nauroth commented on HDFS-7815: - Hi, [~frha]. You can add this line to your log4

[jira] [Commented] (HDFS-7748) Separate ECN flags from the Status in the DataTransferPipelineAck

2015-03-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369817#comment-14369817 ] Chris Nauroth commented on HDFS-7748: - Hi Anu. This patch looks mostly good to me. He

[jira] [Commented] (HDFS-7938) OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac

2015-03-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364488#comment-14364488 ] Chris Nauroth commented on HDFS-7938: - Hello, [~kiranmr]. Are you interested in taking

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361281#comment-14361281 ] Chris Nauroth commented on HDFS-7915: - Thanks, Colin. I had missed that the first time

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14361218#comment-14361218 ] Chris Nauroth commented on HDFS-7915: - I'm repeating my earlier comment in case it got

[jira] [Commented] (HDFS-7915) The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error

2015-03-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357693#comment-14357693 ] Chris Nauroth commented on HDFS-7915: - Thanks for the patch, Colin. The change looks g

[jira] [Updated] (HDFS-7491) Add incremental blockreport latency to DN metrics

2015-03-11 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7491: Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7722: Hadoop Flags: Reviewed +1 for the patch from me. It looks like this version addresses Colin's last

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-09 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353605#comment-14353605 ] Chris Nauroth commented on HDFS-7722: - Eddy, it looks good. I have just one minor nit.

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-03-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351167#comment-14351167 ] Chris Nauroth commented on HDFS-7722: - [~eddyxu], sorry I haven't had a chance to dig i

[jira] [Commented] (HDFS-7896) HDFS Slow disk detection

2015-03-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350697#comment-14350697 ] Chris Nauroth commented on HDFS-7896: - bq. Chris Nauroth recently added failed volume r

[jira] [Commented] (HDFS-7895) open and getFileInfo APIs treat paths inconsistently wrt protocol

2015-03-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349604#comment-14349604 ] Chris Nauroth commented on HDFS-7895: - Yes, I also wanted to add that {{FileSystem#getF

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349599#comment-14349599 ] Chris Nauroth commented on HDFS-7836: - The thing we're losing is the ability to measure

<    3   4   5   6   7   8   9   10   11   12   >