[jira] [Commented] (HDFS-4154) BKJM: Two namenodes usng bkjm can race to create the version znode

[ https://issues.apache.org/jira/browse/HDFS-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13663962#comment-13663962 ] Han Xiao commented on HDFS-4154: Hi, Uma There has been a testcase for the concurrentFormat

[jira] [Commented] (HDFS-4154) BKJM: Two namenodes usng bkjm can race to create the version znode

[ https://issues.apache.org/jira/browse/HDFS-4154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13663967#comment-13663967 ] Han Xiao commented on HDFS-4154: Sorry for the format before. Hi, Uma There has been a tes

[jira] [Commented] (HDFS-3875) Issue handling checksum errors in write pipeline

[ https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13663996#comment-13663996 ] Hudson commented on HDFS-3875: -- Integrated in Hadoop-Yarn-trunk #217 (See [https://builds.apa

[jira] [Commented] (HDFS-3875) Issue handling checksum errors in write pipeline

[ https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664056#comment-13664056 ] Hudson commented on HDFS-3875: -- Integrated in Hadoop-Hdfs-0.23-Build #615 (See [https://build

[jira] [Commented] (HDFS-3875) Issue handling checksum errors in write pipeline

[ https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664074#comment-13664074 ] Hudson commented on HDFS-3875: -- Integrated in Hadoop-Hdfs-trunk #1406 (See [https://builds.ap

[jira] [Commented] (HDFS-3875) Issue handling checksum errors in write pipeline

[ https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664125#comment-13664125 ] Hudson commented on HDFS-3875: -- Integrated in Hadoop-Mapreduce-trunk #1433 (See [https://buil

[jira] [Commented] (HDFS-4619) No Exception is thrown if we try to create directory using FileContext (create) on RawLocalFileSystem. Even if the directory already exists.

[ https://issues.apache.org/jira/browse/HDFS-4619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664129#comment-13664129 ] Steve Loughran commented on HDFS-4619: -- RawLocalFS could look for the dir existing and

[jira] [Resolved] (HDFS-4619) No Exception is thrown if we try to create directory using FileContext (create) on RawLocalFileSystem. Even if the directory already exists.

[ https://issues.apache.org/jira/browse/HDFS-4619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-4619. -- Resolution: Duplicate > No Exception is thrown if we try to create directory using FileConte

[jira] [Created] (HDFS-4840) ReplicationMonitor gets NPE during shutdown

Kihwal Lee created HDFS-4840: Summary: ReplicationMonitor gets NPE during shutdown Key: HDFS-4840 URL: https://issues.apache.org/jira/browse/HDFS-4840 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-4840) ReplicationMonitor gets NPE during shutdown

[ https://issues.apache.org/jira/browse/HDFS-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664157#comment-13664157 ] Kihwal Lee commented on HDFS-4840: -- Here is a relevant stack trace from the build. {panel

[jira] [Commented] (HDFS-4813) BlocksMap may throw NullPointerException during shutdown

[ https://issues.apache.org/jira/browse/HDFS-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664159#comment-13664159 ] Kihwal Lee commented on HDFS-4813: -- [~gyzj518] Do you think HDFS-4840 is related?

[jira] [Commented] (HDFS-4840) ReplicationMonitor gets NPE during shutdown

[ https://issues.apache.org/jira/browse/HDFS-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664161#comment-13664161 ] Kihwal Lee commented on HDFS-4840: -- Another test case, TestEditLogRace got NPE too while a

[jira] [Updated] (HDFS-4840) ReplicationMonitor and FSEditLogLoader get NPE during shutdown

[ https://issues.apache.org/jira/browse/HDFS-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4840: - Summary: ReplicationMonitor and FSEditLogLoader get NPE during shutdown (was: ReplicationMonitor gets NPE

[jira] [Commented] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664215#comment-13664215 ] Todd Lipcon commented on HDFS-4298: --- Small thing: in the new unit test {{testSelectInputS

[jira] [Commented] (HDFS-4677) Editlog should support synchronous writes

[ https://issues.apache.org/jira/browse/HDFS-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664217#comment-13664217 ] Chris Nauroth commented on HDFS-4677: - +1 for both trunk and branch-1-win patches. Tha

[jira] [Commented] (HDFS-4816) transitionToActive blocks if the SBN is doing checkpoint image transfer

[ https://issues.apache.org/jira/browse/HDFS-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664220#comment-13664220 ] Todd Lipcon commented on HDFS-4816: --- Hey Andrew. I don't see the line "Exception during i

[jira] [Updated] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4298: - Attachment: HDFS-4298.patch Thanks a lot for the review, Todd. Here's a patch which addresses your

[jira] [Created] (HDFS-4841) FsShell commands using webhfds fail ClientFinalizer shutdown hook

Stephen Chu created HDFS-4841: - Summary: FsShell commands using webhfds fail ClientFinalizer shutdown hook Key: HDFS-4841 URL: https://issues.apache.org/jira/browse/HDFS-4841 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4841) FsShell commands using webhfds fail ClientFinalizer shutdown hook

[ https://issues.apache.org/jira/browse/HDFS-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Chu updated HDFS-4841: -- Attachment: jsvc.out hdfs-site.xml hadoop-root-namenode-hdfs-upgrade-pseu

[jira] [Commented] (HDFS-4813) BlocksMap may throw NullPointerException during shutdown

[ https://issues.apache.org/jira/browse/HDFS-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664257#comment-13664257 ] Kihwal Lee commented on HDFS-4813: -- [~jingzhao] Sorry, wrong person was tagged. Jing, it H

[jira] [Commented] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664279#comment-13664279 ] Todd Lipcon commented on HDFS-4298: --- ok, +1 pending Jenkins on the new patch

[jira] [Commented] (HDFS-4840) ReplicationMonitor and FSEditLogLoader get NPE during shutdown

[ https://issues.apache.org/jira/browse/HDFS-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664367#comment-13664367 ] Aaron T. Myers commented on HDFS-4840: -- I've also seen this fail recently during a run

[jira] [Updated] (HDFS-4816) transitionToActive blocks if the SBN is doing checkpoint image transfer

[ https://issues.apache.org/jira/browse/HDFS-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4816: -- Status: Open (was: Patch Available) > transitionToActive blocks if the SBN is doing checkpoint imag

[jira] [Updated] (HDFS-4816) transitionToActive blocks if the SBN is doing checkpoint image transfer

[ https://issues.apache.org/jira/browse/HDFS-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4816: -- Attachment: stacks.out Attaching my jstack output, in case I missed something. I think we don't see an

[jira] [Commented] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664417#comment-13664417 ] Hadoop QA commented on HDFS-4298: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Attachment: 4754.v1.patch > Add an API in the namenode to mark a datanode as stale > ---

[jira] [Updated] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Liochon updated HDFS-4754: -- Status: Patch Available (was: Open) There is a setting to disable it if needed, by configuring

[jira] [Commented] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664439#comment-13664439 ] Aaron T. Myers commented on HDFS-4298: -- TestBookKeeperHACheckpoints is currently faili

[jira] [Updated] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4298: - Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop Flags: Reviewed Status: R

[jira] [Commented] (HDFS-4298) StorageRetentionManager spews warnings when used with QJM

[ https://issues.apache.org/jira/browse/HDFS-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664463#comment-13664463 ] Hudson commented on HDFS-4298: -- Integrated in Hadoop-trunk-Commit #3776 (See [https://builds.

[jira] [Commented] (HDFS-4813) BlocksMap may throw NullPointerException during shutdown

[ https://issues.apache.org/jira/browse/HDFS-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664466#comment-13664466 ] Jing Zhao commented on HDFS-4813: - Yes. I will comment in HDFS-4840. > Blo

[jira] [Commented] (HDFS-4840) ReplicationMonitor and FSEditLogLoader get NPE during shutdown

[ https://issues.apache.org/jira/browse/HDFS-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664480#comment-13664480 ] Jing Zhao commented on HDFS-4840: - We're trying to fix this in HDFS-4813, but seems that fi

[jira] [Updated] (HDFS-4807) DFSOutputStream.createSocketForPipeline() should not include timeout extension on connect

[ https://issues.apache.org/jira/browse/HDFS-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated HDFS-4807: Assignee: Cristina L. Abad > DFSOutputStream.createSocketForPipeline() should not include timeou

[jira] [Commented] (HDFS-4754) Add an API in the namenode to mark a datanode as stale

[ https://issues.apache.org/jira/browse/HDFS-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664529#comment-13664529 ] Hadoop QA commented on HDFS-4754: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-4842) Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree

Jing Zhao created HDFS-4842: --- Summary: Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree Key: HDFS-4842 URL: https://issues.apache.org/jira/browse/HDFS-4842 Proj

[jira] [Updated] (HDFS-4842) Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree

[ https://issues.apache.org/jira/browse/HDFS-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4842: Issue Type: Sub-task (was: Bug) Parent: HDFS-2802 > Snapshot: identify the correct prior snapsh

[jira] [Updated] (HDFS-4842) Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree

[ https://issues.apache.org/jira/browse/HDFS-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4842: Attachment: HDFS-4842.000.patch Initial patch just for review. The idea is that we need to track upwards in

[jira] [Commented] (HDFS-4842) Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree

[ https://issues.apache.org/jira/browse/HDFS-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664773#comment-13664773 ] Jing Zhao commented on HDFS-4842: - After some thinking, I think a more simple fix is: we st

[jira] [Updated] (HDFS-4842) Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree

[ https://issues.apache.org/jira/browse/HDFS-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4842: Attachment: HDFS-4842.001.patch The patch implementing the second kind of fix. > Snapshot:

[jira] [Created] (HDFS-4843) testDeleteBlockPool has a bug which makes it fail occasionally

vincent cho created HDFS-4843: - Summary: testDeleteBlockPool has a bug which makes it fail occasionally Key: HDFS-4843 URL: https://issues.apache.org/jira/browse/HDFS-4843 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-4224) The dncp_block_verification log can be compressed

[ https://issues.apache.org/jira/browse/HDFS-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664846#comment-13664846 ] Brahma Reddy Battula commented on HDFS-4224: Hi Harsha, Any update on this iss

[jira] [Commented] (HDFS-4842) Snapshot: identify the correct prior snapshot when deleting a snapshot under a renamed subtree

[ https://issues.apache.org/jira/browse/HDFS-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664907#comment-13664907 ] Arpit Agarwal commented on HDFS-4842: - Hi Jing, Changes to INodeReference.java look fi

[jira] [Updated] (HDFS-4677) Editlog should support synchronous writes

[ https://issues.apache.org/jira/browse/HDFS-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Mitic updated HDFS-4677: - Attachment: HDFS-4677.branch-2.patch Attaching the branch-2 compatible patch. > Editlog s

[jira] [Commented] (HDFS-4677) Editlog should support synchronous writes

[ https://issues.apache.org/jira/browse/HDFS-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664923#comment-13664923 ] Ivan Mitic commented on HDFS-4677: -- bq. It would be possible to get this into branch-2, co

[jira] [Commented] (HDFS-4677) Editlog should support synchronous writes

[ https://issues.apache.org/jira/browse/HDFS-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13664924#comment-13664924 ] Hadoop QA commented on HDFS-4677: - {color:red}-1 overall{color}. Here are the results of t