[jira] [Assigned] (HDFS-7711) [ HDFS DOC ] Various Typos in ClusterSetup.html and improvements

[ https://issues.apache.org/jira/browse/HDFS-7711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-7711: -- Assignee: Brahma Reddy Battula > [ HDFS DOC ] Various Typos in ClusterSetup.htm

[jira] [Created] (HDFS-7724) "no suitable constructor found" while building Hadoop 2.6.0

Venkatasubramaniam Ramakrishnan created HDFS-7724: - Summary: "no suitable constructor found" while building Hadoop 2.6.0 Key: HDFS-7724 URL: https://issues.apache.org/jira/browse/HDFS-7724

[jira] [Updated] (HDFS-7724) "no suitable constructor found" while building Hadoop 2.6.0

[ https://issues.apache.org/jira/browse/HDFS-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkatasubramaniam Ramakrishnan updated HDFS-7724: -- Attachment: 0202.txt The complete debug/error trace of the issues

[jira] [Updated] (HDFS-7417) Raw XOR coder

[ https://issues.apache.org/jira/browse/HDFS-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7417: Attachment: HDFS-7417-v2.patch Updated the patch merging latest changes on the branch. > Raw XOR coder > ---

[jira] [Updated] (HDFS-7417) Raw XOR coder

[ https://issues.apache.org/jira/browse/HDFS-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7417: Status: Patch Available (was: Open) > Raw XOR coder > - > > Key: HDFS-7417 >

[jira] [Commented] (HDFS-7417) Raw XOR coder

[ https://issues.apache.org/jira/browse/HDFS-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301117#comment-14301117 ] Hadoop QA commented on HDFS-7417: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7545: Attachment: HDFS-7545-001-DFSOutputStream.patch > Data striping support in HDFS client >

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301164#comment-14301164 ] Li Bo commented on HDFS-7545: - HDFS-7545-001-DFSOutputStream.patch has not implemented stripe w

[jira] [Updated] (HDFS-7417) Raw XOR coder

[ https://issues.apache.org/jira/browse/HDFS-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7417: Fix Version/s: HDFS-EC > Raw XOR coder > - > > Key: HDFS-7417 > U

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301229#comment-14301229 ] Kai Zheng commented on HDFS-7545: - Hi Bo, Can you open a sub-task JIRA for your first patc

[jira] [Updated] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7704: - Status: Open (was: Patch Available) > DN heartbeat to Active NN may be blocked and expire if conne

[jira] [Updated] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7704: - Status: Patch Available (was: Open) > DN heartbeat to Active NN may be blocked and expire if conne

[jira] [Updated] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-7704: - Attachment: HDFS-7704-v2.patch Thanks [~kihwal] and [~clamb] for your comments. Attaching a new pat

[jira] [Created] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

Ming Ma created HDFS-7725: - Summary: Incorrect "nodes in service" metrics caused all writes to fail Key: HDFS-7725 URL: https://issues.apache.org/jira/browse/HDFS-7725 Project: Hadoop HDFS Issue Typ

[jira] [Updated] (HDFS-7714) Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.

[ https://issues.apache.org/jira/browse/HDFS-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7714: - Status: Patch Available (was: Open) > Simultaneous restart of HA NameNodes and DataNode can cause DataNode

[jira] [Updated] (HDFS-7714) Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.

[ https://issues.apache.org/jira/browse/HDFS-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7714: - Assignee: Vinayakumar B > Simultaneous restart of HA NameNodes and DataNode can cause DataNode to > regist

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301639#comment-14301639 ] Kihwal Lee commented on HDFS-7707: -- [~yzhangal] Can you post the test case for reference?

[jira] [Updated] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7725: -- Assignee: Ming Ma Status: Patch Available (was: Open) > Incorrect "nodes in service" metrics caused all wr

[jira] [Updated] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7725: -- Attachment: HDFS-7725.patch The patch makes sure the nodeInService count won't be updated when a dead node is re

[jira] [Updated] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7712: -- Attachment: hdfs-7712.003.patch Lots of casting within test cases, think I hit all of em. Also converted

[jira] [Commented] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301686#comment-14301686 ] Kihwal Lee commented on HDFS-7712: -- I will review the patch once the precommit comes back.

[jira] [Updated] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7707: Attachment: reproduceHDFS-7707.patch > Edit log corruption due to delayed block removal again > -

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301743#comment-14301743 ] Yongjun Zhang commented on HDFS-7707: - Hi Kihwal, thanks for your follow-up and the goo

[jira] [Updated] (HDFS-5631) Expose interfaces required by FsDatasetSpi implementations

[ https://issues.apache.org/jira/browse/HDFS-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HDFS-5631: - Attachment: HDFS-5631-branch-2.patch I'd love to blame git, but it looks like I was actually bitten by a bu

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301765#comment-14301765 ] Zhe Zhang commented on HDFS-7545: - Thanks Bo for the good work! The high level logic looks

[jira] [Updated] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7719: Attachment: HDFS-7719.001.patch Updated the patch to use {{nio.Path}} to test parent directory. > B

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301774#comment-14301774 ] Colin Patrick McCabe commented on HDFS-7719: The solution here seems to be to t

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301785#comment-14301785 ] Colin Patrick McCabe commented on HDFS-7722: good idea > DataNode#checkDiskErr

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301790#comment-14301790 ] Colin Patrick McCabe commented on HDFS-7718: There was some discussion about th

[jira] [Commented] (HDFS-7709) Fix Findbug Warnings

[ https://issues.apache.org/jira/browse/HDFS-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301802#comment-14301802 ] Colin Patrick McCabe commented on HDFS-7709: The best way would be to fix it :)

[jira] [Commented] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301807#comment-14301807 ] Colin Patrick McCabe commented on HDFS-7708: Good find. It seems like the bala

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301819#comment-14301819 ] Hadoop QA commented on HDFS-7704: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7718: -- Attachment: HDFS-7718.1.patch [~cmccabe], Attaching initial patch as per your suggestion * Added a {{KeyP

[jira] [Updated] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7718: -- Status: Patch Available (was: Open) > DFSClient objects created by AbstractFileSystem objects created by

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301835#comment-14301835 ] Charles Lamb commented on HDFS-7704: Hi [~shahrs87], I don't understand why you create

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301862#comment-14301862 ] Hadoop QA commented on HDFS-7718: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301870#comment-14301870 ] Colin Patrick McCabe commented on HDFS-7411: Thanks for splitting off the loggi

[jira] [Updated] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7719: Attachment: HDFS-7719.002.patch [~cmccabe] Thanks much for the inputs. I updated the patch to explici

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301881#comment-14301881 ] Andrew Wang commented on HDFS-7411: --- Thanks for reviewing Colin. I'll wait another day be

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301880#comment-14301880 ] Colin Patrick McCabe commented on HDFS-7718: {code} 3465 public KeyProvide

[jira] [Commented] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301885#comment-14301885 ] Charles Lamb commented on HDFS-7682: [~jingzhao], Did you have any more comments on th

[jira] [Updated] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7725: -- Description: One of our clusters sometimes couldn't allocate blocks from any DNs. BlockPlacementPolicyDefault co

[jira] [Commented] (HDFS-5631) Expose interfaces required by FsDatasetSpi implementations

[ https://issues.apache.org/jira/browse/HDFS-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301914#comment-14301914 ] Tsz Wo Nicholas Sze commented on HDFS-5631: --- +1 the branch-2 patch looks good. >

[jira] [Commented] (HDFS-5631) Expose interfaces required by FsDatasetSpi implementations

[ https://issues.apache.org/jira/browse/HDFS-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301917#comment-14301917 ] Tsz Wo Nicholas Sze commented on HDFS-5631: --- I have committed the branch-2 patch.

[jira] [Updated] (HDFS-5631) Expose interfaces required by FsDatasetSpi implementations

[ https://issues.apache.org/jira/browse/HDFS-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-5631: -- Affects Version/s: (was: 3.0.0) Fix Version/s: (was: 3.0.0)

[jira] [Updated] (HDFS-5782) BlockListAsLongs should take lists of Replicas rather than concrete classes

[ https://issues.apache.org/jira/browse/HDFS-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-5782: -- Affects Version/s: (was: 3.0.0) Fix Version/s: (was: 3.0.0)

[jira] [Updated] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

[ https://issues.apache.org/jira/browse/HDFS-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7681: -- Affects Version/s: (was: 3.0.0) Fix Version/s: (was: 3.0.0)

[jira] [Commented] (HDFS-7696) FsDatasetImpl.getTmpInputStreams(..) may leak file descriptors

[ https://issues.apache.org/jira/browse/HDFS-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301986#comment-14301986 ] Hudson commented on HDFS-7696: -- FAILURE: Integrated in Hadoop-trunk-Commit #6983 (See [https:

[jira] [Updated] (HDFS-7696) FsDatasetImpl.getTmpInputStreams(..) may leak file descriptors

[ https://issues.apache.org/jira/browse/HDFS-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7696: -- Priority: Minor (was: Major) > FsDatasetImpl.getTmpInputStreams(..) may leak file descri

[jira] [Commented] (HDFS-5631) Expose interfaces required by FsDatasetSpi implementations

[ https://issues.apache.org/jira/browse/HDFS-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301983#comment-14301983 ] Hudson commented on HDFS-5631: -- FAILURE: Integrated in Hadoop-trunk-Commit #6983 (See [https:

[jira] [Commented] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

[ https://issues.apache.org/jira/browse/HDFS-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301984#comment-14301984 ] Hudson commented on HDFS-7681: -- FAILURE: Integrated in Hadoop-trunk-Commit #6983 (See [https:

[jira] [Commented] (HDFS-5782) BlockListAsLongs should take lists of Replicas rather than concrete classes

[ https://issues.apache.org/jira/browse/HDFS-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14301985#comment-14301985 ] Hudson commented on HDFS-5782: -- FAILURE: Integrated in Hadoop-trunk-Commit #6983 (See [https:

[jira] [Updated] (HDFS-7696) FsDatasetImpl.getTmpInputStreams(..) may leak file descriptors

[ https://issues.apache.org/jira/browse/HDFS-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7696: -- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Statu

[jira] [Updated] (HDFS-7604) Track and display failed DataNode storage locations in NameNode.

[ https://issues.apache.org/jira/browse/HDFS-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7604: Status: Open (was: Patch Available) > Track and display failed DataNode storage locations in NameNod

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302004#comment-14302004 ] Haohui Mai commented on HDFS-6994: -- One of the motivations behind building a native HDFS c

[jira] [Commented] (HDFS-7697) Document the scope of the PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-7697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302013#comment-14302013 ] Haohui Mai commented on HDFS-7697: -- Thanks for the follow ups. Based on the discussion on

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302015#comment-14302015 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- {code} +// Assume 100k block

[jira] [Commented] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302017#comment-14302017 ] Tsz Wo Nicholas Sze commented on HDFS-7270: --- [~wheat9], please address Daryn's co

[jira] [Updated] (HDFS-7604) Track and display failed DataNode storage locations in NameNode.

[ https://issues.apache.org/jira/browse/HDFS-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7604: Attachment: HDFS-7604-screenshot-4.png I've done another mock-up of the UI. This version avoids addi

[jira] [Comment Edited] (HDFS-7604) Track and display failed DataNode storage locations in NameNode.

[ https://issues.apache.org/jira/browse/HDFS-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302025#comment-14302025 ] Chris Nauroth edited comment on HDFS-7604 at 2/2/15 10:05 PM: --

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302030#comment-14302030 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- I also like to get this work here co

[jira] [Commented] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302036#comment-14302036 ] Hadoop QA commented on HDFS-7712: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302037#comment-14302037 ] Hadoop QA commented on HDFS-7725: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7718: -- Attachment: HDFS-7718.2.patch thanks for the review [~cmccabe], Updating patch with your suggestions :

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302047#comment-14302047 ] Arun Suresh commented on HDFS-5796: --- ping [~wheat9] .. does the above suggestion work ?

[jira] [Commented] (HDFS-7270) Add congestion signaling capability to DataNode write protocol

[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302053#comment-14302053 ] Arpit Agarwal commented on HDFS-7270: - +1 from me on the v002 patch, except I don't thi

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302065#comment-14302065 ] Zhe Zhang commented on HDFS-7285: - bq. If we only use small fixed value, for example 64KB a

[jira] [Commented] (HDFS-7704) DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.

[ https://issues.apache.org/jira/browse/HDFS-7704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302067#comment-14302067 ] Kihwal Lee commented on HDFS-7704: -- Adding to what Charles said: If {{BPServiceActorAction

[jira] [Created] (HDFS-7726) Parse and check the configuration settings of edit log to prevent runtime errors

Tianyin Xu created HDFS-7726: Summary: Parse and check the configuration settings of edit log to prevent runtime errors Key: HDFS-7726 URL: https://issues.apache.org/jira/browse/HDFS-7726 Project: Hadoop

[jira] [Commented] (HDFS-7714) Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.

[ https://issues.apache.org/jira/browse/HDFS-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302077#comment-14302077 ] Hadoop QA commented on HDFS-7714: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7726) Parse and check the configuration settings of edit log to prevent runtime errors

[ https://issues.apache.org/jira/browse/HDFS-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-7726: - Status: Open (was: Patch Available) > Parse and check the configuration settings of edit log to prevent ru

[jira] [Updated] (HDFS-7726) Parse and check the configuration settings of edit log to prevent runtime errors

[ https://issues.apache.org/jira/browse/HDFS-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-7726: - Status: Patch Available (was: Open) > Parse and check the configuration settings of edit log to prevent ru

[jira] [Updated] (HDFS-7726) Parse and check the configuration settings of edit log to prevent runtime errors

[ https://issues.apache.org/jira/browse/HDFS-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-7726: - Status: Patch Available (was: Open) > Parse and check the configuration settings of edit log to prevent ru

[jira] [Updated] (HDFS-7726) Parse and check the configuration settings of edit log to prevent runtime errors

[ https://issues.apache.org/jira/browse/HDFS-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated HDFS-7726: - Attachment: check_config_val_EditLogTailer.patch.1 > Parse and check the configuration settings of edit log

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302086#comment-14302086 ] Kai Zheng commented on HDFS-7285: - bq.I think we need to allow dynamic stripe cell size dep

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302092#comment-14302092 ] Andrew Wang commented on HDFS-7411: --- As discussed above, the old limiting scheme is serio

[jira] [Commented] (HDFS-7707) Edit log corruption due to delayed block removal again

[ https://issues.apache.org/jira/browse/HDFS-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302277#comment-14302277 ] Yongjun Zhang commented on HDFS-7707: - Hi Kihwal, Inspired by your comment https://is

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302281#comment-14302281 ] Hadoop QA commented on HDFS-7719: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7712) Switch blockStateChangeLog to use slf4j

[ https://issues.apache.org/jira/browse/HDFS-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7712: -- Attachment: hdfs-7712.004.patch Sigh, these failed tests didn't show up in the previous run, new rev to a

[jira] [Updated] (HDFS-7721) TestBlockScanner.testScanRateLimit may fail

[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7721: --- Assignee: Colin Patrick McCabe Status: Patch Available (was: Open) > TestBlockSc

[jira] [Updated] (HDFS-7721) TestBlockScanner.testScanRateLimit may fail

[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7721: --- Attachment: HDFS-7721.001.patch > TestBlockScanner.testScanRateLimit may fail > ---

[jira] [Commented] (HDFS-7721) TestBlockScanner.testScanRateLimit may fail

[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302288#comment-14302288 ] Colin Patrick McCabe commented on HDFS-7721: * Avoid running the scanner fast i

[jira] [Updated] (HDFS-7721) The HDFS BlockScanner may run fast during the first hour

[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7721: --- Summary: The HDFS BlockScanner may run fast during the first hour (was: TestBlockScann

[jira] [Commented] (HDFS-7721) The HDFS BlockScanner may run fast during the first hour

[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302293#comment-14302293 ] Andrew Wang commented on HDFS-7721: --- +1 pending, looks good > The HDFS BlockScanner may

[jira] [Commented] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302299#comment-14302299 ] Zhe Zhang commented on HDFS-7725: - bq. However, HDFS-7374 introduces another inconsistency

[jira] [Commented] (HDFS-7520) checknative should display a nicer error message when openssl support is not compiled in

[ https://issues.apache.org/jira/browse/HDFS-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302310#comment-14302310 ] Anu Engineer commented on HDFS-7520: This patch defines HADOOP_OPENSSL_LIBRARY if and

[jira] [Updated] (HDFS-7520) checknative should display a nicer error message when openssl support is not compiled in

[ https://issues.apache.org/jira/browse/HDFS-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7520: --- Attachment: HDFS-7520.001.patch > checknative should display a nicer error message when openssl support

[jira] [Updated] (HDFS-7520) checknative should display a nicer error message when openssl support is not compiled in

[ https://issues.apache.org/jira/browse/HDFS-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7520: --- Status: Patch Available (was: Open) > checknative should display a nicer error message when openssl su

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302316#comment-14302316 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- > Because of this, I do not see any

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302319#comment-14302319 ] Colin Patrick McCabe commented on HDFS-7411: I don't see any benefit to splitti

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302322#comment-14302322 ] Arpit Agarwal commented on HDFS-7411: - bq. Ming Ma, Arpit Agarwal, and myself have rev

[jira] [Assigned] (HDFS-7122) Use of ThreadLocal results in poor block placement

[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Lawlor reassigned HDFS-7122: - Assignee: Jonathan Lawlor (was: Andrew Wang) > Use of ThreadLocal results in poor block p

[jira] [Commented] (HDFS-7725) Incorrect "nodes in service" metrics caused all writes to fail

[ https://issues.apache.org/jira/browse/HDFS-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302345#comment-14302345 ] Ming Ma commented on HDFS-7725: --- Thanks, [~zhz]. Yes, the logic of "don't modify nn stats if

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302347#comment-14302347 ] Hadoop QA commented on HDFS-7719: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302490#comment-14302490 ] Haohui Mai commented on HDFS-5796: -- bq. Since this would be a real valid user, hdfs admin

[jira] [Assigned] (HDFS-7122) Use of ThreadLocal results in poor block placement

[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-7122: - Assignee: Andrew Wang (was: Jonathan Lawlor) > Use of ThreadLocal results in poor block placement

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302510#comment-14302510 ] Tsz Wo Nicholas Sze commented on HDFS-7411: --- > ... the old limiting scheme is ser

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302513#comment-14302513 ] Aaron T. Myers commented on HDFS-7411: -- bq. Users are familiar with the existing behav

[jira] [Commented] (HDFS-6651) Deletion failure can leak inodes permanently.

[ https://issues.apache.org/jira/browse/HDFS-6651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302540#comment-14302540 ] Jing Zhao commented on HDFS-6651: - The current patch takes the #5 solution. This simplifies

[jira] [Commented] (HDFS-7520) checknative should display a nicer error message when openssl support is not compiled in

[ https://issues.apache.org/jira/browse/HDFS-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14302542#comment-14302542 ] Hadoop QA commented on HDFS-7520: - {color:red}-1 overall{color}. Here are the results of t

  1   2   >