[jira] [Commented] (HDFS-12504) Ozone: Improve SQLCLI performance

2017-10-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203089#comment-16203089 ] Weiwei Yang commented on HDFS-12504: bq. if we can have some simple benchmark results to see the

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203065#comment-16203065 ] Hadoop QA commented on HDFS-11467: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12637) Extend TestDistributedFileSystemWithECFile with a random EC policy

2017-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203063#comment-16203063 ] Xiao Chen commented on HDFS-12637: -- Thanks [~tasanuma0829] for filing the jira and providing a patch.

[jira] [Commented] (HDFS-12642) Log block and datanode details in BlockRecoveryWorker

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203062#comment-16203062 ] Hadoop QA commented on HDFS-12642: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12415) Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails

2017-10-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203055#comment-16203055 ] Weiwei Yang edited comment on HDFS-12415 at 10/13/17 5:03 AM: -- I am also +1

[jira] [Assigned] (HDFS-12415) Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails

2017-10-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-12415: -- Assignee: Mukul Kumar Singh (was: Weiwei Yang) > Ozone: TestXceiverClientManager and

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails

2017-10-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203055#comment-16203055 ] Weiwei Yang commented on HDFS-12415: I am also +1 to [~msingh]'s patch, lets get this committed and

[jira] [Commented] (HDFS-12613) Native EC coder should implement release() as idempotent function.

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203032#comment-16203032 ] Hadoop QA commented on HDFS-12613: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-12 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203022#comment-16203022 ] Jiandan Yang commented on HDFS-12638: -- [~daryn] NN audit log lost some, and we did not find truncate

[jira] [Commented] (HDFS-12621) Inconsistency/confusion around ViewFileSystem.getDelagation

2017-10-12 Thread Mohammad Kamrul Islam (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202997#comment-16202997 ] Mohammad Kamrul Islam commented on HDFS-12621: -- Thanks [~sureshms] for re-adding me.

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-12 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-11467: Attachment: HDFS-11467.001.patch > Support ErasureCoding section in OIV XML/ReverseXML >

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-12 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-11467: Status: Patch Available (was: Open) > Support ErasureCoding section in OIV XML/ReverseXML >

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-12 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202993#comment-16202993 ] Huafeng Wang commented on HDFS-11467: - As discussed with Wei offline, I'll take this one. > Support

[jira] [Assigned] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-12 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang reassigned HDFS-11467: --- Assignee: Huafeng Wang (was: Wei Zhou) > Support ErasureCoding section in OIV

[jira] [Updated] (HDFS-12642) Log block and datanode details in BlockRecoveryWorker

2017-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12642: - Status: Patch Available (was: Open) > Log block and datanode details in BlockRecoveryWorker >

[jira] [Commented] (HDFS-12650) Use slf4j instead of log4j in LeaseManager

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202981#comment-16202981 ] Hadoop QA commented on HDFS-12650: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-12649) handling of corrupt blocks not suitable for commodity hardware

2017-10-12 Thread Gruust (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gruust resolved HDFS-12649. --- Resolution: Invalid > handling of corrupt blocks not suitable for commodity hardware >

[jira] [Commented] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202878#comment-16202878 ] Hadoop QA commented on HDFS-12626: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12570) [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements

2017-10-12 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-12570: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-12570) [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements

2017-10-12 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202847#comment-16202847 ] Uma Maheswara Rao G commented on HDFS-12570: +1 on the latest patch. Thanks Rakesh for

[jira] [Created] (HDFS-12653) Implement toArray() and toSubArray() for ReadOnlyList

2017-10-12 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-12653: - Summary: Implement toArray() and toSubArray() for ReadOnlyList Key: HDFS-12653 URL: https://issues.apache.org/jira/browse/HDFS-12653 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12653) Implement toArray() and subArray() for ReadOnlyList

2017-10-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12653: -- Summary: Implement toArray() and subArray() for ReadOnlyList (was: Implement toArray()

[jira] [Assigned] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-10-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned HDFS-10685: --- Assignee: Kai Jiang > libhdfs++: return explicit error when non-secured client

[jira] [Commented] (HDFS-12578) TestDeadDatanode#testNonDFSUsedONDeadNodeReReg failing in branch-2.7

2017-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202827#comment-16202827 ] Xiao Chen commented on HDFS-12578: -- Thank you for the investigation [~ajayydv]. And sorry for my delayed

[jira] [Commented] (HDFS-12628) libhdfs crashes on thread exit for JNI+libhdfs applications

2017-10-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202824#comment-16202824 ] Allen Wittenauer commented on HDFS-12628: - Honestly, it's probably time HDFS-8707 got merged into

[jira] [Updated] (HDFS-12650) Use slf4j instead of log4j in LeaseManager

2017-10-12 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12650: -- Status: Patch Available (was: Open) > Use slf4j instead of log4j in LeaseManager >

[jira] [Updated] (HDFS-12650) Use slf4j instead of log4j in LeaseManager

2017-10-12 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12650: -- Attachment: HDFS-12650.01.patch > Use slf4j instead of log4j in LeaseManager >

[jira] [Updated] (HDFS-12650) Use slf4j instead of log4j in LeaseManager

2017-10-12 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12650: -- Attachment: (was: HDFS-12650.01.patch) > Use slf4j instead of log4j in LeaseManager >

[jira] [Updated] (HDFS-12650) Use slf4j instead of log4j in LeaseManager

2017-10-12 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12650: -- Attachment: HDFS-12650.01.patch > Use slf4j instead of log4j in LeaseManager >

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2017-10-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202794#comment-16202794 ] Manoj Govindassamy commented on HDFS-12614: --- Filed HDFS-12652 to track

[jira] [Created] (HDFS-12652) INodeAttributesProvider#getAttributes(): Avoid multiple conversions of path components byte[][] to String[] when requesting INode attributes

2017-10-12 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-12652: - Summary: INodeAttributesProvider#getAttributes(): Avoid multiple conversions of path components byte[][] to String[] when requesting INode attributes Key: HDFS-12652

[jira] [Commented] (HDFS-12411) Ozone: Add container usage information to DN container report

2017-10-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202783#comment-16202783 ] Xiaoyu Yao commented on HDFS-12411: --- Open HDFS-12651 for [~anu]'s comment #4. > Ozone: Add container

[jira] [Created] (HDFS-12651) Ozone: SCM: avoid synchronously loading all the keys from containers upon SCM datanode start

2017-10-12 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12651: - Summary: Ozone: SCM: avoid synchronously loading all the keys from containers upon SCM datanode start Key: HDFS-12651 URL: https://issues.apache.org/jira/browse/HDFS-12651

[jira] [Commented] (HDFS-12639) BPOfferService lock may stall all service actors

2017-10-12 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202766#comment-16202766 ] Hanisha Koneru commented on HDFS-12639: --- Hi [~daryn], This is my understanding of the problem.

[jira] [Updated] (HDFS-12613) Native EC coder should implement release() as idempotent function.

2017-10-12 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12613: - Attachment: HDFS-12613.03.patch Thanks for the suggestion, [~Sammi]. Add checks into java code as

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Attachment: HDFS-12626-HDFS-7240.004.patch Somehow Jenkins ran on v002 patch again, resubmit v003 patch

[jira] [Commented] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202730#comment-16202730 ] Hadoop QA commented on HDFS-12626: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12650) Use slf4j instead of log4j in LeaseManager

2017-10-12 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12650: -- Description: LeaseManager is still using log4j dependencies. We should move those to slf4j. (was:

[jira] [Created] (HDFS-12650) Use slf4j instead of log4j in LeaseManager

2017-10-12 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-12650: - Summary: Use slf4j instead of log4j in LeaseManager Key: HDFS-12650 URL: https://issues.apache.org/jira/browse/HDFS-12650 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202696#comment-16202696 ] Hadoop QA commented on HDFS-12614: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Attachment: HDFS-12626-HDFS-7240.003.patch fix asf license header missing in v003 patch. failed tests

[jira] [Commented] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202654#comment-16202654 ] Hadoop QA commented on HDFS-12626: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12648) DN should provide feedback to NN for throttling commands

2017-10-12 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDFS-12648: - Assignee: Hanisha Koneru > DN should provide feedback to NN for throttling commands >

[jira] [Commented] (HDFS-12585) Add description for config in Ozone config UI

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202608#comment-16202608 ] Chen Liang commented on HDFS-12585: --- Thanks [~ajayydv] for the clarification. Then I think maybe it's

[jira] [Commented] (HDFS-12249) dfsadmin -metaSave to output maintenance mode blocks

2017-10-12 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202604#comment-16202604 ] Wellington Chevreuil commented on HDFS-12249: - I believe the test failures are not related.

[jira] [Commented] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-10-12 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202602#comment-16202602 ] Wellington Chevreuil commented on HDFS-11821: - Any insights from anyone? >

[jira] [Updated] (HDFS-12649) handling of corrupt blocks not suitable for commodity hardware

2017-10-12 Thread Gruust (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gruust updated HDFS-12649: -- Description: Hadoop's documentation tells me it's suitable for commodity hardware in the sense that hardware

[jira] [Updated] (HDFS-12649) handling of corrupt blocks not suitable for commodity hardware

2017-10-12 Thread Gruust (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gruust updated HDFS-12649: -- Description: Hadoop's documentation tells me it's suitable for commodity hardware in the sense that hardware

[jira] [Created] (HDFS-12649) handling of corrupt blocks not suitable for commodity hardware

2017-10-12 Thread Gruust (JIRA)
Gruust created HDFS-12649: - Summary: handling of corrupt blocks not suitable for commodity hardware Key: HDFS-12649 URL: https://issues.apache.org/jira/browse/HDFS-12649 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12632) Ozone: OzoneFileSystem: Add contract tests to OzoneFileSystem

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12632: -- Resolution: Fixed Status: Resolved (was: Patch Available) The failed tests are unrelated. I've

[jira] [Commented] (HDFS-10743) MiniDFSCluster test runtimes can be drastically reduce

2017-10-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202482#comment-16202482 ] Daryn Sharp commented on HDFS-10743: Triggering a block report immediately after the heartbeat isn't

[jira] [Updated] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2017-10-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12614: -- Attachment: HDFS-12614.03.patch Attached v03 patch with more comments. [~yzhangal],

[jira] [Commented] (HDFS-12632) Ozone: OzoneFileSystem: Add contract tests to OzoneFileSystem

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202460#comment-16202460 ] Chen Liang commented on HDFS-12632: --- Thanks [~msingh] for adding the tests. +1 > Ozone:

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Attachment: HDFS-12626-HDFS-7240.002.patch 002 patch to rebase. > Ozone : delete open key entries that

[jira] [Commented] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202361#comment-16202361 ] Hadoop QA commented on HDFS-12626: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202357#comment-16202357 ] Daryn Sharp commented on HDFS-12638: The issues actually appear unrelated. In our case, there was

[jira] [Updated] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12626: -- Status: Patch Available (was: Open) > Ozone : delete open key entries that will no longer be closed >

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails

2017-10-12 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202341#comment-16202341 ] Chen Liang commented on HDFS-12415: --- I looked in this a little bit too. What was happening seems to be

[jira] [Commented] (HDFS-5926) documation should clarify dfs.datanode.du.reserved wrt reserved disk capacity

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202333#comment-16202333 ] Hadoop QA commented on HDFS-5926: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12639) BPOfferService lock may stall all service actors

2017-10-12 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202321#comment-16202321 ] Hanisha Koneru commented on HDFS-12639: --- Sure.. Thanks Daryn. > BPOfferService lock may stall all

[jira] [Assigned] (HDFS-12639) BPOfferService lock may stall all service actors

2017-10-12 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDFS-12639: - Assignee: Hanisha Koneru > BPOfferService lock may stall all service actors >

[jira] [Commented] (HDFS-12632) Ozone: OzoneFileSystem: Add contract tests to OzoneFileSystem

2017-10-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202302#comment-16202302 ] Anu Engineer commented on HDFS-12632: - +1, LGTM. > Ozone: OzoneFileSystem: Add contract tests to

[jira] [Updated] (HDFS-12599) Remove Mockito dependency from DataNodeTestUtils

2017-10-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12599: - Fix Version/s: (was: 3.1.0) > Remove Mockito dependency from DataNodeTestUtils >

[jira] [Commented] (HDFS-12212) Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified

2017-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202294#comment-16202294 ] Wei-Chiu Chuang commented on HDFS-12212: Hi [~vinayrpet] thanks for the patch. The fix itself

[jira] [Commented] (HDFS-12212) Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified

2017-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202257#comment-16202257 ] Wei-Chiu Chuang commented on HDFS-12212: Updated Affects versions based on HDFS-8312's affects

[jira] [Updated] (HDFS-12212) Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified

2017-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12212: --- Affects Version/s: 2.8.2 2.9.0 2.7.4

[jira] [Updated] (HDFS-12490) Ozone: OzoneClient: Add creation/modification time information in OzoneVolume/OzoneBucket/OzoneKey

2017-10-12 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12490: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: OzoneClient: Add

[jira] [Commented] (HDFS-12490) Ozone: OzoneClient: Add creation/modification time information in OzoneVolume/OzoneBucket/OzoneKey

2017-10-12 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202211#comment-16202211 ] Nanda kumar commented on HDFS-12490: I have committed this to feature branch. Thanks for the

[jira] [Commented] (HDFS-12490) Ozone: OzoneClient: Add creation/modification time information in OzoneVolume/OzoneBucket/OzoneKey

2017-10-12 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202203#comment-16202203 ] Nanda kumar commented on HDFS-12490: Since we don't want to expose setter methods for the parameters

[jira] [Commented] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-12 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202148#comment-16202148 ] Íñigo Goiri commented on HDFS-12620: Even with the most standard naming convention, Jenkins is not

[jira] [Commented] (HDFS-12585) Add description for config in Ozone config UI

2017-10-12 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202128#comment-16202128 ] Ajay Kumar commented on HDFS-12585: --- [~vagarychen], thanks for review. Yes, {{propertyMap}} is only

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202092#comment-16202092 ] Daryn Sharp commented on HDFS-12638: It does differ from our case but likely has the same root cause.

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202079#comment-16202079 ] Daryn Sharp commented on HDFS-12638: This is bad. The fsck NPE means the block _is_ in the blocks map

[jira] [Commented] (HDFS-12639) BPOfferService lock may stall all service actors

2017-10-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202067#comment-16202067 ] Daryn Sharp commented on HDFS-12639: Sure, go ahead and assign to yourself. If I don't assign to

[jira] [Commented] (HDFS-12645) FSDatasetImpl lock will stall BP service actors and may cause missing blocks

2017-10-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202063#comment-16202063 ] Daryn Sharp commented on HDFS-12645: I understand the lifeline protocol was designed to avoid the node

[jira] [Assigned] (HDFS-12647) DN commands processing should be async

2017-10-12 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar reassigned HDFS-12647: - Assignee: Nandakumar > DN commands processing should be async >

[jira] [Created] (HDFS-12648) DN should provide feedback to NN for throttling commands

2017-10-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12648: -- Summary: DN should provide feedback to NN for throttling commands Key: HDFS-12648 URL: https://issues.apache.org/jira/browse/HDFS-12648 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5926) documation should clarify dfs.datanode.du.reserved wrt reserved disk capacity

2017-10-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-5926: - Status: Patch Available (was: Open) > documation should clarify dfs.datanode.du.reserved wrt reserved

[jira] [Updated] (HDFS-5926) documation should clarify dfs.datanode.du.reserved wrt reserved disk capacity

2017-10-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-5926: - Attachment: HDFS-5926-1.patch > documation should clarify dfs.datanode.du.reserved wrt reserved disk

[jira] [Updated] (HDFS-5926) documation should clarify dfs.datanode.du.reserved wrt reserved disk capacity

2017-10-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-5926: - Attachment: (was: HDFS-5926-1.patch) > documation should clarify dfs.datanode.du.reserved wrt reserved

[jira] [Created] (HDFS-12647) DN commands processing should be async

2017-10-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12647: -- Summary: DN commands processing should be async Key: HDFS-12647 URL: https://issues.apache.org/jira/browse/HDFS-12647 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12646) Avoid IO while holding the FsDataset lock

2017-10-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12646: -- Summary: Avoid IO while holding the FsDataset lock Key: HDFS-12646 URL: https://issues.apache.org/jira/browse/HDFS-12646 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12570) [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202006#comment-16202006 ] Hadoop QA commented on HDFS-12570: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12645) FSDatasetImpl lock will stall BP service actors and may cause missing blocks

2017-10-12 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12645: -- Summary: FSDatasetImpl lock will stall BP service actors and may cause missing blocks Key: HDFS-12645 URL: https://issues.apache.org/jira/browse/HDFS-12645 Project:

[jira] [Commented] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-10-12 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201997#comment-16201997 ] Rushabh S Shah commented on HDFS-11754: --- [~subru]: I feel the patch is very close to done.

[jira] [Updated] (HDFS-12519) Ozone: Lease Manager framework

2017-10-12 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12519: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: Lease Manager framework >

[jira] [Updated] (HDFS-5926) documation should clarify dfs.datanode.du.reserved wrt reserved disk capacity

2017-10-12 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-5926: - Attachment: HDFS-5926-1.patch > documation should clarify dfs.datanode.du.reserved wrt reserved disk

[jira] [Commented] (HDFS-12519) Ozone: Lease Manager framework

2017-10-12 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201953#comment-16201953 ] Nandakumar commented on HDFS-12519: --- Committed this to HDFS-7240. Thanks [~linyiqun], [~vagarychen] &

[jira] [Updated] (HDFS-12519) Ozone: Lease Manager framework

2017-10-12 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12519: -- Summary: Ozone: Lease Manager framework (was: Ozone: Add a Lease Manager to SCM) > Ozone: Lease

[jira] [Commented] (HDFS-12519) Ozone: Add a Lease Manager to SCM

2017-10-12 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201930#comment-16201930 ] Nandakumar commented on HDFS-12519: --- Test failures are not related, will commit it shortly. > Ozone:

[jira] [Commented] (HDFS-12490) Ozone: OzoneClient: Add creation/modification time information in OzoneVolume/OzoneBucket/OzoneKey

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201903#comment-16201903 ] Hadoop QA commented on HDFS-12490: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12519) Ozone: Add a Lease Manager to SCM

2017-10-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201848#comment-16201848 ] Hadoop QA commented on HDFS-12519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12570) [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements

2017-10-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201817#comment-16201817 ] Rakesh R commented on HDFS-12570: - Attached another patch fixing

[jira] [Updated] (HDFS-12570) [SPS]: Refactor Co-ordinator datanode logic to track the block storage movements

2017-10-12 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12570: Attachment: HDFS-12570-HDFS-10285-04.patch > [SPS]: Refactor Co-ordinator datanode logic to track the block

[jira] [Created] (HDFS-12644) Offer a non-privileged listEncryptionZone operation

2017-10-12 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12644: -- Summary: Offer a non-privileged listEncryptionZone operation Key: HDFS-12644 URL: https://issues.apache.org/jira/browse/HDFS-12644 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12484) Undefined -expunge behavior after 2.8

2017-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201776#comment-16201776 ] Wei-Chiu Chuang commented on HDFS-12484: Thanks [~xyao] and sorry for late update. I was on

[jira] [Resolved] (HDFS-11797) BlockManager#createLocatedBlocks() can throw ArrayIndexOutofBoundsException when corrupt replicas are inconsistent

2017-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11797. Resolution: Duplicate I'm going to close it as a dup of HDFS-11445. Feel free to reopen if

[jira] [Commented] (HDFS-12630) Rolling restart can create inconsistency between blockMap and corrupt replicas map

2017-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201752#comment-16201752 ] Wei-Chiu Chuang commented on HDFS-12630: [~asdaraujo] it's more likely to reproduce with unit

[jira] [Resolved] (HDFS-12630) Rolling restart can create inconsistency between blockMap and corrupt replicas map

2017-10-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-12630. Resolution: Duplicate > Rolling restart can create inconsistency between blockMap and

[jira] [Commented] (HDFS-12490) Ozone: OzoneClient: Add creation/modification time information in OzoneVolume/OzoneBucket/OzoneKey

2017-10-12 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16201721#comment-16201721 ] Nandakumar commented on HDFS-12490: --- Thanks [~msingh] for updating the patch. +1 on v003, pending

  1   2   >