[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226299#comment-16226299 ] Allen Wittenauer commented on HDFS-12711: - For those playing at home: YETUS-570 (in development)

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Summary: DN may not send block report to NN after NN restart (was: DN may not send block report to SNN

[jira] [Updated] (HDFS-12749) DN may not send block report to SNN after SNN restart and DN re-register to SNN,

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Summary: DN may not send block report to SNN after SNN restart and DN re-register to SNN, (was: After SNN

[jira] [Updated] (HDFS-12749) After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: After SNN restart,DN will call BPServiceActor#reRegister method to register. But when DN

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226268#comment-16226268 ] Hadoop QA commented on HDFS-11902: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12744: --- Attachment: HDFS-12744.002.patch > More logs when short-circuit read is failed and disabled >

[jira] [Commented] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226260#comment-16226260 ] Weiwei Yang commented on HDFS-12459: Hi [~shahrs87], any updates on this? > Fix revert: Add new op

[jira] [Commented] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226258#comment-16226258 ] Weiwei Yang commented on HDFS-12744: Thanks [~jzhuge] for the quick review, looks like the pre-commit

[jira] [Commented] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226256#comment-16226256 ] John Zhuge commented on HDFS-12744: --- +1 LGTM > More logs when short-circuit read is failed and disabled

[jira] [Updated] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12744: -- Labels: supportability (was: ) > More logs when short-circuit read is failed and disabled >

[jira] [Commented] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226242#comment-16226242 ] Hadoop QA commented on HDFS-12459: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226227#comment-16226227 ] Hadoop QA commented on HDFS-12725: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12682: - Attachment: HDFS-12682.05.patch Thanks for the review Eddy! Patch 5 addressed all comments. Also fixed

[jira] [Updated] (HDFS-12749) After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Affects Version/s: (was: 2.7.4) > After SNN restart and DN re-register to SNN,some DN may not send

[jira] [Updated] (HDFS-12749) After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Target Version/s: (was: 2.7.4) > After SNN restart and DN re-register to SNN,some DN may not send block

[jira] [Created] (HDFS-12749) After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large

2017-10-30 Thread TanYuxin (JIRA)
TanYuxin created HDFS-12749: --- Summary: After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large Key: HDFS-12749 URL: https://issues.apache.org/jira/browse/HDFS-12749

[jira] [Created] (HDFS-12748) Standby NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY

2017-10-30 Thread Jiandan Yang (JIRA)
Jiandan Yang created HDFS-12748: Summary: Standby NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY Key: HDFS-12748 URL: https://issues.apache.org/jira/browse/HDFS-12748 Project: Hadoop

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226133#comment-16226133 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226123#comment-16226123 ] Hadoop QA commented on HDFS-12682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12459: --- Attachment: HDFS-12459.003.patch Rebase to latest trunk > Fix revert: Add new op

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226111#comment-16226111 ] Weiwei Yang commented on HDFS-12638: Hi [~shv] Thanks for the new patch. One question though, in

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: (was: HDFS-11902-HDFS-9806.010.patch) > [READ] Merge

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.010.patch > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226084#comment-16226084 ] Hadoop QA commented on HDFS-12681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226037#comment-16226037 ] John Zhuge edited comment on HDFS-12714 at 10/31/17 1:00 AM: - [~joemcdonnell]

[jira] [Commented] (HDFS-12732) Correct spellings of ramdomly to randomly in log.

2017-10-30 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226060#comment-16226060 ] Akira Ajisaka commented on HDFS-12732: -- +1 pending Jenkins. > Correct spellings of ramdomly to

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226047#comment-16226047 ] Xiaoyu Yao commented on HDFS-12697: --- [~bharatviswa], can you fix the checkstyle and shell check

[jira] [Commented] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226037#comment-16226037 ] John Zhuge commented on HDFS-12714: --- [~joemcdonnell] Thanks for the contribution! How did u test the

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226023#comment-16226023 ] Lei (Eddy) Xu commented on HDFS-12682: -- Hi, [~xiaochen] Thanks for the updates. Overall LGTM. Minor

[jira] [Comment Edited] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226009#comment-16226009 ] Arpit Agarwal edited comment on HDFS-12499 at 10/30/17 11:59 PM: -

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12499: - Target Version/s: 3.0.0 > dfs.namenode.shared.edits.dir property is currently namenode specific

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12638: --- Attachment: HDFS-12638.002.patch You are right we are not collecting the

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226009#comment-16226009 ] Arpit Agarwal commented on HDFS-12499: -- [~andrew.wang], This change makes the

[jira] [Commented] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226008#comment-16226008 ] Yongjun Zhang commented on HDFS-12737: -- Thanks [~jojochuang] for working on this issue. Hi [~jnp]

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12499: - Labels: (was: Incompatible) > dfs.namenode.shared.edits.dir property is currently namenode

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12499: - Component/s: qjm > dfs.namenode.shared.edits.dir property is currently namenode specific key >

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12499: - Hadoop Flags: Incompatible change > dfs.namenode.shared.edits.dir property is currently namenode

[jira] [Updated] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12705: -- Attachment: HDFS-12705.002.patch Thanks [~nandakumar131] and [~daryn] for reviewing the patch.

[jira] [Commented] (HDFS-12730) Verify open files captured in the snapshots across config disable and enable

2017-10-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225996#comment-16225996 ] Hanisha Koneru commented on HDFS-12730: --- Thanks for the patch, [~manojg]. This is what I understood

[jira] [Commented] (HDFS-12564) Add the documents of swebhdfs configurations on the client side

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225940#comment-16225940 ] Xiaoyu Yao commented on HDFS-12564: --- [~tasanuma0829], thanks for working on this. The patch does not

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225910#comment-16225910 ] Sean Mackrory commented on HDFS-7878: - No other feedback from me - +1 on the bits I understand, like

[jira] [Commented] (HDFS-12736) Enable SSL Documentation

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225901#comment-16225901 ] Xiaoyu Yao commented on HDFS-12736: --- [~tasanuma0829], thanks for the comments. If I understand

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225895#comment-16225895 ] Anu Engineer commented on HDFS-7878: Thanks for the heads up. Please go ahead. > API - expose an

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225886#comment-16225886 ] Sean Mackrory commented on HDFS-206: Yetus never reviewed your 3rd patch, and Jenkins now appears to be

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Attachment: HDFS-12725.03.patch Thanks for the review [~jojochuang]. Patch 3 to address the comments.

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225867#comment-16225867 ] Chris Douglas commented on HDFS-7878: - Thanks [~elgoiri] and [~ste...@apache.org]. If there's no other

[jira] [Commented] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225821#comment-16225821 ] Xiao Chen commented on HDFS-12667: -- I haven't found time to look at what this means to hdfs startFiles

[jira] [Created] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2017-10-30 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12747: -- Summary: Lease monitor may infinitely loop on the same lease Key: HDFS-12747 URL: https://issues.apache.org/jira/browse/HDFS-12747 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225705#comment-16225705 ] Xiaoyu Yao edited comment on HDFS-12474 at 10/30/17 9:54 PM: - Thanks

[jira] [Commented] (HDFS-12396) Webhdfs file system should get delegation token from kms provider.

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225807#comment-16225807 ] Hadoop QA commented on HDFS-12396: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12682: - Attachment: HDFS-12682.04.patch Attaching patch 4 which is a hybrid solution between the approaches in

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225782#comment-16225782 ] Tsz Wo Nicholas Sze commented on HDFS-12594: We could also use on-disk key-value store such as

[jira] [Comment Edited] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225679#comment-16225679 ] Wei-Chiu Chuang edited comment on HDFS-12725 at 10/30/17 9:23 PM: -- Hi

[jira] [Commented] (HDFS-12746) DataNode Audit Logger

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225750#comment-16225750 ] Anu Engineer commented on HDFS-12746: - bq. I'm not sure about machine readable. Did you have something

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225724#comment-16225724 ] Steve Loughran commented on HDFS-7878: -- Bits I Understand are +1 from me > API - expose an unique

[jira] [Commented] (HDFS-12718) Ozone: fix thread number calculation in CBlockManager

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225728#comment-16225728 ] Hadoop QA commented on HDFS-12718: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225717#comment-16225717 ] Gabor Bota commented on HDFS-206: - Ok, thanks! I also agree that closing the resource like this would give

[jira] [Commented] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225705#comment-16225705 ] Xiaoyu Yao commented on HDFS-12474: --- Thanks [~nandakumar131] for working on it. The patch looks good to

[jira] [Updated] (HDFS-12743) Ozone: Fix Ozone's env vars (again)

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12743: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225679#comment-16225679 ] Wei-Chiu Chuang commented on HDFS-12725: Hi [~xiaochen] thanks for filing the jira and posting a

[jira] [Updated] (HDFS-12743) Ozone: Fix Ozone's env vars (again)

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12743: Summary: Ozone: Fix Ozone's env vars (again) (was: Fix Ozone's env vars (again)) > Ozone: Fix

[jira] [Commented] (HDFS-12743) Fix Ozone's env vars (again)

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225676#comment-16225676 ] Anu Engineer commented on HDFS-12743: - +1, Thank you for catching this and fixing this. I will commit

[jira] [Commented] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225674#comment-16225674 ] Chris Douglas commented on HDFS-9914: - Odd, {{TestWebHdfsTimeouts}} always fails for me. Though when I

[jira] [Commented] (HDFS-12746) DataNode Audit Logger

2017-10-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225664#comment-16225664 ] Erik Krogen commented on HDFS-12746: Thanks for the feedback [~anu]! I agree with you about logging

[jira] [Commented] (HDFS-12746) DataNode Audit Logger

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225651#comment-16225651 ] Anu Engineer commented on HDFS-12746: - [~xkrogen] It is an interesting idea. Recently I had an

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225630#comment-16225630 ] Anu Engineer commented on HDFS-12734: - maybe we should check-in a dummy config.toml for now and get

[jira] [Commented] (HDFS-12738) Namenode logs many "SSL renegotiate denied" warnings after enable HTTPS for HDFS

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225616#comment-16225616 ] Xiaoyu Yao commented on HDFS-12738: --- [~kihwal], on a pretty idle newly setup of 3 node clusters, I see

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225586#comment-16225586 ] Tsz Wo Nicholas Sze commented on HDFS-12594: Indeed, it may be possible for DistCpSync to run

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225571#comment-16225571 ] Tsz Wo Nicholas Sze commented on HDFS-12594: > Implementing RemoteIterator class so that rpc

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-30 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225562#comment-16225562 ] Sean Busbey commented on HDFS-12711: interesting. what's the spread on surefire versions for hadoops?

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-30 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Attachment: HDFS-12594.004.patch The patch addresses: 1) CheckStyle issues 2)FindBugs

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-10-30 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225532#comment-16225532 ] Jitendra Nath Pandey commented on HDFS-7240: [~shv] Thank you for taking out time to review

[jira] [Commented] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225504#comment-16225504 ] Tsz Wo Nicholas Sze commented on HDFS-12720: Patch looks good. Just some minor comments: -

[jira] [Created] (HDFS-12746) DataNode Audit Logger

2017-10-30 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-12746: -- Summary: DataNode Audit Logger Key: HDFS-12746 URL: https://issues.apache.org/jira/browse/HDFS-12746 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-10380) libhdfs++: Get rid of socket template parameter in RpcConnection

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10380: --- Assignee: James Clampffer (was: James Clampffer) Status: Open (was: Patch Available)

[jira] [Updated] (HDFS-9227) Check block checksums for integrity

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9227: -- Assignee: James Clampffer (was: James Clampffer) Status: Open (was: Patch Available) >

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225462#comment-16225462 ] Hadoop QA commented on HDFS-7240: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11544: --- Status: Open (was: Patch Available) > libhdfs++: Improve C API error reporting >

[jira] [Updated] (HDFS-12427) libhdfs++: Prevent Requests from holding dangling pointer to RpcEngine

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-12427: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed the 001 patch

[jira] [Commented] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225450#comment-16225450 ] Hadoop QA commented on HDFS-12720: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225441#comment-16225441 ] Arpit Agarwal commented on HDFS-12498: -- +1 for the v05 patch, pending Jenkins. > Journal Syncer is

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-30 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225424#comment-16225424 ] Bharat Viswanadham commented on HDFS-12498: --- [~arpitagarwal] Fixed checkstyle issues.

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-30 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12498: -- Attachment: HDFS-12498.05.patch > Journal Syncer is not started in Federated + HA

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225404#comment-16225404 ] Hanisha Koneru commented on HDFS-12498: --- Yes. Patch v04 LGTM. Thanks. > Journal Syncer is not

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225394#comment-16225394 ] Íñigo Goiri commented on HDFS-7878: --- [~chris.douglas], thanks for pushing this. V21 LGTM. For the QA

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.09.patch Accidentally picked up a v06 change in v08. This is ready for

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Labels: hdfs-ec-3.0-must-do (was: ) > BlockPlacementPolicyRackFaultTolerant still fails with racks with

[jira] [Assigned] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-12116: Assignee: Gabor Bota (was: Xiao Chen) Sure Gabor, thanks for helping! Assigning this to you. :)

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225318#comment-16225318 ] Chris Douglas commented on HDFS-7878: - Folks, can this get a definitive review? I think v21 addresses

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225308#comment-16225308 ] Hadoop QA commented on HDFS-12665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-30 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225298#comment-16225298 ] Elek, Marton commented on HDFS-12734: - Yes, currently it requires the hugo files, but I can improve it

[jira] [Updated] (HDFS-12718) Ozone: fix thread number calculation in CBlockManager

2017-10-30 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12718: Attachment: HDFS-12718-HDFS-7240.002.patch Patch is improved according to the suggestion. I also

[jira] [Issue Comment Deleted] (HDFS-2139) Fast copy for HDFS.

2017-10-30 Thread feiwei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwei updated HDFS-2139: - Comment: was deleted (was: In FsDatasetImpl.java , You should modify to ensure synchronization public void

[jira] [Commented] (HDFS-12718) Ozone: fix thread number calculation in CBlockManager

2017-10-30 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225284#comment-16225284 ] Elek, Marton commented on HDFS-12718: - Yes, I also considered this option as well, and couldn't decide

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225278#comment-16225278 ] Sean Mackrory commented on HDFS-206: Ah - you know what? I didn't see that the last argument passed to

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2017-10-30 Thread feiwei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225268#comment-16225268 ] feiwei commented on HDFS-2139: -- In FsDatasetImpl.java , You should modify to ensure synchronization public

[jira] [Commented] (HDFS-12738) Namenode logs many "SSL renegotiate denied" warnings after enable HTTPS for HDFS

2017-10-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225248#comment-16225248 ] Kihwal Lee commented on HDFS-12738: --- How frequent is it relative to the request rate? > Namenode logs

[jira] [Commented] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225234#comment-16225234 ] Hadoop QA commented on HDFS-12667: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >