[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: Now our cluster have thousands of DN, millions of files and blocks. When NN restart, NN's load

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226339#comment-16226339 ] He Xiaoqiao commented on HDFS-12749: [~tanyuxin] could you attach some more troublesho

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: Now our cluster have thousands of DN, millions of files and blocks. When NN restart, NN's load

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: Now our cluster have thousands of DN, files num 100+ million, block num 100+ million. When NN

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: Now our cluster have 7000+ DN, files num 180+ million, block num 180+ million. When NN restart

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: Now our cluster have 7000+ DN, files num 180+ million, block num 180+ million. When NN restart

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: Now our cluster have 7000+ DN, files num 180+ million, block num 180+ million. When NN restart

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: Now our cluster have 7000+ DN, files num 180+ million, block num 180+ million. After SNN restar

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: Now our cluster have 7000+ DN, files num 180+ million, block num 180+ million. After SNN restar

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: Now our cluster have 7000+ DN, files num 180+ million, block num 180+ million. After SNN restar

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226299#comment-16226299 ] Allen Wittenauer commented on HDFS-12711: - For those playing at home: YETUS-570 (

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Summary: DN may not send block report to NN after NN restart (was: DN may not send block report to SNN afte

[jira] [Updated] (HDFS-12749) DN may not send block report to SNN after SNN restart and DN re-register to SNN,

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Summary: DN may not send block report to SNN after SNN restart and DN re-register to SNN, (was: After SNN r

[jira] [Updated] (HDFS-12749) After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Description: After SNN restart,DN will call BPServiceActor#reRegister method to register. But when DN regist

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226268#comment-16226268 ] Hadoop QA commented on HDFS-11902: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12744: --- Attachment: HDFS-12744.002.patch > More logs when short-circuit read is failed and disabled >

[jira] [Commented] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226260#comment-16226260 ] Weiwei Yang commented on HDFS-12459: Hi [~shahrs87], any updates on this? > Fix rever

[jira] [Commented] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226258#comment-16226258 ] Weiwei Yang commented on HDFS-12744: Thanks [~jzhuge] for the quick review, looks like

[jira] [Commented] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226256#comment-16226256 ] John Zhuge commented on HDFS-12744: --- +1 LGTM > More logs when short-circuit read is fai

[jira] [Updated] (HDFS-12744) More logs when short-circuit read is failed and disabled

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12744: -- Labels: supportability (was: ) > More logs when short-circuit read is failed and disabled > ---

[jira] [Commented] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226242#comment-16226242 ] Hadoop QA commented on HDFS-12459: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226227#comment-16226227 ] Hadoop QA commented on HDFS-12725: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12682: - Attachment: HDFS-12682.05.patch Thanks for the review Eddy! Patch 5 addressed all comments. Also fixed ch

[jira] [Updated] (HDFS-12749) After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Affects Version/s: (was: 2.7.4) > After SNN restart and DN re-register to SNN,some DN may not send block

[jira] [Updated] (HDFS-12749) After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large

2017-10-30 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Target Version/s: (was: 2.7.4) > After SNN restart and DN re-register to SNN,some DN may not send block re

[jira] [Created] (HDFS-12749) After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large

2017-10-30 Thread TanYuxin (JIRA)
TanYuxin created HDFS-12749: --- Summary: After SNN restart and DN re-register to SNN,some DN may not send block report to SNN if DN num is too large Key: HDFS-12749 URL: https://issues.apache.org/jira/browse/HDFS-12749

[jira] [Created] (HDFS-12748) Standby NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY

2017-10-30 Thread Jiandan Yang (JIRA)
Jiandan Yang created HDFS-12748: Summary: Standby NameNode memory leak when accessing webhdfs GETHOMEDIRECTORY Key: HDFS-12748 URL: https://issues.apache.org/jira/browse/HDFS-12748 Project: Hadoop HD

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226133#comment-16226133 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226123#comment-16226123 ] Hadoop QA commented on HDFS-12682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12459: --- Attachment: HDFS-12459.003.patch Rebase to latest trunk > Fix revert: Add new op GETFILEBLOCKLOCATION

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226111#comment-16226111 ] Weiwei Yang commented on HDFS-12638: Hi [~shv] Thanks for the new patch. One question

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and FileRegionPr

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: (was: HDFS-11902-HDFS-9806.010.patch) > [READ] Merge BlockFormatProvider

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and FileRegionPr

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-30 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.010.patch > [READ] Merge BlockFormatProvider and FileRe

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226084#comment-16226084 ] Hadoop QA commented on HDFS-12681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226037#comment-16226037 ] John Zhuge edited comment on HDFS-12714 at 10/31/17 1:00 AM: -

[jira] [Commented] (HDFS-12732) Correct spellings of ramdomly to randomly in log.

2017-10-30 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226060#comment-16226060 ] Akira Ajisaka commented on HDFS-12732: -- +1 pending Jenkins. > Correct spellings of r

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226047#comment-16226047 ] Xiaoyu Yao commented on HDFS-12697: --- [~bharatviswa], can you fix the checkstyle and shel

[jira] [Commented] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-30 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226037#comment-16226037 ] John Zhuge commented on HDFS-12714: --- [~joemcdonnell] Thanks for the contribution! How d

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226023#comment-16226023 ] Lei (Eddy) Xu commented on HDFS-12682: -- Hi, [~xiaochen] Thanks for the updates. Overa

[jira] [Comment Edited] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226009#comment-16226009 ] Arpit Agarwal edited comment on HDFS-12499 at 10/30/17 11:59 PM: ---

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12499: - Target Version/s: 3.0.0 > dfs.namenode.shared.edits.dir property is currently namenode specific ke

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12638: --- Attachment: HDFS-12638.002.patch You are right we are not collecting the copy-on-trunc

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226009#comment-16226009 ] Arpit Agarwal commented on HDFS-12499: -- [~andrew.wang], This change makes the {{dfs.

[jira] [Commented] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16226008#comment-16226008 ] Yongjun Zhang commented on HDFS-12737: -- Thanks [~jojochuang] for working on this issu

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12499: - Labels: (was: Incompatible) > dfs.namenode.shared.edits.dir property is currently namenode speci

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12499: - Hadoop Flags: Incompatible change > dfs.namenode.shared.edits.dir property is currently namenode s

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12499: - Component/s: qjm > dfs.namenode.shared.edits.dir property is currently namenode specific key > ---

[jira] [Updated] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-10-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12705: -- Attachment: HDFS-12705.002.patch Thanks [~nandakumar131] and [~daryn] for reviewing the patch. U

[jira] [Commented] (HDFS-12730) Verify open files captured in the snapshots across config disable and enable

2017-10-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225996#comment-16225996 ] Hanisha Koneru commented on HDFS-12730: --- Thanks for the patch, [~manojg]. This is w

[jira] [Commented] (HDFS-12564) Add the documents of swebhdfs configurations on the client side

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225940#comment-16225940 ] Xiaoyu Yao commented on HDFS-12564: --- [~tasanuma0829], thanks for working on this. The pa

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225910#comment-16225910 ] Sean Mackrory commented on HDFS-7878: - No other feedback from me - +1 on the bits I und

[jira] [Commented] (HDFS-12736) Enable SSL Documentation

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225901#comment-16225901 ] Xiaoyu Yao commented on HDFS-12736: --- [~tasanuma0829], thanks for the comments. If I unde

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225895#comment-16225895 ] Anu Engineer commented on HDFS-7878: Thanks for the heads up. Please go ahead. > API

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225886#comment-16225886 ] Sean Mackrory commented on HDFS-206: Yetus never reviewed your 3rd patch, and Jenkins no

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Attachment: HDFS-12725.03.patch Thanks for the review [~jojochuang]. Patch 3 to address the comments. Ini

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225867#comment-16225867 ] Chris Douglas commented on HDFS-7878: - Thanks [~elgoiri] and [~ste...@apache.org]. If

[jira] [Commented] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225821#comment-16225821 ] Xiao Chen commented on HDFS-12667: -- I haven't found time to look at what this means to hd

[jira] [Created] (HDFS-12747) Lease monitor may infinitely loop on the same lease

2017-10-30 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-12747: -- Summary: Lease monitor may infinitely loop on the same lease Key: HDFS-12747 URL: https://issues.apache.org/jira/browse/HDFS-12747 Project: Hadoop HDFS Issue Typ

[jira] [Comment Edited] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225705#comment-16225705 ] Xiaoyu Yao edited comment on HDFS-12474 at 10/30/17 9:54 PM: -

[jira] [Commented] (HDFS-12396) Webhdfs file system should get delegation token from kms provider.

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225807#comment-16225807 ] Hadoop QA commented on HDFS-12396: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12682: - Attachment: HDFS-12682.04.patch Attaching patch 4 which is a hybrid solution between the approaches in pat

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225782#comment-16225782 ] Tsz Wo Nicholas Sze commented on HDFS-12594: We could also use on-disk key-val

[jira] [Comment Edited] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225679#comment-16225679 ] Wei-Chiu Chuang edited comment on HDFS-12725 at 10/30/17 9:23 PM: --

[jira] [Commented] (HDFS-12746) DataNode Audit Logger

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225750#comment-16225750 ] Anu Engineer commented on HDFS-12746: - bq. I'm not sure about machine readable. Did yo

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225724#comment-16225724 ] Steve Loughran commented on HDFS-7878: -- Bits I Understand are +1 from me > API - expo

[jira] [Commented] (HDFS-12718) Ozone: fix thread number calculation in CBlockManager

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225728#comment-16225728 ] Hadoop QA commented on HDFS-12718: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-206) Support for head in FSShell

2017-10-30 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225717#comment-16225717 ] Gabor Bota commented on HDFS-206: - Ok, thanks! I also agree that closing the resource like t

[jira] [Commented] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225705#comment-16225705 ] Xiaoyu Yao commented on HDFS-12474: --- Thanks [~nandakumar131] for working on it. The patc

[jira] [Updated] (HDFS-12743) Ozone: Fix Ozone's env vars (again)

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12743: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target Ver

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225679#comment-16225679 ] Wei-Chiu Chuang commented on HDFS-12725: Hi [~xiaochen] thanks for filing the jira

[jira] [Updated] (HDFS-12743) Ozone: Fix Ozone's env vars (again)

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12743: Summary: Ozone: Fix Ozone's env vars (again) (was: Fix Ozone's env vars (again)) > Ozone: Fix Ozon

[jira] [Commented] (HDFS-12743) Fix Ozone's env vars (again)

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225676#comment-16225676 ] Anu Engineer commented on HDFS-12743: - +1, Thank you for catching this and fixing this

[jira] [Commented] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225674#comment-16225674 ] Chris Douglas commented on HDFS-9914: - Odd, {{TestWebHdfsTimeouts}} always fails for me

[jira] [Commented] (HDFS-12746) DataNode Audit Logger

2017-10-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225664#comment-16225664 ] Erik Krogen commented on HDFS-12746: Thanks for the feedback [~anu]! I agree with you

[jira] [Commented] (HDFS-12746) DataNode Audit Logger

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225651#comment-16225651 ] Anu Engineer commented on HDFS-12746: - [~xkrogen] It is an interesting idea. Recently

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225630#comment-16225630 ] Anu Engineer commented on HDFS-12734: - maybe we should check-in a dummy config.toml fo

[jira] [Commented] (HDFS-12738) Namenode logs many "SSL renegotiate denied" warnings after enable HTTPS for HDFS

2017-10-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225616#comment-16225616 ] Xiaoyu Yao commented on HDFS-12738: --- [~kihwal], on a pretty idle newly setup of 3 node c

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225586#comment-16225586 ] Tsz Wo Nicholas Sze commented on HDFS-12594: Indeed, it may be possible for Di

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225571#comment-16225571 ] Tsz Wo Nicholas Sze commented on HDFS-12594: > Implementing RemoteIterator cla

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-30 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225562#comment-16225562 ] Sean Busbey commented on HDFS-12711: interesting. what's the spread on surefire versio

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-30 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Attachment: HDFS-12594.004.patch The patch addresses: 1) CheckStyle issues 2)FindBugs

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-10-30 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225532#comment-16225532 ] Jitendra Nath Pandey commented on HDFS-7240: [~shv] Thank you for taking out ti

[jira] [Commented] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225504#comment-16225504 ] Tsz Wo Nicholas Sze commented on HDFS-12720: Patch looks good. Just some mino

[jira] [Created] (HDFS-12746) DataNode Audit Logger

2017-10-30 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-12746: -- Summary: DataNode Audit Logger Key: HDFS-12746 URL: https://issues.apache.org/jira/browse/HDFS-12746 Project: Hadoop HDFS Issue Type: Improvement Compo

[jira] [Updated] (HDFS-10380) libhdfs++: Get rid of socket template parameter in RpcConnection

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10380: --- Assignee: James Clampffer (was: James Clampffer) Status: Open (was: Patch Available) >

[jira] [Updated] (HDFS-9227) Check block checksums for integrity

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9227: -- Assignee: James Clampffer (was: James Clampffer) Status: Open (was: Patch Available) > Ch

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225462#comment-16225462 ] Hadoop QA commented on HDFS-7240: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11544: --- Status: Open (was: Patch Available) > libhdfs++: Improve C API error reporting >

[jira] [Updated] (HDFS-12427) libhdfs++: Prevent Requests from holding dangling pointer to RpcEngine

2017-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-12427: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed the 001 patch tha

[jira] [Commented] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225450#comment-16225450 ] Hadoop QA commented on HDFS-12720: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225441#comment-16225441 ] Arpit Agarwal commented on HDFS-12498: -- +1 for the v05 patch, pending Jenkins. > Jou

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-30 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225424#comment-16225424 ] Bharat Viswanadham commented on HDFS-12498: --- [~arpitagarwal] Fixed checkstyle is

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-30 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12498: -- Attachment: HDFS-12498.05.patch > Journal Syncer is not started in Federated + HA cluste

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225404#comment-16225404 ] Hanisha Koneru commented on HDFS-12498: --- Yes. Patch v04 LGTM. Thanks. > Journal Syn

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-30 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16225394#comment-16225394 ] Íñigo Goiri commented on HDFS-7878: --- [~chris.douglas], thanks for pushing this. V21 LGTM.

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-30 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.09.patch Accidentally picked up a v06 change in v08. This is ready for revi

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Labels: hdfs-ec-3.0-must-do (was: ) > BlockPlacementPolicyRackFaultTolerant still fails with racks with v

[jira] [Assigned] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-10-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-12116: Assignee: Gabor Bota (was: Xiao Chen) Sure Gabor, thanks for helping! Assigning this to you. :) >

  1   2   >