[jira] [Commented] (HDFS-11828) [READ] Refactor FsDatasetImpl to use the BlockAlias from ClientProtocol for PROVIDED blocks.

2017-08-22 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137942#comment-16137942 ] Virajith Jalaparti commented on HDFS-11828: --- [~ehiggs], Similar to HDFS-11639,

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137938#comment-16137938 ] Hadoop QA commented on HDFS-12283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11639) [READ] Encode the BlockAlias in the client protocol

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137939#comment-16137939 ] Hadoop QA commented on HDFS-11639: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11639) [READ] Encode the BlockAlias in the client protocol

2017-08-22 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137937#comment-16137937 ] Virajith Jalaparti commented on HDFS-11639: --- Hi [~ehiggs], As this change is req

[jira] [Comment Edited] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137912#comment-16137912 ] Weiwei Yang edited comment on HDFS-12282 at 8/23/17 5:25 AM: -

[jira] [Updated] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12327: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolv

[jira] [Comment Edited] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137912#comment-16137912 ] Weiwei Yang edited comment on HDFS-12282 at 8/23/17 5:24 AM: -

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137912#comment-16137912 ] Weiwei Yang commented on HDFS-12282: Ah [~anu], I think you are right, this worker thr

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137899#comment-16137899 ] Weiwei Yang commented on HDFS-12327: +1 to v3 patch, I will commit this shortly. > Oz

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137891#comment-16137891 ] Anu Engineer commented on HDFS-12282: - bq. SCMNodeManager#handleHeartbeat is already a

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.16.patch Thanks a lot Wei-Chiu! Patch 16 to fix checkstyles, and edited a few log c

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136469#comment-16136469 ] Xiao Chen edited comment on HDFS-10899 at 8/23/17 4:26 AM: --- bq.

[jira] [Commented] (HDFS-12339) NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper

2017-08-22 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137866#comment-16137866 ] John Zhuge commented on HDFS-12339: --- Thanks [~saileshpatel] for the great report with so

[jira] [Updated] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-22 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12283: -- Attachment: HDFS-12283-HDFS-7240.008.patch fix the checkstyle issue. > Ozone: DeleteKey-5: Implement SC

[jira] [Updated] (HDFS-12328) Ozone: Purge metadata of deleted blocks after max retry times

2017-08-22 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12328: -- Description: In HDFS-12283, we set the value of count to -1 if blocks cannot be deleted after max retry

[jira] [Commented] (HDFS-12339) NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper

2017-08-22 Thread Sailesh Patel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137817#comment-16137817 ] Sailesh Patel commented on HDFS-12339: -- 2017-08-22 18:40:02,817 TRACE org.apache.hado

[jira] [Created] (HDFS-12339) NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper

2017-08-22 Thread Sailesh Patel (JIRA)
Sailesh Patel created HDFS-12339: Summary: NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper Key: HDFS-12339 URL: https://issues.apache.org/jira/browse/HDFS-12339

[jira] [Comment Edited] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137598#comment-16137598 ] Uma Maheswara Rao G edited comment on HDFS-12225 at 8/23/17 1:21 AM: ---

[jira] [Commented] (HDFS-12294) Let distcp to bypass external attribute provider when calling getFileStatus etc at source cluster

2017-08-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137676#comment-16137676 ] Chris Douglas commented on HDFS-12294: -- Replied on HDFS-12295, to keep the discussion

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137675#comment-16137675 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12295) NameNode to support file path prefix /.reserved/bypassExtAttr

2017-08-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137674#comment-16137674 ] Chris Douglas commented on HDFS-12295: -- If the subtree under {{/.reserved/bypassExtAt

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137598#comment-16137598 ] Uma Maheswara Rao G commented on HDFS-12225: Hi [~surendrasingh] thanks for up

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: HDFS-11888-HDFS-7240.004.patch Patch 003 contains some unexpected YARN changes from IntelliJ

[jira] [Comment Edited] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137583#comment-16137583 ] Xiaoyu Yao edited comment on HDFS-11888 at 8/22/17 11:15 PM: -

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137468#comment-16137468 ] Wei-Chiu Chuang edited comment on HDFS-10899 at 8/22/17 11:09 PM: --

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-005.patch Fixing unit tests by adding back non-use metric. > Federa

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137535#comment-16137535 ] Hadoop QA commented on HDFS-11888: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137490#comment-16137490 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137484#comment-16137484 ] Hadoop QA commented on HDFS-12334: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137468#comment-16137468 ] Wei-Chiu Chuang edited comment on HDFS-10899 at 8/22/17 9:55 PM: ---

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137468#comment-16137468 ] Wei-Chiu Chuang commented on HDFS-10899: Thanks for the rev015 patch! Looks like

[jira] [Created] (HDFS-12338) Ozone: SCM: clean up containers that timeout during creation

2017-08-22 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12338: - Summary: Ozone: SCM: clean up containers that timeout during creation Key: HDFS-12338 URL: https://issues.apache.org/jira/browse/HDFS-12338 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137393#comment-16137393 ] Hadoop QA commented on HDFS-11888: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-004.patch Fixing unit findbugs. > Federation Metrics >

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-22 Thread Mikhail Erofeev (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137312#comment-16137312 ] Mikhail Erofeev commented on HDFS-12292: Hey [~msingh], thank you. 1) The logic i

[jira] [Commented] (HDFS-7967) Reduce the performance impact of the balancer

2017-08-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137268#comment-16137268 ] Kihwal Lee commented on HDFS-7967: -- [~djp], the progress is stalled because the replica tr

[jira] [Comment Edited] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137266#comment-16137266 ] Chen Liang edited comment on HDFS-12334 at 8/22/17 7:38 PM: To

[jira] [Updated] (HDFS-12334) [branch-2] Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-08-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12334: -- Attachment: HDFS-12334-branch-2.002.patch To trigger Jenkins. > [branch-2] Add storage type demand to i

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137253#comment-16137253 ] Anu Engineer commented on HDFS-11888: - +1, LGTM. I closely reviewed patch v2 and skimm

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137233#comment-16137233 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: HDFS-11888-HDFS-7240.003.patch > Ozone: SCM: use container state machine for open containers

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137215#comment-16137215 ] Xiaoyu Yao commented on HDFS-11888: --- Thanks [~vagarychen] for the review. I attached a n

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-22 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137209#comment-16137209 ] Manoj Govindassamy commented on HDFS-12191: --- Thanks for working on this [~yzhang

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: HDFS-11888-HDFS-7240.002.patch > Ozone: SCM: use container state machine for open containers

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: (was: HDFS-12181-HDFS-7240.002.patch) > Ozone: SCM: use container state machine for open

[jira] [Updated] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11888: -- Attachment: HDFS-12181-HDFS-7240.002.patch > Ozone: SCM: use container state machine for open containers

[jira] [Comment Edited] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137172#comment-16137172 ] Xiaoyu Yao edited comment on HDFS-11888 at 8/22/17 6:37 PM: Th

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137172#comment-16137172 ] Xiaoyu Yao commented on HDFS-11888: --- Thanks [~anu] for the detailed review. bq. BlockC

[jira] [Commented] (HDFS-11888) Ozone: SCM: use container state machine for open containers allocated for key/blcoks

2017-08-22 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137173#comment-16137173 ] Chen Liang commented on HDFS-11888: --- Thanks [~xyao] for taking care of this! Looks prett

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137086#comment-16137086 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-003.patch Fixed findbugs. > Federation Metrics > --

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16137031#comment-16137031 ] Hadoop QA commented on HDFS-10899: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12335) Federation Metrics

2017-08-22 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12335: --- Attachment: HDFS-12335-HDFS-10467-002.patch Fixing unit tests. > Federation Metrics > ---

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136983#comment-16136983 ] Hadoop QA commented on HDFS-12336: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12337) Ozone: Concurrent RocksDB open calls fail because of "No locks available"

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136939#comment-16136939 ] Hadoop QA commented on HDFS-12337: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-22 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136897#comment-16136897 ] Wellington Chevreuil commented on HDFS-12182: - I believe the test failures are

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Status: Patch Available (was: Open) > Add functionality to re-encrypt EDEKs > ---

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-22 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12336: Status: Patch Available (was: Open) > Listing encryption zones still fails when del

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-22 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12336: Attachment: HDFS-12336.001.patch Proposing initial patch with changes to also cover

[jira] [Updated] (HDFS-12337) Ozone: Concurrent RocksDB open calls fail because of "No locks available"

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12337: - Attachment: HDFS-12337-HDFS-7240.001.patch > Ozone: Concurrent RocksDB open calls fail bec

[jira] [Updated] (HDFS-12337) Ozone: Concurrent RocksDB open calls fail because of "No locks available"

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12337: - Status: Patch Available (was: Open) > Ozone: Concurrent RocksDB open calls fail because o

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136758#comment-16136758 ] Hadoop QA commented on HDFS-12225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-12337) Ozone: Concurrent RocksDB open calls fail because of "No locks available"

2017-08-22 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12337: Summary: Ozone: Concurrent RocksDB open calls fail because of "No locks available" Key: HDFS-12337 URL: https://issues.apache.org/jira/browse/HDFS-12337 Proje

[jira] [Created] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-22 Thread Wellington Chevreuil (JIRA)
Wellington Chevreuil created HDFS-12336: --- Summary: Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory Key: HDFS-12336 URL: https://issues.apache.org/jira/br

[jira] [Commented] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136647#comment-16136647 ] Hadoop QA commented on HDFS-11968: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136641#comment-16136641 ] Surendra Singh Lilhore commented on HDFS-12225: --- Attached updated patch. Ple

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12225: -- Attachment: HDFS-12225-HDFS-10285-08.patch > [SPS]: Optimize extended attributes

[jira] [Commented] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136628#comment-16136628 ] Hadoop QA commented on HDFS-12283: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136620#comment-16136620 ] Hadoop QA commented on HDFS-12282: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12216) Ozone: TestKeys is failing consistently

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136610#comment-16136610 ] Mukul Kumar Singh commented on HDFS-12216: -- Looked into the recent failures after

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136595#comment-16136595 ] Hadoop QA commented on HDFS-12280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136579#comment-16136579 ] Yiqun Lin commented on HDFS-12280: -- The error was thrown from the following exception tha

[jira] [Updated] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11968: - Status: Patch Available (was: Open) > ViewFS: StoragePolicies commands fail with HDFS fed

[jira] [Updated] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11968: - Attachment: HDFS-11968.001.patch > ViewFS: StoragePolicies commands fail with HDFS federat

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136551#comment-16136551 ] Hadoop QA commented on HDFS-12327: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12282: --- Attachment: HDFS-12282-HDFS-7240.003.patch > Ozone: DeleteKey-4: Block delete via HB between SCM and D

[jira] [Updated] (HDFS-12283) Ozone: DeleteKey-5: Implement SCM DeletedBlockLog

2017-08-22 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-12283: -- Attachment: HDFS-12283-HDFS-7240.007.patch upload v7 patch > Ozone: DeleteKey-5: Implement SCM DeletedB

[jira] [Commented] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136510#comment-16136510 ] Hadoop QA commented on HDFS-12327: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136494#comment-16136494 ] Hadoop QA commented on HDFS-12282: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136492#comment-16136492 ] Mukul Kumar Singh commented on HDFS-12280: -- [~anu], TestKeys is still failing occ

[jira] [Updated] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-22 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12280: --- Attachment: HDFS-12280-HDFS-7240.002.patch I have included the changes suggested by [~msingh]. TestKe

[jira] [Comment Edited] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136455#comment-16136455 ] Xiao Chen edited comment on HDFS-10899 at 8/22/17 8:04 AM: --- Than

[jira] [Commented] (HDFS-12292) Federation: Support viewfs:// schema path for DfsAdmin commands

2017-08-22 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136484#comment-16136484 ] Mukul Kumar Singh commented on HDFS-12292: -- Thanks for the updated patch [~erofee

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.15.patch > Add functionality to re-encrypt EDEKs >

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136480#comment-16136480 ] Xiao Chen commented on HDFS-10899: -- Patch 15 uploaded, still based on PATCH-14705.. Add

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136469#comment-16136469 ] Xiao Chen commented on HDFS-10899: -- bq. ReencryptionUpdater#throttle(): updater would kee

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136462#comment-16136462 ] Xiao Chen commented on HDFS-10899: -- bq. It looks like ReencryptionTask.batch does not nee

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

2017-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136458#comment-16136458 ] Weiwei Yang commented on HDFS-12282: Hi [~anu] {{SCMNodeManager#sendHeartbeat}} is th

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136455#comment-16136455 ] Xiao Chen commented on HDFS-10899: -- Thanks a lot for the reviews [~jojochuang], good comm

[jira] [Updated] (HDFS-12327) Ozone: support setting timeout in background service

2017-08-22 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12327: - Attachment: HDFS-12327-HDFS-7240.003.patch > Ozone: support setting timeout in background service > --

[jira] [Commented] (HDFS-12335) Federation Metrics

2017-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16136418#comment-16136418 ] Hadoop QA commented on HDFS-12335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote