[jira] [Created] (HDDS-3284) ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3284: -- Summary: ozonesecure-mr test fails due to lack of disk space Key: HDDS-3284 URL: https://issues.apache.org/jira/browse/HDDS-3284 Project: Hadoop Distributed Data S

[jira] [Commented] (HDDS-3271) The block file is not deleted after the key is deleted

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067551#comment-17067551 ] mingchao zhao commented on HDDS-3271: - Hi [~msingh] Thank you for your discussion. >T

[jira] [Updated] (HDDS-3284) ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3284: - Labels: pull-request-available (was: ) > ozonesecure-mr test fails due to lack of disk space > --

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
adoroszlai opened a new pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725 ## What changes were proposed in this pull request? Disable YARN disk utilization check in `ozonesecure-mr` acceptance test.

[jira] [Updated] (HDDS-3284) ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3284: --- Status: Patch Available (was: In Progress) > ozonesecure-mr test fails due to lack of disk sp

[jira] [Comment Edited] (HDDS-3271) The block file is not deleted after the key is deleted

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067551#comment-17067551 ] mingchao zhao edited comment on HDDS-3271 at 3/26/20, 10:36 AM:

[jira] [Comment Edited] (HDDS-3271) The block file is not deleted after the key is deleted

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067551#comment-17067551 ] mingchao zhao edited comment on HDDS-3271 at 3/26/20, 10:37 AM:

[GitHub] [hadoop-ozone] sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604386700 Thanks for looking into this. +1 on this from me, pending CI, but some of the "it-*" tests are a bit flaky.

[GitHub] [hadoop-ozone] adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604392865 Thanks @sodonnel. Since it only changes acceptance tests, I think we can merge it even if `it-client` happens to f

[GitHub] [hadoop-ozone] sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
sodonnel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604396747 Yea, I have seen random failures on it-client. As this is a yarn only change, I cannot see how it could impact the in

[jira] [Commented] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-03-26 Thread Isa Hekmatizadeh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067652#comment-17067652 ] Isa Hekmatizadeh commented on HDDS-3267: please assign this task to me, I'm curren

[GitHub] [hadoop-ozone] sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604425486 Acceptance is failing with: ``` ===

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r398582704 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeli

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r398601166 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/pipeli

[GitHub] [hadoop-ozone] sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604452924 Thanks for the updates here. I think the code looks much cleaner now with the debug statements and refactored

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r398621936 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/pi

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r398622023 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pi

[GitHub] [hadoop-ozone] timmylicheng commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
timmylicheng commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604466974 > Thanks for the updates here. I think the code looks much cleaner now with the debug statements and refac

[GitHub] [hadoop-ozone] sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-26 Thread GitBox
sodonnel commented on issue #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#issuecomment-604486699 Thanks for quickly addressing the final issues. I am +1 on this now. I will commit it later pending the

[jira] [Assigned] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-03-26 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-3267: --- Assignee: Isa Hekmatizadeh > Replace ContainerCache in BlockUtils by LoadingCache > -

[jira] [Commented] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-03-26 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067774#comment-17067774 ] Mukul Kumar Singh commented on HDDS-3267: - [~esa.hekmat], I have added you as a co

[jira] [Created] (HDDS-3285) MiniOzoneChaosCluster exits because of deadline exceeding

2020-03-26 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-3285: --- Summary: MiniOzoneChaosCluster exits because of deadline exceeding Key: HDDS-3285 URL: https://issues.apache.org/jira/browse/HDDS-3285 Project: Hadoop Distribute

[jira] [Updated] (HDDS-3285) MiniOzoneChaosCluster exits because of deadline exceeding

2020-03-26 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-3285: Description: 2020-03-26 21:26:48,869 [pool-326-thread-2] INFO util.ExitUtil (ExitUtil.java

[jira] [Updated] (HDDS-3285) MiniOzoneChaosCluster exits because of deadline exceeding

2020-03-26 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDDS-3285: Description: 2020-03-26 21:26:48,869 [pool-326-thread-2] INFO util.ExitUtil (ExitUtil.java

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #399: HDDS-2424. Add the recover-trash command server side handling.

2020-03-26 Thread GitBox
bharatviswa504 commented on a change in pull request #399: HDDS-2424. Add the recover-trash command server side handling. URL: https://github.com/apache/hadoop-ozone/pull/399#discussion_r398700964 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/res

[GitHub] [hadoop-ozone] vivekratnavel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
vivekratnavel commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604541141 +1 LGTM. This is an automated message from the

[jira] [Commented] (HDDS-3088) maxRetries value is too large while trying to reconnect to SCM server

2020-03-26 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17067895#comment-17067895 ] Arpit Agarwal commented on HDDS-3088: - cc [~shashikant], does this tie in with the ret

[jira] [Updated] (HDDS-3267) Replace ContainerCache in BlockUtils by LoadingCache

2020-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3267: - Labels: pull-request-available (was: ) > Replace ContainerCache in BlockUtils by LoadingCache > -

[GitHub] [hadoop-ozone] esahekmat opened a new pull request #726: HDDS-3267. replace containerCache in blockUtils by LoadingCache

2020-03-26 Thread GitBox
esahekmat opened a new pull request #726: HDDS-3267. replace containerCache in blockUtils by LoadingCache URL: https://github.com/apache/hadoop-ozone/pull/726 ## What changes were proposed in this pull request? ContainerCache removed and instead of it, LoadingCache replaced in BlockUtil

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
hanishakoneru commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604623673 Thanks @adoroszlai for working on this. I will go ahead and merge this as the change is only in acceptance tests

[GitHub] [hadoop-ozone] hanishakoneru merged pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
hanishakoneru merged pull request #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests

2020-03-26 Thread GitBox
hanishakoneru commented on issue #723: HDDS-3281. Add timeouts to all robot tests URL: https://github.com/apache/hadoop-ozone/pull/723#issuecomment-604676324 @adoroszlai, I think even with that limitation the timeout will help us isolate the problem. Let's say the acceptance suit is cancel

[GitHub] [hadoop-ozone] adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space

2020-03-26 Thread GitBox
adoroszlai commented on issue #725: HDDS-3284. ozonesecure-mr test fails due to lack of disk space URL: https://github.com/apache/hadoop-ozone/pull/725#issuecomment-604678295 Thanks @sodonnel and @vivekratnavel for the review, and @hanishakoneru for merging it. ---

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit

2020-03-26 Thread GitBox
bharatviswa504 commented on a change in pull request #625: HDDS-2980. Delete replayed entry from OpenKeyTable during commit URL: https://github.com/apache/hadoop-ozone/pull/625#discussion_r398972414 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/r

[jira] [Updated] (HDDS-3273) OM HA: getconf must return all OMs

2020-03-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3273: - Labels: pull-request-available (was: ) > OM HA: getconf must return all OMs > ---

[GitHub] [hadoop-ozone] swagle opened a new pull request #727: HDDS-3273. getConf does not return all OM addresses.

2020-03-26 Thread GitBox
swagle opened a new pull request #727: HDDS-3273. getConf does not return all OM addresses. URL: https://github.com/apache/hadoop-ozone/pull/727 ## What changes were proposed in this pull request? Added a new utility method to return a list of addresses keyed by serviceId. ## Wha

[GitHub] [hadoop-ozone] swagle commented on issue #727: HDDS-3273. getConf does not return all OM addresses.

2020-03-26 Thread GitBox
swagle commented on issue #727: HDDS-3273. getConf does not return all OM addresses. URL: https://github.com/apache/hadoop-ozone/pull/727#issuecomment-604774954 cc: @xiaoyuyao / @bharatviswa504 for review. This is an automate

[GitHub] [hadoop-ozone] swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time.

2020-03-26 Thread GitBox
swagle commented on issue #718: HDDS-3224. Enforce volume and bucket name rule at create time. URL: https://github.com/apache/hadoop-ozone/pull/718#issuecomment-604776938 S3BucketCreateRequest checked for length but the verifyResourceName is more comprehensive. We are still doing length

[jira] [Resolved] (HDDS-3271) The block file is not deleted after the key is deleted

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao resolved HDDS-3271. - Resolution: Not A Problem > The block file is not deleted after the key is deleted > -

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #721: HDDS-3279. Rebase OFS branch

2020-03-26 Thread GitBox
xiaoyuyao commented on issue #721: HDDS-3279. Rebase OFS branch URL: https://github.com/apache/hadoop-ozone/pull/721#issuecomment-604791737 +1. Please go ahead push the change **outside github as Squash and merge is the only option with github.** --

[jira] [Created] (HDDS-3286) Support batchDelete when deleting path.

2020-03-26 Thread mingchao zhao (Jira)
mingchao zhao created HDDS-3286: --- Summary: Support batchDelete when deleting path. Key: HDDS-3286 URL: https://issues.apache.org/jira/browse/HDDS-3286 Project: Hadoop Distributed Data Store Iss

[jira] [Updated] (HDDS-3286) Support batchDelete when deleting path.

2020-03-26 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-3286: Description: Currently delete file is to get all the keys in the directory, and then delete one by

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses.

2020-03-26 Thread GitBox
bharatviswa504 commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses. URL: https://github.com/apache/hadoop-ozone/pull/727#discussion_r399039110 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java #

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses.

2020-03-26 Thread GitBox
bharatviswa504 commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses. URL: https://github.com/apache/hadoop-ozone/pull/727#discussion_r399039110 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java #

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent.

2020-03-26 Thread GitBox
bharatviswa504 commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent. URL: https://github.com/apache/hadoop-ozone/pull/722#issuecomment-604819927 Test failures are unrelated. This is an auto

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #722: HDDS-3074. Make the configuration of container scrub consistent.

2020-03-26 Thread GitBox
bharatviswa504 merged pull request #722: HDDS-3074. Make the configuration of container scrub consistent. URL: https://github.com/apache/hadoop-ozone/pull/722 This is an automated message from the Apache Git Service. To resp

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent.

2020-03-26 Thread GitBox
bharatviswa504 commented on issue #722: HDDS-3074. Make the configuration of container scrub consistent. URL: https://github.com/apache/hadoop-ozone/pull/722#issuecomment-604820134 Thank You @cku328 for the contribution. This

[jira] [Resolved] (HDDS-3074) Make the configuration of container scrub consistent

2020-03-26 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-3074. -- Fix Version/s: 0.6.0 Resolution: Fixed > Make the configuration of container scru

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses.

2020-03-26 Thread GitBox
swagle commented on a change in pull request #727: HDDS-3273. getConf does not return all OM addresses. URL: https://github.com/apache/hadoop-ozone/pull/727#discussion_r399053289 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java ## @@ -8