[jira] [Updated] (HDDS-3795) No coverage reported for Ozone FS

2020-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3795: - Labels: pull-request-available (was: ) > No coverage reported for Ozone FS >

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1071: HDDS-3795. No coverage reported for Ozone FS

2020-06-12 Thread GitBox
adoroszlai opened a new pull request #1071: URL: https://github.com/apache/hadoop-ozone/pull/1071 ## What changes were proposed in this pull request? Ozone FS has some tests, but [0% coverage](https://codecov.io/gh/apache/hadoop-ozone/tree/96f07d5c27ba8f2ab9d77df25e10d4cb94489e5f/had

[jira] [Created] (HDDS-3796) Allow running coverage locally

2020-06-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3796: -- Summary: Allow running coverage locally Key: HDDS-3796 URL: https://issues.apache.org/jira/browse/HDDS-3796 Project: Hadoop Distributed Data Store Issue

[jira] [Created] (HDDS-3795) No coverage reported for Ozone FS

2020-06-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3795: -- Summary: No coverage reported for Ozone FS Key: HDDS-3795 URL: https://issues.apache.org/jira/browse/HDDS-3795 Project: Hadoop Distributed Data Store Iss

[jira] [Resolved] (HDDS-3768) Fix a typo in StorageContainerNodeProtocol#register

2020-06-12 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-3768. - Fix Version/s: 0.6.0 Resolution: Fixed > Fix a typo in StorageContainerNodeProtocol

[GitHub] [hadoop-ozone] dineshchitlangia merged pull request #1045: HDDS-3768. Fix a typo in StorageContainerNodeProtocol#register

2020-06-12 Thread GitBox
dineshchitlangia merged pull request #1045: URL: https://github.com/apache/hadoop-ozone/pull/1045 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1066: HDDS-3770. Improve getPipelines performance

2020-06-12 Thread GitBox
xiaoyuyao commented on a change in pull request #1066: URL: https://github.com/apache/hadoop-ozone/pull/1066#discussion_r439691874 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/SCMContainerManager.java ## @@ -416,13 +417,12 @@ public v

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #921: HDDS-3583. Loosen some rule restrictions of checkstyle

2020-06-12 Thread GitBox
xiaoyuyao commented on pull request #921: URL: https://github.com/apache/hadoop-ozone/pull/921#issuecomment-643532154 Thanks all for the discussion, this change can be arguable from both sides. If I understand correctly, @anuengineer indicated a valid binding veto here. According to the pr

[GitHub] [hadoop-ozone] vivekratnavel commented on pull request #921: HDDS-3583. Loosen some rule restrictions of checkstyle

2020-06-12 Thread GitBox
vivekratnavel commented on pull request #921: URL: https://github.com/apache/hadoop-ozone/pull/921#issuecomment-643516494 @maobaolong @sodonnel I agree with you both. I like the approach of starting a vote thread similar to a normal release or merge vote and give it 7 days for responses. I

[jira] [Issue Comment Deleted] (HDDS-1202) Detection and Reporting of Orphan Chunks

2020-06-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-1202: Comment: was deleted (was: [~sdeka] I will take a stab at this. ) > Detection and Reporting

[jira] [Assigned] (HDDS-1202) Detection and Reporting of Orphan Chunks

2020-06-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-1202: --- Assignee: (was: Aravindan Vijayan) > Detection and Reporting of Orphan Chunks > -

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1070: HDDS-3785. Update topology.aware.read parameter in ozone-topology compose config

2020-06-12 Thread GitBox
codecov-commenter commented on pull request #1070: URL: https://github.com/apache/hadoop-ozone/pull/1070#issuecomment-643508362 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1070?src=pr&el=h1) Report > Merging [#1070](https://codecov.io/gh/apache/hadoop-ozone/pull/1070?src

[GitHub] [hadoop-ozone] sodonnel commented on pull request #921: HDDS-3583. Loosen some rule restrictions of checkstyle

2020-06-12 Thread GitBox
sodonnel commented on pull request #921: URL: https://github.com/apache/hadoop-ozone/pull/921#issuecomment-643494970 > There are still lots of contributor around me complain with the 80 character per line limitation. > So a month past, a vehemently discussion has taken place in the m

[jira] [Updated] (HDDS-2991) Support ACL in OFS

2020-06-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2991: - Target Version/s: 0.7.0 (was: 0.6.0) > Support ACL in OFS > -- > > Key: H

[jira] [Commented] (HDDS-2991) Support ACL in OFS

2020-06-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134547#comment-17134547 ] Xiaoyu Yao commented on HDDS-2991: -- Move to 0.7.0 as it involves mapping hadoop acl to oz

[jira] [Updated] (HDDS-2991) Support ACL in OFS

2020-06-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2991: - Labels: Triaged (was: TriagePending) > Support ACL in OFS > -- > > Key: H

[jira] [Updated] (HDDS-3785) Update topology.aware.read parameter in ozone-topology compose config

2020-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3785: - Labels: pull-request-available (was: ) > Update topology.aware.read parameter in ozone-topology c

[GitHub] [hadoop-ozone] sodonnel opened a new pull request #1070: HDDS-3785. Update topology.aware.read parameter in ozone-topology compose config

2020-06-12 Thread GitBox
sodonnel opened a new pull request #1070: URL: https://github.com/apache/hadoop-ozone/pull/1070 ## What changes were proposed in this pull request? HDDS-1865 updated the parameter dfs.network.topology.aware.read.enable to ozone.network.topology.aware.read, but in the docker-compose c

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #933: HDDS-3604. Use Ozone version from Hadoop Sercurity/Token classes

2020-06-12 Thread GitBox
xiaoyuyao commented on pull request #933: URL: https://github.com/apache/hadoop-ozone/pull/933#issuecomment-643480495 Thanks @vinayakumarb for the patch. It LGTM but needs a rebase after recent master changes. This is an a

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1002: HDDS-3642. Stop/Pause Background services while replacing OM DB with checkpoint from Leader

2020-06-12 Thread GitBox
codecov-commenter edited a comment on pull request #1002: URL: https://github.com/apache/hadoop-ozone/pull/1002#issuecomment-642325738 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1002?src=pr&el=h1) Report > Merging [#1002](https://codecov.io/gh/apache/hadoop-ozone/pull/1

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1051: Redundancy if condition code in ListPipelinesSubcommand

2020-06-12 Thread GitBox
codecov-commenter commented on pull request #1051: URL: https://github.com/apache/hadoop-ozone/pull/1051#issuecomment-643451424 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1051?src=pr&el=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@12387

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1044: HDDS-3743. Avoid NetUtils#normalize when get DatanodeDetails from proto

2020-06-12 Thread GitBox
xiaoyuyao commented on a change in pull request #1044: URL: https://github.com/apache/hadoop-ozone/pull/1044#discussion_r439589149 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/scm/net/NetUtils.java ## @@ -59,9 +64,12 @@ public static String normalize(S

[GitHub] [hadoop-ozone] bhemanthkumar commented on pull request #1069: Remove the redundancy if condition code in ListPipelinesSubcommand

2020-06-12 Thread GitBox
bhemanthkumar commented on pull request #1069: URL: https://github.com/apache/hadoop-ozone/pull/1069#issuecomment-643425889 raised another PR This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [hadoop-ozone] bhemanthkumar closed pull request #1069: Remove the redundancy if condition code in ListPipelinesSubcommand

2020-06-12 Thread GitBox
bhemanthkumar closed pull request #1069: URL: https://github.com/apache/hadoop-ozone/pull/1069 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [hadoop-ozone] bhemanthkumar opened a new pull request #1069: Remove the redundancy if condition code in ListPipelinesSubcommand

2020-06-12 Thread GitBox
bhemanthkumar opened a new pull request #1069: URL: https://github.com/apache/hadoop-ozone/pull/1069 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## What is the link to the Apache JIRA (Please create an issue in ASF JI

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1002: HDDS-3642. Stop/Pause Background services while replacing OM DB with checkpoint from Leader

2020-06-12 Thread GitBox
bharatviswa504 commented on pull request #1002: URL: https://github.com/apache/hadoop-ozone/pull/1002#issuecomment-643415638 Kicked off CI run, test has not run due to unavailability of artificats. This is an automate

[GitHub] [hadoop-ozone] vivekratnavel commented on pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-12 Thread GitBox
vivekratnavel commented on pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065#issuecomment-643401727 @adoroszlai Thanks for the review! I have merged it now. If there is any issue, we can always revert it.

[GitHub] [hadoop-ozone] vivekratnavel merged pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-12 Thread GitBox
vivekratnavel merged pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[jira] [Updated] (HDDS-3741) Reload old OM state if Install Snapshot from Leader fails

2020-06-12 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-3741: - Target Version/s: 0.6.0 Priority: Critical (was: Major) > Reload old OM state if Inst

[GitHub] [hadoop-ozone] smengcl edited a comment on pull request #1021: HDDS-2665. Implement new Ozone Filesystem scheme ofs://

2020-06-12 Thread GitBox
smengcl edited a comment on pull request #1021: URL: https://github.com/apache/hadoop-ozone/pull/1021#issuecomment-643381693 The only test failure after HDDS-3767 merge is it-hdds-om `TestOzoneManagerHAWithData#testOMRestart`, which is a flaky test also seen on master branch: https://elek.

[GitHub] [hadoop-ozone] smengcl edited a comment on pull request #1021: HDDS-2665. Implement new Ozone Filesystem scheme ofs://

2020-06-12 Thread GitBox
smengcl edited a comment on pull request #1021: URL: https://github.com/apache/hadoop-ozone/pull/1021#issuecomment-643381693 The only test failure after HDDS-3767 merge is it-hdds-om TestOzoneManagerHAWithData#testOMRestart, which is a flaky test also seen on master branch: https://elek.gi

[GitHub] [hadoop-ozone] smengcl commented on pull request #1021: HDDS-2665. Implement new Ozone Filesystem scheme ofs://

2020-06-12 Thread GitBox
smengcl commented on pull request #1021: URL: https://github.com/apache/hadoop-ozone/pull/1021#issuecomment-643381693 The only test failure after HDDS-3767 merge is it-hdds-om TestOzoneManagerHAWithData, which is a flaky test also seen on master branch: https://elek.github.io/ozone-build-r

[jira] [Updated] (HDDS-2175) Propagate System Exceptions from the OzoneManager

2020-06-12 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2175: Target Version/s: 0.7.0 (was: 0.6.0) > Propagate System Exceptions from the OzoneManager >

[GitHub] [hadoop-ozone] maobaolong commented on pull request #921: HDDS-3583. Loosen some rule restrictions of checkstyle

2020-06-12 Thread GitBox
maobaolong commented on pull request #921: URL: https://github.com/apache/hadoop-ozone/pull/921#issuecomment-643350226 There are still lots of contributor around me complain with the 80 character per line limitation. So a month past, a vehemently discussion has taken place in the mai

[jira] [Created] (HDDS-3794) Topology Aware read does not work correctly in XceiverClientGrpc

2020-06-12 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDDS-3794: --- Summary: Topology Aware read does not work correctly in XceiverClientGrpc Key: HDDS-3794 URL: https://issues.apache.org/jira/browse/HDDS-3794 Project: Hadoop Di

[jira] [Commented] (HDDS-1354) Kerberos principal configuration of OzoneManager doesn't use FQDN

2020-06-12 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134268#comment-17134268 ] Marton Elek commented on HDDS-1354: --- Same is true for the docker-compose based environme

[jira] [Commented] (HDDS-1354) Kerberos principal configuration of OzoneManager doesn't use FQDN

2020-06-12 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134263#comment-17134263 ] Marton Elek commented on HDDS-1354: --- I think this is still a problem. In CM environments

[GitHub] [hadoop-ozone] bshashikant commented on pull request #1068: HDDS-3611. Ozone client should not consider closed container error as failure.

2020-06-12 Thread GitBox
bshashikant commented on pull request #1068: URL: https://github.com/apache/hadoop-ozone/pull/1068#issuecomment-643291103 Thanks @lokeshj1703 for working on this. The change looks ok. I think in this case, ozone client has already exhausted the max attempt count trying to write the data

[jira] [Comment Edited] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-06-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134237#comment-17134237 ] Aravindan Vijayan edited comment on HDDS-3765 at 6/12/20, 1:52 PM: -

[jira] [Commented] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-06-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134237#comment-17134237 ] Aravindan Vijayan commented on HDDS-3765: - [~bharat] Thanks for the question. If y

[jira] [Comment Edited] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-06-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134237#comment-17134237 ] Aravindan Vijayan edited comment on HDDS-3765 at 6/12/20, 1:52 PM: -

[jira] [Comment Edited] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-06-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134237#comment-17134237 ] Aravindan Vijayan edited comment on HDDS-3765 at 6/12/20, 1:52 PM: -

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1054: Hdds 3772. Add LOG to S3ErrorTable for easier problem locating.

2020-06-12 Thread GitBox
codecov-commenter edited a comment on pull request #1054: URL: https://github.com/apache/hadoop-ozone/pull/1054#issuecomment-642411148 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1054?src=pr&el=h1) Report > Merging [#1054](https://codecov.io/gh/apache/hadoop-ozone/pull/1

[jira] [Created] (HDDS-3793) Use Hadoop 2.7.2 for ozone-mr/hadoop27 acceptance tests

2020-06-12 Thread Marton Elek (Jira)
Marton Elek created HDDS-3793: - Summary: Use Hadoop 2.7.2 for ozone-mr/hadoop27 acceptance tests Key: HDDS-3793 URL: https://issues.apache.org/jira/browse/HDDS-3793 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-12 Thread GitBox
adoroszlai commented on pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065#issuecomment-643239420 @elek can we merge this? This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Created] (HDDS-3792) Separate client proto files of Ozone to separated subprojects

2020-06-12 Thread Marton Elek (Jira)
Marton Elek created HDDS-3792: - Summary: Separate client proto files of Ozone to separated subprojects Key: HDDS-3792 URL: https://issues.apache.org/jira/browse/HDDS-3792 Project: Hadoop Distributed Data

[jira] [Comment Edited] (HDDS-3721) Implement getContentSummary to provide replicated size properly to dfs -du command

2020-06-12 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134151#comment-17134151 ] Istvan Fajth edited comment on HDDS-3721 at 6/12/20, 11:49 AM: -

[jira] [Comment Edited] (HDDS-3721) Implement getContentSummary to provide replicated size properly to dfs -du command

2020-06-12 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134151#comment-17134151 ] Istvan Fajth edited comment on HDDS-3721 at 6/12/20, 11:48 AM: -

[jira] [Commented] (HDDS-3721) Implement getContentSummary to provide replicated size properly to dfs -du command

2020-06-12 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134151#comment-17134151 ] Istvan Fajth commented on HDDS-3721: At first I thought this one is simply a client si

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1005: HDDS-3350. Ozone Retry Policy Improvements.

2020-06-12 Thread GitBox
codecov-commenter edited a comment on pull request #1005: URL: https://github.com/apache/hadoop-ozone/pull/1005#issuecomment-643219318 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1005?src=pr&el=h1) Report > :exclamation: No coverage uploaded for pull request base (`maste

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1005: HDDS-3350. Ozone Retry Policy Improvements.

2020-06-12 Thread GitBox
codecov-commenter commented on pull request #1005: URL: https://github.com/apache/hadoop-ozone/pull/1005#issuecomment-643219318 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1005?src=pr&el=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@10b64

[jira] [Updated] (HDDS-3611) Ozone client should not consider closed container error as failure

2020-06-12 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDDS-3611: -- Status: Patch Available (was: Open) > Ozone client should not consider closed container error as failur

[jira] [Resolved] (HDDS-3753) SCMPipelineManager's createPipeline method has redundant synchronization modifiers

2020-06-12 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar resolved HDDS-3753. --- Fix Version/s: 0.6.0 Target Version/s: 0.6.0 (was: 0.7.0) Resolution: Fixed > SCMPip

[GitHub] [hadoop-ozone] nandakumar131 merged pull request #1039: HDDS-3753. remove redundant synchronized for SCMPipelineManager's createPipeline method

2020-06-12 Thread GitBox
nandakumar131 merged pull request #1039: URL: https://github.com/apache/hadoop-ozone/pull/1039 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [hadoop-ozone] nandakumar131 commented on pull request #1039: HDDS-3753. remove redundant synchronized for SCMPipelineManager's createPipeline method

2020-06-12 Thread GitBox
nandakumar131 commented on pull request #1039: URL: https://github.com/apache/hadoop-ozone/pull/1039#issuecomment-643211421 Thanks for the contribution @wuweiwei95 This is an automated message from the Apache Git Service. To

[jira] [Updated] (HDDS-3791) Ozone client should not reset retry count after handling exception

2020-06-12 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDDS-3791: -- Component/s: Ozone Client > Ozone client should not reset retry count after handling exception > ---

[jira] [Created] (HDDS-3791) Ozone client should not reset retry count after handling exception

2020-06-12 Thread Lokesh Jain (Jira)
Lokesh Jain created HDDS-3791: - Summary: Ozone client should not reset retry count after handling exception Key: HDDS-3791 URL: https://issues.apache.org/jira/browse/HDDS-3791 Project: Hadoop Distributed

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1057: HDDS-3782. Remove podAntiAffinity from datanode-statefulset

2020-06-12 Thread GitBox
codecov-commenter edited a comment on pull request #1057: URL: https://github.com/apache/hadoop-ozone/pull/1057#issuecomment-642533206 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1057?src=pr&el=h1) Report > Merging [#1057](https://codecov.io/gh/apache/hadoop-ozone/pull/1

[GitHub] [hadoop-ozone] lokeshj1703 opened a new pull request #1068: HDDS-3611. Ozone client should not consider closed container error as failure.

2020-06-12 Thread GitBox
lokeshj1703 opened a new pull request #1068: URL: https://github.com/apache/hadoop-ozone/pull/1068 ## What changes were proposed in this pull request? ContainerNotOpen exception exception is thrown by datanode when client is writing to a non open container. Currently ozone client see

[jira] [Updated] (HDDS-3611) Ozone client should not consider closed container error as failure

2020-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3611: - Labels: TriagePending pull-request-available (was: TriagePending) > Ozone client should not consi

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1061: HDDS-3262. Fix TestOzoneRpcClientWithRatis.java.

2020-06-12 Thread GitBox
codecov-commenter edited a comment on pull request #1061: URL: https://github.com/apache/hadoop-ozone/pull/1061#issuecomment-642615531 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1061?src=pr&el=h1) Report > Merging [#1061](https://codecov.io/gh/apache/hadoop-ozone/pull/1

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1058: HDDS-3778. Block distribution in a pipeline among open containers is not uniform.

2020-06-12 Thread GitBox
codecov-commenter edited a comment on pull request #1058: URL: https://github.com/apache/hadoop-ozone/pull/1058#issuecomment-642582373 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1058?src=pr&el=h1) Report > Merging [#1058](https://codecov.io/gh/apache/hadoop-ozone/pull/1

[GitHub] [hadoop-ozone] elek commented on pull request #1062: HDDS-3783. Upload coverage even if tests failed

2020-06-12 Thread GitBox
elek commented on pull request #1062: URL: https://github.com/apache/hadoop-ozone/pull/1062#issuecomment-643184139 > I think that's due to using wrong base coverage data. I am not sure. I thought `codecov` compares the branch with the master instead of `git merge-base`. Seems to be

[GitHub] [hadoop-ozone] elek commented on pull request #1062: HDDS-3783. Upload coverage even if tests failed

2020-06-12 Thread GitBox
elek commented on pull request #1062: URL: https://github.com/apache/hadoop-ozone/pull/1062#issuecomment-643184526 BTW we can have different rules for codecov / sonarcloud AFAIK. This is an automated message from the Apache G

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1059: HDDS-3779. Add csi interface documents to show how to use ozone csi

2020-06-12 Thread GitBox
maobaolong commented on pull request #1059: URL: https://github.com/apache/hadoop-ozone/pull/1059#issuecomment-643171687 This PR only modify the documents, it cannot fail the tests, so we should collect these fail test and mark as ignore, we can open it until we prove the test recover to s

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-12 Thread GitBox
codecov-commenter edited a comment on pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065#issuecomment-643027469 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1065?src=pr&el=h1) Report > Merging [#1065](https://codecov.io/gh/apache/hadoop-ozone/pull/1

[jira] [Updated] (HDDS-3787) Make CSI command configurable.

2020-06-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3787: - Labels: pull-request-available (was: ) > Make CSI command configurable. > ---

[GitHub] [hadoop-ozone] codecov-commenter edited a comment on pull request #1021: HDDS-2665. Implement new Ozone Filesystem scheme ofs://

2020-06-12 Thread GitBox
codecov-commenter edited a comment on pull request #1021: URL: https://github.com/apache/hadoop-ozone/pull/1021#issuecomment-642834625 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1021?src=pr&el=h1) Report > Merging [#1021](https://codecov.io/gh/apache/hadoop-ozone/pull/1

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #1067: HDDS-3787. Make CSI command configurable.

2020-06-12 Thread GitBox
maobaolong opened a new pull request #1067: URL: https://github.com/apache/hadoop-ozone/pull/1067 ## What changes were proposed in this pull request? It doesn't have to use goofys as the mountable tools to access Ozone. With this PR, we can config a other command to mount file system

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1057: HDDS-3782. Remove podAntiAffinity from datanode-statefulset

2020-06-12 Thread GitBox
maobaolong commented on pull request #1057: URL: https://github.com/apache/hadoop-ozone/pull/1057#issuecomment-643159402 @elek I agree with your suggestion, > I am sure that the real ozone example should have real podAntiAffinity as it provides an example to use real Ozone Thank

[jira] [Commented] (HDDS-3683) Ozone fuse support

2020-06-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17134073#comment-17134073 ] Sammi Chen commented on HDDS-3683: -- Hi [~maobaolong], thanks for update the performance.

[jira] [Created] (HDDS-3790) Add a readme documents for kubernetes/examples

2020-06-12 Thread maobaolong (Jira)
maobaolong created HDDS-3790: Summary: Add a readme documents for kubernetes/examples Key: HDDS-3790 URL: https://issues.apache.org/jira/browse/HDDS-3790 Project: Hadoop Distributed Data Store Is

[GitHub] [hadoop-ozone] bshashikant commented on pull request #1005: HDDS-3350. Ozone Retry Policy Improvements.

2020-06-12 Thread GitBox
bshashikant commented on pull request #1005: URL: https://github.com/apache/hadoop-ozone/pull/1005#issuecomment-643155376 Unit test failures are related. @lokeshj1703 can you please check? This is an automated message from th

[GitHub] [hadoop-ozone] bshashikant commented on pull request #1061: HDDS-3262. Fix TestOzoneRpcClientWithRatis.java.

2020-06-12 Thread GitBox
bshashikant commented on pull request #1061: URL: https://github.com/apache/hadoop-ozone/pull/1061#issuecomment-643154316 Filed https://issues.apache.org/jira/browse/HDDS-3789 to track the unit test failure. This is an autom

[jira] [Updated] (HDDS-3789) Fix TestOzoneRpcClientAbstract#testDeletedKeyForGDPR

2020-06-12 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-3789: -- Parent: HDDS-2964 Issue Type: Sub-task (was: Bug) > Fix TestOzoneRpcClientAbstr

[jira] [Created] (HDDS-3789) Fix TestOzoneRpcClientAbstract#testDeletedKeyForGDPR

2020-06-12 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-3789: - Summary: Fix TestOzoneRpcClientAbstract#testDeletedKeyForGDPR Key: HDDS-3789 URL: https://issues.apache.org/jira/browse/HDDS-3789 Project: Hadoop Distributed

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #814: HDDS-3286. BasicOzoneFileSystem support batchDelete.

2020-06-12 Thread GitBox
codecov-commenter commented on pull request #814: URL: https://github.com/apache/hadoop-ozone/pull/814#issuecomment-643145609 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/814?src=pr&el=h1) Report > :exclamation: No coverage uploaded for pull request base (`master@26d8375`)

[jira] [Updated] (HDDS-3784) Use matrix build for integration test

2020-06-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3784: --- Status: Patch Available (was: In Progress) > Use matrix build for integration test >

[jira] [Created] (HDDS-3788) Introduce TimeDuration class for ConfigType.TIME

2020-06-12 Thread Lokesh Jain (Jira)
Lokesh Jain created HDDS-3788: - Summary: Introduce TimeDuration class for ConfigType.TIME Key: HDDS-3788 URL: https://issues.apache.org/jira/browse/HDDS-3788 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-12 Thread GitBox
adoroszlai commented on a change in pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065#discussion_r439270950 ## File path: hadoop-ozone/recon/pom.xml ## @@ -86,7 +86,7 @@ com.github.eirslett frontend-maven-plugin -1.10.0

[jira] [Assigned] (HDDS-3620) BasicOzoneFileSystem support batchRename

2020-06-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao reassigned HDDS-3620: --- Assignee: mingchao zhao > BasicOzoneFileSystem support batchRename >

[jira] [Resolved] (HDDS-3754) Rename framework to common-server

2020-06-12 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-3754. --- Resolution: Won't Fix > Rename framework to common-server > - > >

[GitHub] [hadoop-ozone] elek closed pull request #1038: HDDS-3754. Rename framework to common-server

2020-06-12 Thread GitBox
elek closed pull request #1038: URL: https://github.com/apache/hadoop-ozone/pull/1038 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hadoop-ozone] elek commented on pull request #1038: HDDS-3754. Rename framework to common-server

2020-06-12 Thread GitBox
elek commented on pull request #1038: URL: https://github.com/apache/hadoop-ozone/pull/1038#issuecomment-643129862 Ok. For me `framework` was not expressive enough. I found that multiple serverside shared dependency (`common`) are added the `hdds/common` (which is not good as it's s

[GitHub] [hadoop-ozone] elek commented on pull request #1057: HDDS-3782. Remove podAntiAffinity from datanode-statefulset

2020-06-12 Thread GitBox
elek commented on pull request #1057: URL: https://github.com/apache/hadoop-ozone/pull/1057#issuecomment-643127553 Thanks to open this issue @maobaolong This approach is already considered, and you can find the arguments in https://issues.apache.org/jira/browse/HDDS-1646 why do we h

[jira] [Updated] (HDDS-3630) Merge rocksdb in datanode

2020-06-12 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3630: - Attachment: Merge RocksDB in Datanode-v2.pdf > Merge rocksdb in datanode > - > >

[GitHub] [hadoop-ozone] vivekratnavel commented on a change in pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-12 Thread GitBox
vivekratnavel commented on a change in pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065#discussion_r439253484 ## File path: hadoop-ozone/recon/pom.xml ## @@ -86,37 +86,46 @@ com.github.eirslett frontend-maven-plugin +1.

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1023: HDDS-3718: Improve OmKeyLocationInfoGroup internal data structure

2020-06-12 Thread GitBox
codecov-commenter commented on pull request #1023: URL: https://github.com/apache/hadoop-ozone/pull/1023#issuecomment-643114995 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1023?src=pr&el=h1) Report > Merging [#1023](https://codecov.io/gh/apache/hadoop-ozone/pull/1023?src

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1065: HDDS-3777. Reduce recon UI build time

2020-06-12 Thread GitBox
adoroszlai commented on a change in pull request #1065: URL: https://github.com/apache/hadoop-ozone/pull/1065#discussion_r439235123 ## File path: hadoop-ozone/recon/pom.xml ## @@ -86,37 +86,46 @@ com.github.eirslett frontend-maven-plugin +1.10.

[jira] [Comment Edited] (HDDS-1354) Kerberos principal configuration of OzoneManager doesn't use FQDN

2020-06-12 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17133611#comment-17133611 ] Marton Elek edited comment on HDDS-1354 at 6/12/20, 7:17 AM: -