[jira] [Created] (HDDS-3004) S3 gateway write failure when leader OM is down and OM HA is enabled

2020-02-12 Thread Li Cheng (Jira)
Li Cheng created HDDS-3004: -- Summary: S3 gateway write failure when leader OM is down and OM HA is enabled Key: HDDS-3004 URL: https://issues.apache.org/jira/browse/HDDS-3004 Project: Hadoop Distributed Data

[jira] [Created] (HDDS-3005) OM HA may need to scmcli to list all leader hosts

2020-02-12 Thread Li Cheng (Jira)
Li Cheng created HDDS-3005: -- Summary: OM HA may need to scmcli to list all leader hosts Key: HDDS-3005 URL: https://issues.apache.org/jira/browse/HDDS-3005 Project: Hadoop Distributed Data Store Iss

[GitHub] [hadoop-ozone] elek commented on a change in pull request #543: HDDS-2997. Support github comment based commands

2020-02-12 Thread GitBox
elek commented on a change in pull request #543: HDDS-2997. Support github comment based commands URL: https://github.com/apache/hadoop-ozone/pull/543#discussion_r378119516 ## File path: .github/comment-commands/pending.sh ## @@ -0,0 +1,31 @@ +#!/usr/bin/env bash +# Licens

[jira] [Commented] (HDDS-2443) Python client/interface for Ozone

2020-02-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035183#comment-17035183 ] mingchao zhao commented on HDDS-2443: - Here is the write performance test report for p

[jira] [Updated] (HDDS-2443) Python client/interface for Ozone

2020-02-12 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-2443: Attachment: pyarrow_ozone_test.docx > Python client/interface for Ozone > --

[GitHub] [hadoop-ozone] elek commented on issue #449: HDDS-2891. Apache NiFi PutFile processor is failing with secure Ozone S3G

2020-02-12 Thread GitBox
elek commented on issue #449: HDDS-2891. Apache NiFi PutFile processor is failing with secure Ozone S3G URL: https://github.com/apache/hadoop-ozone/pull/449#issuecomment-585117463 Thanks a lot the review and commit @bharatviswa504 (I know it's very time consuming this kind of very low-leve

[GitHub] [hadoop-ozone] elek commented on issue #536: HDDS-2988. Use getPropertiesByPrefix instead of regex in matching ratis client and server properties.

2020-02-12 Thread GitBox
elek commented on issue #536: HDDS-2988. Use getPropertiesByPrefix instead of regex in matching ratis client and server properties. URL: https://github.com/apache/hadoop-ozone/pull/536#issuecomment-585117102 > we can use "datanode.raft.server" for RatisServer config and for client "datano

[GitHub] [hadoop-ozone] HorizonNet opened a new pull request #548: HDFS-12766 Moved logs to use parameterized log syntax instead of String concatenation

2020-02-12 Thread GitBox
HorizonNet opened a new pull request #548: HDFS-12766 Moved logs to use parameterized log syntax instead of String concatenation URL: https://github.com/apache/hadoop-ozone/pull/548 ## What changes were proposed in this pull request? Changed the String concatenation in the logging to

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #543: HDDS-2997. Support github comment based commands

2020-02-12 Thread GitBox
adoroszlai commented on a change in pull request #543: HDDS-2997. Support github comment based commands URL: https://github.com/apache/hadoop-ozone/pull/543#discussion_r378245941 ## File path: .github/comment-commands/pending.sh ## @@ -0,0 +1,31 @@ +#!/usr/bin/env bash +#

[GitHub] [hadoop-ozone] elek commented on a change in pull request #543: HDDS-2997. Support github comment based commands

2020-02-12 Thread GitBox
elek commented on a change in pull request #543: HDDS-2997. Support github comment based commands URL: https://github.com/apache/hadoop-ozone/pull/543#discussion_r378281735 ## File path: .github/comment-commands/retest.sh ## @@ -0,0 +1,30 @@ +#!/usr/bin/env bash +# License

[GitHub] [hadoop-ozone] anuengineer merged pull request #502: HDDS-2955. Unnecessary log messages in DBStoreBuilder

2020-02-12 Thread GitBox
anuengineer merged pull request #502: HDDS-2955. Unnecessary log messages in DBStoreBuilder URL: https://github.com/apache/hadoop-ozone/pull/502 This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Updated] (HDDS-2955) Unnecessary log messages in DBStoreBuilder

2020-02-12 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDDS-2955: --- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) [~xy

[GitHub] [hadoop-ozone] arp7 commented on issue #261: HDDS-2610. Fix the ObjectStore#listVolumes failure when argument is null

2020-02-12 Thread GitBox
arp7 commented on issue #261: HDDS-2610. Fix the ObjectStore#listVolumes failure when argument is null URL: https://github.com/apache/hadoop-ozone/pull/261#issuecomment-585424462 Hi @cxorm , looks like Attila has already approved these changes. Can you please rebase the patch, we can help

[jira] [Updated] (HDDS-3006) Integrate Prometheus into Ozone Recon.

2020-02-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3006: Description: The goal of Recon is to provide a window into the state of the Ozone cluster.

[jira] [Created] (HDDS-3006) Integrate Prometheus into Ozone Recon.

2020-02-12 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-3006: --- Summary: Integrate Prometheus into Ozone Recon. Key: HDDS-3006 URL: https://issues.apache.org/jira/browse/HDDS-3006 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-2976) Recon throws error while trying to get snapshot in secure environment

2020-02-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2976: Priority: Critical (was: Major) > Recon throws error while trying to get snapshot in secure

[jira] [Updated] (HDDS-2995) Add integration test for Recon's Passive SCM state.

2020-02-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2995: Summary: Add integration test for Recon's Passive SCM state. (was: Add integration test for

[jira] [Assigned] (HDDS-2899) Add Robot Tests for Recon - OM integration.

2020-02-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-2899: --- Assignee: Aravindan Vijayan > Add Robot Tests for Recon - OM integration. > -

[GitHub] [hadoop-ozone] adoroszlai commented on issue #502: HDDS-2955. Unnecessary log messages in DBStoreBuilder

2020-02-12 Thread GitBox
adoroszlai commented on issue #502: HDDS-2955. Unnecessary log messages in DBStoreBuilder URL: https://github.com/apache/hadoop-ozone/pull/502#issuecomment-585439345 Thanks @avijayanhwx and @xiaoyuyao for the review, and @anuengineer for reviewing and merging this. ---

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #549: Revert "HDDS-2914. Certain Hive queries started to fail on generating splits"

2020-02-12 Thread GitBox
avijayanhwx opened a new pull request #549: Revert "HDDS-2914. Certain Hive queries started to fail on generating splits" URL: https://github.com/apache/hadoop-ozone/pull/549 Reverting the patch since it was determined by @fapifta that it does not fix the underlying issue. Reverts

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #536: HDDS-2988. Use getPropertiesByPrefix instead of regex in matching ratis client and server properties.

2020-02-12 Thread GitBox
bharatviswa504 commented on issue #536: HDDS-2988. Use getPropertiesByPrefix instead of regex in matching ratis client and server properties. URL: https://github.com/apache/hadoop-ozone/pull/536#issuecomment-585471740 > > we can use "datanode.raft.server" for RatisServer config and for clie

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #536: HDDS-2988. Use getPropertiesByPrefix instead of regex in matching ratis client and server properties.

2020-02-12 Thread GitBox
bharatviswa504 edited a comment on issue #536: HDDS-2988. Use getPropertiesByPrefix instead of regex in matching ratis client and server properties. URL: https://github.com/apache/hadoop-ozone/pull/536#issuecomment-585471740 > > we can use "datanode.raft.server" for RatisServer config and

[GitHub] [hadoop-ozone] sonarcloud[bot] commented on issue #549: Revert "HDDS-2914. Certain Hive queries started to fail on generating splits"

2020-02-12 Thread GitBox
sonarcloud[bot] commented on issue #549: Revert "HDDS-2914. Certain Hive queries started to fail on generating splits" URL: https://github.com/apache/hadoop-ozone/pull/549#issuecomment-585477071 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/project/issues?id=hadoop-

[jira] [Commented] (HDDS-3004) S3 gateway write failure when leader OM is down and OM HA is enabled

2020-02-12 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035966#comment-17035966 ] Li Cheng commented on HDDS-3004: S3g logs: 2020-02-12 10:39:04,486 [qtp225472281-67] INFO

[jira] [Commented] (HDDS-3004) S3 gateway write failure when leader OM is down and OM HA is enabled

2020-02-12 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035970#comment-17035970 ] Li Cheng commented on HDDS-3004: When I bounce the leader OM one more time, it turns out t

[jira] [Commented] (HDDS-3004) S3 gateway write failure when leader OM is down and OM HA is enabled

2020-02-12 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035971#comment-17035971 ] Li Cheng commented on HDDS-3004: Another thing I notice is: > S3 gateway write failure wh

[jira] [Comment Edited] (HDDS-3004) S3 gateway write failure when leader OM is down and OM HA is enabled

2020-02-12 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035971#comment-17035971 ] Li Cheng edited comment on HDDS-3004 at 2/13/20 7:01 AM: - Another

[GitHub] [hadoop-ozone] timmylicheng commented on issue #393: HDDS-1590 Aggregate bytes write metrics from container to datanode and to SCM

2020-02-12 Thread GitBox
timmylicheng commented on issue #393: HDDS-1590 Aggregate bytes write metrics from container to datanode and to SCM URL: https://github.com/apache/hadoop-ozone/pull/393#issuecomment-585594255 > Thanks to post this patch @timmylicheng. Overall it looks good, but I am not sure about the moti