[jira] [Assigned] (HDDS-3235) Change to default of max retry count for Ozone client

2020-03-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-3235: - Assignee: Sadanand Shenoy > Change to default of max retry count for Ozone client

[jira] [Created] (HDDS-3235) Change to default of max retry count for Ozone client

2020-03-18 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-3235: - Summary: Change to default of max retry count for Ozone client Key: HDDS-3235 URL: https://issues.apache.org/jira/browse/HDDS-3235 Project: Hadoop Distribut

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bharatviswa504 commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-601004472 > > > @bshashikant I agree with you. This is not a permanent solution, till then it is a temporary fix. As right now de

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bharatviswa504 commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-601004578 /pending "to address comments from @bshashikant" This

[GitHub] [hadoop-ozone] bshashikant edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bshashikant edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600997186 > > @bshashikant I agree with you. This is not a permanent solution, till then it is a temporary fix. As right now

[GitHub] [hadoop-ozone] bshashikant edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bshashikant edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600997186 > > @bshashikant I agree with you. This is not a permanent solution, till then it is a temporary fix. As right now

[GitHub] [hadoop-ozone] bshashikant edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bshashikant edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600997186 > > @bshashikant I agree with you. This is not a permanent solution, till then it is a temporary fix. As right now

[GitHub] [hadoop-ozone] swagle commented on issue #693: HDDS-3220. Filesystem client should not retry on AccessControlException.

2020-03-18 Thread GitBox
swagle commented on issue #693: HDDS-3220. Filesystem client should not retry on AccessControlException. URL: https://github.com/apache/hadoop-ozone/pull/693#issuecomment-600997211 Thank you @dineshchitlangia for review and merge. ---

[GitHub] [hadoop-ozone] bshashikant commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bshashikant commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600997186 > > @bshashikant I agree with you. This is not a permanent solution, till then it is a temporary fix. As right now default

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bharatviswa504 edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600989958 @bshashikant I agree with you. This is not a permanent solution, till exponential back off with exception based

[GitHub] [hadoop-ozone] dineshchitlangia commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
dineshchitlangia commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600995068 > @bshashikant I agree with you. This is not a permanent solution, till then it is a temporary fix. As right now defa

[GitHub] [hadoop-ozone] dineshchitlangia edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
dineshchitlangia edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600995068 > @bshashikant I agree with you. This is not a permanent solution, till then it is a temporary fix. As right n

[jira] [Assigned] (HDDS-3229) 2-way commit did not happen when WRITE failure injected in one of the datanodes of a piepeline

2020-03-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-3229: - Assignee: Shashikant Banerjee > 2-way commit did not happen when WRITE failure in

[jira] [Resolved] (HDDS-3229) 2-way commit did not happen when WRITE failure injected in one of the datanodes of a piepeline

2020-03-18 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee resolved HDDS-3229. --- Fix Version/s: 0.5.0 Resolution: Not A Problem > 2-way commit did not happen wh

[jira] [Resolved] (HDDS-3220) Filesystem client should not retry on AccessControlException

2020-03-18 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-3220. - Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~swagle] for the fix. Thanks [~arp]

[GitHub] [hadoop-ozone] dineshchitlangia merged pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException.

2020-03-18 Thread GitBox
dineshchitlangia merged pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException. URL: https://github.com/apache/hadoop-ozone/pull/693 This is an automated message from the Apache Git Servic

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException.

2020-03-18 Thread GitBox
swagle commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException. URL: https://github.com/apache/hadoop-ozone/pull/693#discussion_r394795579 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocol

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #687: HDDS-2184. Rename ozone scmcli to ozone admin

2020-03-18 Thread GitBox
dineshchitlangia commented on a change in pull request #687: HDDS-2184. Rename ozone scmcli to ozone admin URL: https://github.com/apache/hadoop-ozone/pull/687#discussion_r394791473 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/container/WithScmClient

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #687: HDDS-2184. Rename ozone scmcli to ozone admin

2020-03-18 Thread GitBox
dineshchitlangia commented on a change in pull request #687: HDDS-2184. Rename ozone scmcli to ozone admin URL: https://github.com/apache/hadoop-ozone/pull/687#discussion_r394793293 ## File path: hadoop-hdds/docs/content/tools/SCMCLI.md ## @@ -1,27 +0,0 @@ Review c

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #687: HDDS-2184. Rename ozone scmcli to ozone admin

2020-03-18 Thread GitBox
dineshchitlangia commented on a change in pull request #687: HDDS-2184. Rename ozone scmcli to ozone admin URL: https://github.com/apache/hadoop-ozone/pull/687#discussion_r394792695 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/container/WithScmClient

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bharatviswa504 edited a comment on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600989958 @bshashikant I agree with you. This is not a permanent solution, till then it is a temporary fix. As right now d

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bharatviswa504 commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600989958 @bshashikant I agree with you. This is not a permanent solution, till then it is a temporary fix. As right now default

[GitHub] [hadoop-ozone] cku328 commented on issue #669: HDDS-3144. Fixed failed test case.

2020-03-18 Thread GitBox
cku328 commented on issue #669: HDDS-3144. Fixed failed test case. URL: https://github.com/apache/hadoop-ozone/pull/669#issuecomment-600988506 Thanks @elek for the review. This is an automated message from the Apache Git Servi

[GitHub] [hadoop-ozone] bshashikant commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bshashikant commented on issue #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698#issuecomment-600988399 @bharatviswa504 , i would prefer to not change it right away, because it might not hold good for all cases. Let's implemen

[GitHub] [hadoop-ozone] dineshchitlangia commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException.

2020-03-18 Thread GitBox
dineshchitlangia commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException. URL: https://github.com/apache/hadoop-ozone/pull/693#discussion_r394790620 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/o

[jira] [Updated] (HDDS-3234) Fix retry interval default in Ozone client

2020-03-18 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3234: - Labels: billiontest pull-request-available (was: pull-request-available) > Fix retry inte

[jira] [Updated] (HDDS-3234) Fix retry interval default in Ozone client

2020-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3234: - Labels: pull-request-available (was: ) > Fix retry interval default in Ozone client > ---

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #698: HDDS-3234. Fix retry interval default in Ozone client.

2020-03-18 Thread GitBox
bharatviswa504 opened a new pull request #698: HDDS-3234. Fix retry interval default in Ozone client. URL: https://github.com/apache/hadoop-ozone/pull/698 ## What changes were proposed in this pull request? change retry interval value from 1s -> 15s. ## What is the link to the

[jira] [Created] (HDDS-3234) Fix retry interval default in Ozone client

2020-03-18 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3234: Summary: Fix retry interval default in Ozone client Key: HDDS-3234 URL: https://issues.apache.org/jira/browse/HDDS-3234 Project: Hadoop Distributed Data Store

[jira] [Assigned] (HDDS-3144) LogSubcommandTest fails

2020-03-18 Thread Neo Yang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neo Yang reassigned HDDS-3144: -- Assignee: Neo Yang > LogSubcommandTest fails > --- > > Key: HDDS-31

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one

2020-03-18 Thread GitBox
runzhiwang opened a new pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one URL: https://github.com/apache/hadoop-ozone/pull/692 ## What changes were proposed in this pull request? What's the problem ? 1. If down

[GitHub] [hadoop-ozone] runzhiwang closed pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one

2020-03-18 Thread GitBox
runzhiwang closed pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one URL: https://github.com/apache/hadoop-ozone/pull/692 This is an automated message from th

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #697: S3g jaeger 2

2020-03-18 Thread GitBox
runzhiwang opened a new pull request #697: S3g jaeger 2 URL: https://github.com/apache/hadoop-ozone/pull/697 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## What is the link to the Apache JIRA (Please create an issue i

[GitHub] [hadoop-ozone] runzhiwang closed pull request #697: S3g jaeger 2

2020-03-18 Thread GitBox
runzhiwang closed pull request #697: S3g jaeger 2 URL: https://github.com/apache/hadoop-ozone/pull/697 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[jira] [Updated] (HDDS-3164) Add Recon endpoint to serve missing containers and its metadata.

2020-03-18 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian updated HDDS-3164: - Summary: Add Recon endpoint to serve missing containers and its metadata.

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one

2020-03-18 Thread GitBox
runzhiwang opened a new pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one URL: https://github.com/apache/hadoop-ozone/pull/692 ## What changes were proposed in this pull request? What's the problem ? 1. If down

[GitHub] [hadoop-ozone] runzhiwang closed pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one

2020-03-18 Thread GitBox
runzhiwang closed pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one URL: https://github.com/apache/hadoop-ozone/pull/692 This is an automated message from th

[jira] [Resolved] (HDDS-2190) Ozone administrators should be able to list all the volumes

2020-03-18 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian resolved HDDS-2190. -- Resolution: Duplicate > Ozone administrators should be able to list all

[GitHub] [hadoop-ozone] vivekratnavel commented on issue #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key.

2020-03-18 Thread GitBox
vivekratnavel commented on issue #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key. URL: https://github.com/apache/hadoop-ozone/pull/689#issuecomment-600933732 Thank you @avijayanhwx and @xiaoyuyao for the reviews! --

[jira] [Resolved] (HDDS-3183) Deprecate old Recon HTTP Server Keytab config key

2020-03-18 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-3183. - Resolution: Fixed Thanks for the patch [~vivekratnavel]. Merged the PR. > Deprecate old

[GitHub] [hadoop-ozone] avijayanhwx commented on issue #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key.

2020-03-18 Thread GitBox
avijayanhwx commented on issue #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key. URL: https://github.com/apache/hadoop-ozone/pull/689#issuecomment-600932848 The unit test failure is unrelated. This is an aut

[GitHub] [hadoop-ozone] avijayanhwx commented on issue #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key.

2020-03-18 Thread GitBox
avijayanhwx commented on issue #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key. URL: https://github.com/apache/hadoop-ozone/pull/689#issuecomment-600932675 Thank you for the patch @vivekratnavel & the review @xiaoyuyao. ---

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key.

2020-03-18 Thread GitBox
avijayanhwx merged pull request #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key. URL: https://github.com/apache/hadoop-ozone/pull/689 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop-ozone] vivekratnavel commented on a change in pull request #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key.

2020-03-18 Thread GitBox
vivekratnavel commented on a change in pull request #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key. URL: https://github.com/apache/hadoop-ozone/pull/689#discussion_r394690824 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/Configurat

[jira] [Assigned] (HDDS-3233) ReInitialize the proxy and DtService when rpcAddress is unresolved in RpcClient

2020-03-18 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-3233: Assignee: Bharat Viswanadham > ReInitialize the proxy and DtService when rpcAddress

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException.

2020-03-18 Thread GitBox
bharatviswa504 commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException. URL: https://github.com/apache/hadoop-ozone/pull/695#discussion_r394681647 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface

2020-03-18 Thread GitBox
bharatviswa504 edited a comment on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface URL: https://github.com/apache/hadoop-ozone/pull/690#issuecomment-600851742 > Thanks @sodonnel for working on this. > > I feel that instead of maintaining safemode state

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException.

2020-03-18 Thread GitBox
bharatviswa504 commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException. URL: https://github.com/apache/hadoop-ozone/pull/695#discussion_r394681647 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/

[jira] [Resolved] (HDDS-1990) Make expiry of Delegation tokens to OM HA model.

2020-03-18 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru resolved HDDS-1990. -- Resolution: Not A Problem Revoked/ Cancelled delegation token information is propagated to all O

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException.

2020-03-18 Thread GitBox
bharatviswa504 commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException. URL: https://github.com/apache/hadoop-ozone/pull/695#discussion_r394681401 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/

[GitHub] [hadoop-ozone] sodonnel commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface

2020-03-18 Thread GitBox
sodonnel commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface URL: https://github.com/apache/hadoop-ozone/pull/690#issuecomment-600895440 > Safemode state change event handler should only worry about starting the services that are required to be star

[jira] [Created] (HDDS-3233) ReInitialize the proxy and DtService when rpcAddress is unresolved in RpcClient

2020-03-18 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3233: Summary: ReInitialize the proxy and DtService when rpcAddress is unresolved in RpcClient Key: HDDS-3233 URL: https://issues.apache.org/jira/browse/HDDS-3233 P

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation URL: https://github.com/apache/hadoop-ozone/pull/524#discussion_r394662754 ## File path: hadoop-hdds/docs/content/beyond/RunningWithHDFS.zh.md ## @@ -0,0 +1,64 @@ +--- +t

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation URL: https://github.com/apache/hadoop-ozone/pull/524#discussion_r394661559 ## File path: hadoop-hdds/docs/content/beyond/RunningWithHDFS.zh.md ## @@ -0,0 +1,64 @@ +--- +t

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation URL: https://github.com/apache/hadoop-ozone/pull/524#discussion_r394659781 ## File path: hadoop-hdds/docs/content/beyond/RunningWithHDFS.zh.md ## @@ -0,0 +1,64 @@ +--- +t

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation URL: https://github.com/apache/hadoop-ozone/pull/524#discussion_r394659191 ## File path: hadoop-hdds/docs/content/beyond/RunningWithHDFS.zh.md ## @@ -0,0 +1,64 @@ +--- +t

[jira] [Updated] (HDDS-3056) Allow all users to list all volumes

2020-03-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3056: - Component/s: Ozone Manager > Allow all users to list all volumes > --- > >

[jira] [Updated] (HDDS-3056) Allow all users to list all volumes

2020-03-18 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3056: - Status: Patch Available (was: Open) > Allow all users to list all volumes > -

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #524: HDDS-2797. beyond/RunningWithHDFS.md translation URL: https://github.com/apache/hadoop-ozone/pull/524#discussion_r394658413 ## File path: hadoop-hdds/docs/content/beyond/RunningWithHDFS.zh.md ## @@ -0,0 +1,64 @@ +--- +t

[GitHub] [hadoop-ozone] smengcl commented on issue #696: HDDS-3056. Allow all users to list all volumes

2020-03-18 Thread GitBox
smengcl commented on issue #696: HDDS-3056. Allow all users to list all volumes URL: https://github.com/apache/hadoop-ozone/pull/696#issuecomment-600875149 @elek @xiaoyuyao Would you take a look? Thanks. Essentially what this does is removing the admin check in `listAllVolumes`.

[jira] [Updated] (HDDS-3056) Allow all users to list all volumes

2020-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3056: - Labels: pull-request-available (was: ) > Allow all users to list all volumes > --

[GitHub] [hadoop-ozone] smengcl opened a new pull request #696: HDDS-3056. Allow all users to list all volumes

2020-03-18 Thread GitBox
smengcl opened a new pull request #696: HDDS-3056. Allow all users to list all volumes URL: https://github.com/apache/hadoop-ozone/pull/696 ## What changes were proposed in this pull request? Allow all users (not only admins) to list all volumes. ## What is the link to the Apa

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface

2020-03-18 Thread GitBox
bharatviswa504 commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface URL: https://github.com/apache/hadoop-ozone/pull/690#issuecomment-600851742 > Thanks @sodonnel for working on this. > > I feel that instead of maintaining safemode state at dif

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException.

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException. URL: https://github.com/apache/hadoop-ozone/pull/695#discussion_r394626645 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/OMPro

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException.

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException. URL: https://github.com/apache/hadoop-ozone/pull/695#discussion_r394627535 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/OMFai

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException.

2020-03-18 Thread GitBox
bharatviswa504 opened a new pull request #695: HDDS-3137. OM RpcClient fail with java.lang.IllegalArgumentException. URL: https://github.com/apache/hadoop-ozone/pull/695 ## What changes were proposed in this pull request? Fix Rpcclient creation failing with java.lang.IllegalArgumentE

[jira] [Updated] (HDDS-3137) OM RpcClient fail with java.lang.IllegalArgumentException

2020-03-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3137: - Labels: OMHATest pull-request-available (was: OMHATest) > OM RpcClient fail with java.lang.Illega

[GitHub] [hadoop-ozone] swagle commented on issue #693: HDDS-3220. Filesystem client should not retry on AccessControlException.

2020-03-18 Thread GitBox
swagle commented on issue #693: HDDS-3220. Filesystem client should not retry on AccessControlException. URL: https://github.com/apache/hadoop-ozone/pull/693#issuecomment-600831012 > LGTM, +1. Thanks @xiaoyuyao for the review.

[GitHub] [hadoop-ozone] nandakumar131 commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface

2020-03-18 Thread GitBox
nandakumar131 commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface URL: https://github.com/apache/hadoop-ozone/pull/690#issuecomment-600814923 Thanks @sodonnel for working on this. I feel that instead of maintaining safemode state at different

[jira] [Resolved] (HDDS-3042) Support running full Ratis pipeline from IDE (IntelliJ)

2020-03-18 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3042. -- Fix Version/s: 0.6.0 Resolution: Fixed Thanks [~elek] for the contribution and all for the review

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #571: HDDS-3042. Support running full Ratis pipeline from IDE (IntelliJ)

2020-03-18 Thread GitBox
xiaoyuyao merged pull request #571: HDDS-3042. Support running full Ratis pipeline from IDE (IntelliJ) URL: https://github.com/apache/hadoop-ozone/pull/571 This is an automated message from the Apache Git Service. To respond

[jira] [Updated] (HDDS-3175) Healthy datanodes are marked as stale

2020-03-18 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-3175: -- Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Heal

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #618: HDDS-2911. Fix lastUsed and stateEnterTime value in container info is not human friendly

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #618: HDDS-2911. Fix lastUsed and stateEnterTime value in container info is not human friendly URL: https://github.com/apache/hadoop-ozone/pull/618#discussion_r394577636 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop

[GitHub] [hadoop-ozone] nandakumar131 merged pull request #674: HDDS-3175. Healthy datanodes are marked as stale

2020-03-18 Thread GitBox
nandakumar131 merged pull request #674: HDDS-3175. Healthy datanodes are marked as stale URL: https://github.com/apache/hadoop-ozone/pull/674 This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key.

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #689: HDDS-3183. Deprecate old Recon HTTP Server Keytab config key. URL: https://github.com/apache/hadoop-ozone/pull/689#discussion_r394570555 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/ConfigurationP

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #665: HDDS-3160. Disable index and filter block cache for RocksDB.

2020-03-18 Thread GitBox
xiaoyuyao commented on issue #665: HDDS-3160. Disable index and filter block cache for RocksDB. URL: https://github.com/apache/hadoop-ozone/pull/665#issuecomment-600798768 I mean do we see better BLOCK_CACHE_DATA_HIT after moving out of the index/filter. More detail of the block cache stat

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #520: HDDS-2793. concept/Datanodes.md translation

2020-03-18 Thread GitBox
hanishakoneru commented on issue #520: HDDS-2793. concept/Datanodes.md translation URL: https://github.com/apache/hadoop-ozone/pull/520#issuecomment-600794598 This error is from an old run. Confirmed with @xiaoyuyao that the new runs do not have the OM HA tests. --

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads

2020-03-18 Thread GitBox
bharatviswa504 commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads URL: https://github.com/apache/hadoop-ozone/pull/578#issuecomment-600791255 I want to add one point here. The same chunkExecutor threads are used for readStateMachineData. This will be use

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #578: HDDS-3053. Decrease the number of the chunk writer threads

2020-03-18 Thread GitBox
bharatviswa504 edited a comment on issue #578: HDDS-3053. Decrease the number of the chunk writer threads URL: https://github.com/apache/hadoop-ozone/pull/578#issuecomment-600791255 I want to add one point here. The same chunkExecutor threads are used for readStateMachineData. This will

[GitHub] [hadoop-ozone] arp7 commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads

2020-03-18 Thread GitBox
arp7 commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads URL: https://github.com/apache/hadoop-ozone/pull/578#issuecomment-600788099 Can we make it a data driven decision? I looked at the linked document. I didn't understand the test methodology. E.g. when y

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one URL: https://github.com/apache/hadoop-ozone/pull/692#discussion_r394545983 ## File path: hadoop-ozone/ozone-manager/src/main/java/

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #643: HDDS-2339. Add OzoneManager to MiniOzoneChaosCluster

2020-03-18 Thread GitBox
hanishakoneru commented on issue #643: HDDS-2339. Add OzoneManager to MiniOzoneChaosCluster URL: https://github.com/apache/hadoop-ozone/pull/643#issuecomment-600778477 > Can we also add an optional paramenter to the shell script to run the om failure version too ? @mukul1987, can yo

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads

2020-03-18 Thread GitBox
xiaoyuyao commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads URL: https://github.com/apache/hadoop-ozone/pull/578#issuecomment-600776996 Agree with @elek chunkexecutor threads are mostly I/O bounded, adding excessive number of threads won't help much but co

[jira] [Updated] (HDDS-3172) Use DBStore instead of MetadataStore in SCM

2020-03-18 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3172: -- Summary: Use DBStore instead of MetadataStore in SCM (was: Deprecate MetadataStore interface) > Use D

[GitHub] [hadoop-ozone] sodonnel commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface

2020-03-18 Thread GitBox
sodonnel commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface URL: https://github.com/apache/hadoop-ozone/pull/690#issuecomment-600762562 > Thanks @sodonnel , agree the new code looks better. > > One question: Just wondering if the `EventQueue`

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException.

2020-03-18 Thread GitBox
swagle commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException. URL: https://github.com/apache/hadoop-ozone/pull/693#discussion_r394515008 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocol

[GitHub] [hadoop-ozone] elek commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads

2020-03-18 Thread GitBox
elek commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads URL: https://github.com/apache/hadoop-ozone/pull/578#issuecomment-600757015 > @elek , if you really think this seems to be causing issues in tests , we can change it to a lower value. I think it

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException.

2020-03-18 Thread GitBox
arp7 commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException. URL: https://github.com/apache/hadoop-ozone/pull/693#discussion_r394503942 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocolPB

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException.

2020-03-18 Thread GitBox
swagle commented on a change in pull request #693: HDDS-3220. Filesystem client should not retry on AccessControlException. URL: https://github.com/apache/hadoop-ozone/pull/693#discussion_r394500132 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/protocol

[GitHub] [hadoop-ozone] elek commented on issue #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM.

2020-03-18 Thread GitBox
elek commented on issue #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM. URL: https://github.com/apache/hadoop-ozone/pull/656#issuecomment-600744173 Thanks the review @adoroszlai, I fixed the typo bugs. > Would be nice to include mock-scm.btm script in hado

[jira] [Created] (HDDS-3232) Include the byteman scripts in the distribution tar file

2020-03-18 Thread Marton Elek (Jira)
Marton Elek created HDDS-3232: - Summary: Include the byteman scripts in the distribution tar file Key: HDDS-3232 URL: https://issues.apache.org/jira/browse/HDDS-3232 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #520: HDDS-2793. concept/Datanodes.md translation

2020-03-18 Thread GitBox
xiaoyuyao commented on issue #520: HDDS-2793. concept/Datanodes.md translation URL: https://github.com/apache/hadoop-ozone/pull/520#issuecomment-600742835 == 2019-11-16T11:59:00.0120726Z ozone-om-ha-testOMHA :: S

[jira] [Updated] (HDDS-3144) LogSubcommandTest fails

2020-03-18 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3144: --- Labels: (was: pull-request-available) > LogSubcommandTest fails > --- >

[GitHub] [hadoop-ozone] elek commented on a change in pull request #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM.

2020-03-18 Thread GitBox
elek commented on a change in pull request #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM. URL: https://github.com/apache/hadoop-ozone/pull/656#discussion_r394492372 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/freon/FakeScmConta

[GitHub] [hadoop-ozone] xiaoyuyao commented on issue #520: HDDS-2793. concept/Datanodes.md translation

2020-03-18 Thread GitBox
xiaoyuyao commented on issue #520: HDDS-2793. concept/Datanodes.md translation URL: https://github.com/apache/hadoop-ozone/pull/520#issuecomment-600738284 If you download the acceptance test results from the link and https://github.com/apache/hadoop-ozone/suites/485213917/artifacts/25317

[GitHub] [hadoop-ozone] elek commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface

2020-03-18 Thread GitBox
elek commented on issue #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface URL: https://github.com/apache/hadoop-ozone/pull/690#issuecomment-600737932 Thanks @sodonnel , agree the new code looks better. One question: Just wondering if the `EventQueue` can be us

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing.

2020-03-18 Thread GitBox
xiaoyuyao commented on a change in pull request #438: HDDS-2878. Refactor MiniOzoneLoadGenerator to add more load generators to chaos testing. URL: https://github.com/apache/hadoop-ozone/pull/438#discussion_r394483511 ## File path: hadoop-ozone/fault-injection-test/mini-chaos-tests

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests.

2020-03-18 Thread GitBox
hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests. URL: https://github.com/apache/hadoop-ozone/pull/265#issuecomment-600733324 @xiaoyuyao, this is the same issue but I am surprised how the OM-HA tests are running when they are disabled. Can you please point to

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #520: HDDS-2793. concept/Datanodes.md translation

2020-03-18 Thread GitBox
hanishakoneru commented on issue #520: HDDS-2793. concept/Datanodes.md translation URL: https://github.com/apache/hadoop-ozone/pull/520#issuecomment-600731894 @xiaoyuyao, OM-HA tests are disabled and should not be running. In the following CI run, the acceptance test suite does not run

[GitHub] [hadoop-ozone] elek commented on a change in pull request #571: HDDS-3042. Support running full Ratis pipeline from IDE (IntelliJ)

2020-03-18 Thread GitBox
elek commented on a change in pull request #571: HDDS-3042. Support running full Ratis pipeline from IDE (IntelliJ) URL: https://github.com/apache/hadoop-ozone/pull/571#discussion_r394476150 ## File path: hadoop-ozone/dev-support/intellij/runConfigurations/Datanode2.xml ##

  1   2   >