[GitHub] [ozone] bshashikant edited a comment on pull request #1523: HDDS-4320. Let Ozone input streams implement CanUnbuffer

2020-11-10 Thread GitBox
bshashikant edited a comment on pull request #1523: URL: https://github.com/apache/ozone/pull/1523#issuecomment-725268132 > Thanks @bshashikant for taking a look. > > > 1. In unbuffer, do we need to remove the corresponding blockInputStreams and chunkInputStreams which are already re

[GitHub] [ozone] bshashikant commented on pull request #1523: HDDS-4320. Let Ozone input streams implement CanUnbuffer

2020-11-10 Thread GitBox
bshashikant commented on pull request #1523: URL: https://github.com/apache/ozone/pull/1523#issuecomment-725268132 > Thanks @bshashikant for taking a look. > > > 1. In unbuffer, do we need to remove the corresponding blockInputStreams and chunkInputStreams which are already read?

[GitHub] [ozone] bshashikant commented on a change in pull request #1555: HDDS-4347.Make Ozone specific Trash remover multi threaded

2020-11-10 Thread GitBox
bshashikant commented on a change in pull request #1555: URL: https://github.com/apache/ozone/pull/1555#discussion_r521177145 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/TrashPolicyOzone.java ## @@ -0,0 +1,288 @@ +/* + * Licensed to the Ap

[jira] [Updated] (HDDS-4439) SCM should create transactions using all blocks received from OM

2020-11-10 Thread Aryan Gupta (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aryan Gupta updated HDDS-4439: -- Summary: SCM should create transactions using all blocks received from OM (was: SCM should send less da

[jira] [Updated] (HDDS-4439) SCM should reduce RPC payLoad to OM for deletion ACK

2020-11-10 Thread Aryan Gupta (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aryan Gupta updated HDDS-4439: -- Summary: SCM should reduce RPC payLoad to OM for deletion ACK (was: SCM should create transactions usin

[jira] [Updated] (HDDS-4426) SCM should create transactions using all blocks received from OM

2020-11-10 Thread Aryan Gupta (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aryan Gupta updated HDDS-4426: -- Summary:SCM should create transactions using all blocks received from OM (was: SCM should reduce RP

[jira] [Updated] (HDDS-4426) SCM should reduce RPC payLoad to OM for deletion ACK

2020-11-10 Thread Aryan Gupta (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aryan Gupta updated HDDS-4426: -- Summary: SCM should reduce RPC payLoad to OM for deletion ACK (was: SCM should create transactions usin

[GitHub] [ozone] bshashikant commented on a change in pull request #1555: HDDS-4347.Make Ozone specific Trash remover multi threaded

2020-11-10 Thread GitBox
bshashikant commented on a change in pull request #1555: URL: https://github.com/apache/ozone/pull/1555#discussion_r521153748 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/TrashPolicyOzone.java ## @@ -0,0 +1,288 @@ +/* + * Licensed to the Ap

[GitHub] [ozone] sadanand48 commented on a change in pull request #1555: HDDS-4347.Make Ozone specific Trash remover multi threaded

2020-11-10 Thread GitBox
sadanand48 commented on a change in pull request #1555: URL: https://github.com/apache/ozone/pull/1555#discussion_r521151304 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/TrashPolicyOzone.java ## @@ -0,0 +1,288 @@ +/* + * Licensed to the Apa

[GitHub] [ozone] lokeshj1703 commented on a change in pull request #1561: HDDS-4426. SCM should create transactions using all blocks received from OM

2020-11-10 Thread GitBox
lokeshj1703 commented on a change in pull request #1561: URL: https://github.com/apache/ozone/pull/1561#discussion_r521140093 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/server/SCMBlockProtocolServer.java ## @@ -224,54 +224,49 @@ public void j

[GitHub] [ozone] runzhiwang commented on pull request #1559: HDDS-4435. Fix can not insert the second entry when hive on ozone

2020-11-10 Thread GitBox
runzhiwang commented on pull request #1559: URL: https://github.com/apache/ozone/pull/1559#issuecomment-725227539 @adoroszlai Thanks for suggestions. I have updated the patch. Could you help review it again ? This is an auto

[GitHub] [ozone] bshashikant commented on a change in pull request #1555: HDDS-4347.Make Ozone specific Trash remover multi threaded

2020-11-10 Thread GitBox
bshashikant commented on a change in pull request #1555: URL: https://github.com/apache/ozone/pull/1555#discussion_r521136226 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/TrashPolicyOzone.java ## @@ -0,0 +1,288 @@ +/* + * Licensed to the Ap

[GitHub] [ozone] bshashikant commented on a change in pull request #1555: HDDS-4347.Make Ozone specific Trash remover multi threaded

2020-11-10 Thread GitBox
bshashikant commented on a change in pull request #1555: URL: https://github.com/apache/ozone/pull/1555#discussion_r521135929 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/TrashPolicyOzone.java ## @@ -0,0 +1,288 @@ +/* + * Licensed to the Ap

[GitHub] [ozone] bshashikant commented on pull request #1542: HDDS-4417. Simplify Ozone client code with configuration object

2020-11-10 Thread GitBox
bshashikant commented on pull request #1542: URL: https://github.com/apache/ozone/pull/1542#issuecomment-725222401 @elek , can u check the failed checks. The changes in general look good to me. This is an automated message f

[jira] [Updated] (HDDS-4417) Simplify Ozone client code with configuration object

2020-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4417: - Labels: pull-request-available (was: ) > Simplify Ozone client code with configuration object > -

[jira] [Resolved] (HDDS-4438) Avoid counting skipped transactions belonging to open containers

2020-11-10 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain resolved HDDS-4438. --- Fix Version/s: 1.1.0 Resolution: Fixed > Avoid counting skipped transactions belonging to open

[GitHub] [ozone] bshashikant edited a comment on pull request #1542: HDDS-4417. Simplify Ozone client code with configuration object

2020-11-10 Thread GitBox
bshashikant edited a comment on pull request #1542: URL: https://github.com/apache/ozone/pull/1542#issuecomment-725222401 @elek , can u check the failed checks. The changes in general look good to me. Will look into it in more detail. --

[GitHub] [ozone] bshashikant commented on pull request #1565: HDDS-4438. Avoid counting skipped transactions belonging to open containers.

2020-11-10 Thread GitBox
bshashikant commented on pull request #1565: URL: https://github.com/apache/ozone/pull/1565#issuecomment-725221415 Thanks @lokeshj1703 for working on this. I have committed this. This is an automated message from the Apache G

[GitHub] [ozone] bshashikant merged pull request #1565: HDDS-4438. Avoid counting skipped transactions belonging to open containers.

2020-11-10 Thread GitBox
bshashikant merged pull request #1565: URL: https://github.com/apache/ozone/pull/1565 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[jira] [Updated] (HDDS-4441) Add metrics for ACL related operations

2020-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4441: - Labels: pull-request-available (was: ) > Add metrics for ACL related operations > ---

[GitHub] [ozone] ayushtkn opened a new pull request #1571: HDDS-4441. Add metrics for ACL related operations.

2020-11-10 Thread GitBox
ayushtkn opened a new pull request #1571: URL: https://github.com/apache/ozone/pull/1571 ## What changes were proposed in this pull request? Add acl related metrics in OM ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-4441 ## How

[jira] [Assigned] (HDDS-4441) Add metrics for ACL related operations

2020-11-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDDS-4441: -- Assignee: Ayush Saxena > Add metrics for ACL related operations > -

[GitHub] [ozone] bshashikant commented on pull request #1526: HDDS-4399. Safe mode rule for piplelines should only consider open pipelines.

2020-11-10 Thread GitBox
bshashikant commented on pull request #1526: URL: https://github.com/apache/ozone/pull/1526#issuecomment-725217845 @bharatviswa504 @nandakumar131 can you please review? This is an automated message from the Apache Git Service

[GitHub] [ozone] amaliujia commented on pull request #1546: HDDS-4422. Fix TestMiniOzoneHACluster.testGetOMLeader()

2020-11-10 Thread GitBox
amaliujia commented on pull request #1546: URL: https://github.com/apache/ozone/pull/1546#issuecomment-725206067 R @nandakumar131 This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [ozone] bshashikant commented on pull request #1530: HDDS-4363. Add metric to track the number of RocksDB open/close operations.

2020-11-10 Thread GitBox
bshashikant commented on pull request #1530: URL: https://github.com/apache/ozone/pull/1530#issuecomment-725145274 @jojochuang , usually we don't commit unless every check comes out green in Ozone.Let's retrigger the checks once again. -

[jira] [Updated] (HDDS-4443) Recon: Using Mysql database throws exception and fails startup

2020-11-10 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian updated HDDS-4443: - Status: Patch Available (was: Open) > Recon: Using Mysql database throws

[GitHub] [ozone] rakeshadr commented on a change in pull request #1557: HDDS-4357: Rename : make rename an atomic ops by updating key path entry in dir/file table

2020-11-10 Thread GitBox
rakeshadr commented on a change in pull request #1557: URL: https://github.com/apache/ozone/pull/1557#discussion_r521090228 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRenameRequestV1.java ## @@ -0,0 +1,289 @@ +/** + * Lic

[jira] [Updated] (HDDS-4443) Recon: Using Mysql database throws exception and fails startup

2020-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4443: - Labels: pull-request-available (was: ) > Recon: Using Mysql database throws exception and fails s

[GitHub] [ozone] vivekratnavel opened a new pull request #1570: HDDS-4443. Recon: Using Mysql database throws exception and fails startup

2020-11-10 Thread GitBox
vivekratnavel opened a new pull request #1570: URL: https://github.com/apache/ozone/pull/1570 ## What changes were proposed in this pull request? Fix length of the primary key in one of the SQL tables of Recon and set auto-commit flag to default to true. ## What is the link to

[GitHub] [ozone] rakeshadr commented on a change in pull request #1557: HDDS-4357: Rename : make rename an atomic ops by updating key path entry in dir/file table

2020-11-10 Thread GitBox
rakeshadr commented on a change in pull request #1557: URL: https://github.com/apache/ozone/pull/1557#discussion_r521082903 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRenameRequestV1.java ## @@ -0,0 +1,289 @@ +/** + * Lic

[GitHub] [ozone] rakeshadr commented on a change in pull request #1557: HDDS-4357: Rename : make rename an atomic ops by updating key path entry in dir/file table

2020-11-10 Thread GitBox
rakeshadr commented on a change in pull request #1557: URL: https://github.com/apache/ozone/pull/1557#discussion_r521065700 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystemV1.java ## @@ -260,6 +260,44 @@ private void test

[jira] [Resolved] (HDDS-4436) TestReplicationManager#testUnderReplicatedQuasiClosedContainerWithUnhealthyReplica fails intermittently

2020-11-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDDS-4436. Fix Version/s: 1.1.0 Resolution: Fixed > TestReplicationManager#testUnderReplicatedQuasiClose

[GitHub] [ozone] ayushtkn merged pull request #1560: HDDS-4436.TestReplicationManager#testUnderReplicatedQuasiClosedContainerWithUnhealthyReplica fails intermittently.

2020-11-10 Thread GitBox
ayushtkn merged pull request #1560: URL: https://github.com/apache/ozone/pull/1560 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [ozone] ayushtkn commented on pull request #1560: HDDS-4436.TestReplicationManager#testUnderReplicatedQuasiClosedContainerWithUnhealthyReplica fails intermittently.

2020-11-10 Thread GitBox
ayushtkn commented on pull request #1560: URL: https://github.com/apache/ozone/pull/1560#issuecomment-725098520 Thanx @adoroszlai for the review!!! This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [ozone] linyiqun commented on a change in pull request #1557: HDDS-4357: Rename : make rename an atomic ops by updating key path entry in dir/file table

2020-11-10 Thread GitBox
linyiqun commented on a change in pull request #1557: URL: https://github.com/apache/ozone/pull/1557#discussion_r521060006 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystemV1.java ## @@ -260,6 +260,44 @@ private void testL

[GitHub] [ozone] bharatviswa504 commented on a change in pull request #1557: HDDS-4357: Rename : make rename an atomic ops by updating key path entry in dir/file table

2020-11-10 Thread GitBox
bharatviswa504 commented on a change in pull request #1557: URL: https://github.com/apache/ozone/pull/1557#discussion_r520961960 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRenameRequestV1.java ## @@ -0,0 +1,289 @@ +/** +

[GitHub] [ozone] cxorm commented on a change in pull request #1564: HDDS-4437. Avoid unnecessary builder conversion in setting volume Quota/Owner request

2020-11-10 Thread GitBox
cxorm commented on a change in pull request #1564: URL: https://github.com/apache/ozone/pull/1564#discussion_r520968935 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/volume/OMVolumeSetQuotaRequest.java ## @@ -71,12 +71,12 @@ public O

[jira] [Resolved] (HDDS-4445) Owner info is not passed to authorizer for BUCKET/KEY create request

2020-11-10 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-4445. -- Fix Version/s: 1.1.0 Resolution: Fixed > Owner info is not passed to authorizer for BUCKET/KEY cr

[GitHub] [ozone] xiaoyuyao commented on pull request #1563: HDDS-4445. Owner info is not passed to authorizer for BUCKET/KEY crea…

2020-11-10 Thread GitBox
xiaoyuyao commented on pull request #1563: URL: https://github.com/apache/ozone/pull/1563#issuecomment-725022858 Thanks @arp7 for the Review. I've merged the PR to master. This is an automated message from the Apache Git Ser

[GitHub] [ozone] xiaoyuyao merged pull request #1563: HDDS-4445. Owner info is not passed to authorizer for BUCKET/KEY crea…

2020-11-10 Thread GitBox
xiaoyuyao merged pull request #1563: URL: https://github.com/apache/ozone/pull/1563 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [ozone] jojochuang commented on pull request #1530: HDDS-4363. Add metric to track the number of RocksDB open/close operations.

2020-11-10 Thread GitBox
jojochuang commented on pull request #1530: URL: https://github.com/apache/ozone/pull/1530#issuecomment-725022422 @mukul1987 ok to merge? This is an automated message from the Apache Git Service. To respond to the message, pl

[jira] [Resolved] (HDDS-4446) Update Jetty version to 9.4.34

2020-11-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDDS-4446. --- Fix Version/s: 1.1.0 Resolution: Fixed > Update Jetty version to 9.4.34 > -

[jira] [Assigned] (HDDS-4446) Update Jetty version to 9.4.34

2020-11-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDDS-4446: - Assignee: Wei-Chiu Chuang > Update Jetty version to 9.4.34 >

[GitHub] [ozone] jojochuang commented on pull request #1566: HDDS-4446. Update Jetty version to 9.4.34.

2020-11-10 Thread GitBox
jojochuang commented on pull request #1566: URL: https://github.com/apache/ozone/pull/1566#issuecomment-724991541 Merged. Thanks @ayushtkn ! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [ozone] jojochuang merged pull request #1566: HDDS-4446. Update Jetty version to 9.4.34.

2020-11-10 Thread GitBox
jojochuang merged pull request #1566: URL: https://github.com/apache/ozone/pull/1566 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Updated] (HDDS-4442) Disable the location information of audit logger to reduce overhead

2020-11-10 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4442: --- Status: Patch Available (was: In Progress) > Disable the location information of audit logger

[GitHub] [ozone] yuyang733 commented on pull request #1541: HDDS-4080. Create ZH translation of OzoneManager.md in doc.

2020-11-10 Thread GitBox
yuyang733 commented on pull request #1541: URL: https://github.com/apache/ozone/pull/1541#issuecomment-724942665 > Thanks @yuyang733 for working on this. > > I think we should ensure that some of the words are consistent with other existing documents. > `Container` -> `容器`, > `

[GitHub] [ozone] prashantpogde commented on a change in pull request #1508: HDDS-4342. Add DataNode state and transitions for a node going through upgrade.

2020-11-10 Thread GitBox
prashantpogde commented on a change in pull request #1508: URL: https://github.com/apache/ozone/pull/1508#discussion_r520835630 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/ozone/scm/node/TestSCMNodeMetrics.java ## @@ -182,7 +196,7 @@ public void testNo

[jira] [Updated] (HDDS-4448) Duplicate refreshPipeline in listStatus

2020-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4448: - Labels: pull-request-available (was: ) > Duplicate refreshPipeline in listStatus > --

[GitHub] [ozone] adoroszlai opened a new pull request #1569: HDDS-4448. Duplicate refreshPipeline in listStatus

2020-11-10 Thread GitBox
adoroszlai opened a new pull request #1569: URL: https://github.com/apache/ozone/pull/1569 ## What changes were proposed in this pull request? Currently `KeyManagerImpl#listStatus` issues duplicate `refreshPipeline` for each file. HDDS-3824 moved `refreshPipeline` outside the bucket

[GitHub] [ozone] prashantpogde commented on a change in pull request #1508: HDDS-4342. Add DataNode state and transitions for a node going through upgrade.

2020-11-10 Thread GitBox
prashantpogde commented on a change in pull request #1508: URL: https://github.com/apache/ozone/pull/1508#discussion_r520815018 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/NonHealthyToReadOnlyHealthyNodeHandler.java ## @@ -0,0 +1,65 @@ +/

[GitHub] [ozone] prashantpogde commented on a change in pull request #1508: HDDS-4342. Add DataNode state and transitions for a node going through upgrade.

2020-11-10 Thread GitBox
prashantpogde commented on a change in pull request #1508: URL: https://github.com/apache/ozone/pull/1508#discussion_r520814642 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/DatanodeInfo.java ## @@ -69,6 +77,24 @@ public void updateLastHear

[GitHub] [ozone] prashantpogde commented on a change in pull request #1508: HDDS-4342. Add DataNode state and transitions for a node going through upgrade.

2020-11-10 Thread GitBox
prashantpogde commented on a change in pull request #1508: URL: https://github.com/apache/ozone/pull/1508#discussion_r520812428 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/DatanodeInfo.java ## @@ -53,6 +56,11 @@ public DatanodeInfo(Datano

[GitHub] [ozone] jojochuang commented on pull request #1567: HDDS-4442. Disable the location information of audit logger to reduce overhead

2020-11-10 Thread GitBox
jojochuang commented on pull request #1567: URL: https://github.com/apache/ozone/pull/1567#issuecomment-724859219 We should update the PR title... This is an automated message from the Apache Git Service. To respond to the me

[jira] [Reopened] (HDDS-4444) Remove KeyManagerImpl#refreshPipeline because it is the same as refresh()

2020-11-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDDS-: --- > Remove KeyManagerImpl#refreshPipeline because it is the same as refresh() >

[jira] [Resolved] (HDDS-4444) Remove KeyManagerImpl#refreshPipeline because it is the same as refresh()

2020-11-10 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDDS-. --- Resolution: Duplicate > Remove KeyManagerImpl#refreshPipeline because it is the same as refres

[GitHub] [ozone] rakeshadr commented on a change in pull request #1557: HDDS-4357: Rename : make rename an atomic ops by updating key path entry in dir/file table

2020-11-10 Thread GitBox
rakeshadr commented on a change in pull request #1557: URL: https://github.com/apache/ozone/pull/1557#discussion_r520733078 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystemV1.java ## @@ -260,6 +260,44 @@ private void test

[GitHub] [ozone] rakeshadr commented on a change in pull request #1557: HDDS-4357: Rename : make rename an atomic ops by updating key path entry in dir/file table

2020-11-10 Thread GitBox
rakeshadr commented on a change in pull request #1557: URL: https://github.com/apache/ozone/pull/1557#discussion_r520733078 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystemV1.java ## @@ -260,6 +260,44 @@ private void test

[jira] [Updated] (HDDS-4386) Each EndpointStateMachine uses its own thread pool to talk with SCM/Recon

2020-11-10 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4386: - Fix Version/s: 1.1.0 > Each EndpointStateMachine uses its own thread pool to talk with SCM/Recon > ---

[jira] [Created] (HDDS-4449) Rename config ozone.datanode.pipeline.limit

2020-11-10 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HDDS-4449: - Summary: Rename config ozone.datanode.pipeline.limit Key: HDDS-4449 URL: https://issues.apache.org/jira/browse/HDDS-4449 Project: Hadoop Distributed Data Store

[GitHub] [ozone] sodonnel opened a new pull request #1568: Decom merge master nov 10

2020-11-10 Thread GitBox
sodonnel opened a new pull request #1568: URL: https://github.com/apache/ozone/pull/1568 ## What changes were proposed in this pull request? Merge the master branch into HDDS-1880-Decom. There was only 1 minor conflict in SCMBlockDeletingService.java/ ## What is the link

[GitHub] [ozone] elek commented on pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on pull request #1419: URL: https://github.com/apache/ozone/pull/1419#issuecomment-724778123 Pushed the new version. Thanks again the feedback @arp7. Would you be so kind to take another look. I also uploaded a PDF version to https://issues.apache.org/jira/browse/HDDS

[jira] [Updated] (HDDS-3755) Storage-class support for Ozone

2020-11-10 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3755: -- Description: Use a storage-class as an abstraction which combines replication configuration, container

[jira] [Updated] (HDDS-3755) Storage-class support for Ozone

2020-11-10 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3755: -- Attachment: storage-class-v2.pdf > Storage-class support for Ozone > --- > >

[GitHub] [ozone] elek commented on pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on pull request #1419: URL: https://github.com/apache/ozone/pull/1419#issuecomment-724776405 > I think if you really want to proceed with this idea, you should update your design doc to describe in detail just the initial/phase 1 changes of capturing existing storage classes

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520642332 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520646534 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520641142 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520639978 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520637490 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520636322 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520634089 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520633863 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520633410 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520632402 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[jira] [Updated] (HDDS-4442) Disable the location information of audit logger to reduce overhead

2020-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4442: - Labels: pull-request-available (was: ) > Disable the location information of audit logger to redu

[GitHub] [ozone] adoroszlai opened a new pull request #1567: HDDS-4442. Disable the location information of audit logger to reduce overhead

2020-11-10 Thread GitBox
adoroszlai opened a new pull request #1567: URL: https://github.com/apache/ozone/pull/1567 ## What changes were proposed in this pull request? [Make all Log4J2 loggers asynchronous](http://logging.apache.org/log4j/2.0/manual/async.html#Making_All_Loggers_Asynchronous) (only used for

[jira] [Resolved] (HDDS-4420) Missing a container shouldn't log message at ERROR level

2020-11-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDDS-4420. Fix Version/s: 1.1.0 Resolution: Fixed > Missing a container shouldn't log message at ERROR

[GitHub] [ozone] ayushtkn commented on pull request #1554: HDDS-4420. Missing a container shouldn't log message at ERROR level

2020-11-10 Thread GitBox
ayushtkn commented on pull request #1554: URL: https://github.com/apache/ozone/pull/1554#issuecomment-724744083 Merged PR. Thanx Everyone!!! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [ozone] ayushtkn merged pull request #1554: HDDS-4420. Missing a container shouldn't log message at ERROR level

2020-11-10 Thread GitBox
ayushtkn merged pull request #1554: URL: https://github.com/apache/ozone/pull/1554 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[jira] [Assigned] (HDDS-4448) Duplicate refreshPipeline in listStatus

2020-11-10 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-4448: -- Assignee: Attila Doroszlai > Duplicate refreshPipeline in listStatus >

[GitHub] [ozone] ayushtkn commented on pull request #1554: HDDS-4420. Missing a container shouldn't log message at ERROR level

2020-11-10 Thread GitBox
ayushtkn commented on pull request #1554: URL: https://github.com/apache/ozone/pull/1554#issuecomment-724719262 Thanx have assigned it you. If no comments from @jojochuang or @cku328 Will merge this by tomorrow. This i

[jira] [Commented] (HDDS-4420) Missing a container shouldn't log message at ERROR level

2020-11-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229224#comment-17229224 ] Ayush Saxena commented on HDDS-4420: Added [~a493172422] as contributor and assigned.

[jira] [Assigned] (HDDS-4420) Missing a container shouldn't log message at ERROR level

2020-11-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDDS-4420: -- Assignee: YI-CHEN WANG > Missing a container shouldn't log message at ERROR level > --

[jira] [Assigned] (HDDS-4442) Disable the location information of audit logger to reduce overhead

2020-11-10 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-4442: -- Assignee: Attila Doroszlai > Disable the location information of audit logger to reduce

[GitHub] [ozone] wycccccc commented on pull request #1554: HDDS-4420. Missing a container shouldn't log message at ERROR level

2020-11-10 Thread GitBox
wycc commented on pull request #1554: URL: https://github.com/apache/ozone/pull/1554#issuecomment-724702135 @ayushtkn I have already replied in JIRA, thank you. This is an automated message from the Apache Git Service. To

[jira] [Commented] (HDDS-4420) Missing a container shouldn't log message at ERROR level

2020-11-10 Thread YI-CHEN WANG (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229214#comment-17229214 ] YI-CHEN WANG commented on HDDS-4420: I would like to ask you to help me to join the JI

[jira] [Issue Comment Deleted] (HDDS-4420) Missing a container shouldn't log message at ERROR level

2020-11-10 Thread Jira
[ https://issues.apache.org/jira/browse/HDDS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 王懿宸 updated HDDS-4420: -- Comment: was deleted (was: I would like to ask you to help me to join the JIRA contributor list, thank you.) > Missing

[jira] [Commented] (HDDS-4420) Missing a container shouldn't log message at ERROR level

2020-11-10 Thread Jira
[ https://issues.apache.org/jira/browse/HDDS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17229198#comment-17229198 ] 王懿宸 commented on HDDS-4420: --- I would like to ask you to help me to join the JIRA contributor lis

[jira] [Created] (HDDS-4448) Duplicate refreshPipeline in listStatus

2020-11-10 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-4448: -- Summary: Duplicate refreshPipeline in listStatus Key: HDDS-4448 URL: https://issues.apache.org/jira/browse/HDDS-4448 Project: Hadoop Distributed Data Store

[GitHub] [ozone] yuyang733 commented on pull request #1539: HDDS-4079. Create ZH translation of Containers.md in doc.

2020-11-10 Thread GitBox
yuyang733 commented on pull request #1539: URL: https://github.com/apache/ozone/pull/1539#issuecomment-724648060 > Thanks @yuyang733 for working on this. > > I think we should ensure that some of the words are consistent with other existing documents. > Container -> 容器 ,etc.

[GitHub] [ozone] ayushtkn edited a comment on pull request #1556: HDDS-4434.Fix typo in Admin.md

2020-11-10 Thread GitBox
ayushtkn edited a comment on pull request #1556: URL: https://github.com/apache/ozone/pull/1556#issuecomment-724570581 That is ok. You can't change the commit message without reverting. And this commit will still stay. Until the jira id is not wrong, things would be good --

[GitHub] [ozone] elek commented on a change in pull request #1419: HDDS-3755. [DESIGN] Storage-class for Ozone

2020-11-10 Thread GitBox
elek commented on a change in pull request #1419: URL: https://github.com/apache/ozone/pull/1419#discussion_r520461837 ## File path: hadoop-hdds/docs/content/design/storage-class.md ## @@ -19,10 +19,331 @@ author: Marton Ele See the License for the specific language governin

[GitHub] [ozone] yuyang733 commented on pull request #1539: HDDS-4079. Create ZH translation of Containers.md in doc.

2020-11-10 Thread GitBox
yuyang733 commented on pull request #1539: URL: https://github.com/apache/ozone/pull/1539#issuecomment-724599055 > @yuyang733 Thanks for this document. > > Please insert a space around a English word, something like this > > `Container是Ozone/HDDS的基本复制单元` -> `Container 是 Ozone/H

[GitHub] [ozone] linyiqun commented on a change in pull request #1552: HDDS-4404. Datanode can go OOM when a Recon or SCM Server is very slow in processing reports

2020-11-10 Thread GitBox
linyiqun commented on a change in pull request #1552: URL: https://github.com/apache/ozone/pull/1552#discussion_r520411203 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/states/endpoint/HeartbeatEndpointTask.java ## @@ -147,8

[GitHub] [ozone] linyiqun commented on a change in pull request #1552: HDDS-4404. Datanode can go OOM when a Recon or SCM Server is very slow in processing reports

2020-11-10 Thread GitBox
linyiqun commented on a change in pull request #1552: URL: https://github.com/apache/ozone/pull/1552#discussion_r520411203 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/states/endpoint/HeartbeatEndpointTask.java ## @@ -147,8

[jira] [Updated] (HDDS-4393) Fix CI and test failures after force push on 2020/10/26

2020-11-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4393: - Labels: pull-request-available (was: ) > Fix CI and test failures after force push on 2020/10/26

[GitHub] [ozone] elek commented on pull request #1522: HDDS-4393. Test CI failures after force push.

2020-11-10 Thread GitBox
elek commented on pull request #1522: URL: https://github.com/apache/ozone/pull/1522#issuecomment-724578850 Hi, just curious? What kind of force push was necessary and why? (I have no problem with that, just interested to learn.) ---

[GitHub] [ozone] linyiqun commented on a change in pull request #1552: HDDS-4404. Datanode can go OOM when a Recon or SCM Server is very slow in processing reports

2020-11-10 Thread GitBox
linyiqun commented on a change in pull request #1552: URL: https://github.com/apache/ozone/pull/1552#discussion_r520411203 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/states/endpoint/HeartbeatEndpointTask.java ## @@ -147,8

[GitHub] [ozone] ayushtkn edited a comment on pull request #1556: HDDS-4434.Fix typo in Admin.md

2020-11-10 Thread GitBox
ayushtkn edited a comment on pull request #1556: URL: https://github.com/apache/ozone/pull/1556#issuecomment-724570581 That is ok. You can't change the commit message without reverting. And this commit will still stay. Until the jira id is not wrongs, things would be good -

  1   2   >