[GitHub] [ozone] bharatviswa504 commented on a change in pull request #1489: HDDS-4308. Fix issue with quota update

2020-10-27 Thread GitBox
bharatviswa504 commented on a change in pull request #1489: URL: https://github.com/apache/ozone/pull/1489#discussion_r513169793 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRequest.java ## @@ -597,27 +596,40 @@ protected

[GitHub] [ozone] bharatviswa504 commented on a change in pull request #1489: HDDS-4308. Fix issue with quota update

2020-10-27 Thread GitBox
bharatviswa504 commented on a change in pull request #1489: URL: https://github.com/apache/ozone/pull/1489#discussion_r513169229 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRequest.java ## @@ -597,27 +596,40 @@ protected

[GitHub] [ozone] bharatviswa504 commented on a change in pull request #1498: HDDS-4339. Allow AWSSignatureProcessor init when aws signature is absent.

2020-10-27 Thread GitBox
bharatviswa504 commented on a change in pull request #1498: URL: https://github.com/apache/ozone/pull/1498#discussion_r513166313 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/OzoneClientProducer.java ## @@ -80,9 +81,15 @@ private OzoneClient

[jira] [Created] (HDDS-4396) Ozone TLP - update documents

2020-10-27 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-4396: Summary: Ozone TLP - update documents Key: HDDS-4396 URL: https://issues.apache.org/jira/browse/HDDS-4396 Project: Hadoop Distributed Data Store Issue Type: Task

[jira] [Updated] (HDDS-4396) Ozone TLP - update documents

2020-10-27 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4396: - Target Version/s: 1.1.0 > Ozone TLP - update documents > > >

[GitHub] [ozone] captainzmc commented on pull request #1497: HDDS-4345. Replace the deprecated Lock method

2020-10-27 Thread GitBox
captainzmc commented on pull request #1497: URL: https://github.com/apache/ozone/pull/1497#issuecomment-717654070 Thanks for @xiaoyuyao’s feedback. The issues has been fixed This is an automated message from the Apache Git

[GitHub] [ozone] captainzmc commented on a change in pull request #1489: HDDS-4308. Fix issue with quota update

2020-10-27 Thread GitBox
captainzmc commented on a change in pull request #1489: URL: https://github.com/apache/ozone/pull/1489#discussion_r513140628 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRequest.java ## @@ -597,27 +596,40 @@ protected

[jira] [Commented] (HDDS-4333) Ozone supports append operation

2020-10-27 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221752#comment-17221752 ] Arpit Agarwal commented on HDDS-4333: - I don't think we should implement the append/truncate features

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1515: HDDS-4373. [Design] Ozone support append operation

2020-10-27 Thread GitBox
arp7 commented on a change in pull request #1515: URL: https://github.com/apache/hadoop-ozone/pull/1515#discussion_r513026161 ## File path: hadoop-hdds/docs/content/design/append.md ## @@ -0,0 +1,87 @@ +--- +title: Append +summary: Append to the existing key. +date: 2020-10-22

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1515: HDDS-4373. [Design] Ozone support append operation

2020-10-27 Thread GitBox
arp7 commented on a change in pull request #1515: URL: https://github.com/apache/hadoop-ozone/pull/1515#discussion_r513025813 ## File path: hadoop-hdds/docs/content/design/append.md ## @@ -0,0 +1,87 @@ +--- +title: Append +summary: Append to the existing key. +date: 2020-10-22

[GitHub] [hadoop-ozone] prashantpogde commented on pull request #1507: HDDS-4307.Start Trash Emptier in Ozone Manager

2020-10-27 Thread GitBox
prashantpogde commented on pull request #1507: URL: https://github.com/apache/hadoop-ozone/pull/1507#issuecomment-717415113 +1 LGTM This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Resolved] (HDDS-3731) add storage space quota doc

2020-10-27 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3731. -- Fix Version/s: 1.1.0 Resolution: Fixed Thanks [~simonss] for the contribution. The PR has been

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #1516: HDDS-3731. [doc]add storage space quota document.

2020-10-27 Thread GitBox
xiaoyuyao merged pull request #1516: URL: https://github.com/apache/hadoop-ozone/pull/1516 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1516: HDDS-3731. [doc]add storage space quota document.

2020-10-27 Thread GitBox
xiaoyuyao commented on pull request #1516: URL: https://github.com/apache/hadoop-ozone/pull/1516#issuecomment-717361668 Thanks @captainzmc for the update. LGTM, +1. This is an automated message from the Apache Git Service.

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1489: HDDS-4308. Fix issue with quota update

2020-10-27 Thread GitBox
linyiqun commented on a change in pull request #1489: URL: https://github.com/apache/hadoop-ozone/pull/1489#discussion_r512749950 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRequest.java ## @@ -597,27 +596,40 @@ protected

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1489: HDDS-4308. Fix issue with quota update

2020-10-27 Thread GitBox
linyiqun commented on a change in pull request #1489: URL: https://github.com/apache/hadoop-ozone/pull/1489#discussion_r512749950 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyRequest.java ## @@ -597,27 +596,40 @@ protected

[GitHub] [hadoop-ozone] bshashikant commented on pull request #1523: HDDS-4320. Let Ozone input streams implement CanUnbuffer

2020-10-27 Thread GitBox
bshashikant commented on pull request #1523: URL: https://github.com/apache/hadoop-ozone/pull/1523#issuecomment-717257127 Thanks @adoroszlai . I am still reviewing this, however, i have couple of questions: 1) In unbuffer, do we need to remove the corresponding blockInputStreams and

[jira] [Resolved] (HDDS-4386) Each EndpointStateMachine uses its own thread pool to talk with SCM/Recon

2020-10-27 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-4386. - Resolution: Fixed Merged the PR. Thanks for the fix [~glengeng]. > Each

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1518: HDDS-4386: Each EndpointStateMachine uses its own thread pool to talk with SCM/Recon

2020-10-27 Thread GitBox
avijayanhwx merged pull request #1518: URL: https://github.com/apache/hadoop-ozone/pull/1518 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HDDS-4355) Deleted container is marked as missing on recon UI

2020-10-27 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221397#comment-17221397 ] Aravindan Vijayan commented on HDDS-4355: - [~Sammi] Yes, this is a known limitation in Recon

[jira] [Assigned] (HDDS-4355) Deleted container is marked as missing on recon UI

2020-10-27 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-4355: --- Assignee: Aravindan Vijayan > Deleted container is marked as missing on recon UI >

[jira] [Commented] (HDDS-4385) It would be nice if there is a search function using container ID on Recon Missing Container page

2020-10-27 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221390#comment-17221390 ] Aravindan Vijayan commented on HDDS-4385: - [~vivekratnavel] Assigning this to you since it is a UI

[jira] [Assigned] (HDDS-4385) It would be nice if there is a search function using container ID on Recon Missing Container page

2020-10-27 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-4385: --- Assignee: Vivek Ratnavel Subramanian > It would be nice if there is a search

[GitHub] [hadoop-ozone] sadanand48 commented on a change in pull request #1507: HDDS-4307.Start Trash Emptier in Ozone Manager

2020-10-27 Thread GitBox
sadanand48 commented on a change in pull request #1507: URL: https://github.com/apache/hadoop-ozone/pull/1507#discussion_r512567525 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -1228,17 +1238,57 @@ public void

[jira] [Updated] (HDDS-3959) Avoid HddsProtos.PipelineID#toString

2020-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3959: - Labels: pull-request-available (was: ) > Avoid HddsProtos.PipelineID#toString >

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1525: HDDS-3959. Avoid HddsProtos.PipelineID#toString

2020-10-27 Thread GitBox
adoroszlai opened a new pull request #1525: URL: https://github.com/apache/hadoop-ozone/pull/1525 ## What changes were proposed in this pull request? Change `CreatePipelineCommandHandler` and `ClosePipelineCommandHandler` to use the non-proto `PipelineID` object for logging. This

[GitHub] [hadoop-ozone] captainzmc commented on pull request #1489: HDDS-4308. Fix issue with quota update

2020-10-27 Thread GitBox
captainzmc commented on pull request #1489: URL: https://github.com/apache/hadoop-ozone/pull/1489#issuecomment-717123932 Hi @linyiqun,I modified the implementation based on the latest comments. Can you help to review this PR.

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1507: HDDS-4307.Start Trash Emptier in Ozone Manager

2020-10-27 Thread GitBox
rakeshadr commented on a change in pull request #1507: URL: https://github.com/apache/hadoop-ozone/pull/1507#discussion_r512525048 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -1228,17 +1238,57 @@ public void

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1507: HDDS-4307.Start Trash Emptier in Ozone Manager

2020-10-27 Thread GitBox
rakeshadr commented on a change in pull request #1507: URL: https://github.com/apache/hadoop-ozone/pull/1507#discussion_r512525048 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -1228,17 +1238,57 @@ public void

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #1489: HDDS-4308. Fix issue with quota update

2020-10-27 Thread GitBox
captainzmc edited a comment on pull request #1489: URL: https://github.com/apache/hadoop-ozone/pull/1489#issuecomment-708182129 Hi @bharatviswa504, Can you help to review this PR. This is an automated message from the Apache

[jira] [Updated] (HDDS-4320) Let Ozone input streams implement CanUnbuffer

2020-10-27 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4320: --- Status: Patch Available (was: In Progress) > Let Ozone input streams implement CanUnbuffer >

[jira] [Commented] (HDDS-4344) Block Deletion Performance Improvements

2020-10-27 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221206#comment-17221206 ] Lokesh Jain commented on HDDS-4344: --- HDDS-4297 gives better deletion speed for deleting a milllion keys.

[jira] [Resolved] (HDDS-4388) Make writeStateMachineTimeout retry count proportional to node failure timeout

2020-10-27 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain resolved HDDS-4388. --- Resolution: Fixed > Make writeStateMachineTimeout retry count proportional to node failure timeout >

[GitHub] [hadoop-ozone] lokeshj1703 commented on pull request #1519: HDDS-4388. Make writeStateMachineTimeout retry count proportional to node failure timeout

2020-10-27 Thread GitBox
lokeshj1703 commented on pull request #1519: URL: https://github.com/apache/hadoop-ozone/pull/1519#issuecomment-717039024 @bshashikant Thanks for the contribution! I have merged the PR to master branch. This is an automated

[GitHub] [hadoop-ozone] lokeshj1703 closed pull request #1519: HDDS-4388. Make writeStateMachineTimeout retry count proportional to node failure timeout

2020-10-27 Thread GitBox
lokeshj1703 closed pull request #1519: URL: https://github.com/apache/hadoop-ozone/pull/1519 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #1503: HDDS-4332: ListFileStatus - do lookup in directory and file tables

2020-10-27 Thread GitBox
rakeshadr commented on pull request #1503: URL: https://github.com/apache/hadoop-ozone/pull/1503#issuecomment-717036194 > Thanks for updating the PR, @rakeshadr . One further review comment below. > > In additional, current test change not fully cover the test for listStatusV1.

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1503: HDDS-4332: ListFileStatus - do lookup in directory and file tables

2020-10-27 Thread GitBox
rakeshadr commented on a change in pull request #1503: URL: https://github.com/apache/hadoop-ozone/pull/1503#discussion_r512452877 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyManagerImpl.java ## @@ -2205,6 +2276,318 @@ private void

[GitHub] [hadoop-ozone] rakeshadr commented on a change in pull request #1503: HDDS-4332: ListFileStatus - do lookup in directory and file tables

2020-10-27 Thread GitBox
rakeshadr commented on a change in pull request #1503: URL: https://github.com/apache/hadoop-ozone/pull/1503#discussion_r512452877 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyManagerImpl.java ## @@ -2205,6 +2276,318 @@ private void

[jira] [Updated] (HDDS-4258) Set GDPR to a Security submenu in EN and CN document.

2020-10-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4258: - Labels: newbie pull-request-available (was: newbie) > Set GDPR to a Security submenu in EN and

[GitHub] [hadoop-ozone] frischHWC opened a new pull request #1524: HDDS-4258.Set GDPR to a Security submenu in EN and CN document

2020-10-27 Thread GitBox
frischHWC opened a new pull request #1524: URL: https://github.com/apache/hadoop-ozone/pull/1524 ## What changes were proposed in this pull request? Setting GDPR to security submenu for EN & CN pages. ## What is the link to the Apache JIRA

[jira] [Assigned] (HDDS-4258) Set GDPR to a Security submenu in EN and CN document.

2020-10-27 Thread Jira
[ https://issues.apache.org/jira/browse/HDDS-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Risch reassigned HDDS-4258: Assignee: François Risch > Set GDPR to a Security submenu in EN and CN document. >

[jira] [Updated] (HDDS-4191) Add failover proxy for SCM container client

2020-10-27 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-4191: --- Status: Patch Available (was: In Progress) https://github.com/apache/hadoop-ozone/pull/1514 > Add failover

[jira] [Commented] (HDDS-4393) Fix CI and test failures after force push on 2020/10/26

2020-10-27 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221168#comment-17221168 ] Li Cheng commented on HDDS-4393: [https://github.com/apache/hadoop-ozone/pull/1522] shows the current