[jira] [Updated] (HDDS-4135) In ContainerStateManagerV2, modification of RocksDB should be consistent with that of memory state.

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4135: Description:   Fix a bug in https://issues.apache.org/jira/browse/HDDS-3895  In ContainerStateManagerV2, b

[jira] [Updated] (HDDS-4135) In ContainerStateManagerV2, modification of RocksDB should be consistent with that of memory state.

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4135: Labels: (was: pull-request-available) > In ContainerStateManagerV2, modification of RocksDB should be cons

[jira] [Updated] (HDDS-4135) In ContainerStateManagerV2, modification of RocksDB should be in consistency with that of memory state.

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4135: Description:   Fix a bug in https://issues.apache.org/jira/browse/HDDS-3895   In ContainerStateManagerV2,

[jira] [Updated] (HDDS-4135) In ContainerStateManagerV2, modification of RocksDB should be consistent with that of memory state.

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4135: Summary: In ContainerStateManagerV2, modification of RocksDB should be consistent with that of memory state.

[GitHub] [hadoop-ozone] maobaolong closed pull request #984: HDDS-3654. Let backgroundCreator create pipeline for the support replication factors alternately

2020-08-24 Thread GitBox
maobaolong closed pull request #984: URL: https://github.com/apache/hadoop-ozone/pull/984 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (HDDS-4077) Incomplete OzoneFileSystem statistics

2020-08-24 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4077: --- Status: Patch Available (was: In Progress) > Incomplete OzoneFileSystem statistics >

[GitHub] [hadoop-ozone] captainzmc closed pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-08-24 Thread GitBox
captainzmc closed pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hadoop-ozone] maobaolong commented on pull request #984: HDDS-3654. Let backgroundCreator create pipeline for the support replication factors alternately

2020-08-24 Thread GitBox
maobaolong commented on pull request #984: URL: https://github.com/apache/hadoop-ozone/pull/984#issuecomment-678989162 @elek Thanks you for approve this PR, now it passed all CI checks. This is an automated message from the A

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1320: HDDS-4111. Keep the CSI.zh.md consistent with CSI.md

2020-08-24 Thread GitBox
maobaolong commented on pull request #1320: URL: https://github.com/apache/hadoop-ozone/pull/1320#issuecomment-678990048 @runitao Thanks for the +1. @cxorm Please take a look at this CSI.zh.md update. This is an automated

[jira] [Created] (HDDS-4136) CLONE - In ContainerStateManagerV2, modification of RocksDB should be consistent with that of memory state.

2020-08-24 Thread Glen Geng (Jira)
Glen Geng created HDDS-4136: --- Summary: CLONE - In ContainerStateManagerV2, modification of RocksDB should be consistent with that of memory state. Key: HDDS-4136 URL: https://issues.apache.org/jira/browse/HDDS-4136

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state updates for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Summary: Design for Error/Exception handling in state updates for container/pipeline V2 (was: CLONE - In Co

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Summary: Design for Error/Exception handling in state update for container/pipeline V2 (was: Design for Err

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Description: I have a concern about how to handling exceptions occurred in writing RocksDB for container V2

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Description: (was:   Fix a bug in https://issues.apache.org/jira/browse/HDDS-3895  In ContainerStateMan

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Description: I have a concern about how to handle exceptions occurred in writing RocksDB for container V2,

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Description: I have a concern about how to handle exceptions occurred in writing RocksDB for container V2,

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1336: HDDS-4119. Improve performance of the BufferPool management of Ozone client

2020-08-24 Thread GitBox
adoroszlai commented on a change in pull request #1336: URL: https://github.com/apache/hadoop-ozone/pull/1336#discussion_r475439432 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/common/ChunkBuffer.java ## @@ -88,6 +86,12 @@ default ChunkBuffer put(byte

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Description: I have a concern about how to handle exceptions occurred in writing RocksDB for container V2,

[jira] [Created] (HDDS-4137) Turn on the verbose mode of safe mode check on testlib

2020-08-24 Thread maobaolong (Jira)
maobaolong created HDDS-4137: Summary: Turn on the verbose mode of safe mode check on testlib Key: HDDS-4137 URL: https://issues.apache.org/jira/browse/HDDS-4137 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] captainzmc commented on pull request #1296: HDDS-4053. Volume space: add quotaUsageInBytes and update it when write and delete key.

2020-08-24 Thread GitBox
captainzmc commented on pull request #1296: URL: https://github.com/apache/hadoop-ozone/pull/1296#issuecomment-679067616 @ChenSammi CC This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1339: HDDS-4131. Container report should update container key count and bytes used if they differ in SCM

2020-08-24 Thread GitBox
adoroszlai commented on a change in pull request #1339: URL: https://github.com/apache/hadoop-ozone/pull/1339#discussion_r475524057 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/AbstractContainerReportHandler.java ## @@ -103,14 +108,44

[jira] [Created] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
runzhiwang created HDDS-4138: Summary: Improve crc efficiency Key: HDDS-4138 URL: https://issues.apache.org/jira/browse/HDDS-4138 Project: Hadoop Distributed Data Store Issue Type: Task

[jira] [Updated] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4138: - Description: HADOOP has implemented several method to calculate crc: https://issues.apache.org/jira/brows

[jira] [Updated] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4138: - Description: HADOOP has implemented several method to calculate crc: https://issues.apache.org/jira/brows

[jira] [Updated] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4138: - Description: HADOOP has implemented several method to calculate crc: https://issues.apache.org/jira/brows

[jira] [Updated] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4138: - Attachment: screenshot-1.png > Improve crc efficiency > -- > > Key: HD

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #1339: HDDS-4131. Container report should update container key count and bytes used if they differ in SCM

2020-08-24 Thread GitBox
sodonnel commented on a change in pull request #1339: URL: https://github.com/apache/hadoop-ozone/pull/1339#discussion_r475547913 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/AbstractContainerReportHandler.java ## @@ -103,14 +108,44 @

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #1339: HDDS-4131. Container report should update container key count and bytes used if they differ in SCM

2020-08-24 Thread GitBox
sodonnel commented on a change in pull request #1339: URL: https://github.com/apache/hadoop-ozone/pull/1339#discussion_r475548705 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/container/TestContainerReportHandler.java ## @@ -483,9 +485,167 @@ pu

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Description: I have a concern about how to handle exceptions occurred in writing RocksDB for container V2,

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Description: I have a concern about how to handle exceptions occurred in writing RocksDB for container V2,

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Description: I have a concern about how to handle exceptions occurred in writing RocksDB for container V2,

[jira] [Updated] (HDDS-4136) Design for Error/Exception handling in state update for container/pipeline V2

2020-08-24 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4136: Description: I have a concern about how to handle exceptions occurred in writing RocksDB for container V2,

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1339: HDDS-4131. Container report should update container key count and bytes used if they differ in SCM

2020-08-24 Thread GitBox
adoroszlai commented on a change in pull request #1339: URL: https://github.com/apache/hadoop-ozone/pull/1339#discussion_r475523841 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/AbstractContainerReportHandler.java ## @@ -103,13 +108,44

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1339: HDDS-4131. Container report should update container key count and bytes used if they differ in SCM

2020-08-24 Thread GitBox
adoroszlai commented on a change in pull request #1339: URL: https://github.com/apache/hadoop-ozone/pull/1339#discussion_r475577292 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/AbstractContainerReportHandler.java ## @@ -103,14 +108,44

[GitHub] [hadoop-ozone] GlenGeng opened a new pull request #1342: HDDS-4135: In ContainerStateManagerV2, modification of RocksDB should be consistent with that of memory state.

2020-08-24 Thread GitBox
GlenGeng opened a new pull request #1342: URL: https://github.com/apache/hadoop-ozone/pull/1342 ## What changes were proposed in this pull request? Fix a bug in https://issues.apache.org/jira/browse/HDDS-3895 In ContainerStateManagerV2, both disk state (column families in Rocks

[jira] [Updated] (HDDS-4135) In ContainerStateManagerV2, modification of RocksDB should be consistent with that of memory state.

2020-08-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4135: - Labels: pull-request-available (was: ) > In ContainerStateManagerV2, modification of RocksDB shou

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #1343: HDDS-4137. Turn on the verbose mode of safe mode check on testlib

2020-08-24 Thread GitBox
maobaolong opened a new pull request #1343: URL: https://github.com/apache/hadoop-ozone/pull/1343 ## What changes were proposed in this pull request? Turn on the verbose mode of safe mode check on testlib ## What is the link to the Apache JIRA HDDS-4137 ## How was

[jira] [Updated] (HDDS-4118) Allow running Kubernetes example tests on k3d

2020-08-24 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4118: --- Resolution: Not A Problem Status: Resolved (was: Patch Available) > Allow running Kub

[jira] [Updated] (HDDS-4137) Turn on the verbose mode of safe mode check on testlib

2020-08-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4137: - Labels: pull-request-available (was: ) > Turn on the verbose mode of safe mode check on testlib >

[jira] [Resolved] (HDDS-4094) Support byte-leve write in Freon HadoopFsGenerator

2020-08-24 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-4094. Fix Version/s: 0.7.0 Resolution: Implemented > Support byte-leve write in Freon Hadoo

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1310: HDDS-4094. Support byte-level write in Freon HadoopFsGenerator

2020-08-24 Thread GitBox
adoroszlai merged pull request #1310: URL: https://github.com/apache/hadoop-ozone/pull/1310 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Updated] (HDDS-4094) Support byte-leve write in Freon HadoopFsGenerator

2020-08-24 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4094: --- Labels: (was: pull-request-available) > Support byte-leve write in Freon HadoopFsGenerator >

[jira] [Commented] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-08-24 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17183281#comment-17183281 ] Marton Elek commented on HDDS-4097: --- Thanks to explain it [~bharat]. I am closer now, bu

[jira] [Updated] (HDDS-4121) Implement OmMetadataMangerImpl#getExpiredOpenKeys

2020-08-24 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-4121: - Description: Implement the getExpiredOpenKeys method in OmMetadataMangerImpl to return keys in the open ke

[jira] [Updated] (HDDS-4120) Implement cleanup service for OM open key table

2020-08-24 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-4120: - Description: Currently, uncommitted keys in the OM open key table remain there until they are committed.

[jira] [Created] (HDDS-4139) Update version number in upgrade tests

2020-08-24 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-4139: -- Summary: Update version number in upgrade tests Key: HDDS-4139 URL: https://issues.apache.org/jira/browse/HDDS-4139 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1337: HDDS-4129. change MAX_QUOTA_IN_BYTES to Long.MAX_VALUE.

2020-08-24 Thread GitBox
adoroszlai commented on a change in pull request #1337: URL: https://github.com/apache/hadoop-ozone/pull/1337#discussion_r475697694 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/OzoneConsts.java ## @@ -200,9 +200,9 @@ public static Versioning getVersio

[GitHub] [hadoop-ozone] elek commented on pull request #1110: HDDS-3843. Throw the specific exception other than NPE.

2020-08-24 Thread GitBox
elek commented on pull request #1110: URL: https://github.com/apache/hadoop-ozone/pull/1110#issuecomment-679204042 /pending @maobaolong Do we have the same error with this patch as AWS? This is an automated message from the A

[GitHub] [hadoop-ozone] elek commented on pull request #1121: HDDS-3432. Enable TestBlockDeletion test cases.

2020-08-24 Thread GitBox
elek commented on pull request #1121: URL: https://github.com/apache/hadoop-ozone/pull/1121#issuecomment-679204445 /pending "I still see 1/20 failure due to timeout at TestBlockDeletion.testBlockDeletion(TestBlockDeletion.java:174)." ---

[GitHub] [hadoop-ozone] elek commented on pull request #1181: [POC] HDDS-3915. Simple trash emptier on OM

2020-08-24 Thread GitBox
elek commented on pull request #1181: URL: https://github.com/apache/hadoop-ozone/pull/1181#issuecomment-679204900 /pending draft PR without activity This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop-ozone] elek commented on pull request #970: HDDS-3666. Fix delete container cli failed.

2020-08-24 Thread GitBox
elek commented on pull request #970: URL: https://github.com/apache/hadoop-ozone/pull/970#issuecomment-679205837 What is the state of this PR? If I understood well we need this change but requires a cleanup on this PR... Thi

[GitHub] [hadoop-ozone] elek commented on pull request #1232: HDDS-3431. Enable TestContainerReplication test cases

2020-08-24 Thread GitBox
elek commented on pull request #1232: URL: https://github.com/apache/hadoop-ozone/pull/1232#issuecomment-679206176 /pending review comments are not answered This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop-ozone] elek commented on pull request #928: [WIP] HDDS-3599. Implement ofs://: Add contract test for HA

2020-08-24 Thread GitBox
elek commented on pull request #928: URL: https://github.com/apache/hadoop-ozone/pull/928#issuecomment-679206516 /pending Draft and no activity This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [hadoop-ozone] elek commented on pull request #1192: HDDS-3947: Sort DNs for client when the key is a file for #getFileStatus #listStatus APIs

2020-08-24 Thread GitBox
elek commented on pull request #1192: URL: https://github.com/apache/hadoop-ozone/pull/1192#issuecomment-679207273 /pending "@rakeshadr , can you plz add some details here as to why sorting of dns is required ?" This is an a

[GitHub] [hadoop-ozone] elek commented on pull request #1271: HDDS-4020. ACL commands like getacl and setacl should return a response only when Native Authorizer is enabled.

2020-08-24 Thread GitBox
elek commented on pull request #1271: URL: https://github.com/apache/hadoop-ozone/pull/1271#issuecomment-679206934 /pending Review comments are not addressed + no clean build This is an automated message from the Apache Git S

[GitHub] [hadoop-ozone] elek commented on pull request #1274: HDDS-3810. Add the logic to distribute open containers among the pipelines of a datanode.

2020-08-24 Thread GitBox
elek commented on pull request #1274: URL: https://github.com/apache/hadoop-ozone/pull/1274#issuecomment-679208064 Green build + approval. Will merge this after a new build. This is an automated message from the Apache Git Se

[GitHub] [hadoop-ozone] elek commented on pull request #1230: HDDS-2949: mkdir : store directory entries in a separate table

2020-08-24 Thread GitBox
elek commented on pull request #1230: URL: https://github.com/apache/hadoop-ozone/pull/1230#issuecomment-679209035 /pending review comments are not addressed This is an automated message from the Apache Git Service. To respon

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #934: HDDS-3605. Support close all pipelines.

2020-08-24 Thread GitBox
adoroszlai commented on pull request #934: URL: https://github.com/apache/hadoop-ozone/pull/934#issuecomment-679212788 /close This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop-ozone] sadanand48 commented on pull request #1232: HDDS-3431. Enable TestContainerReplication test cases

2020-08-24 Thread GitBox
sadanand48 commented on pull request #1232: URL: https://github.com/apache/hadoop-ozone/pull/1232#issuecomment-679216992 Thanks @adoroszlai for reviewing this. Sorry for the late reply . I had followed this comment ` Since datanode commands are added through event queue, onMessage method

[GitHub] [hadoop-ozone] github-actions[bot] closed pull request #934: HDDS-3605. Support close all pipelines.

2020-08-24 Thread GitBox
github-actions[bot] closed pull request #934: URL: https://github.com/apache/hadoop-ozone/pull/934 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] github-actions[bot] commented on pull request #934: HDDS-3605. Support close all pipelines.

2020-08-24 Thread GitBox
github-actions[bot] commented on pull request #934: URL: https://github.com/apache/hadoop-ozone/pull/934#issuecomment-679217966 Thank you very much for the patch. I am closing this PR __temporarily__ as there was no activity recently and it is waiting for response from its author.

[GitHub] [hadoop-ozone] bharatviswa504 closed pull request #1271: HDDS-4020. ACL commands like getacl and setacl should return a response only when Native Authorizer is enabled.

2020-08-24 Thread GitBox
bharatviswa504 closed pull request #1271: URL: https://github.com/apache/hadoop-ozone/pull/1271 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1337: HDDS-4129. change MAX_QUOTA_IN_BYTES to Long.MAX_VALUE.

2020-08-24 Thread GitBox
bharatviswa504 commented on pull request #1337: URL: https://github.com/apache/hadoop-ozone/pull/1337#issuecomment-679223880 Closing this as HDDS-4089 planning to fix this issue to make ACL commands work with the external authorizer. ---

[jira] [Resolved] (HDDS-4020) ACL commands like getacl and setacl should return a response only when Native Authorizer is enabled

2020-08-24 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-4020. -- Resolution: Won't Fix > ACL commands like getacl and setacl should return a response onl

[jira] [Created] (HDDS-4140) Auto-close /pending pull requests after 21 days of inactivity

2020-08-24 Thread Marton Elek (Jira)
Marton Elek created HDDS-4140: - Summary: Auto-close /pending pull requests after 21 days of inactivity Key: HDDS-4140 URL: https://issues.apache.org/jira/browse/HDDS-4140 Project: Hadoop Distributed Data

[GitHub] [hadoop-ozone] elek opened a new pull request #1344: HDDS-4140. Auto-close /pending pull requests after 21 days of inactivity

2020-08-24 Thread GitBox
elek opened a new pull request #1344: URL: https://github.com/apache/hadoop-ozone/pull/1344 ## What changes were proposed in this pull request? Earlier we introduced a way to mark the inactive pull requests with "pending" label (with the help of /pending comment). This pull re

[jira] [Updated] (HDDS-4140) Auto-close /pending pull requests after 21 days of inactivity

2020-08-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4140: - Labels: pull-request-available (was: ) > Auto-close /pending pull requests after 21 days of inact

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-24 Thread GitBox
avijayanhwx commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r475740631 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/upgrade/OMLayoutFeatureCatalog.java ## @@ -0,0 +1,71 @@ +/** +

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-24 Thread GitBox
avijayanhwx commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r475741754 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/response/s3/security/package-info.java ## @@ -19,4 +19,4 @@ /

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1345: HDDS-4139. Update version number in upgrade tests

2020-08-24 Thread GitBox
adoroszlai opened a new pull request #1345: URL: https://github.com/apache/hadoop-ozone/pull/1345 ## What changes were proposed in this pull request? Update version number `0.6.0` to `1.0.0` in upgrade scripts and tests (content and file/directory names). https://issues.apache

[jira] [Updated] (HDDS-4139) Update version number in upgrade tests

2020-08-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4139: - Labels: pull-request-available (was: ) > Update version number in upgrade tests > ---

[GitHub] [hadoop-ozone] smengcl closed pull request #1181: [POC] HDDS-3915. Simple trash emptier on OM

2020-08-24 Thread GitBox
smengcl closed pull request #1181: URL: https://github.com/apache/hadoop-ozone/pull/1181 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hadoop-ozone] smengcl commented on pull request #1181: [POC] HDDS-3915. Simple trash emptier on OM

2020-08-24 Thread GitBox
smengcl commented on pull request #1181: URL: https://github.com/apache/hadoop-ozone/pull/1181#issuecomment-679267871 Closing this PR as this is only a POC and won't be ever merged. This is an automated message from the Apach

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-24 Thread GitBox
avijayanhwx commented on pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#issuecomment-679268593 > Hi @avijayanhwx, > > thank you for starting this work, and posting an inital version of the core code for the upgrade support. > I have a few general questio

[GitHub] [hadoop-ozone] arp7 commented on pull request #1088: HDDS-3805. [OFS] Remove usage of OzoneClientAdapter interface

2020-08-24 Thread GitBox
arp7 commented on pull request #1088: URL: https://github.com/apache/hadoop-ozone/pull/1088#issuecomment-679270871 Folks - what is the benefit of splitting this into smaller Jiras? Is it just to make the code review easier?

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1271: HDDS-4020. ACL commands like getacl and setacl should return a response only when Native Authorizer is enabled.

2020-08-24 Thread GitBox
bharatviswa504 commented on pull request #1271: URL: https://github.com/apache/hadoop-ozone/pull/1271#issuecomment-679274161 Closing this as HDDS-4089 is trying to fix acl commands when external authorizer is configured. Thi

[GitHub] [hadoop-ozone] smengcl commented on pull request #1330: HDDS-4074. [OFS] Implement AbstractFileSystem for RootedOzoneFileSystem

2020-08-24 Thread GitBox
smengcl commented on pull request #1330: URL: https://github.com/apache/hadoop-ozone/pull/1330#issuecomment-679274423 @elek Would you like to take a look at this? This is an automated message from the Apache Git Service. To r

[jira] [Updated] (HDDS-3829) Introduce Layout Feature interface in Ozone.

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3829: Status: Patch Available (was: Open) > Introduce Layout Feature interface in Ozone. > --

[jira] [Created] (HDDS-4141) Implement Finalize command in Ozone Manager.

2020-08-24 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-4141: --- Summary: Implement Finalize command in Ozone Manager. Key: HDDS-4141 URL: https://issues.apache.org/jira/browse/HDDS-4141 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4141) Implement Finalize command in Ozone Manager.

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4141: Description: * On the client side, add a new command to finalize OM through CLI. * On the se

[jira] [Created] (HDDS-4142) Expose upgrade related state through CLI & JMX

2020-08-24 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-4142: --- Summary: Expose upgrade related state through CLI & JMX Key: HDDS-4142 URL: https://issues.apache.org/jira/browse/HDDS-4142 Project: Hadoop Distributed Data Stor

[jira] [Updated] (HDDS-4142) Expose upgrade related state through CLI & JMX

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4142: Parent: HDDS-3698 Issue Type: Sub-task (was: Bug) > Expose upgrade related state th

[jira] [Updated] (HDDS-4142) Expose upgrade related state through JMX

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4142: Summary: Expose upgrade related state through JMX (was: Expose upgrade related state throug

[jira] [Created] (HDDS-4143) Introduce version in OM Ratis request.

2020-08-24 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-4143: --- Summary: Introduce version in OM Ratis request. Key: HDDS-4143 URL: https://issues.apache.org/jira/browse/HDDS-4143 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4143) Implement a

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4143: Summary: Implement a (was: Introduce version in OM Ratis request.) > Implement a > --

[jira] [Assigned] (HDDS-3881) Add current layout version to OM Ratis Request.

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-3881: --- Assignee: Prashant Pogde > Add current layout version to OM Ratis Request. >

[jira] [Updated] (HDDS-3881) Add current layout version to OM Ratis Request.

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3881: Description: To make sure the correct version of the applyTxn step is executed against the r

[jira] [Updated] (HDDS-4143) Implement a version factory for OM Apply Transaction that uses the implementation based on layout version.

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4143: Summary: Implement a version factory for OM Apply Transaction that uses the implementation b

[jira] [Updated] (HDDS-4143) Implement a version factory for OM Apply Transaction that uses the implementation based on layout version.

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4143: Parent: HDDS-3698 Issue Type: Sub-task (was: Task) > Implement a version factory fo

[jira] [Assigned] (HDDS-3830) Introduce OM layout version 'v0'.

2020-08-24 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-3830: --- Assignee: Stephen O'Donnell (was: Aravindan Vijayan) > Introduce OM layout version '

[jira] [Updated] (HDDS-4139) Update version number in upgrade tests

2020-08-24 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4139: --- Status: Patch Available (was: In Progress) > Update version number in upgrade tests > ---

[GitHub] [hadoop-ozone] smengcl commented on pull request #1088: HDDS-3805. [OFS] Remove usage of OzoneClientAdapter interface

2020-08-24 Thread GitBox
smengcl commented on pull request #1088: URL: https://github.com/apache/hadoop-ozone/pull/1088#issuecomment-679346944 After a short discussion with @arp7 and @adoroszlai I think for this PR we won't merge the two classes (`BasicRootedOzoneFileSystem` and `BasicRootedOzoneFileSystemImpl`).

[jira] [Updated] (HDDS-3927) Add OZONE_MANAGER_OPTS and OZONE_DATANODE_OPTS

2020-08-24 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3927: - Description: Similar to {{HDFS_NAMENODE_OPTS}}, {{HDFS_DATANODE_OPTS}}, etc., we should have {{OZONE_MANA

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1324: HDDS-4068. Client should not retry same OM on network connection failure

2020-08-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1324: URL: https://github.com/apache/hadoop-ozone/pull/1324#discussion_r475966746 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/OMFailoverProxyProvider.java ## @@ -172,9 +174,12 @@ private Oz

[GitHub] [hadoop-ozone] hanishakoneru commented on a change in pull request #1324: HDDS-4068. Client should not retry same OM on network connection failure

2020-08-24 Thread GitBox
hanishakoneru commented on a change in pull request #1324: URL: https://github.com/apache/hadoop-ozone/pull/1324#discussion_r475972003 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/OMFailoverProxyProvider.java ## @@ -172,9 +174,12 @@ private Ozo

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1324: HDDS-4068. Client should not retry same OM on network connection failure

2020-08-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1324: URL: https://github.com/apache/hadoop-ozone/pull/1324#discussion_r476093708 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/OMFailoverProxyProvider.java ## @@ -172,9 +174,12 @@ private Oz

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1324: HDDS-4068. Client should not retry same OM on network connection failure

2020-08-24 Thread GitBox
bharatviswa504 commented on a change in pull request #1324: URL: https://github.com/apache/hadoop-ozone/pull/1324#discussion_r476093708 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/OMFailoverProxyProvider.java ## @@ -172,9 +174,12 @@ private Oz

[GitHub] [hadoop-ozone] amaliujia opened a new pull request #1346: [WIP] HDDS-4115. CLI command to show current SCM leader and follower status.

2020-08-24 Thread GitBox
amaliujia opened a new pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346 ## What changes were proposed in this pull request? CLI command to show current SCM leader and follower status. E.g. `ozone admin scmha listratisstatus` ## What is the link to the

[jira] [Updated] (HDDS-4115) CLI command to show current SCM leader and follower status

2020-08-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4115: - Labels: pull-request-available (was: ) > CLI command to show current SCM leader and follower stat

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1346: [WIP] HDDS-4115. CLI command to show current SCM leader and follower status.

2020-08-24 Thread GitBox
amaliujia commented on pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#issuecomment-679615937 R: @timmylicheng This is still WIP. Can you give some suggestions. Just want to make sure I am on the right track. --

  1   2   >