[GitHub] [hadoop-ozone] nandakumar131 commented on issue #313: HDDS-2242. Avoid unnecessary rpc needed to discover the pipeline leader.

2019-12-12 Thread GitBox
nandakumar131 commented on issue #313: HDDS-2242. Avoid unnecessary rpc needed to discover the pipeline leader. URL: https://github.com/apache/hadoop-ozone/pull/313#issuecomment-565333775 > > The code will become a lot simpler if the leader node in `Pipeline` is represented as `DatanodeDet

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #291: HDDS-1574 Average out pipeline allocation on datanodes and add metrcs/test

2019-12-12 Thread GitBox
xiaoyuyao commented on a change in pull request #291: HDDS-1574 Average out pipeline allocation on datanodes and add metrcs/test URL: https://github.com/apache/hadoop-ozone/pull/291#discussion_r357511301 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #291: HDDS-1574 Average out pipeline allocation on datanodes and add metrcs/test

2019-12-12 Thread GitBox
xiaoyuyao commented on a change in pull request #291: HDDS-1574 Average out pipeline allocation on datanodes and add metrcs/test URL: https://github.com/apache/hadoop-ozone/pull/291#discussion_r357509565 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/

[GitHub] [hadoop-ozone] adoroszlai commented on issue #341: HDDS-2414. Simplify robot tests with removing output greps

2019-12-12 Thread GitBox
adoroszlai commented on issue #341: HDDS-2414. Simplify robot tests with removing output greps URL: https://github.com/apache/hadoop-ozone/pull/341#issuecomment-565327920 @elek please review This is an automated message from

[GitHub] [hadoop-ozone] adoroszlai commented on issue #342: HDDS-2709. Maven property skipShade should not skip ozonefs compilation

2019-12-12 Thread GitBox
adoroszlai commented on issue #342: HDDS-2709. Maven property skipShade should not skip ozonefs compilation URL: https://github.com/apache/hadoop-ozone/pull/342#issuecomment-565327979 @elek please review This is an automated

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation.

2019-12-12 Thread GitBox
adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation. URL: https://github.com/apache/hadoop-ozone/pull/348#discussion_r357503054 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/datanod

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation.

2019-12-12 Thread GitBox
adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation. URL: https://github.com/apache/hadoop-ozone/pull/348#discussion_r357502346 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/datanod

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation.

2019-12-12 Thread GitBox
adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation. URL: https://github.com/apache/hadoop-ozone/pull/348#discussion_r357507729 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/datanod

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation.

2019-12-12 Thread GitBox
adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation. URL: https://github.com/apache/hadoop-ozone/pull/348#discussion_r357500392 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/datanod

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation.

2019-12-12 Thread GitBox
adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation. URL: https://github.com/apache/hadoop-ozone/pull/348#discussion_r357505137 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/datanod

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation.

2019-12-12 Thread GitBox
adoroszlai commented on a change in pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation. URL: https://github.com/apache/hadoop-ozone/pull/348#discussion_r357502263 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/datanod

[jira] [Updated] (HDDS-2722) Let ChunkManager read/write ChunkBuffer instead of ByteBuffer

2019-12-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2722: --- Status: Patch Available (was: In Progress) > Let ChunkManager read/write ChunkBuffer instead

[jira] [Updated] (HDDS-2722) Let ChunkManager read/write ChunkBuffer instead of ByteBuffer

2019-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2722: - Labels: pull-request-available (was: ) > Let ChunkManager read/write ChunkBuffer instead of ByteB

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #352: HDDS-2722. Let ChunkManager read/write ChunkBuffer instead of ByteBuffer

2019-12-12 Thread GitBox
adoroszlai opened a new pull request #352: HDDS-2722. Let ChunkManager read/write ChunkBuffer instead of ByteBuffer URL: https://github.com/apache/hadoop-ozone/pull/352 ## What changes were proposed in this pull request? Change `ChunkManager` read/write methods to accept/return `Chun

[jira] [Assigned] (HDDS-1590) Add per pipeline metrics

2019-12-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDDS-1590: Assignee: Li Cheng > Add per pipeline metrics > > > Key: H

[jira] [Updated] (HDDS-1575) Add support for storage policies to Pipelines

2019-12-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-1575: - Parent: (was: HDDS-1564) Issue Type: Improvement (was: Sub-task) > Add support for storage po

[jira] [Commented] (HDDS-1575) Add support for storage policies to Pipelines

2019-12-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995366#comment-16995366 ] Xiaoyu Yao commented on HDDS-1575: -- Move this out of multi-raft support. This can be impl

[GitHub] [hadoop-ozone] avijayanhwx commented on issue #331: HDDS-2188. Implement LocatedFileStatus & getFileBlockLocations to pro…

2019-12-12 Thread GitBox
avijayanhwx commented on issue #331: HDDS-2188. Implement LocatedFileStatus & getFileBlockLocations to pro… URL: https://github.com/apache/hadoop-ozone/pull/331#issuecomment-565305120 The acceptance test failures are due to this patch. I am looking into it. ---

[jira] [Updated] (HDDS-2176) Add new pipeline state “CLOSING” and new CLOSE_PIPELINE_STATUS command

2019-12-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2176: - Parent: (was: HDDS-1564) Issue Type: Improvement (was: Sub-task) > Add new pipeline state “CL

[jira] [Updated] (HDDS-2034) Async RATIS pipeline creation and destroy through heartbeat commands

2019-12-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2034: - Parent: (was: HDDS-1564) Issue Type: New Feature (was: Sub-task) > Async RATIS pipeline creat

[jira] [Comment Edited] (HDDS-2036) Multi-raft support on single datanode integration test

2019-12-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995363#comment-16995363 ] Xiaoyu Yao edited comment on HDDS-2036 at 12/13/19 5:16 AM: Th

[jira] [Resolved] (HDDS-2036) Multi-raft support on single datanode integration test

2019-12-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-2036. -- Resolution: Fixed The test change is covered by HDDS-1576. > Multi-raft support on single datanode inte

[jira] [Resolved] (HDDS-1573) Add scrubber metrics and pipeline metrics

2019-12-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-1573. -- Resolution: Implemented There metrics have been implemented as part of the feature.  > Add scrubber met

[jira] [Commented] (HDDS-1590) Add per pipeline metrics

2019-12-12 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995357#comment-16995357 ] Xiaoyu Yao commented on HDDS-1590: -- TODO: add SCM per pipeline bytes write metrics. > Ad

[GitHub] [hadoop-ozone] adoroszlai commented on issue #322: HDDS-2684. Refactor common test utilities to hadoop-hdds/common

2019-12-12 Thread GitBox
adoroszlai commented on issue #322: HDDS-2684. Refactor common test utilities to hadoop-hdds/common URL: https://github.com/apache/hadoop-ozone/pull/322#issuecomment-565287537 Thanks @arp7 for reviewing and committing it. Thi

[jira] [Updated] (HDDS-2684) Refactor common test utilities to hadoop-hdds/common

2019-12-12 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-2684: Fix Version/s: 0.5.0 Target Version/s: (was: 0.5.0) Resolution: Fixed

[GitHub] [hadoop-ozone] arp7 merged pull request #322: HDDS-2684. Refactor common test utilities to hadoop-hdds/common

2019-12-12 Thread GitBox
arp7 merged pull request #322: HDDS-2684. Refactor common test utilities to hadoop-hdds/common URL: https://github.com/apache/hadoop-ozone/pull/322 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop-ozone] arp7 commented on issue #322: HDDS-2684. Refactor common test utilities to hadoop-hdds/common

2019-12-12 Thread GitBox
arp7 commented on issue #322: HDDS-2684. Refactor common test utilities to hadoop-hdds/common URL: https://github.com/apache/hadoop-ozone/pull/322#issuecomment-565259614 +1 Looks like Xiaoyu's comments are addressed. Xiaoyu - if not we can address in a followup Jira. --

[jira] [Assigned] (HDDS-1989) Fix ApplyTransaction error handling in OzoneManagerStateMachine

2019-12-12 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-1989: Assignee: Bharat Viswanadham > Fix ApplyTransaction error handling in OzoneManagerS

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #351: HDDS-1989. Fix ApplyTransaction error handling in OzoneManagerStateMachine.

2019-12-12 Thread GitBox
bharatviswa504 opened a new pull request #351: HDDS-1989. Fix ApplyTransaction error handling in OzoneManagerStateMachine. URL: https://github.com/apache/hadoop-ozone/pull/351 ## What changes were proposed in this pull request? Terminate OM, after a critical error in apply tr

[jira] [Updated] (HDDS-1989) Fix ApplyTransaction error handling in OzoneManagerStateMachine

2019-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-1989: - Labels: pull-request-available (was: ) > Fix ApplyTransaction error handling in OzoneManagerState

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #350: WIP: HDDS-1989. Fix ApplyTransaction error handling in OzoneManagerStateMachine

2019-12-12 Thread GitBox
bharatviswa504 opened a new pull request #350: WIP: HDDS-1989. Fix ApplyTransaction error handling in OzoneManagerStateMachine URL: https://github.com/apache/hadoop-ozone/pull/350 ## What changes were proposed in this pull request? Right now, applyTransaction calls validateAndUpdateC

[GitHub] [hadoop-ozone] bharatviswa504 closed pull request #350: WIP: HDDS-1989. Fix ApplyTransaction error handling in OzoneManagerStateMachine

2019-12-12 Thread GitBox
bharatviswa504 closed pull request #350: WIP: HDDS-1989. Fix ApplyTransaction error handling in OzoneManagerStateMachine URL: https://github.com/apache/hadoop-ozone/pull/350 This is an automated message from the Apache Git S

[jira] [Updated] (HDDS-2188) Implement LocatedFileStatus & getFileBlockLocations to provide node/localization information to Yarn/Mapreduce

2019-12-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2188: Status: Patch Available (was: In Progress) > Implement LocatedFileStatus & getFileBlockLoca

[jira] [Assigned] (HDDS-2714) Add Ratis leader info for scm pipeline info command

2019-12-12 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-2714: - Assignee: Siddharth Wagle > Add Ratis leader info for scm pipeline info command > ---

[jira] [Assigned] (HDDS-2716) ReadStateMachine failure should close down the ratis pipeline

2019-12-12 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-2716: - Assignee: Siddharth Wagle > ReadStateMachine failure should close down the ratis pipeline

[jira] [Commented] (HDDS-2703) OzoneFSInputStream to support ByteBufferReadable

2019-12-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995169#comment-16995169 ] YiSheng Lien commented on HDDS-2703: Note: Cause the current dependency version of Had

[jira] [Comment Edited] (HDDS-2703) OzoneFSInputStream to support ByteBufferReadable

2019-12-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995169#comment-16995169 ] YiSheng Lien edited comment on HDDS-2703 at 12/12/19 10:41 PM: -

[GitHub] [hadoop-ozone] sodonnel commented on issue #309: HDDS-2593. DatanodeAdminMonitor should track under replicated containers and complete the admin workflow accordingly

2019-12-12 Thread GitBox
sodonnel commented on issue #309: HDDS-2593. DatanodeAdminMonitor should track under replicated containers and complete the admin workflow accordingly URL: https://github.com/apache/hadoop-ozone/pull/309#issuecomment-565213144 That test is still failing event after merging master to the bra

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable

2019-12-12 Thread GitBox
cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable URL: https://github.com/apache/hadoop-ozone/pull/345#discussion_r357394456 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OzoneFSInputStream.ja

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable

2019-12-12 Thread GitBox
cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable URL: https://github.com/apache/hadoop-ozone/pull/345#discussion_r357394244 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OzoneFSInputStream.ja

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable

2019-12-12 Thread GitBox
cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable URL: https://github.com/apache/hadoop-ozone/pull/345#discussion_r357393478 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OzoneFSInputStream.ja

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable

2019-12-12 Thread GitBox
cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable URL: https://github.com/apache/hadoop-ozone/pull/345#discussion_r357393104 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OzoneFSInputStream.ja

[GitHub] [hadoop-ozone] jojochuang commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable

2019-12-12 Thread GitBox
jojochuang commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable URL: https://github.com/apache/hadoop-ozone/pull/345#discussion_r357386990 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/OzoneFSInputStre

[jira] [Commented] (HDDS-2443) Python client/interface for Ozone

2019-12-12 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995138#comment-16995138 ] Wei-Chiu Chuang commented on HDDS-2443: --- Thanks for the doc. It looks so easy to sup

[jira] [Updated] (HDDS-2723) Wrap filesystem.open() with try-catch in TestOzoneFSInputStream

2019-12-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien updated HDDS-2723: --- Description: Thanks [~weichiu] for the proposal. To ensure resource is closed properly, we could wrap

[jira] [Updated] (HDDS-2723) Wrap filesystem.open() with try-catch in TestOzoneFSInputStream

2019-12-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien updated HDDS-2723: --- Summary: Wrap filesystem.open() with try-catch in TestOzoneFSInputStream (was: Wrap filesystem.open()

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable

2019-12-12 Thread GitBox
cxorm commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable URL: https://github.com/apache/hadoop-ozone/pull/345#discussion_r357364575 ## File path: hadoop-ozone/ozonefs/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFSInputStrea

[jira] [Updated] (HDDS-2723) Wrap filesystem.open() with try-catch to ensure resource is closed properly

2019-12-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien updated HDDS-2723: --- External issue ID: (was: HDDS-2703) > Wrap filesystem.open() with try-catch to ensure resource is cl

[jira] [Updated] (HDDS-2723) Wrap filesystem.open() with try-catch to ensure resource is closed properly

2019-12-12 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien updated HDDS-2723: --- Environment: (was: [PR of HDDS-2703|http://example.com]) > Wrap filesystem.open() with try-catch t

[jira] [Created] (HDDS-2723) Wrap filesystem.open() with try-catch to ensure resource is closed properly

2019-12-12 Thread YiSheng Lien (Jira)
YiSheng Lien created HDDS-2723: -- Summary: Wrap filesystem.open() with try-catch to ensure resource is closed properly Key: HDDS-2723 URL: https://issues.apache.org/jira/browse/HDDS-2723 Project: Hadoop D

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #329: HDDS-2423. Add the recover-trash command client side code

2019-12-12 Thread GitBox
cxorm commented on a change in pull request #329: HDDS-2423. Add the recover-trash command client side code URL: https://github.com/apache/hadoop-ozone/pull/329#discussion_r357352410 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/rpc/RpcClient.java

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #329: HDDS-2423. Add the recover-trash command client side code

2019-12-12 Thread GitBox
cxorm commented on a change in pull request #329: HDDS-2423. Add the recover-trash command client side code URL: https://github.com/apache/hadoop-ozone/pull/329#discussion_r357350576 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java

[GitHub] [hadoop-ozone] jojochuang commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable

2019-12-12 Thread GitBox
jojochuang commented on a change in pull request #345: HDDS-2703. OzoneFSInputStream to support ByteBufferReadable URL: https://github.com/apache/hadoop-ozone/pull/345#discussion_r357315867 ## File path: hadoop-ozone/ozonefs/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFSInput

[jira] [Created] (HDDS-2722) Let ChunkManager read/write ChunkBuffer instead of ByteBuffer

2019-12-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2722: -- Summary: Let ChunkManager read/write ChunkBuffer instead of ByteBuffer Key: HDDS-2722 URL: https://issues.apache.org/jira/browse/HDDS-2722 Project: Hadoop Distrib

[jira] [Created] (HDDS-2721) Allow wrapping list of ByteBuffers with ChunkBuffer

2019-12-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2721: -- Summary: Allow wrapping list of ByteBuffers with ChunkBuffer Key: HDDS-2721 URL: https://issues.apache.org/jira/browse/HDDS-2721 Project: Hadoop Distributed Data S

[jira] [Created] (HDDS-2720) Ozone Failure injection Service

2019-12-12 Thread Prashant Pogde (Jira)
Prashant Pogde created HDDS-2720: Summary: Ozone Failure injection Service Key: HDDS-2720 URL: https://issues.apache.org/jira/browse/HDDS-2720 Project: Hadoop Distributed Data Store Issue Typ

[jira] [Updated] (HDDS-2719) Rename S3Token to S3AuthInfo

2019-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2719: - Labels: pull-request-available (was: ) > Rename S3Token to S3AuthInfo > -

[GitHub] [hadoop-ozone] mohammadjkhan opened a new pull request #349: HDDS-2719. Rename S3Token to S3AuthInfo

2019-12-12 Thread GitBox
mohammadjkhan opened a new pull request #349: HDDS-2719. Rename S3Token to S3AuthInfo URL: https://github.com/apache/hadoop-ozone/pull/349 ## What changes were proposed in this pull request? Renamed references of S3TOKEN to S3AUTHINFO ## What is the link to the Apache JIRA http

[jira] [Updated] (HDDS-2601) Fix Broken Link In Website

2019-12-12 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDDS-2601: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Fix Broken Link In Website > --

[GitHub] [hadoop-ozone] cxorm commented on issue #296: HDDS-2659. KeyValueHandler#handleCreateContainer should log the exception on container creation failure

2019-12-12 Thread GitBox
cxorm commented on issue #296: HDDS-2659. KeyValueHandler#handleCreateContainer should log the exception on container creation failure URL: https://github.com/apache/hadoop-ozone/pull/296#issuecomment-565110871 Thanks @xiaoyuyao, @anuengineer and @bharatviswa504 for the reviews. And than

[jira] [Updated] (HDDS-2035) Implement datanode level CLI to reveal pipeline info

2019-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2035: - Labels: pull-request-available (was: ) > Implement datanode level CLI to reveal pipeline info > -

[GitHub] [hadoop-ozone] timmylicheng opened a new pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation.

2019-12-12 Thread GitBox
timmylicheng opened a new pull request #348: HDDS-2035 Implement datanode level CLI to reveal pipeline relation. URL: https://github.com/apache/hadoop-ozone/pull/348 ## What changes were proposed in this pull request? #HDDS-2035 Implement datanode level CLI to reveal pipeline info

[jira] [Updated] (HDDS-2675) Sonar : fix issues in PipelineStateManager

2019-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2675: - Labels: pull-request-available (was: ) > Sonar : fix issues in PipelineStateManager > ---

[GitHub] [hadoop-ozone] supratimdeka opened a new pull request #347: HDDS-2675. Sonar : fix issues in PipelineStateManager

2019-12-12 Thread GitBox
supratimdeka opened a new pull request #347: HDDS-2675. Sonar : fix issues in PipelineStateManager URL: https://github.com/apache/hadoop-ozone/pull/347 ## What changes were proposed in this pull request? Resolved all Sonar "code smell" category issues in PipelineStateManager.java, inclu

[GitHub] [hadoop-ozone] sodonnel edited a comment on issue #309: HDDS-2593. DatanodeAdminMonitor should track under replicated containers and complete the admin workflow accordingly

2019-12-12 Thread GitBox
sodonnel edited a comment on issue #309: HDDS-2593. DatanodeAdminMonitor should track under replicated containers and complete the admin workflow accordingly URL: https://github.com/apache/hadoop-ozone/pull/309#issuecomment-565064730 The unit test failure is still this one, unrelated to the

[GitHub] [hadoop-ozone] sodonnel edited a comment on issue #309: HDDS-2593. DatanodeAdminMonitor should track under replicated containers and complete the admin workflow accordingly

2019-12-12 Thread GitBox
sodonnel edited a comment on issue #309: HDDS-2593. DatanodeAdminMonitor should track under replicated containers and complete the admin workflow accordingly URL: https://github.com/apache/hadoop-ozone/pull/309#issuecomment-565064730 The unit test failure is still this one, unrelated to the

[GitHub] [hadoop-ozone] sodonnel commented on issue #309: HDDS-2593. DatanodeAdminMonitor should track under replicated containers and complete the admin workflow accordingly

2019-12-12 Thread GitBox
sodonnel commented on issue #309: HDDS-2593. DatanodeAdminMonitor should track under replicated containers and complete the admin workflow accordingly URL: https://github.com/apache/hadoop-ozone/pull/309#issuecomment-565064730 The unit test failure is still this one, unrelated to the change

[GitHub] [hadoop-ozone] elek commented on issue #337: HDDS-2706. Add class CRLCodec - used for certificate revocation list.

2019-12-12 Thread GitBox
elek commented on issue #337: HDDS-2706. Add class CRLCodec - used for certificate revocation list. URL: https://github.com/apache/hadoop-ozone/pull/337#issuecomment-565018418 Thank you very much the patch @abhishekaypurohit Is there any related design doc which can help to understand the

[jira] [Resolved] (HDDS-1792) Use ConcurrentHashSet in place of ConcurrentHashMap in ContainerStteMachine.

2019-12-12 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh resolved HDDS-1792. - Resolution: Invalid > Use ConcurrentHashSet in place of ConcurrentHashMap in ContainerStte

[jira] [Resolved] (HDDS-1679) TestBCSID failing because of dangling db references

2019-12-12 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh resolved HDDS-1679. - Resolution: Cannot Reproduce Haven't seen this in a while. resolving this. > TestBCSID fa

[jira] [Resolved] (HDDS-2663) Add OzoneFileSystem to MiniOzoneChaosCluster

2019-12-12 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh resolved HDDS-2663. - Resolution: Duplicate > Add OzoneFileSystem to MiniOzoneChaosCluster > ---

[jira] [Updated] (HDDS-2719) Rename S3Token to S3AuthInfo

2019-12-12 Thread Mohammad (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad updated HDDS-2719: --- Fix Version/s: (was: 0.4.2) 0.5.0 > Rename S3Token to S3AuthInfo >

[jira] [Updated] (HDDS-2719) Rename S3Token to S3AuthInfo

2019-12-12 Thread Mohammad (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad updated HDDS-2719: --- Component/s: S3 > Rename S3Token to S3AuthInfo > > > Key: HDDS-27

[jira] [Updated] (HDDS-2719) Rename S3Token to S3AuthInfo

2019-12-12 Thread Mohammad (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad updated HDDS-2719: --- Component/s: (was: SCM) > Rename S3Token to S3AuthInfo > > >

[jira] [Updated] (HDDS-2719) Rename S3Token to S3AuthInfo

2019-12-12 Thread Mohammad (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad updated HDDS-2719: --- Description: Rename S3Token to something like S3AuthInfo Item #24 in the list of ideas for new contributors t

[jira] [Updated] (HDDS-2719) Rename S3Token to S3AuthInfo

2019-12-12 Thread Mohammad (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad updated HDDS-2719: --- Labels: (was: pull-request-available pull-requests-available sonar) > Rename S3Token to S3AuthInfo > ---

[jira] [Created] (HDDS-2719) Rename S3Token to S3AuthInfo

2019-12-12 Thread Mohammad (Jira)
Mohammad created HDDS-2719: -- Summary: Rename S3Token to S3AuthInfo Key: HDDS-2719 URL: https://issues.apache.org/jira/browse/HDDS-2719 Project: Hadoop Distributed Data Store Issue Type: Improvement

[jira] [Updated] (HDDS-2588) Consolidate compose environments

2019-12-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2588: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Consolidate compose envir

[jira] [Updated] (HDDS-2588) Consolidate compose environments

2019-12-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2588: --- Issue Type: Improvement (was: Bug) > Consolidate compose environments > -

[jira] [Updated] (HDDS-2588) Consolidate compose environments

2019-12-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2588: --- Fix Version/s: 0.5.0 > Consolidate compose environments > > >

[GitHub] [hadoop-ozone] adoroszlai commented on issue #238: HDDS-2588. Consolidate compose environments

2019-12-12 Thread GitBox
adoroszlai commented on issue #238: HDDS-2588. Consolidate compose environments URL: https://github.com/apache/hadoop-ozone/pull/238#issuecomment-564959372 Thanks @anuengineer, @avijayanhwx, @bharatviswa504 for review, and @elek for review and commit. --

[GitHub] [hadoop-ozone] adoroszlai commented on issue #324: HDDS-2688. Refactor container response builders to hadoop-hdds/common

2019-12-12 Thread GitBox
adoroszlai commented on issue #324: HDDS-2688. Refactor container response builders to hadoop-hdds/common URL: https://github.com/apache/hadoop-ozone/pull/324#issuecomment-564958466 Thanks @bshashikant for reviewing and committing this. -

[jira] [Resolved] (HDDS-2659) KeyValueHandler#handleCreateContainer should log the exception on container creation failure

2019-12-12 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh resolved HDDS-2659. - Fix Version/s: 0.5.0 Resolution: Fixed Thanks for the contribution [~cxorm]. I have

[GitHub] [hadoop-ozone] elek closed pull request #238: HDDS-2588. Consolidate compose environments

2019-12-12 Thread GitBox
elek closed pull request #238: HDDS-2588. Consolidate compose environments URL: https://github.com/apache/hadoop-ozone/pull/238 This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [hadoop-ozone] mukul1987 merged pull request #296: HDDS-2659. KeyValueHandler#handleCreateContainer should log the exception on container creation failure

2019-12-12 Thread GitBox
mukul1987 merged pull request #296: HDDS-2659. KeyValueHandler#handleCreateContainer should log the exception on container creation failure URL: https://github.com/apache/hadoop-ozone/pull/296 This is an automated message f

[jira] [Updated] (HDDS-2688) Refactor container response builders to hdds-common

2019-12-12 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-2688: -- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Av

[GitHub] [hadoop-ozone] bshashikant merged pull request #324: HDDS-2688. Refactor container response builders to hadoop-hdds/common

2019-12-12 Thread GitBox
bshashikant merged pull request #324: HDDS-2688. Refactor container response builders to hadoop-hdds/common URL: https://github.com/apache/hadoop-ozone/pull/324 This is an automated message from the Apache Git Service. To re

[jira] [Created] (HDDS-2718) Send chunks in increments to datanode

2019-12-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2718: -- Summary: Send chunks in increments to datanode Key: HDDS-2718 URL: https://issues.apache.org/jira/browse/HDDS-2718 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-2717) Handle chunk increments in datanode

2019-12-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-2717: --- Issue Type: Improvement (was: Task) > Handle chunk increments in datanode > -

[jira] [Created] (HDDS-2717) Handle chunk increments in datanode

2019-12-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2717: -- Summary: Handle chunk increments in datanode Key: HDDS-2717 URL: https://issues.apache.org/jira/browse/HDDS-2717 Project: Hadoop Distributed Data Store I

[jira] [Created] (HDDS-2716) ReadStateMachine failure should close down the ratis pipeline

2019-12-12 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2716: - Summary: ReadStateMachine failure should close down the ratis pipeline Key: HDDS-2716 URL: https://issues.apache.org/jira/browse/HDDS-2716 Project: Hadoop

[GitHub] [hadoop-ozone] elek commented on issue #323: HDDS-2686. Use protobuf 3 instead of protobuf 2

2019-12-12 Thread GitBox
elek commented on issue #323: HDDS-2686. Use protobuf 3 instead of protobuf 2 URL: https://github.com/apache/hadoop-ozone/pull/323#issuecomment-564928421 > but there are acceptance test failures. Yes, the problem is in the mr test with hadoop-32. With hadoop 2.7 - 3.1 we have no prob

[jira] [Created] (HDDS-2715) Add config for client buffer increment size

2019-12-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2715: -- Summary: Add config for client buffer increment size Key: HDDS-2715 URL: https://issues.apache.org/jira/browse/HDDS-2715 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-2714) Add Ratis leader info for scm pipeline info command

2019-12-12 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2714: - Summary: Add Ratis leader info for scm pipeline info command Key: HDDS-2714 URL: https://issues.apache.org/jira/browse/HDDS-2714 Project: Hadoop Distributed

[jira] [Created] (HDDS-2713) Decouple client write size and datanode chunk size

2019-12-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-2713: -- Summary: Decouple client write size and datanode chunk size Key: HDDS-2713 URL: https://issues.apache.org/jira/browse/HDDS-2713 Project: Hadoop Distributed Data St