[jira] [Commented] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057622#comment-17057622 ] runzhiwang commented on HDDS-3168: -- I'm working on it. > Improve the efficiency of readi

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA.

2020-03-11 Thread GitBox
swagle commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA. URL: https://github.com/apache/hadoop-ozone/pull/666#discussion_r391393575 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/spi/impl/OzoneManag

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA.

2020-03-11 Thread GitBox
swagle commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA. URL: https://github.com/apache/hadoop-ozone/pull/666#discussion_r391393410 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/recon/TestReco

[jira] [Resolved] (HDDS-3104) Integration test crashes due to critical error in datanode

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-3104. - Resolution: Fixed Thank you for the fix [~swagle]. I have merged the PR. > Integration te

[GitHub] [hadoop-ozone] swagle commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA.

2020-03-11 Thread GitBox
swagle commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA. URL: https://github.com/apache/hadoop-ozone/pull/666#discussion_r391393245 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/recon/TestReco

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #660: HDDS-3104. Integration test crashes due to critical error in datanode.

2020-03-11 Thread GitBox
avijayanhwx merged pull request #660: HDDS-3104. Integration test crashes due to critical error in datanode. URL: https://github.com/apache/hadoop-ozone/pull/660 This is an automated message from the Apache Git Service. To r

[GitHub] [hadoop-ozone] avijayanhwx commented on issue #660: HDDS-3104. Integration test crashes due to critical error in datanode.

2020-03-11 Thread GitBox
avijayanhwx commented on issue #660: HDDS-3104. Integration test crashes due to critical error in datanode. URL: https://github.com/apache/hadoop-ozone/pull/660#issuecomment-597997651 Thanks for the patch @swagle and the review @adoroszlai. -

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA.

2020-03-11 Thread GitBox
avijayanhwx commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA. URL: https://github.com/apache/hadoop-ozone/pull/666#discussion_r391391882 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/spi/impl/Ozone

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA.

2020-03-11 Thread GitBox
avijayanhwx commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA. URL: https://github.com/apache/hadoop-ozone/pull/666#discussion_r391388475 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/recon/Tes

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA.

2020-03-11 Thread GitBox
avijayanhwx commented on a change in pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA. URL: https://github.com/apache/hadoop-ozone/pull/666#discussion_r391391590 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/recon/Tes

[jira] [Updated] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3168: - Description: Read a 100MB object which 25 chunks, the jaeger trace information as the image shows. Now ozo

[jira] [Updated] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3168: - Description: Read a 100MB object, the jaeger trace information as the image shows. Now ozone read each chu

[jira] [Updated] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3168: - Description: !screenshot-3.png! (was: !screenshot-2.png! ) > Improve the efficiency of reading object

[jira] [Updated] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3168: - Attachment: screenshot-3.png > Improve the efficiency of reading object >

[jira] [Updated] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3168: - Description: !screenshot-2.png! (was: !screenshot-1.png! ) > Improve the efficiency of reading object

[jira] [Updated] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3168: - Attachment: screenshot-2.png > Improve the efficiency of reading object >

[jira] [Updated] (HDDS-3167) Support different replication factor for CLOSED Container

2020-03-11 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3167: - Description: For open container, it's replication is decided by Ratis pipeline number number. For closed

[jira] [Updated] (HDDS-3167) Support different replication factor for CLOSED Container

2020-03-11 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3167: - Description: For open container, it's replication is decided by Ratis pipeline number number. For closed

[jira] [Updated] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3168: - Description: !screenshot-1.png! > Improve the efficiency of reading object > ---

[jira] [Updated] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3168: - Attachment: screenshot-1.png > Improve the efficiency of reading object >

[jira] [Created] (HDDS-3168) Improve the efficiency of reading object

2020-03-11 Thread runzhiwang (Jira)
runzhiwang created HDDS-3168: Summary: Improve the efficiency of reading object Key: HDDS-3168 URL: https://issues.apache.org/jira/browse/HDDS-3168 Project: Hadoop Distributed Data Store Issue Ty

[jira] [Created] (HDDS-3167) Support different replication factor for CLOSED Container

2020-03-11 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3167: Summary: Support different replication factor for CLOSED Container Key: HDDS-3167 URL: https://issues.apache.org/jira/browse/HDDS-3167 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] runzhiwang commented on issue #645: HDDS-3130. Add jaeger trace span in s3gateway

2020-03-11 Thread GitBox
runzhiwang commented on issue #645: HDDS-3130. Add jaeger trace span in s3gateway URL: https://github.com/apache/hadoop-ozone/pull/645#issuecomment-597972397 @elek Very reasonable suggestion. I will try it, thank you very much. --

[jira] [Updated] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-11 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3155: - Summary: Improved ozone client flush implementation to make it faster. (was: Improved ozone flush impleme

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #663: HDDS-3156 update allocateContainer to remove additional createPipeline step.

2020-03-11 Thread GitBox
bharatviswa504 commented on a change in pull request #663: HDDS-3156 update allocateContainer to remove additional createPipeline step. URL: https://github.com/apache/hadoop-ozone/pull/663#discussion_r391349687 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hd

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #663: HDDS-3156 update allocateContainer to remove additional createPipeline step.

2020-03-11 Thread GitBox
bharatviswa504 commented on a change in pull request #663: HDDS-3156 update allocateContainer to remove additional createPipeline step. URL: https://github.com/apache/hadoop-ozone/pull/663#discussion_r391349507 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hd

[jira] [Updated] (HDDS-3008) parse and dump ozonemanager ratis segment file to printable text

2020-03-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3008: - Labels: pull-request-available (was: ) > parse and dump ozonemanager ratis segment file to printa

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #667: HDDS-3008. parse and dump ozonemanager ratis segment file to printable text.

2020-03-11 Thread GitBox
bharatviswa504 opened a new pull request #667: HDDS-3008. parse and dump ozonemanager ratis segment file to printable text. URL: https://github.com/apache/hadoop-ozone/pull/667 ## What changes were proposed in this pull request? Add a CLI command to dump OM ratis logs. ## What

[jira] [Updated] (HDDS-3008) parse and dump ozonemanager ratis segment file to printable text

2020-03-11 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3008: - Status: Patch Available (was: Open) > parse and dump ozonemanager ratis segment file to p

[jira] [Updated] (HDDS-3008) parse and dump ozonemanager ratis segment file to printable text

2020-03-11 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3008: - Issue Type: New Feature (was: Bug) > parse and dump ozonemanager ratis segment file to pr

[jira] [Created] (HDDS-3166) Recon server start should not fail if HTTP server start fails

2020-03-11 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-3166: Summary: Recon server start should not fail if HTTP server start fails Key: HDDS-3166 URL: https://issues.apache.org/jira/browse/HDDS-3166 Pro

[jira] [Updated] (HDDS-2848) Recon changes to make snapshots work with OM HA

2020-03-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2848: - Labels: pull-request-available (was: ) > Recon changes to make snapshots work with OM HA > --

[GitHub] [hadoop-ozone] swagle commented on issue #666: HDDS-2848. Recon changes to make snapshots work with OM HA.

2020-03-11 Thread GitBox
swagle commented on issue #666: HDDS-2848. Recon changes to make snapshots work with OM HA. URL: https://github.com/apache/hadoop-ozone/pull/666#issuecomment-597936333 @avijayanhwx / @bharatviswa504 could you guys please review? -

[GitHub] [hadoop-ozone] swagle opened a new pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA.

2020-03-11 Thread GitBox
swagle opened a new pull request #666: HDDS-2848. Recon changes to make snapshots work with OM HA. URL: https://github.com/apache/hadoop-ozone/pull/666 ## What changes were proposed in this pull request? Implemented changes proposed in the Jira and added an integration test. ## Wh

[jira] [Updated] (HDDS-2848) Recon changes to make snapshots work with OM HA

2020-03-11 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-2848: -- Summary: Recon changes to make snapshots work with OM HA (was: Recon changed to make snapshots

[jira] [Updated] (HDDS-2848) Recon changed to make snapshots work with OM HA

2020-03-11 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-2848: -- Summary: Recon changed to make snapshots work with OM HA (was: Recon should work with OM HA) >

[jira] [Resolved] (HDDS-2899) Add Robot Tests for Recon - OM integration.

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-2899. - Resolution: Fixed Fixed as part of HDDS-3117. > Add Robot Tests for Recon - OM integratio

[jira] [Updated] (HDDS-2976) Recon throws error while trying to get snapshot in secure environment

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2976: Parent: HDDS-1996 Issue Type: Sub-task (was: Bug) > Recon throws error while trying

[jira] [Updated] (HDDS-2976) Recon throws error while trying to get snapshot in secure environment

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2976: Target Version/s: 0.6.0 (was: 0.5.0) > Recon throws error while trying to get snapshot in s

[jira] [Resolved] (HDDS-3159) Bump RocksDB version to the latest one

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-3159. - Resolution: Fixed Thank you for the patch [~elek]. I have merged the PR. > Bump RocksDB v

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #664: HDDS-3159. Bump RocksDB version to the latest one.

2020-03-11 Thread GitBox
avijayanhwx merged pull request #664: HDDS-3159. Bump RocksDB version to the latest one. URL: https://github.com/apache/hadoop-ozone/pull/664 This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [hadoop-ozone] avijayanhwx commented on issue #664: HDDS-3159. Bump RocksDB version to the latest one.

2020-03-11 Thread GitBox
avijayanhwx commented on issue #664: HDDS-3159. Bump RocksDB version to the latest one. URL: https://github.com/apache/hadoop-ozone/pull/664#issuecomment-597882260 Thank you @elek for the patch, @mukul1987 and @HorizonNet for the reviews. ---

[jira] [Resolved] (HDDS-3148) Logs cluttered by AlreadyExistsException from Ratis

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan resolved HDDS-3148. - Resolution: Fixed Thank you for fixing this [~swagle]. > Logs cluttered by AlreadyExists

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #661: HDDS-3148. Logs cluttered by AlreadyExistsException from Ratis.

2020-03-11 Thread GitBox
avijayanhwx merged pull request #661: HDDS-3148. Logs cluttered by AlreadyExistsException from Ratis. URL: https://github.com/apache/hadoop-ozone/pull/661 This is an automated message from the Apache Git Service. To respond

[jira] [Assigned] (HDDS-2848) Recon should work with OM HA

2020-03-11 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-2848: - Assignee: Siddharth Wagle > Recon should work with OM HA > >

[GitHub] [hadoop-ozone] adoroszlai commented on issue #648: HDDS-3117. Recon throws InterruptedException while getting new snapshot from OM.

2020-03-11 Thread GitBox
adoroszlai commented on issue #648: HDDS-3117. Recon throws InterruptedException while getting new snapshot from OM. URL: https://github.com/apache/hadoop-ozone/pull/648#issuecomment-597847230 Thanks @avijayanhwx for the fix, @swagle and @vivekratnavel for the reviews.

[GitHub] [hadoop-ozone] adoroszlai merged pull request #648: HDDS-3117. Recon throws InterruptedException while getting new snapshot from OM.

2020-03-11 Thread GitBox
adoroszlai merged pull request #648: HDDS-3117. Recon throws InterruptedException while getting new snapshot from OM. URL: https://github.com/apache/hadoop-ozone/pull/648 This is an automated message from the Apache Git Serv

[jira] [Updated] (HDDS-3117) Recon throws InterruptedException while getting new snapshot from OM

2020-03-11 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3117: --- Labels: (was: pull-request-available) > Recon throws InterruptedException while getting new

[jira] [Updated] (HDDS-3117) Recon throws InterruptedException while getting new snapshot from OM

2020-03-11 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3117: --- Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Availabl

[jira] [Created] (HDDS-3165) Integrate Recon missing containers UI with endpoint.

2020-03-11 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-3165: --- Summary: Integrate Recon missing containers UI with endpoint. Key: HDDS-3165 URL: https://issues.apache.org/jira/browse/HDDS-3165 Project: Hadoop Distributed Dat

[jira] [Updated] (HDDS-3164) Add Recon endpoint to serve missing containers along with keys that were present in them.

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3164: Summary: Add Recon endpoint to serve missing containers along with keys that were present in

[jira] [Created] (HDDS-3164) Add Recon endpoint to serve missing containers along with keys that are present in them.

2020-03-11 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-3164: --- Summary: Add Recon endpoint to serve missing containers along with keys that are present in them. Key: HDDS-3164 URL: https://issues.apache.org/jira/browse/HDDS-3164

[jira] [Updated] (HDDS-2848) Recon should work with OM HA

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2848: Description: Recon talks to OM in 2 ways - Through HTTP to get DB snapshot, and through RPC

[jira] [Updated] (HDDS-2848) Recon should work with OM HA

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2848: Summary: Recon should work with OM HA (was: Verify Recon works as expected with OM HA) > R

[jira] [Updated] (HDDS-2899) Add Robot Tests for Recon - OM integration.

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-2899: Description: * Write a key to Ozone Manager and makes sure Recon picks the container/key up

[jira] [Assigned] (HDDS-2899) Add Robot Tests for Recon - OM integration.

2020-03-11 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-2899: --- Assignee: Aravindan Vijayan > Add Robot Tests for Recon - OM integration. > -

[jira] [Commented] (HDDS-3133) Add export objectIds in Ozone as FileIds to allow LLAP to cache the files

2020-03-11 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057341#comment-17057341 ] Bharat Viswanadham commented on HDDS-3133: -- Just want to add here objectID's are

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM.

2020-03-11 Thread GitBox
adoroszlai commented on a change in pull request #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM. URL: https://github.com/apache/hadoop-ozone/pull/656#discussion_r391137896 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/freon/FakeSc

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM.

2020-03-11 Thread GitBox
adoroszlai commented on a change in pull request #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM. URL: https://github.com/apache/hadoop-ozone/pull/656#discussion_r391146930 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/freon/FakeCl

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM.

2020-03-11 Thread GitBox
adoroszlai commented on a change in pull request #656: HDDS-3142. Create isolated enviornment for OM to test it without SCM. URL: https://github.com/apache/hadoop-ozone/pull/656#discussion_r391139332 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/freon/FakeSc

[jira] [Assigned] (HDDS-3086) Failure running integration test it-freon

2020-03-11 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-3086: - Assignee: Shashikant Banerjee > Failure running integration test it-freon >

[jira] [Commented] (HDDS-3086) Failure running integration test it-freon

2020-03-11 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057225#comment-17057225 ] Attila Doroszlai commented on HDDS-3086: Attached test output with log level for a

[jira] [Updated] (HDDS-3086) Failure running integration test it-freon

2020-03-11 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3086: --- Attachment: debug_output.zip > Failure running integration test it-freon > --

[jira] [Assigned] (HDDS-3086) Failure running integration test it-freon

2020-03-11 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-3086: -- Assignee: (was: Attila Doroszlai) > Failure running integration test it-freon > --

[jira] [Comment Edited] (HDDS-3155) Improved ozone flush implementation to make it faster.

2020-03-11 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057213#comment-17057213 ] Shashikant Banerjee edited comment on HDDS-3155 at 3/11/20, 5:03 PM: ---

[jira] [Comment Edited] (HDDS-3155) Improved ozone flush implementation to make it faster.

2020-03-11 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057213#comment-17057213 ] Shashikant Banerjee edited comment on HDDS-3155 at 3/11/20, 5:01 PM: ---

[jira] [Commented] (HDDS-3155) Improved ozone flush implementation to make it faster.

2020-03-11 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057213#comment-17057213 ] Shashikant Banerjee commented on HDDS-3155: --- {code:java} Currently, each flush o

[GitHub] [hadoop-ozone] cxorm commented on issue #261: HDDS-2610. Fix the ObjectStore#listVolumes failure when argument is null

2020-03-11 Thread GitBox
cxorm commented on issue #261: HDDS-2610. Fix the ObjectStore#listVolumes failure when argument is null URL: https://github.com/apache/hadoop-ozone/pull/261#issuecomment-597746582 Thanks all for the help. This is an automated

[GitHub] [hadoop-ozone] cxorm commented on issue #432: HDDS-2832. Fix listing buckets for setting --start with last bucket

2020-03-11 Thread GitBox
cxorm commented on issue #432: HDDS-2832. Fix listing buckets for setting --start with last bucket URL: https://github.com/apache/hadoop-ozone/pull/432#issuecomment-597745563 Thank you @elek for the review and commit. This is

[jira] [Assigned] (HDDS-3163) write Key is hung when write delay is injected in datanode dir

2020-03-11 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-3163: --- Assignee: Lokesh Jain > write Key is hung when write delay is injected in datanode di

[jira] [Created] (HDDS-3163) write Key is hung when write delay is injected in datanode dir

2020-03-11 Thread Nilotpal Nandi (Jira)
Nilotpal Nandi created HDDS-3163: Summary: write Key is hung when write delay is injected in datanode dir Key: HDDS-3163 URL: https://issues.apache.org/jira/browse/HDDS-3163 Project: Hadoop Distribute

[GitHub] [hadoop-ozone] timmylicheng commented on issue #663: HDDS-3156 update allocateContainer to remove additional createPipeline step.

2020-03-11 Thread GitBox
timmylicheng commented on issue #663: HDDS-3156 update allocateContainer to remove additional createPipeline step. URL: https://github.com/apache/hadoop-ozone/pull/663#issuecomment-597735438 This is going to let Ratis Three pipeline creation be handled only in BackgroundPipelineCreator. Fo

[GitHub] [hadoop-ozone] swagle commented on issue #660: HDDS-3104. Integration test crashes due to critical error in datanode.

2020-03-11 Thread GitBox
swagle commented on issue #660: HDDS-3104. Integration test crashes due to critical error in datanode. URL: https://github.com/apache/hadoop-ozone/pull/660#issuecomment-597725117 > Thanks @swagle for working on this. I managed to reproduce the problem you describe by adding some sleep here

[jira] [Created] (HDDS-3162) Support more than one container with DatanodeChunkGenerator

2020-03-11 Thread Marton Elek (Jira)
Marton Elek created HDDS-3162: - Summary: Support more than one container with DatanodeChunkGenerator Key: HDDS-3162 URL: https://issues.apache.org/jira/browse/HDDS-3162 Project: Hadoop Distributed Data St

[GitHub] [hadoop-ozone] elek edited a comment on issue #645: HDDS-3130. Add jaeger trace span in s3gateway

2020-03-11 Thread GitBox
elek edited a comment on issue #645: HDDS-3130. Add jaeger trace span in s3gateway URL: https://github.com/apache/hadoop-ozone/pull/645#issuecomment-597710811 Thank you very much the idea and the patch @runzhiwang I 100% support to introduce tracing for s3g. It's a very good idea. A

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on issue #654: HDDS-3150. Implement getIfExist in Table and use it in CreateKey/File

2020-03-11 Thread GitBox
bharatviswa504 edited a comment on issue #654: HDDS-3150. Implement getIfExist in Table and use it in CreateKey/File URL: https://github.com/apache/hadoop-ozone/pull/654#issuecomment-597708204 > > How was this patch tested? > > $ support-tools-0.1.0-SNAPSHOT/bin/ozone-tools benchmark om

[GitHub] [hadoop-ozone] elek commented on issue #645: HDDS-3130. Add jaeger trace span in s3gateway

2020-03-11 Thread GitBox
elek commented on issue #645: HDDS-3130. Add jaeger trace span in s3gateway URL: https://github.com/apache/hadoop-ozone/pull/645#issuecomment-597710811 Thank you very much the idea and the patch @runzhiwang I 100% support to introduce tracing for s3g. It's a very good idea. About the

[GitHub] [hadoop-ozone] bharatviswa504 commented on issue #654: HDDS-3150. Implement getIfExist in Table and use it in CreateKey/File

2020-03-11 Thread GitBox
bharatviswa504 commented on issue #654: HDDS-3150. Implement getIfExist in Table and use it in CreateKey/File URL: https://github.com/apache/hadoop-ozone/pull/654#issuecomment-597708204 > > How was this patch tested? > > $ support-tools-0.1.0-SNAPSHOT/bin/ozone-tools benchmark om write -

[GitHub] [hadoop-ozone] adoroszlai commented on issue #551: HDDS-2717. Handle chunk increments in datanode

2020-03-11 Thread GitBox
adoroszlai commented on issue #551: HDDS-2717. Handle chunk increments in datanode URL: https://github.com/apache/hadoop-ozone/pull/551#issuecomment-597698720 Thanks @bshashikant, @lokeshj1703, @elek and @arp7 for the reviews. ---

[jira] [Updated] (HDDS-3160) Disable index and filter block cache for RocksDB

2020-03-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3160: - Labels: pull-request-available (was: ) > Disable index and filter block cache for RocksDB > -

[GitHub] [hadoop-ozone] adoroszlai commented on issue #659: HDDS-2989. Intermittent timeout in TestBlockManager

2020-03-11 Thread GitBox
adoroszlai commented on issue #659: HDDS-2989. Intermittent timeout in TestBlockManager URL: https://github.com/apache/hadoop-ozone/pull/659#issuecomment-597697480 Thanks @elek for reviewing and committing it. This is an auto

[GitHub] [hadoop-ozone] elek opened a new pull request #665: HDDS-3160. Disable index and filter block cache for RocksDB.

2020-03-11 Thread GitBox
elek opened a new pull request #665: HDDS-3160. Disable index and filter block cache for RocksDB. URL: https://github.com/apache/hadoop-ozone/pull/665 ## What changes were proposed in this pull request? During preformance tests It was noticed that the OM performance is droppe

[GitHub] [hadoop-ozone] elek opened a new pull request #664: HDDS-3159. Bump RocksDB version to the latest one.

2020-03-11 Thread GitBox
elek opened a new pull request #664: HDDS-3159. Bump RocksDB version to the latest one. URL: https://github.com/apache/hadoop-ozone/pull/664 ## What changes were proposed in this pull request? 6.0.1 – our current version from RocksDB – released one year ago. Since than many new vers

[jira] [Updated] (HDDS-3159) Bump RocksDB version to the latest one

2020-03-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3159: - Labels: pull-request-available (was: ) > Bump RocksDB version to the latest one > ---

[jira] [Commented] (HDDS-3147) User factor passed in get(uri,conf,user) API doesn't take effect

2020-03-11 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057099#comment-17057099 ] Lokesh Jain commented on HDDS-3147: --- [~micahzhao] You are right. This is a bug. In Basic

[jira] [Resolved] (HDDS-2989) Intermittent timeout in TestBlockManager

2020-03-11 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2989. --- Fix Version/s: 0.6.0 Resolution: Fixed > Intermittent timeout in TestBlockManager > ---

[GitHub] [hadoop-ozone] elek closed pull request #659: HDDS-2989. Intermittent timeout in TestBlockManager

2020-03-11 Thread GitBox
elek closed pull request #659: HDDS-2989. Intermittent timeout in TestBlockManager URL: https://github.com/apache/hadoop-ozone/pull/659 This is an automated message from the Apache Git Service. To respond to the message, ple

[jira] [Updated] (HDDS-2717) Handle chunk increments in datanode

2020-03-11 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2717: -- Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Hand

[GitHub] [hadoop-ozone] elek closed pull request #551: HDDS-2717. Handle chunk increments in datanode

2020-03-11 Thread GitBox
elek closed pull request #551: HDDS-2717. Handle chunk increments in datanode URL: https://github.com/apache/hadoop-ozone/pull/551 This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [hadoop-ozone] elek commented on issue #551: HDDS-2717. Handle chunk increments in datanode

2020-03-11 Thread GitBox
elek commented on issue #551: HDDS-2717. Handle chunk increments in datanode URL: https://github.com/apache/hadoop-ozone/pull/551#issuecomment-597676604 > Thanks the review @bshashikant and the patch @adoroszlai And thanks the review @lokeshj17 and @arp7. I am pushing it now.

[GitHub] [hadoop-ozone] adoroszlai commented on issue #652: HDDS-3141. Unit check fails to execute insight and mini-chaos-tests modules

2020-03-11 Thread GitBox
adoroszlai commented on issue #652: HDDS-3141. Unit check fails to execute insight and mini-chaos-tests modules URL: https://github.com/apache/hadoop-ozone/pull/652#issuecomment-597664172 Thanks @elek for reviewing and committing it.

[jira] [Commented] (HDDS-3155) Improved ozone flush implementation to make it faster.

2020-03-11 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057043#comment-17057043 ] Mukul Kumar Singh commented on HDDS-3155: - thanks for looking into this problem [~

[jira] [Updated] (HDDS-3141) Unit check fails to execute insight and mini-chaos-tests modules

2020-03-11 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-3141: -- Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Unit

[GitHub] [hadoop-ozone] elek closed pull request #652: HDDS-3141. Unit check fails to execute insight and mini-chaos-tests modules

2020-03-11 Thread GitBox
elek closed pull request #652: HDDS-3141. Unit check fails to execute insight and mini-chaos-tests modules URL: https://github.com/apache/hadoop-ozone/pull/652 This is an automated message from the Apache Git Service. To res

[jira] [Resolved] (HDDS-2832) Fix listing buckets for setting --start with last bucket

2020-03-11 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2832. --- Fix Version/s: 0.6.0 Resolution: Fixed > Fix listing buckets for setting --start with last buck

[GitHub] [hadoop-ozone] elek closed pull request #432: HDDS-2832. Fix listing buckets for setting --start with last bucket

2020-03-11 Thread GitBox
elek closed pull request #432: HDDS-2832. Fix listing buckets for setting --start with last bucket URL: https://github.com/apache/hadoop-ozone/pull/432 This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop-ozone] elek commented on issue #432: HDDS-2832. Fix listing buckets for setting --start with last bucket

2020-03-11 Thread GitBox
elek commented on issue #432: HDDS-2832. Fix listing buckets for setting --start with last bucket URL: https://github.com/apache/hadoop-ozone/pull/432#issuecomment-597657964 Finally, full green build: Thanks the contribution, I am merging it to the master.

[GitHub] [hadoop-ozone] elek commented on issue #654: HDDS-3150. Implement getIfExist in Table and use it in CreateKey/File

2020-03-11 Thread GitBox
elek commented on issue #654: HDDS-3150. Implement getIfExist in Table and use it in CreateKey/File URL: https://github.com/apache/hadoop-ozone/pull/654#issuecomment-597632158 > How was this patch tested? > $ support-tools-0.1.0-SNAPSHOT/bin/ozone-tools benchmark om write -d=35m -w=50

[GitHub] [hadoop-ozone] cku328 commented on issue #662: HDDS-3157. Fixed docker startup command.

2020-03-11 Thread GitBox
cku328 commented on issue #662: HDDS-3157. Fixed docker startup command. URL: https://github.com/apache/hadoop-ozone/pull/662#issuecomment-597617736 Thanks @adoroszlai for the review. This is an automated message from the Apac

[jira] [Created] (HDDS-3161) we need to block illegal characters when creating keys

2020-03-11 Thread mingchao zhao (Jira)
mingchao zhao created HDDS-3161: --- Summary: we need to block illegal characters when creating keys Key: HDDS-3161 URL: https://issues.apache.org/jira/browse/HDDS-3161 Project: Hadoop Distributed Data Stor

  1   2   >