[GitHub] [hadoop-ozone] ChenSammi commented on issue #618: HDDS-2911. Fix lastUsed and stateEnterTime value in container info is not human friendly

2020-03-17 Thread GitBox
ChenSammi commented on issue #618: HDDS-2911. Fix lastUsed and stateEnterTime value in container info is not human friendly URL: https://github.com/apache/hadoop-ozone/pull/618#issuecomment-600454660 @captainzmc suggest add the time zone information. You can take a look at how key info i

[jira] [Issue Comment Deleted] (HDDS-3220) Filesystem client should not retry on AccessControlException

2020-03-17 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-3220: -- Comment: was deleted (was: [~arp] Is this with branch code or trunk?) > Filesystem client shoul

[jira] [Commented] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061396#comment-17061396 ] Shashikant Banerjee commented on HDDS-3155: --- Thanks [~micahzhao]. In ozone, the

[jira] [Comment Edited] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061396#comment-17061396 ] Shashikant Banerjee edited comment on HDDS-3155 at 3/18/20, 5:02 AM: ---

[jira] [Commented] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061383#comment-17061383 ] mingchao zhao commented on HDDS-3155: - Hi [~shashikant] Thanks for your feedback.

[jira] [Commented] (HDDS-3220) Filesystem client should not retry on AccessControlException

2020-03-17 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061379#comment-17061379 ] Siddharth Wagle commented on HDDS-3220: --- [~arp] Is this with branch code or trunk?

[GitHub] [hadoop-ozone] timmylicheng commented on issue #663: HDDS-3156 update allocateContainer to remove additional createPipeline step.

2020-03-17 Thread GitBox
timmylicheng commented on issue #663: HDDS-3156 update allocateContainer to remove additional createPipeline step. URL: https://github.com/apache/hadoop-ozone/pull/663#issuecomment-600406625 > Thanks @timmylicheng for working on this. > > We don't need any complex conditions here. Th

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-17 Thread GitBox
timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r394085862 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pi

[jira] [Commented] (HDDS-3224) Enforce volume and bucket name rule at create time

2020-03-17 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061358#comment-17061358 ] Siddharth Wagle commented on HDDS-3224: --- [~Sammi] How was volume created? > Enforc

[jira] [Assigned] (HDDS-3220) Filesystem client should not retry on AccessControlException

2020-03-17 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-3220: - Assignee: Siddharth Wagle > Filesystem client should not retry on AccessControlException

[jira] [Assigned] (HDDS-3224) Enforce volume and bucket name rule at create time

2020-03-17 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-3224: - Assignee: Siddharth Wagle > Enforce volume and bucket name rule at create time >

[jira] [Updated] (HDDS-3217) Datanode startup is slow due to iterating container DB 2-3 times

2020-03-17 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-3217: -- Priority: Critical (was: Major) > Datanode startup is slow due to iterating container DB 2-3 ti

[GitHub] [hadoop-ozone] runzhiwang closed pull request #645: HDDS-3130. Add jaeger trace span in s3gateway

2020-03-17 Thread GitBox
runzhiwang closed pull request #645: HDDS-3130. Add jaeger trace span in s3gateway URL: https://github.com/apache/hadoop-ozone/pull/645 This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #645: HDDS-3130. Add jaeger trace span in s3gateway

2020-03-17 Thread GitBox
runzhiwang opened a new pull request #645: HDDS-3130. Add jaeger trace span in s3gateway URL: https://github.com/apache/hadoop-ozone/pull/645 ## What changes were proposed in this pull request? Add jaeger trace span in s3gateway. ## What is the link to the Apache JIRA h

[jira] [Updated] (HDDS-3168) Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3168: - Summary: Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one (was: Mer

[GitHub] [hadoop-ozone] runzhiwang commented on issue #692: HDDS-3168. Merge a lot of RPC call getContainerWithPipeline into one

2020-03-17 Thread GitBox
runzhiwang commented on issue #692: HDDS-3168. Merge a lot of RPC call getContainerWithPipeline into one URL: https://github.com/apache/hadoop-ozone/pull/692#issuecomment-600377571 @ChenSammi @xiaoyuyao Could you help review it ? Thank you very much. ---

[jira] [Updated] (HDDS-3168) Merge a lot of RPC call getContainerWithPipeline into one

2020-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3168: - Labels: pull-request-available (was: ) > Merge a lot of RPC call getContainerWithPipeline into on

[GitHub] [hadoop-ozone] runzhiwang opened a new pull request #692: HDDS-3168. Merge a lot of RPC call getContainerWithPipeline into one

2020-03-17 Thread GitBox
runzhiwang opened a new pull request #692: HDDS-3168. Merge a lot of RPC call getContainerWithPipeline into one URL: https://github.com/apache/hadoop-ozone/pull/692 ## What changes were proposed in this pull request? What's the problem ? 1. If download 187MB file, there will b

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests.

2020-03-17 Thread GitBox
hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests. URL: https://github.com/apache/hadoop-ozone/pull/265#issuecomment-600364074 Thanks @adoroszlai and @elek. I have incorporated your suggestions. The tests are passing locally. I will let CI run once again to

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests.

2020-03-17 Thread GitBox
hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests. URL: https://github.com/apache/hadoop-ozone/pull/265#issuecomment-600363670 /pending This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests.

2020-03-17 Thread GitBox
hanishakoneru commented on issue #265: HDDS-2621. Enable OM HA acceptance tests. URL: https://github.com/apache/hadoop-ozone/pull/265#issuecomment-600363363 /ready This is an automated message from the Apache Git Service. To r

[jira] [Updated] (HDDS-3226) Tracing Ozone Manager DB write batch operations

2020-03-17 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-3226: - Status: Patch Available (was: Open) > Tracing Ozone Manager DB write batch operations >

[jira] [Updated] (HDDS-3226) Tracing Ozone Manager DB write batch operations

2020-03-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3226: - Labels: pull-request-available (was: ) > Tracing Ozone Manager DB write batch operations > -

[GitHub] [hadoop-ozone] xiaoyuyao opened a new pull request #691: HDDS-3226. Tracing Ozone Manager DB write batch operations.

2020-03-17 Thread GitBox
xiaoyuyao opened a new pull request #691: HDDS-3226. Tracing Ozone Manager DB write batch operations. URL: https://github.com/apache/hadoop-ozone/pull/691 ## What changes were proposed in this pull request? Currently the OM DB write is asynchronously handled in OzoneManagerDoubleBuf

[jira] [Created] (HDDS-3226) Tracing Ozone Manager DB write batch operations

2020-03-17 Thread Xiaoyu Yao (Jira)
Xiaoyu Yao created HDDS-3226: Summary: Tracing Ozone Manager DB write batch operations Key: HDDS-3226 URL: https://issues.apache.org/jira/browse/HDDS-3226 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] nandakumar131 commented on issue #663: HDDS-3156 update allocateContainer to remove additional createPipeline step.

2020-03-17 Thread GitBox
nandakumar131 commented on issue #663: HDDS-3156 update allocateContainer to remove additional createPipeline step. URL: https://github.com/apache/hadoop-ozone/pull/663#issuecomment-600269488 Thanks @timmylicheng for working on this. We don't need any complex conditions here. The

[jira] [Assigned] (HDDS-1990) Make expiry of Delegation tokens to OM HA model.

2020-03-17 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDDS-1990: Assignee: Hanisha Koneru > Make expiry of Delegation tokens to OM HA model. > -

[GitHub] [hadoop-ozone] adoroszlai commented on issue #685: HDDS-3184. Fix MiniOzoneChaosTest to set the correct defaults.

2020-03-17 Thread GitBox
adoroszlai commented on issue #685: HDDS-3184. Fix MiniOzoneChaosTest to set the correct defaults. URL: https://github.com/apache/hadoop-ozone/pull/685#issuecomment-600202201 > /retest Unfortunately `/retest` doesn't really work, empty commit is created but CI not triggered. We hav

[GitHub] [hadoop-ozone] mukul1987 commented on issue #685: HDDS-3184. Fix MiniOzoneChaosTest to set the correct defaults.

2020-03-17 Thread GitBox
mukul1987 commented on issue #685: HDDS-3184. Fix MiniOzoneChaosTest to set the correct defaults. URL: https://github.com/apache/hadoop-ozone/pull/685#issuecomment-600195089 /retest This is an automated message from the Apach

[jira] [Assigned] (HDDS-3214) Unhealthy datanodes repeatedly participate in pipeline creation

2020-03-17 Thread Prashant Pogde (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Pogde reassigned HDDS-3214: Assignee: Prashant Pogde > Unhealthy datanodes repeatedly participate in pipeline creation

[jira] [Commented] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061019#comment-17061019 ] Shashikant Banerjee commented on HDDS-3155: --- Thanks [~micahzhao].  >>   1. If y

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. Both write and

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. Both write and

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. Both write and

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. Both write and

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Attachment: screenshot-5.png > Read a big object cost 2 times more than write it by s3g >

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Attachment: (was: screenshot-4.png) > Read a big object cost 2 times more than write it by s3g > -

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. Both write and

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Attachment: screenshot-4.png > Read a big object cost 2 times more than write it by s3g >

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #623: HDDS-2941. file create : create key table entries for intermediate directories in the path

2020-03-17 Thread GitBox
mukul1987 commented on a change in pull request #623: HDDS-2941. file create : create key table entries for intermediate directories in the path URL: https://github.com/apache/hadoop-ozone/pull/623#discussion_r392690515 ## File path: hadoop-ozone/integration-test/src/test/java/org/

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #623: HDDS-2941. file create : create key table entries for intermediate directories in the path

2020-03-17 Thread GitBox
mukul1987 commented on a change in pull request #623: HDDS-2941. file create : create key table entries for intermediate directories in the path URL: https://github.com/apache/hadoop-ozone/pull/623#discussion_r392690500 ## File path: hadoop-ozone/integration-test/src/test/java/org/

[GitHub] [hadoop-ozone] mukul1987 commented on a change in pull request #623: HDDS-2941. file create : create key table entries for intermediate directories in the path

2020-03-17 Thread GitBox
mukul1987 commented on a change in pull request #623: HDDS-2941. file create : create key table entries for intermediate directories in the path URL: https://github.com/apache/hadoop-ozone/pull/623#discussion_r393663559 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apa

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Attachment: (was: screenshot-2.png) > Read a big object cost 2 times more than write it by s3g > -

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. Both write and

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Attachment: (was: screenshot-1.png) > Read a big object cost 2 times more than write it by s3g > -

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. Both write and

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. I use {code:ja

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. I use {code:ja

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-17 Thread GitBox
sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r393661301 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeli

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. I use tcpdump

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. I use tcpdump

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. I use tcpdump

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Attachment: screenshot-3.png > Read a big object cost 2 times more than write it by s3g >

[jira] [Comment Edited] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058462#comment-17058462 ] mingchao zhao edited comment on HDDS-3155 at 3/17/20, 12:52 PM:

[jira] [Comment Edited] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058462#comment-17058462 ] mingchao zhao edited comment on HDDS-3155 at 3/17/20, 12:41 PM:

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. I use tcpdump

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-17 Thread GitBox
timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r393622294 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pi

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. I use tcpdump

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-17 Thread GitBox
timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r393621978 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pi

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-17 Thread GitBox
timmylicheng commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r393621927 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pi

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. I use tcpdump

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. I use tcpdump

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Description: By s3gateway, write a 187MB file cost 5 seconds, but read it cost 17 seconds. !screenshot-1

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Attachment: screenshot-1.png > Read a big object cost 2 times more than write it by s3g >

[jira] [Updated] (HDDS-3223) Read a big object cost 2 times more than write it by s3g

2020-03-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Attachment: screenshot-2.png > Read a big object cost 2 times more than write it by s3g >

[jira] [Assigned] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao reassigned HDDS-3155: --- Assignee: (was: mingchao zhao) > Improved ozone client flush implementation to make it fa

[jira] [Comment Edited] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058462#comment-17058462 ] mingchao zhao edited comment on HDDS-3155 at 3/17/20, 11:41 AM:

[jira] [Commented] (HDDS-3167) Support different replication factor for CLOSED Container

2020-03-17 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060843#comment-17060843 ] Sammi Chen commented on HDDS-3167: -- Sure, it's a good idea. It seems https://hackmd.io/

[jira] [Commented] (HDDS-3214) Unhealthy datanodes repeatedly participate in pipeline creation

2020-03-17 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060823#comment-17060823 ] Lokesh Jain commented on HDDS-3214: --- There are three pipelines. One node in each pipelin

[jira] [Comment Edited] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058462#comment-17058462 ] mingchao zhao edited comment on HDDS-3155 at 3/17/20, 10:21 AM:

[jira] [Created] (HDDS-3225) Trigger a container report on failed volume

2020-03-17 Thread Lokesh Jain (Jira)
Lokesh Jain created HDDS-3225: - Summary: Trigger a container report on failed volume Key: HDDS-3225 URL: https://issues.apache.org/jira/browse/HDDS-3225 Project: Hadoop Distributed Data Store Iss

[jira] [Updated] (HDDS-3177) Periodic dependency update (Java)

2020-03-17 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3177: --- Labels: (was: pull-request-available) > Periodic dependency update (Java) >

[jira] [Commented] (HDDS-3167) Support different replication factor for CLOSED Container

2020-03-17 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060778#comment-17060778 ] Marton Elek commented on HDDS-3167: --- > Marton Elek do you want to think it strictly and

[GitHub] [hadoop-ozone] elek commented on a change in pull request #680: HDDS-3177. Periodic dependency update (Java)

2020-03-17 Thread GitBox
elek commented on a change in pull request #680: HDDS-3177. Periodic dependency update (Java) URL: https://github.com/apache/hadoop-ozone/pull/680#discussion_r393554746 ## File path: hadoop-hdds/tools/pom.xml ## @@ -54,6 +54,12 @@ https://maven.apache.org/xsd/maven-4.0.0.x

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback

2020-03-17 Thread GitBox
sodonnel commented on a change in pull request #678: HDDS-3179 Pipeline placement based on Topology does not have fallback URL: https://github.com/apache/hadoop-ozone/pull/678#discussion_r393536554 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeli

[jira] [Comment Edited] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058462#comment-17058462 ] mingchao zhao edited comment on HDDS-3155 at 3/17/20, 8:46 AM: -

[jira] [Comment Edited] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058462#comment-17058462 ] mingchao zhao edited comment on HDDS-3155 at 3/17/20, 8:46 AM: -

[jira] [Comment Edited] (HDDS-3155) Improved ozone client flush implementation to make it faster.

2020-03-17 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058462#comment-17058462 ] mingchao zhao edited comment on HDDS-3155 at 3/17/20, 8:43 AM: -

[jira] [Created] (HDDS-3224) Enforce volume and bucket name rule at create time

2020-03-17 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3224: Summary: Enforce volume and bucket name rule at create time Key: HDDS-3224 URL: https://issues.apache.org/jira/browse/HDDS-3224 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] sodonnel commented on a change in pull request #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface

2020-03-17 Thread GitBox
sodonnel commented on a change in pull request #690: HDDS-3221. Refactor SafeModeHandler to use a Notification Interface URL: https://github.com/apache/hadoop-ozone/pull/690#discussion_r393485617 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/safemode