[jira] [Updated] (HDDS-3861) Fix handlePipelineFailure throw exception if role is follower

2020-06-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3861: - Description: !screenshot-1.png! > Fix handlePipelineFailure throw exception if role is follower > --

[jira] [Updated] (HDDS-3861) Fix handlePipelineFailure throw exception if role is follower

2020-06-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3861: - Attachment: screenshot-1.png > Fix handlePipelineFailure throw exception if role is follower > ---

[jira] [Created] (HDDS-3861) Fix handlePipelineFailure throw exception if role is follower

2020-06-24 Thread runzhiwang (Jira)
runzhiwang created HDDS-3861: Summary: Fix handlePipelineFailure throw exception if role is follower Key: HDDS-3861 URL: https://issues.apache.org/jira/browse/HDDS-3861 Project: Hadoop Distributed Data St

[jira] [Created] (HDDS-3854) Fix error return value of KeyValueBlockIterator#hasNext

2020-06-23 Thread runzhiwang (Jira)
runzhiwang created HDDS-3854: Summary: Fix error return value of KeyValueBlockIterator#hasNext Key: HDDS-3854 URL: https://issues.apache.org/jira/browse/HDDS-3854 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3630) Merge rocksdb in datanode

2020-06-12 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3630: - Attachment: Merge RocksDB in Datanode-v2.pdf > Merge rocksdb in datanode > - > >

[jira] [Updated] (HDDS-3770) Improve getPipelines performance

2020-06-11 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3770: - Summary: Improve getPipelines performance (was: Improve discardPipeline performance) > Improve getPipeli

[jira] [Updated] (HDDS-3770) Improve discardPipeline performance

2020-06-10 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3770: - Summary: Improve discardPipeline performance (was: Improve discardPipeline) > Improve discardPipeline per

[jira] [Commented] (HDDS-3481) SCM ask too many datanodes to replicate the same container

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17130090#comment-17130090 ] runzhiwang commented on HDDS-3481: -- bq. Should we consider balancing the replication sour

[jira] [Updated] (HDDS-3481) SCM ask too many datanodes to replicate the same container

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3481: - Summary: SCM ask too many datanodes to replicate the same container (was: SCM ask 31 datanodes to replica

[jira] [Updated] (HDDS-3770) Improve discardPipeline

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3770: - Description: !screenshot-1.png! > Improve discardPipeline > --- > >

[jira] [Updated] (HDDS-3770) Improve discardPipeline

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3770: - Attachment: screenshot-1.png > Improve discardPipeline > --- > > Key:

[jira] [Created] (HDDS-3770) Improve discardPipeline

2020-06-09 Thread runzhiwang (Jira)
runzhiwang created HDDS-3770: Summary: Improve discardPipeline Key: HDDS-3770 URL: https://issues.apache.org/jira/browse/HDDS-3770 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Commented] (HDDS-3481) SCM ask 31 datanodes to replicate the same container

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17129894#comment-17129894 ] runzhiwang commented on HDDS-3481: -- bq. What was the cause of the delay? Was the node slo

[jira] [Updated] (HDDS-3743) Avoid NetUtils.normalize when get DatanodeDetails from proto

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3743) Avoid NetUtils.normalize when get DatanodeDetails from proto

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3743) Avoid NetUtils.normalize when get DatanodeDetails from proto

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Attachment: screenshot-4.png > Avoid NetUtils.normalize when get DatanodeDetails from proto >

[jira] [Updated] (HDDS-3743) Avoid NetUtils.normalize when get DatanodeDetails from proto

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Attachment: screenshot-3.png > Avoid NetUtils.normalize when get DatanodeDetails from proto >

[jira] [Updated] (HDDS-3743) Avoid NetUtils.normalize when get DatanodeDetails from proto

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3743) Avoid NetUtils.normalize when get DatanodeDetails from proto

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Attachment: screenshot-2.png > Avoid NetUtils.normalize when get DatanodeDetails from proto >

[jira] [Updated] (HDDS-3743) Avoid NetUtils.normalize when get DatanodeDetails from proto

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Summary: Avoid NetUtils.normalize when get DatanodeDetails from proto (was: Improve OM performance with 4

[jira] [Updated] (HDDS-3763) Avoid serialization between UUID and String

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3763: - Description: Serialization between UUID and String not only cost cpu, but also make the proto bigger, beca

[jira] [Created] (HDDS-3763) Avoid serialization between UUID and String

2020-06-09 Thread runzhiwang (Jira)
runzhiwang created HDDS-3763: Summary: Avoid serialization between UUID and String Key: HDDS-3763 URL: https://issues.apache.org/jira/browse/HDDS-3763 Project: Hadoop Distributed Data Store Issu

[jira] [Created] (HDDS-3760) Avoid UUID#toString call in Pipeline#getProtobufMessage

2020-06-09 Thread runzhiwang (Jira)
runzhiwang created HDDS-3760: Summary: Avoid UUID#toString call in Pipeline#getProtobufMessage Key: HDDS-3760 URL: https://issues.apache.org/jira/browse/HDDS-3760 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3759) Avoid UUID#toString call in PipelineID#getProtobuf.

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3759: - Summary: Avoid UUID#toString call in PipelineID#getProtobuf. (was: Improve SCM performace with 0.13% by a

[jira] [Updated] (HDDS-3759) Improve SCM performace with 0.13% by avoid UUID.toString

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3759: - Attachment: screenshot-1.png > Improve SCM performace with 0.13% by avoid UUID.toString >

[jira] [Updated] (HDDS-3759) Improve SCM performace with 0.13% by avoid UUID.toString

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3759: - Attachment: screenshot-2.png > Improve SCM performace with 0.13% by avoid UUID.toString >

[jira] [Updated] (HDDS-3759) Improve SCM performace with 0.13% by avoid UUID.toString

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3759: - Description: !screenshot-1.png! !screenshot-2.png! was: !screenshot-1.png! !screenshot-2.png!

[jira] [Updated] (HDDS-3759) Improve SCM performace with 0.13% by avoid UUID.toString

2020-06-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3759: - Description: !screenshot-1.png! !screenshot-2.png! > Improve SCM performace with 0.13% by avoid UUID.

[jira] [Created] (HDDS-3759) Improve SCM performace with 0.13% by avoid UUID.toString

2020-06-09 Thread runzhiwang (Jira)
runzhiwang created HDDS-3759: Summary: Improve SCM performace with 0.13% by avoid UUID.toString Key: HDDS-3759 URL: https://issues.apache.org/jira/browse/HDDS-3759 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3750) Improve SCM performance with 3.2% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3750: - Attachment: screenshot-3.png > Improve SCM performance with 3.2% by avoid stream.collect > ---

[jira] [Updated] (HDDS-3750) Improve SCM performance with 3.2% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3750: - Description: I start a ozone cluster with 1000 datanodes and 10 s3gateway, and run two weeks with heavy w

[jira] [Updated] (HDDS-3750) Improve SCM performance with 3.2% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3750: - Attachment: screenshot-2.png > Improve SCM performance with 3.2% by avoid stream.collect > ---

[jira] [Updated] (HDDS-3750) Improve SCM performance with 3.2% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3750: - Attachment: screenshot-1.png > Improve SCM performance with 3.2% by avoid stream.collect > ---

[jira] [Created] (HDDS-3750) Improve SCM performance with 3.2% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
runzhiwang created HDDS-3750: Summary: Improve SCM performance with 3.2% by avoid stream.collect Key: HDDS-3750 URL: https://issues.apache.org/jira/browse/HDDS-3750 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3749) Improve OM performance with 3.7% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3749: - Description: I start a ozone cluster with 1000 datanodes and 10 s3gateway, and run two weeks with heavy w

[jira] [Updated] (HDDS-3749) Improve OM performance with 3.7% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3749: - Attachment: screenshot-5.png > Improve OM performance with 3.7% by avoid stream.collect >

[jira] [Updated] (HDDS-3749) Improve OM performance with 3.7% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3749: - Summary: Improve OM performance with 3.7% by avoid stream.collect (was: Improve OM performance with 3% by

[jira] [Updated] (HDDS-3749) Improve OM performance with 3% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3749: - Attachment: screenshot-4.png > Improve OM performance with 3% by avoid stream.collect > --

[jira] [Updated] (HDDS-3749) Improve OM performance with 3% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3749: - Attachment: screenshot-2.png > Improve OM performance with 3% by avoid stream.collect > --

[jira] [Updated] (HDDS-3749) Improve OM performance with 3% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3749: - Description: I start a ozone cluster with 1000 datanodes and 10 s3gateway, and run two weeks with heavy w

[jira] [Updated] (HDDS-3749) Improve OM performance with 3% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3749: - Attachment: screenshot-1.png > Improve OM performance with 3% by avoid stream.collect > --

[jira] [Updated] (HDDS-3749) Improve OM performance with 3% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3749: - Attachment: screenshot-3.png > Improve OM performance with 3% by avoid stream.collect > --

[jira] [Created] (HDDS-3749) Improve OM performance with 3% by avoid stream.collect

2020-06-08 Thread runzhiwang (Jira)
runzhiwang created HDDS-3749: Summary: Improve OM performance with 3% by avoid stream.collect Key: HDDS-3749 URL: https://issues.apache.org/jira/browse/HDDS-3749 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
runzhiwang created HDDS-3745: Summary: Improve OM and SCM performance with 50% by avoid call getServiceList Key: HDDS-3745 URL: https://issues.apache.org/jira/browse/HDDS-3745 Project: Hadoop Distributed

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 64% by avoid call getServiceInfo in s3g

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Summary: Improve OM and SCM performance with 64% by avoid call getServiceInfo in s3g (was: Improve OM and

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 63% by avoid call getServiceInfo in s3g

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Summary: Improve OM and SCM performance with 63% by avoid call getServiceInfo in s3g (was: Improve OM and

[jira] [Updated] (HDDS-3742) Improve OM performance with 5.29% by avoid stream.collect

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3742: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3742) Improve OM performance with 5.29% by avoid stream.collect

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3742: - Attachment: om.svg > Improve OM performance with 5.29% by avoid stream.collect > -

[jira] [Updated] (HDDS-3742) Improve OM performance with 5.29% by avoid stream.collect

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3742: - Attachment: screenshot-1.png > Improve OM performance with 5.29% by avoid stream.collect > ---

[jira] [Updated] (HDDS-3733) Improve SCM performance

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3733: - Summary: Improve SCM performance (was: Improve the performance of SCM) > Improve SCM performance > --

[jira] [Created] (HDDS-3742) Improve OM performance with 5.29% by avoid stream.collect

2020-06-06 Thread runzhiwang (Jira)
runzhiwang created HDDS-3742: Summary: Improve OM performance with 5.29% by avoid stream.collect Key: HDDS-3742 URL: https://issues.apache.org/jira/browse/HDDS-3742 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3746) Improve SCM performance with 1.6% by getContainerReplicasByBatch

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3746: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3746) Improve SCM performance with 1.6% by getContainerReplicasByBatch

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3746: - Attachment: screenshot-1.png > Improve SCM performance with 1.6% by getContainerReplicasByBatch >

[jira] [Updated] (HDDS-3746) Improve SCM performance with 1.6% by getContainerReplicasByBatch

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3746: - Description: !screenshot-1.png! > Improve SCM performance with 1.6% by getContainerReplicasByBatch > ---

[jira] [Updated] (HDDS-3746) Improve SCM performance with 1.6% by getContainerReplicasByBatch

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3746: - Summary: Improve SCM performance with 1.6% by getContainerReplicasByBatch (was: Improve scm performance w

[jira] [Updated] (HDDS-3746) Improve scm performance with 1.6% by getContainerReplicasByBatch

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3746: - Summary: Improve scm performance with 1.6% by getContainerReplicasByBatch (was: Improve OM performance wi

[jira] [Updated] (HDDS-3744) Improve OM performance with 1.75% by avoid String.toUpperCase

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3744: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3744) Improve OM performance with 1.75% by avoid String.toUpperCase

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3744: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Created] (HDDS-3746) Improve OM performance with 1.6% by getContainerReplicasByBatch

2020-06-06 Thread runzhiwang (Jira)
runzhiwang created HDDS-3746: Summary: Improve OM performance with 1.6% by getContainerReplicasByBatch Key: HDDS-3746 URL: https://issues.apache.org/jira/browse/HDDS-3746 Project: Hadoop Distributed Data

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceInfo in s3g

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Attachment: om.svg > Improve OM and SCM performance with 50% by avoid call getServiceInfo in s3g > ---

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceInfo in s3g

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Attachment: scm.svg > Improve OM and SCM performance with 50% by avoid call getServiceInfo in s3g > --

[jira] [Updated] (HDDS-3744) Improve OM performance with 1.75% by avoid String.toUpperCase

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3744: - Attachment: screenshot-1.png > Improve OM performance with 1.75% by avoid String.toUpperCase > ---

[jira] [Updated] (HDDS-3744) Improve OM performance with 1.75% by avoid String.toUpperCase

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3744: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceInfo in s3g

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Summary: Improve OM and SCM performance with 50% by avoid call getServiceInfo in s3g (was: Improve OM and

[jira] [Updated] (HDDS-3743) Improve OM performance with 4.83% by avoid NetUtils.normalize

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3743) Improve OM performance with 4.83% by avoid NetUtils.normalize

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Created] (HDDS-3744) Improve OM performance with 1.75% by avoid String.toUpperCase

2020-06-06 Thread runzhiwang (Jira)
runzhiwang created HDDS-3744: Summary: Improve OM performance with 1.75% by avoid String.toUpperCase Key: HDDS-3744 URL: https://issues.apache.org/jira/browse/HDDS-3744 Project: Hadoop Distributed Data St

[jira] [Updated] (HDDS-3158) Create client for each request in s3g cost too much cpu of om and scm.

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3158: - Summary: Create client for each request in s3g cost too much cpu of om and scm. (was: Create client for e

[jira] [Updated] (HDDS-3743) Improve OM performance with 4.83% by avoid NetUtils.normalize

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3743) Improve OM performance with 4.83% by avoid NetUtils.normalize

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Attachment: om.svg > Improve OM performance with 4.83% by avoid NetUtils.normalize > -

[jira] [Updated] (HDDS-3743) Improve OM performance with 4.83% by avoid NetUtils.normalize

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3738) Improve OM performance with 13.47% by avoid UUID.fromString

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3738: - Summary: Improve OM performance with 13.47% by avoid UUID.fromString (was: Improve the performance of OM

[jira] [Updated] (HDDS-3737) Improve OM performance

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3737: - Summary: Improve OM performance (was: Improve the performance of OM) > Improve OM performance > -

[jira] [Updated] (HDDS-3743) Improve OM performance with 4.83% by avoid NetUtils.normalize

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Attachment: screenshot-1.png > Improve OM performance with 4.83% by avoid NetUtils.normalize > ---

[jira] [Updated] (HDDS-3743) Improve OM performance with 4.83% by avoid NetUtils.normalize

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3743: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Created] (HDDS-3743) Improve OM performance with 4.83% by avoid NetUtils.normalize

2020-06-06 Thread runzhiwang (Jira)
runzhiwang created HDDS-3743: Summary: Improve OM performance with 4.83% by avoid NetUtils.normalize Key: HDDS-3743 URL: https://issues.apache.org/jira/browse/HDDS-3743 Project: Hadoop Distributed Data St

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Description: I start a ozone cluster with 1000 datanodes and 10 s3gateway, and run two weeks with heavy w

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Description: *What's the problem ?* I start a ozone cluster with 1000 datanodes and 10 s3gateway, and run

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Description: What's the problem ? I start a ozone cluster with 1000 datanodes and 10 s3gateway, and run tw

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Attachment: screenshot-2.png > Improve OM and SCM performance with 50% by avoid call getServiceList >

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Description: I start a ozone cluster with 1000 datanodes and 10 s3gateway, and run two weeks with heavy w

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Attachment: screenshot-1.png > Improve OM and SCM performance with 50% by avoid call getServiceList >

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Description: Now s3g create a client for each request. when create each RpcClient, s3g will call ServiceI

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Description: Now s3g create a client for each request. when create each RpcClient, s3g will call ServiceI

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList in s3g

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Summary: Improve OM and SCM performance with 50% by avoid call getServiceList in s3g (was: Improve OM and

[jira] [Updated] (HDDS-3745) Improve OM and SCM performance with 50% by avoid call getServiceList

2020-06-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3745: - Description: Now s3g create a client for each request. when create each RpcClient, s3g will call ServiceI

[jira] [Updated] (HDDS-3739) Improve datanode performance by avoid get waitting deleted blocks from RocksDB

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3739: - Attachment: output.svg > Improve datanode performance by avoid get waitting deleted blocks from RocksDB >

[jira] [Updated] (HDDS-3739) Improve datanode performance by avoid get waitting deleted blocks from RocksDB

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3739: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3739) Improve datanode performance by avoid get waitting deleted blocks from RocksDB

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3739: - Attachment: screenshot-1.png > Improve datanode performance by avoid get waitting deleted blocks from Rock

[jira] [Created] (HDDS-3739) Improve datanode performance by avoid get waitting deleted blocks from RocksDB

2020-06-05 Thread runzhiwang (Jira)
runzhiwang created HDDS-3739: Summary: Improve datanode performance by avoid get waitting deleted blocks from RocksDB Key: HDDS-3739 URL: https://issues.apache.org/jira/browse/HDDS-3739 Project: Hadoop Di

[jira] [Updated] (HDDS-3738) Improve the performance of OM with 13.47 by avoid UUID.fromString

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3738: - Attachment: output.svg > Improve the performance of OM with 13.47 by avoid UUID.fromString > -

[jira] [Updated] (HDDS-3738) Improve the performance of OM with 13.47 by avoid UUID.fromString

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3738: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

[jira] [Updated] (HDDS-3738) Improve the performance of OM with 13.47 by avoid UUID.fromString

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3738: - Attachment: screenshot-1.png > Improve the performance of OM with 13.47 by avoid UUID.fromString > ---

[jira] [Updated] (HDDS-3738) Improve the performance of OM with 13.47 by avoid UUID.fromString

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3738: - Parent: HDDS-3737 Issue Type: Sub-task (was: Improvement) > Improve the performance of OM with 13

[jira] [Created] (HDDS-3738) Improve the performance of OM with 13.47 by avoid UUID.fromString

2020-06-05 Thread runzhiwang (Jira)
runzhiwang created HDDS-3738: Summary: Improve the performance of OM with 13.47 by avoid UUID.fromString Key: HDDS-3738 URL: https://issues.apache.org/jira/browse/HDDS-3738 Project: Hadoop Distributed Dat

[jira] [Created] (HDDS-3737) Improve the performance of OM

2020-06-05 Thread runzhiwang (Jira)
runzhiwang created HDDS-3737: Summary: Improve the performance of OM Key: HDDS-3737 URL: https://issues.apache.org/jira/browse/HDDS-3737 Project: Hadoop Distributed Data Store Issue Type: Improve

[jira] [Updated] (HDDS-3736) Improve the performance of SCM with 1% by getContainerByBatch

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3736: - Attachment: output.svg > Improve the performance of SCM with 1% by getContainerByBatch > -

[jira] [Updated] (HDDS-3735) Improve the performance of SCM with 0.78% by decrease the times of lock and unlock

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3735: - Attachment: output.svg > Improve the performance of SCM with 0.78% by decrease the times of lock and > un

[jira] [Updated] (HDDS-3734) Improve the performance of SCM with 3.86% by avoid TreeSet.addAll

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3734: - Attachment: output.svg > Improve the performance of SCM with 3.86% by avoid TreeSet.addAll > -

[jira] [Updated] (HDDS-3736) Improve the performance of SCM with 1% by getContainerByBatch

2020-06-05 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3736: - Description: I start a ozone cluster with 1000 datanodes, and run two weeks with heavy workload, and perf

<    1   2   3   4   5   6   7   >