[jira] [Reopened] (HDDS-4378) Ozone shell support truncate API

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang reopened HDDS-4378: -- > Ozone shell support truncate API > > > Key: HDDS-4378 >

[jira] [Resolved] (HDDS-4378) Ozone shell support truncate API

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang resolved HDDS-4378. -- Assignee: runzhiwang Resolution: Fixed > Ozone shell support truncate API >

[jira] [Updated] (HDDS-4382) SCM send truncate block to datanode

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4382: - Description: SCM starts a background thread to send TruncateBlocksCommandProto to the datanode. > SCM

[jira] [Updated] (HDDS-4379) OM marks truncated blocks

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4379: - Description: Append mean ozone client can append some content to the tail of some key. So if Client1

[jira] [Updated] (HDDS-4383) Datanode truncates blocks on the disk

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4383: - Description: Datanode starts a background thread to process . If it is FilePerBlock, we use

[jira] [Updated] (HDDS-4379) OM marks truncated blocks

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4379: - Summary: OM marks truncated blocks (was: Mark truncated blocks in OM) > OM marks truncated blocks >

[jira] [Created] (HDDS-4383) Datanode truncates blocks on the disk

2020-10-22 Thread runzhiwang (Jira)
runzhiwang created HDDS-4383: Summary: Datanode truncates blocks on the disk Key: HDDS-4383 URL: https://issues.apache.org/jira/browse/HDDS-4383 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-4377) Datanode truncates blocks on the disk

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4377: - Description: When Datanode receives TruncateBlocksCommand, in the RocksDB, Datanode deletes the chunks

[jira] [Updated] (HDDS-4377) Datanode changes the block length in rocksdb

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4377: - Summary: Datanode changes the block length in rocksdb (was: Datanode truncates blocks on the disk) >

[jira] [Created] (HDDS-4382) SCM send truncate block to datanode

2020-10-22 Thread runzhiwang (Jira)
runzhiwang created HDDS-4382: Summary: SCM send truncate block to datanode Key: HDDS-4382 URL: https://issues.apache.org/jira/browse/HDDS-4382 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-4376) SCM create transaction for truncated blocks

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4376: - Description: When scm receives TruncateScmKeyRequestProto, for the deleteBlocks, scm has already

[jira] [Updated] (HDDS-4381) OM send truncate key to SCM

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4381: - Description: OM starts a background thread to select a certain number of entries from truncateTable, and

[jira] [Created] (HDDS-4381) OM send truncate key to SCM

2020-10-22 Thread runzhiwang (Jira)
runzhiwang created HDDS-4381: Summary: OM send truncate key to SCM Key: HDDS-4381 URL: https://issues.apache.org/jira/browse/HDDS-4381 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Created] (HDDS-4380) OM stores truncate key in truncateTable

2020-10-22 Thread runzhiwang (Jira)
runzhiwang created HDDS-4380: Summary: OM stores truncate key in truncateTable Key: HDDS-4380 URL: https://issues.apache.org/jira/browse/HDDS-4380 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-4380) OM stores truncate key in truncateTable

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4380: - Description: OM stores in truncateTable. The TruncateKey in RepeatedTruncateOmKeyInfo represents one

[jira] [Updated] (HDDS-4375) OM changes the block length when receives truncate request

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4375: - Description: When OM receives truncate(key, newLength),in the keyTable, OM deletes the blocks which are

[jira] [Updated] (HDDS-4375) OM changes the block length when receives truncate request

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4375: - Summary: OM changes the block length when receives truncate request (was: OM changes the block length

[jira] [Updated] (HDDS-4375) OM changes the block length when receive truncate request

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4375: - Summary: OM changes the block length when receive truncate request (was: Client asks OM to change the

[jira] [Created] (HDDS-4379) Mark truncated blocks in OM

2020-10-22 Thread runzhiwang (Jira)
runzhiwang created HDDS-4379: Summary: Mark truncated blocks in OM Key: HDDS-4379 URL: https://issues.apache.org/jira/browse/HDDS-4379 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Created] (HDDS-4378) Ozone shell support truncate API

2020-10-22 Thread runzhiwang (Jira)
runzhiwang created HDDS-4378: Summary: Ozone shell support truncate API Key: HDDS-4378 URL: https://issues.apache.org/jira/browse/HDDS-4378 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Created] (HDDS-4376) SCM create transaction for truncated blocks

2020-10-22 Thread runzhiwang (Jira)
runzhiwang created HDDS-4376: Summary: SCM create transaction for truncated blocks Key: HDDS-4376 URL: https://issues.apache.org/jira/browse/HDDS-4376 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-4377) Datanode truncates blocks on the disk

2020-10-22 Thread runzhiwang (Jira)
runzhiwang created HDDS-4377: Summary: Datanode truncates blocks on the disk Key: HDDS-4377 URL: https://issues.apache.org/jira/browse/HDDS-4377 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-4375) Client asks OM to change the block length when truncate

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4375: - Parent: HDDS-4239 Issue Type: Sub-task (was: New Feature) > Client asks OM to change the block

[jira] [Created] (HDDS-4375) Client asks OM to change the block length when truncate

2020-10-22 Thread runzhiwang (Jira)
runzhiwang created HDDS-4375: Summary: Client asks OM to change the block length when truncate Key: HDDS-4375 URL: https://issues.apache.org/jira/browse/HDDS-4375 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4239) Ozone support truncate operation

2020-10-22 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Parent: (was: HDDS-3714) Issue Type: New Feature (was: Sub-task) > Ozone support truncate

[jira] [Updated] (HDDS-4239) Ozone support truncate operation

2020-09-21 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Attachment: (was: Ozone Truncate Design-v3.pdf) > Ozone support truncate operation >

[jira] [Updated] (HDDS-4239) Ozone support truncate operation

2020-09-21 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Attachment: Ozone Truncate Design.pdf > Ozone support truncate operation >

[jira] [Updated] (HDDS-4239) Ozone support truncate operation

2020-09-21 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Attachment: (was: Ozone Truncate Design-v2.pdf) > Ozone support truncate operation >

[jira] [Updated] (HDDS-4239) Ozone support truncate operation

2020-09-21 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Attachment: (was: Ozone Truncate Design-v1.pdf) > Ozone support truncate operation >

[jira] [Updated] (HDDS-4239) Ozone support truncate operation

2020-09-18 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Attachment: Ozone Truncate Design-v3.pdf > Ozone support truncate operation >

[jira] [Updated] (HDDS-4239) Ozone support truncate operation

2020-09-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Attachment: Ozone Truncate Design-v2.pdf > Ozone support truncate operation >

[jira] [Created] (HDDS-4240) Ozone support append operation

2020-09-13 Thread runzhiwang (Jira)
runzhiwang created HDDS-4240: Summary: Ozone support append operation Key: HDDS-4240 URL: https://issues.apache.org/jira/browse/HDDS-4240 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-4239) Ozone support truncate operation

2020-09-13 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Summary: Ozone support truncate operation (was: Ozone support truncate) > Ozone support truncate

[jira] [Updated] (HDDS-4239) Ozone support truncate

2020-09-13 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Attachment: Ozone Truncate Design-v1.pdf > Ozone support truncate > -- > >

[jira] [Updated] (HDDS-4239) Ozone support truncate

2020-09-13 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Description: Design:

[jira] [Updated] (HDDS-4239) Ozone support truncate

2020-09-13 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4239: - Parent: HDDS-3714 Issue Type: Sub-task (was: New Feature) > Ozone support truncate >

[jira] [Created] (HDDS-4239) Ozone support truncate

2020-09-13 Thread runzhiwang (Jira)
runzhiwang created HDDS-4239: Summary: Ozone support truncate Key: HDDS-4239 URL: https://issues.apache.org/jira/browse/HDDS-4239 Project: Hadoop Distributed Data Store Issue Type: New Feature

[jira] [Assigned] (HDDS-3714) Ozone support append truncate operation

2020-09-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang reassigned HDDS-3714: Assignee: runzhiwang > Ozone support append truncate operation >

[jira] [Resolved] (HDDS-4214) Fix failed UT: TestContainerStateMachineFailures#testApplyTransactionFailure

2020-09-06 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang resolved HDDS-4214. -- Resolution: Duplicate > Fix failed UT: TestContainerStateMachineFailures#testApplyTransactionFailure >

[jira] [Created] (HDDS-4214) Fix failed UT: TestContainerStateMachineFailures#testApplyTransactionFailure

2020-09-06 Thread runzhiwang (Jira)
runzhiwang created HDDS-4214: Summary: Fix failed UT: TestContainerStateMachineFailures#testApplyTransactionFailure Key: HDDS-4214 URL: https://issues.apache.org/jira/browse/HDDS-4214 Project: Hadoop

[jira] [Created] (HDDS-4202) Upgrade ratis to 1.1.0-ea949f1-SNAPSHOT

2020-09-02 Thread runzhiwang (Jira)
runzhiwang created HDDS-4202: Summary: Upgrade ratis to 1.1.0-ea949f1-SNAPSHOT Key: HDDS-4202 URL: https://issues.apache.org/jira/browse/HDDS-4202 Project: Hadoop Distributed Data Store Issue

[jira] [Created] (HDDS-4201) Improve the performance of OmKeyLocationInfoGroup

2020-09-02 Thread runzhiwang (Jira)
runzhiwang created HDDS-4201: Summary: Improve the performance of OmKeyLocationInfoGroup Key: HDDS-4201 URL: https://issues.apache.org/jira/browse/HDDS-4201 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4199) Fix failed UT: TestOMAllocateBlockRequest#testValidateAndUpdateCache

2020-09-02 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4199: - Attachment: screenshot-1.png > Fix failed UT: TestOMAllocateBlockRequest#testValidateAndUpdateCache >

[jira] [Updated] (HDDS-4199) Fix failed UT: TestOMAllocateBlockRequest#testValidateAndUpdateCache

2020-09-02 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4199: - Description: !screenshot-1.png! > Fix failed UT: TestOMAllocateBlockRequest#testValidateAndUpdateCache

[jira] [Assigned] (HDDS-4199) Fix failed UT: TestOMAllocateBlockRequest#testValidateAndUpdateCache

2020-09-02 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang reassigned HDDS-4199: Assignee: runzhiwang > Fix failed UT: TestOMAllocateBlockRequest#testValidateAndUpdateCache >

[jira] [Created] (HDDS-4199) Fix failed UT: TestOMAllocateBlockRequest#testValidateAndUpdateCache

2020-09-02 Thread runzhiwang (Jira)
runzhiwang created HDDS-4199: Summary: Fix failed UT: TestOMAllocateBlockRequest#testValidateAndUpdateCache Key: HDDS-4199 URL: https://issues.apache.org/jira/browse/HDDS-4199 Project: Hadoop Distributed

[jira] [Updated] (HDDS-4187) Fix recon OOM

2020-09-02 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4187: - Summary: Fix recon OOM (was: Fix memory leak of recon) > Fix recon OOM > - > >

[jira] [Updated] (HDDS-4187) Fix memory leak of recon

2020-09-01 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4187: - Description: 40 datanodes with 400, 000 containers, start recon with xmx:10G. After several hours,

[jira] [Updated] (HDDS-4187) Fix memory leak of recon

2020-09-01 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4187: - Description: 40 datanodes with 400, 000 containers, start recon with xmx:10G. After several hours,

[jira] [Updated] (HDDS-4187) Fix memory leak of recon

2020-09-01 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4187: - Attachment: screenshot-2.png > Fix memory leak of recon > > >

[jira] [Updated] (HDDS-4187) Fix memory leak of recon

2020-09-01 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4187: - Attachment: screenshot-1.png > Fix memory leak of recon > > >

[jira] [Updated] (HDDS-4187) Fix memory leak of recon

2020-09-01 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4187: - Description: 40 datanodes with 400, 000 containers, start recon with xmx:10G. After several hours,

[jira] [Created] (HDDS-4187) Fix memory leak of recon

2020-09-01 Thread runzhiwang (Jira)
runzhiwang created HDDS-4187: Summary: Fix memory leak of recon Key: HDDS-4187 URL: https://issues.apache.org/jira/browse/HDDS-4187 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Updated] (HDDS-2922) Balance ratis leader distribution in datanodes

2020-08-31 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-2922: - Summary: Balance ratis leader distribution in datanodes (was: Recommend leader host to Ratis via

[jira] [Updated] (HDDS-4176) Fix failed UT: test2WayCommitForTimeoutException

2020-08-31 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4176: - Description: org.apache.ratis.protocol.GroupMismatchException: 6f2b1ee5-bc2b-491c-bff4-ab0f4ce64709:

[jira] [Created] (HDDS-4176) Fix failed UT: test2WayCommitForTimeoutException

2020-08-31 Thread runzhiwang (Jira)
runzhiwang created HDDS-4176: Summary: Fix failed UT: test2WayCommitForTimeoutException Key: HDDS-4176 URL: https://issues.apache.org/jira/browse/HDDS-4176 Project: Hadoop Distributed Data Store

[jira] [Comment Edited] (HDDS-3630) Merge rocksdb in datanode

2020-08-30 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182908#comment-17182908 ] runzhiwang edited comment on HDDS-3630 at 8/31/20, 12:54 AM: - In my test, the

[jira] [Comment Edited] (HDDS-3630) Merge rocksdb in datanode

2020-08-30 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182908#comment-17182908 ] runzhiwang edited comment on HDDS-3630 at 8/31/20, 12:49 AM: - In my test, the

[jira] [Updated] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4138: - Description: HADOOP has implemented several method to calculate crc:

[jira] [Updated] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4138: - Attachment: screenshot-1.png > Improve crc efficiency > -- > > Key:

[jira] [Updated] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4138: - Description: HADOOP has implemented several method to calculate crc:

[jira] [Updated] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-4138: - Description: HADOOP has implemented several method to calculate crc:

[jira] [Created] (HDDS-4138) Improve crc efficiency

2020-08-24 Thread runzhiwang (Jira)
runzhiwang created HDDS-4138: Summary: Improve crc efficiency Key: HDDS-4138 URL: https://issues.apache.org/jira/browse/HDDS-4138 Project: Hadoop Distributed Data Store Issue Type: Task

[jira] [Comment Edited] (HDDS-3630) Merge rocksdb in datanode

2020-08-23 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182908#comment-17182908 ] runzhiwang edited comment on HDDS-3630 at 8/24/20, 3:00 AM: In my test, the

[jira] [Comment Edited] (HDDS-3630) Merge rocksdb in datanode

2020-08-23 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182908#comment-17182908 ] runzhiwang edited comment on HDDS-3630 at 8/24/20, 2:56 AM: In my test, the

[jira] [Commented] (HDDS-3630) Merge rocksdb in datanode

2020-08-23 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182908#comment-17182908 ] runzhiwang commented on HDDS-3630: -- In my test, the capacity of the container is 5GB,

[jira] [Created] (HDDS-4024) Avoid while loop too soon when exception happen

2020-07-24 Thread runzhiwang (Jira)
runzhiwang created HDDS-4024: Summary: Avoid while loop too soon when exception happen Key: HDDS-4024 URL: https://issues.apache.org/jira/browse/HDDS-4024 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-3978) Switch log4j to log4j2 to avoid deadlock

2020-07-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3978: - Description: We met dead lock related to log4j, the jstack information has been attached. For the

[jira] [Updated] (HDDS-3978) Switch log4j to log4j2 to avoid deadlock

2020-07-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3978: - Description: We met dead lock related to log4j, the jstack information has been attached. For the

[jira] [Updated] (HDDS-3978) Switch log4j to log4j2 to avoid deadlock

2020-07-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3978: - Description: We met dead lock related to log4j, the jstack information has been attached. (was: We met

[jira] [Updated] (HDDS-3978) Switch log4j to log4j2 to avoid deadlock

2020-07-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3978: - Description: We met dead lock related to log4j, the jstack information has been attached. > Switch log4j

[jira] [Updated] (HDDS-3978) Switch log4j to log4j2 to avoid deadlock

2020-07-17 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3978: - Attachment: jstack-deadlock-log.txt > Switch log4j to log4j2 to avoid deadlock >

[jira] [Created] (HDDS-3978) Switch log4j to log4j2 to avoid deadlock

2020-07-17 Thread runzhiwang (Jira)
runzhiwang created HDDS-3978: Summary: Switch log4j to log4j2 to avoid deadlock Key: HDDS-3978 URL: https://issues.apache.org/jira/browse/HDDS-3978 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-3952) Merge small container

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3952: - Summary: Merge small container (was: Make container could be reopened) > Merge small container >

[jira] [Comment Edited] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159636#comment-17159636 ] runzhiwang edited comment on HDDS-3952 at 7/17/20, 3:02 AM: [~msingh] Hi,

[jira] [Comment Edited] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159636#comment-17159636 ] runzhiwang edited comment on HDDS-3952 at 7/17/20, 3:01 AM: [~msingh] Hi,

[jira] [Comment Edited] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159636#comment-17159636 ] runzhiwang edited comment on HDDS-3952 at 7/17/20, 3:00 AM: [~msingh] Hi,

[jira] [Commented] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17159636#comment-17159636 ] runzhiwang commented on HDDS-3952: -- [~msingh] Hi, Thanks for review. The backgroud of this jira is our

[jira] [Updated] (HDDS-3952) Make container could be reopened

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3952: - Attachment: screenshot-1.png > Make container could be reopened > > >

[jira] [Resolved] (HDDS-3941) Enable core dump when crash in C++

2020-07-16 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang resolved HDDS-3941. -- Fix Version/s: 0.6.0 Resolution: Fixed > Enable core dump when crash in C++ >

[jira] [Updated] (HDDS-3957) Fix mixed use of Longs.toByteArray and Ints.fromByteArray

2020-07-13 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3957: - Summary: Fix mixed use of Longs.toByteArray and Ints.fromByteArray (was: Fix error use Longs.toByteArray

[jira] [Created] (HDDS-3957) Fix error use Longs.toByteArray and Ints.fromByteArray of DB_PENDING_DELETE_BLOCK_COUNT_KEY

2020-07-13 Thread runzhiwang (Jira)
runzhiwang created HDDS-3957: Summary: Fix error use Longs.toByteArray and Ints.fromByteArray of DB_PENDING_DELETE_BLOCK_COUNT_KEY Key: HDDS-3957 URL: https://issues.apache.org/jira/browse/HDDS-3957

[jira] [Updated] (HDDS-3933) Fix memory leak because of too many Datanode State Machine Thread

2020-07-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3933: - Summary: Fix memory leak because of too many Datanode State Machine Thread (was: memory leak because of

[jira] [Updated] (HDDS-3223) Improve s3g read 1GB object efficiency by 100 times

2020-07-09 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3223: - Summary: Improve s3g read 1GB object efficiency by 100 times (was: Improve s3g read 1GB object

[jira] [Updated] (HDDS-3941) Enable core dump when crash in C++

2020-07-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3941: - Summary: Enable core dump when crash in C++ (was: Set core file size to debug when crash in C++) >

[jira] [Updated] (HDDS-3933) memory leak because of too many Datanode State Machine Thread

2020-07-08 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3933: - Summary: memory leak because of too many Datanode State Machine Thread (was: Memory leak because of too

[jira] [Updated] (HDDS-3933) Memory leak because of too many Datanode State Machine Thread

2020-07-07 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3933: - Attachment: jstack.txt > Memory leak because of too many Datanode State Machine Thread >

[jira] [Updated] (HDDS-3933) Memory leak because of too many Datanode State Machine Thread

2020-07-07 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3933: - Description: When create 22345th Datanode State Machine Thread, OOM happened. !screenshot-1.png!

[jira] [Updated] (HDDS-3933) Memory leak because of too many Datanode State Machine Thread

2020-07-07 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3933: - Attachment: screenshot-3.png > Memory leak because of too many Datanode State Machine Thread >

[jira] [Assigned] (HDDS-3853) Container marked as missing on datanode while container directory do exist

2020-07-07 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang reassigned HDDS-3853: Assignee: runzhiwang (was: Shashikant Banerjee) > Container marked as missing on datanode while

[jira] [Updated] (HDDS-3933) Memory leak because of too many Datanode State Machine Thread

2020-07-07 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3933: - Description: When create 22345th Datanode State Machine Thread, OOM happened. !screenshot-1.png!

[jira] [Updated] (HDDS-3933) Memory leak because of too many Datanode State Machine Thread

2020-07-07 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3933: - Attachment: screenshot-2.png > Memory leak because of too many Datanode State Machine Thread >

[jira] [Updated] (HDDS-3933) Memory leak because of too many Datanode State Machine Thread

2020-07-07 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3933: - Description: When create 22345th Datanode State Machine Thread, OOM happened. !screenshot-1.png! >

[jira] [Updated] (HDDS-3933) Memory leak because of too many Datanode State Machine Thread

2020-07-07 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3933: - Attachment: screenshot-1.png > Memory leak because of too many Datanode State Machine Thread >

[jira] [Created] (HDDS-3933) Memory leak because of too many Datanode State Machine Thread

2020-07-07 Thread runzhiwang (Jira)
runzhiwang created HDDS-3933: Summary: Memory leak because of too many Datanode State Machine Thread Key: HDDS-3933 URL: https://issues.apache.org/jira/browse/HDDS-3933 Project: Hadoop Distributed Data

[jira] [Assigned] (HDDS-2922) Recommend leader host to Ratis via pipeline creation

2020-07-03 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang reassigned HDDS-2922: Assignee: runzhiwang (was: Li Cheng) > Recommend leader host to Ratis via pipeline creation >

[jira] [Commented] (HDDS-2922) Recommend leader host to Ratis via pipeline creation

2020-07-03 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150886#comment-17150886 ] runzhiwang commented on HDDS-2922: -- I'm working on it > Recommend leader host to Ratis via pipeline

[jira] [Resolved] (HDDS-3899) Avoid change state from closing to exception in LogAppender

2020-06-29 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang resolved HDDS-3899. -- Resolution: Invalid > Avoid change state from closing to exception in LogAppender >

[jira] [Created] (HDDS-3899) Avoid change state from closing to exception in LogAppender

2020-06-29 Thread runzhiwang (Jira)
runzhiwang created HDDS-3899: Summary: Avoid change state from closing to exception in LogAppender Key: HDDS-3899 URL: https://issues.apache.org/jira/browse/HDDS-3899 Project: Hadoop Distributed Data

[jira] [Updated] (HDDS-3861) Fix handlePipelineFailure throw exception if role is follower

2020-06-24 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang updated HDDS-3861: - Description: !screenshot-1.png! > Fix handlePipelineFailure throw exception if role is follower >

  1   2   3   4   5   6   7   >