[jira] [Created] (HDFS-15787) Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease

2021-01-23 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15787: -- Summary: Remove unnecessary Lease Renew in FSNamesystem#internalReleaseLease Key: HDFS-15787 URL: https://issues.apache.org/jira/browse/HDFS-15787 Project: Hadoop HDFS

[jira] [Created] (HDFS-15559) Complement initialize member variables in TestHdfsConfigFields

2020-09-07 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15559: -- Summary: Complement initialize member variables in TestHdfsConfigFields Key: HDFS-15559 URL: https://issues.apache.org/jira/browse/HDFS-15559 Project: Hadoop HDFS

[jira] [Created] (HDFS-15409) Optimization Strategy for choosing ShortCircuitCache

2020-06-11 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15409: -- Summary: Optimization Strategy for choosing ShortCircuitCache Key: HDFS-15409 URL: https://issues.apache.org/jira/browse/HDFS-15409 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-15285) The same distance and load nodes don't shuffle when consider DataNode load enabled

2020-04-19 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15285: -- Summary: The same distance and load nodes don't shuffle when consider DataNode load enabled Key: HDFS-15285 URL: https://issues.apache.org/jira/browse/HDFS-15285

[jira] [Created] (HDFS-15264) Backport HDFS-13571 to branch-3.1

2020-04-06 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15264: -- Summary: Backport HDFS-13571 to branch-3.1 Key: HDFS-15264 URL: https://issues.apache.org/jira/browse/HDFS-15264 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-15256) Fix typo in DataXceiverServer#run()

2020-04-02 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15256: -- Summary: Fix typo in DataXceiverServer#run() Key: HDFS-15256 URL: https://issues.apache.org/jira/browse/HDFS-15256 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-15255) Consider StorageType in DatanodeManager#sortLocatedBlock()

2020-04-01 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15255: -- Summary: Consider StorageType in DatanodeManager#sortLocatedBlock() Key: HDFS-15255 URL: https://issues.apache.org/jira/browse/HDFS-15255 Project: Hadoop HDFS

[jira] [Created] (HDFS-15182) TestBlockManager#testOneOfTwoRacksDecommissioned() fail in trunk

2020-02-18 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15182: -- Summary: TestBlockManager#testOneOfTwoRacksDecommissioned() fail in trunk Key: HDFS-15182 URL: https://issues.apache.org/jira/browse/HDFS-15182 Project: Hadoop HDFS

[jira] [Created] (HDFS-15174) Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations

2020-02-16 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15174: -- Summary: Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations Key: HDFS-15174 URL: https://issues.apache.org/jira/browse/HDFS-15174 Project: Hadoop

[jira] [Created] (HDFS-15172) Remove unnecessary deadNodeDetectInterval in DeadNodeDetector#checkDeadNodes()

2020-02-15 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15172: -- Summary: Remove unnecessary deadNodeDetectInterval in DeadNodeDetector#checkDeadNodes() Key: HDFS-15172 URL: https://issues.apache.org/jira/browse/HDFS-15172 Project:

[jira] [Created] (HDFS-15161) When evictableMmapped or evictable size is zero, do not throw NoSuchElementException in ShortCircuitCache#close()

2020-02-11 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15161: -- Summary: When evictableMmapped or evictable size is zero, do not throw NoSuchElementException in ShortCircuitCache#close() Key: HDFS-15161 URL:

[jira] [Created] (HDFS-15026) TestPendingReconstruction#testPendingReconstruction() fail in trunk

2019-12-02 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-15026: -- Summary: TestPendingReconstruction#testPendingReconstruction() fail in trunk Key: HDFS-15026 URL: https://issues.apache.org/jira/browse/HDFS-15026 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-14650) DeadNodeDetector redetects Suspicious Node

2019-11-26 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun resolved HDFS-14650. Resolution: Implemented > DeadNodeDetector redetects Suspicious Node >

[jira] [Created] (HDFS-14995) Refactor InvalidateBlocks#printBlockDeletionTime()

2019-11-19 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14995: -- Summary: Refactor InvalidateBlocks#printBlockDeletionTime() Key: HDFS-14995 URL: https://issues.apache.org/jira/browse/HDFS-14995 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-14994) Optimize LowRedundancyBlocks#chooseLowRedundancyBlocks()

2019-11-19 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14994: -- Summary: Optimize LowRedundancyBlocks#chooseLowRedundancyBlocks() Key: HDFS-14994 URL: https://issues.apache.org/jira/browse/HDFS-14994 Project: Hadoop HDFS

[jira] [Created] (HDFS-14942) Change Log Level to warn in JournalNodeSyncer#syncWithJournalAtIndex

2019-10-30 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14942: -- Summary: Change Log Level to warn in JournalNodeSyncer#syncWithJournalAtIndex Key: HDFS-14942 URL: https://issues.apache.org/jira/browse/HDFS-14942 Project: Hadoop HDFS

[jira] [Created] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-28 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14938: -- Summary: Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType() Key: HDFS-14938 URL: https://issues.apache.org/jira/browse/HDFS-14938

[jira] [Created] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-28 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14936: -- Summary: Add getNumOfChildren() for interface InnerNode Key: HDFS-14936 URL: https://issues.apache.org/jira/browse/HDFS-14936 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-14935) Unified constant in DFSNetworkTopology#isNodeInScope

2019-10-25 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14935: -- Summary: Unified constant in DFSNetworkTopology#isNodeInScope Key: HDFS-14935 URL: https://issues.apache.org/jira/browse/HDFS-14935 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-14919) Provide Non DFS Used per disk in DataNode UI

2019-10-21 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14919: -- Summary: Provide Non DFS Used per disk in DataNode UI Key: HDFS-14919 URL: https://issues.apache.org/jira/browse/HDFS-14919 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configuable

2019-10-06 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14896: -- Summary: Make MIN_BLOCKS_FOR_WRITE configuable Key: HDFS-14896 URL: https://issues.apache.org/jira/browse/HDFS-14896 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-14895) Define LOG instead of BlockPlacementPolicy.LOG in DatanodeDescriptor#chooseStorage4Block

2019-10-06 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14895: -- Summary: Define LOG instead of BlockPlacementPolicy.LOG in DatanodeDescriptor#chooseStorage4Block Key: HDFS-14895 URL: https://issues.apache.org/jira/browse/HDFS-14895

[jira] [Created] (HDFS-14877) Remove unused imports from TestClose.java

2019-09-26 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14877: -- Summary: Remove unused imports from TestClose.java Key: HDFS-14877 URL: https://issues.apache.org/jira/browse/HDFS-14877 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-14876) Remove unused imports from TestBlockMissingException.java

2019-09-26 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14876: -- Summary: Remove unused imports from TestBlockMissingException.java Key: HDFS-14876 URL: https://issues.apache.org/jira/browse/HDFS-14876 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-14871) StagingTestBase uses methods not available in Mockito 1.8.5 in branch-3.1

2019-09-24 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun resolved HDFS-14871. Resolution: Duplicate > StagingTestBase uses methods not available in Mockito 1.8.5 in branch-3.1

[jira] [Created] (HDFS-14871) StagingTestBase uses methods not available in Mockito 1.8.5

2019-09-24 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14871: -- Summary: StagingTestBase uses methods not available in Mockito 1.8.5 Key: HDFS-14871 URL: https://issues.apache.org/jira/browse/HDFS-14871 Project: Hadoop HDFS

[jira] [Created] (HDFS-14850) Optimize FileSystemAccessService#getFileSystemConfiguration

2019-09-15 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14850: -- Summary: Optimize FileSystemAccessService#getFileSystemConfiguration Key: HDFS-14850 URL: https://issues.apache.org/jira/browse/HDFS-14850 Project: Hadoop HDFS

[jira] [Created] (HDFS-14844) Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream configurable

2019-09-10 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14844: -- Summary: Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream configurable Key: HDFS-14844 URL: https://issues.apache.org/jira/browse/HDFS-14844

[jira] [Created] (HDFS-14823) BlockReaderRemote#readNextPacket jitter

2019-09-04 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14823: -- Summary: BlockReaderRemote#readNextPacket jitter Key: HDFS-14823 URL: https://issues.apache.org/jira/browse/HDFS-14823 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

2019-09-04 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14820: -- Summary: The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big Key: HDFS-14820 URL: https://issues.apache.org/jira/browse/HDFS-14820

[jira] [Created] (HDFS-14797) Define LOG instead of BlockManager.LOG in ReplicationWork

2019-08-29 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14797: -- Summary: Define LOG instead of BlockManager.LOG in ReplicationWork Key: HDFS-14797 URL: https://issues.apache.org/jira/browse/HDFS-14797 Project: Hadoop HDFS

[jira] [Created] (HDFS-14795) Add Throttler for writing block

2019-08-28 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14795: -- Summary: Add Throttler for writing block Key: HDFS-14795 URL: https://issues.apache.org/jira/browse/HDFS-14795 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-14769) DataNode#DataTransfer

2019-08-23 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14769: -- Summary: DataNode#DataTransfer Key: HDFS-14769 URL: https://issues.apache.org/jira/browse/HDFS-14769 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-14751) TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk

2019-08-19 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14751: -- Summary: TestNameNodeMetadataConsistency#testGenerationStampInFuture fail in trunk Key: HDFS-14751 URL: https://issues.apache.org/jira/browse/HDFS-14751 Project: Hadoop

[jira] [Created] (HDFS-14708) TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk

2019-08-06 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14708: -- Summary: TestLargeBlockReport#testBlockReportSucceedsWithLargerLengthLimit fails in trunk Key: HDFS-14708 URL: https://issues.apache.org/jira/browse/HDFS-14708 Project:

[jira] [Created] (HDFS-14701) Change Log Level to warn in SlotReleaser

2019-08-05 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14701: -- Summary: Change Log Level to warn in SlotReleaser Key: HDFS-14701 URL: https://issues.apache.org/jira/browse/HDFS-14701 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-14651) DeadNodeDetector periodically detects Dead Node

2019-07-15 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14651: -- Summary: DeadNodeDetector periodically detects Dead Node Key: HDFS-14651 URL: https://issues.apache.org/jira/browse/HDFS-14651 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-14650) Re-probing Suspicious Node

2019-07-15 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14650: -- Summary: Re-probing Suspicious Node Key: HDFS-14650 URL: https://issues.apache.org/jira/browse/HDFS-14650 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-14649) DataNode will be placed in DeadNodeDetector#SuspiciousNode when InputStream which access it occurs an error

2019-07-15 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14649: -- Summary: DataNode will be placed in DeadNodeDetector#SuspiciousNode when InputStream which access it occurs an error Key: HDFS-14649 URL:

[jira] [Created] (HDFS-14648) Create DeadNodeDetector state machine model

2019-07-15 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14648: -- Summary: Create DeadNodeDetector state machine model Key: HDFS-14648 URL: https://issues.apache.org/jira/browse/HDFS-14648 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-14644) That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode

2019-07-10 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14644: -- Summary: That replication of block failed leads to decommission is blocked when the number of replicas of block is greater than the number of datanode Key: HDFS-14644 URL:

[jira] [Created] (HDFS-14585) Backport HDFS-8901 Use ByteBuffer in striping positional read

2019-06-20 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14585: -- Summary: Backport HDFS-8901 Use ByteBuffer in striping positional read Key: HDFS-14585 URL: https://issues.apache.org/jira/browse/HDFS-14585 Project: Hadoop HDFS

[jira] [Created] (HDFS-14330) Consider StorageID to choose volume

2019-03-03 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14330: -- Summary: Consider StorageID to choose volume Key: HDFS-14330 URL: https://issues.apache.org/jira/browse/HDFS-14330 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-14313) Get hdfs used space from FsDatasetImpl#volumeMap instead of df/du

2019-02-22 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14313: -- Summary: Get hdfs used space from FsDatasetImpl#volumeMap instead of df/du Key: HDFS-14313 URL: https://issues.apache.org/jira/browse/HDFS-14313 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-14289) Unexpected message type: PooledUnsafeDirectByteBuf when get datanode info by DatanodeWebHdfsMethods

2019-02-18 Thread Lisheng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun resolved HDFS-14289. Resolution: Duplicate > Unexpected message type: PooledUnsafeDirectByteBuf when get datanode info

[jira] [Created] (HDFS-14290) Unexpected message type: PooledUnsafeDirectByteBuf when get datanode info by DatanodeWebHdfsMethods

2019-02-17 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14290: -- Summary: Unexpected message type: PooledUnsafeDirectByteBuf when get datanode info by DatanodeWebHdfsMethods Key: HDFS-14290 URL: https://issues.apache.org/jira/browse/HDFS-14290

[jira] [Created] (HDFS-14289) Unexpected message type: PooledUnsafeDirectByteBuf when get datanode info by DatanodeWebHdfsMethods

2019-02-17 Thread Lisheng Sun (JIRA)
Lisheng Sun created HDFS-14289: -- Summary: Unexpected message type: PooledUnsafeDirectByteBuf when get datanode info by DatanodeWebHdfsMethods Key: HDFS-14289 URL: https://issues.apache.org/jira/browse/HDFS-14289