[
https://issues.apache.org/jira/browse/HDFS-17599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haiyang Hu resolved HDFS-17599.
---
Resolution: Fixed
> EC: Fix the mismatch between locations and indices for mo
Haiyang Hu created HDFS-17564:
-
Summary: Erasure Coding: Fix the issue of inaccurate metrics when
decommission mark busy DN
Key: HDFS-17564
URL: https://issues.apache.org/jira/browse/HDFS-17564
Project
Haiyang Hu created HDFS-17559:
-
Summary: Fix the uuid as null in NameNodeMXBean
Key: HDFS-17559
URL: https://issues.apache.org/jira/browse/HDFS-17559
Project: Hadoop HDFS
Issue Type: Bug
Haiyang Hu created HDFS-17557:
-
Summary: Fix bug for
TestRedundancyMonitor#testChooseTargetWhenAllDataNodesStop
Key: HDFS-17557
URL: https://issues.apache.org/jira/browse/HDFS-17557
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-17464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haiyang Hu resolved HDFS-17464.
---
Fix Version/s: 3.5.0
Resolution: Resolved
> Improve some logs output in class FsDatasetI
[
https://issues.apache.org/jira/browse/HDFS-17451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haiyang Hu resolved HDFS-17451.
---
Fix Version/s: 3.5.0
Hadoop Flags: Reviewed
Resolution: Fixed
> RBF: fix spotbugs
n 22 Apr 2024, at 9:41 AM, Xiaoqiao He wrote:
>> >
>> > I am pleased to announce that Haiyang Hu has been elected as
>> > a committer on the Apache Hadoop project. We appreciate all of
>> > Haiyang's work, and look forward to her/his continued contributions.
>
Haiyang Hu created HDFS-17461:
-
Summary: Fix spotbugs in PeerCache#getInternal
Key: HDFS-17461
URL: https://issues.apache.org/jira/browse/HDFS-17461
Project: Hadoop HDFS
Issue Type: Improvement
Haiyang Hu created HDFS-17455:
-
Summary: Fix Client throw IndexOutOfBoundsException in
DFSInputStream#fetchBlockAt
Key: HDFS-17455
URL: https://issues.apache.org/jira/browse/HDFS-17455
Project: Hadoop
Haiyang Hu created HDFS-17448:
-
Summary: Enhance the stability of the unit test
TestDiskBalancerCommand
Key: HDFS-17448
URL: https://issues.apache.org/jira/browse/HDFS-17448
Project: Hadoop HDFS
Haiyang Hu created HDFS-17431:
-
Summary: Fix log format for BlockRecoveryWorker#recoverBlocks
Key: HDFS-17431
URL: https://issues.apache.org/jira/browse/HDFS-17431
Project: Hadoop HDFS
Issue
Haiyang Hu created HDFS-17430:
-
Summary: RecoveringBlock will skip no live replicas when get block
recovery command.
Key: HDFS-17430
URL: https://issues.apache.org/jira/browse/HDFS-17430
Project: Hadoop
Haiyang Hu created HDFS-17426:
-
Summary: Remove Invalid FileSystemECReadStats logic in
DFSInputStream
Key: HDFS-17426
URL: https://issues.apache.org/jira/browse/HDFS-17426
Project: Hadoop HDFS
Haiyang Hu created HDFS-17406:
-
Summary: Suppress UnresolvedPathException in hdfs router log
Key: HDFS-17406
URL: https://issues.apache.org/jira/browse/HDFS-17406
Project: Hadoop HDFS
Issue Type
Thank you for raising the issue of this long-standing bottleneck, this will
be a very important improvement!
Hopefully can participate and push forward together.
Best Regards~
Brahma Reddy Battula 于2024年2月3日周六 00:40写道：
> Thanks for bringing this and considering all the history around this.
> O
Haiyang Hu created HDFS-17369:
-
Summary: Add uuid into datanode info for NameNodeMXBean
Key: HDFS-17369
URL: https://issues.apache.org/jira/browse/HDFS-17369
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-17361:
-
Summary: DiskBalancer: Query command support with multiple nodes
Key: HDFS-17361
URL: https://issues.apache.org/jira/browse/HDFS-17361
Project: Hadoop HDFS
Issue
Haiyang Hu created HDFS-17352:
-
Summary: Add configuration to control whether DN delete this
replica from disk when client requests a missing block
Key: HDFS-17352
URL: https://issues.apache.org/jira/browse/HDFS
Haiyang Hu created HDFS-17346:
-
Summary: Fix DirectoryScanner check mark the normal blocks as
corrupt.
Key: HDFS-17346
URL: https://issues.apache.org/jira/browse/HDFS-17346
Project: Hadoop HDFS
Haiyang Hu created HDFS-17342:
-
Summary: Fix DataNode may invalidates normal block causing missing
block
Key: HDFS-17342
URL: https://issues.apache.org/jira/browse/HDFS-17342
Project: Hadoop HDFS
Haiyang Hu created HDFS-17310:
-
Summary: DiskBalancer: Enhance the log message
Key: HDFS-17310
URL: https://issues.apache.org/jira/browse/HDFS-17310
Project: Hadoop HDFS
Issue Type: Improvement
Haiyang Hu created HDFS-17298:
-
Summary: Fix NPE in DataNode.handleBadBlock and BlockSender
Key: HDFS-17298
URL: https://issues.apache.org/jira/browse/HDFS-17298
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-17297:
-
Summary: The NameNode should remove block from the BlocksMap if
the block is marked as deleted.
Key: HDFS-17297
URL: https://issues.apache.org/jira/browse/HDFS-17297
Haiyang Hu created HDFS-17279:
-
Summary: RBF: Fix link to Fedbalance document
Key: HDFS-17279
URL: https://issues.apache.org/jira/browse/HDFS-17279
Project: Hadoop HDFS
Issue Type: Improvement
Haiyang Hu created HDFS-17250:
-
Summary: EditLogTailer#triggerActiveLogRoll should handle thread
Interrupted
Key: HDFS-17250
URL: https://issues.apache.org/jira/browse/HDFS-17250
Project: Hadoop HDFS
Haiyang Hu created HDFS-17247:
-
Summary: Improve
AvailableSpaceRackFaultTolerantBlockPlacementPolicy logic
Key: HDFS-17247
URL: https://issues.apache.org/jira/browse/HDFS-17247
Project: Hadoop HDFS
Haiyang Hu created HDFS-17243:
-
Summary: Add the parameter storage type for getBlocks method
Key: HDFS-17243
URL: https://issues.apache.org/jira/browse/HDFS-17243
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-17235:
-
Summary: Fix javadoc errors in BlockManager
Key: HDFS-17235
URL: https://issues.apache.org/jira/browse/HDFS-17235
Project: Hadoop HDFS
Issue Type: Improvement
Haiyang Hu created HDFS-17217:
-
Summary: Add lifeline RPC start up log when
NameNode#startCommonServices
Key: HDFS-17217
URL: https://issues.apache.org/jira/browse/HDFS-17217
Project: Hadoop HDFS
Haiyang Hu created HDFS-17208:
-
Summary: Add the metrics PendingAsyncDiskOperations in datanode
Key: HDFS-17208
URL: https://issues.apache.org/jira/browse/HDFS-17208
Project: Hadoop HDFS
Issue
Haiyang Hu created HDFS-17205:
-
Summary: HdfsServerConstants.MIN_BLOCKS_FOR_WRITE should be
configurable
Key: HDFS-17205
URL: https://issues.apache.org/jira/browse/HDFS-17205
Project: Hadoop HDFS
Haiyang Hu created HDFS-17194:
-
Summary: Enhance the log message for striped block recovery
Key: HDFS-17194
URL: https://issues.apache.org/jira/browse/HDFS-17194
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-17184:
-
Summary: In BlockReceiver method need throw DiskOutOfSpaceException
Key: HDFS-17184
URL: https://issues.apache.org/jira/browse/HDFS-17184
Project: Hadoop HDFS
Haiyang Hu created HDFS-17177:
-
Summary: ErasureCodingWork reconstruct ignore the block length is
Long.MAX_VALUE.
Key: HDFS-17177
URL: https://issues.apache.org/jira/browse/HDFS-17177
Project: Hadoop
Haiyang Hu created HDFS-17172:
-
Summary: Support FSNamesystemLock Parameters reconfigurable
Key: HDFS-17172
URL: https://issues.apache.org/jira/browse/HDFS-17172
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-17137:
-
Summary: Standby/Observer NameNode should not handle redundant
replica block logic when set decrease replication
Key: HDFS-17137
URL: https://issues.apache.org/jira/browse/HDFS
Haiyang Hu created HDFS-17135:
-
Summary: Fsck -blockId display excess state info of blocks
accurately
Key: HDFS-17135
URL: https://issues.apache.org/jira/browse/HDFS-17135
Project: Hadoop HDFS
Haiyang Hu created HDFS-17117:
-
Summary: BlockManager#processMisReplicatesAsync can periodically
print reconstructionQueuesInitProgress
Key: HDFS-17117
URL: https://issues.apache.org/jira/browse/HDFS-17117
Haiyang Hu created HDFS-17116:
-
Summary: Reset startupTime and enterSafeModeTime if check time
interval is negative during router safe mode exit check
Key: HDFS-17116
URL: https://issues.apache.org/jira/browse/HDFS
Haiyang Hu created HDFS-17088:
-
Summary: Improve the debug verifyEC and dfsrouteradmin commands in
HDFSCommands.md
Key: HDFS-17088
URL: https://issues.apache.org/jira/browse/HDFS-17088
Project: Hadoop
Haiyang Hu created HDFS-17087:
-
Summary: Add Throttler for datanode reading block
Key: HDFS-17087
URL: https://issues.apache.org/jira/browse/HDFS-17087
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-17086:
-
Summary: Fix the parameter settings in
TestDiskspaceQuotaUpdate#updateCountForQuota.
Key: HDFS-17086
URL: https://issues.apache.org/jira/browse/HDFS-17086
Project: Hadoop
Haiyang Hu created HDFS-17082:
-
Summary: Add documentation for provisionSnapshotTrash command to
HDFSCommands.md and HdfsSnapshots.md
Key: HDFS-17082
URL: https://issues.apache.org/jira/browse/HDFS-17082
Haiyang Hu created HDFS-17081:
-
Summary: Append ec file check if a block is replicated to at least
the minimum replication need consider ec block
Key: HDFS-17081
URL: https://issues.apache.org/jira/browse/HDFS-17081
Haiyang Hu created HDFS-17076:
-
Summary: Remove the unused method isSlownodeByNameserviceId in
DataNode
Key: HDFS-17076
URL: https://issues.apache.org/jira/browse/HDFS-17076
Project: Hadoop HDFS
Haiyang Hu created HDFS-17075:
-
Summary: Reconfig disk balancer parameters for datanode
Key: HDFS-17075
URL: https://issues.apache.org/jira/browse/HDFS-17075
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-17073:
-
Summary: Enhance the warning message output for
BlockGroupNonStripedChecksumComputer#compute
Key: HDFS-17073
URL: https://issues.apache.org/jira/browse/HDFS-17073
Project
Haiyang Hu created HDFS-17064:
-
Summary: Document the usage of the new Balancer "sortTopNodes" and
"hotBlockTimeInterval" parameter
Key: HDFS-17064
URL: https://issues.apache.org/ji
Haiyang Hu created HDFS-17057:
-
Summary: Add DataNode maintenance states to Federation UI
Key: HDFS-17057
URL: https://issues.apache.org/jira/browse/HDFS-17057
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-17044:
-
Summary: Process reported block toInvalidate logic should set the
block size to NO_ACK
Key: HDFS-17044
URL: https://issues.apache.org/jira/browse/HDFS-17044
Project
Haiyang Hu created HDFS-17019:
-
Summary: Optimize the logic for reconfigure slow peer enable for
Namenode
Key: HDFS-17019
URL: https://issues.apache.org/jira/browse/HDFS-17019
Project: Hadoop HDFS
Haiyang Hu created HDFS-17017:
-
Summary: Fix the issue of parameter length limit in report command
in DFSAdmin.
Key: HDFS-17017
URL: https://issues.apache.org/jira/browse/HDFS-17017
Project: Hadoop HDFS
Haiyang Hu created HDFS-16927:
-
Summary: Command rollingUpgrade query need to get current rolling
upgrade status of each namenode in the nameservice
Key: HDFS-16927
URL: https://issues.apache.org/jira/browse/HDFS
Haiyang Hu created HDFS-16926:
-
Summary: Fix Typo of ImageServlet#Put()
Key: HDFS-16926
URL: https://issues.apache.org/jira/browse/HDFS-16926
Project: Hadoop HDFS
Issue Type: Improvement
Haiyang Hu created HDFS-16910:
-
Summary: Fix incorrectly initializing RandomAccessFile caused PRC
performance decreased for JN
Key: HDFS-16910
URL: https://issues.apache.org/jira/browse/HDFS-16910
Haiyang Hu created HDFS-16892:
-
Summary: Fix method name of RPC.Builder#setnumReaders
Key: HDFS-16892
URL: https://issues.apache.org/jira/browse/HDFS-16892
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-16888:
-
Summary: BlockManager#maxReplicationStreams,
replicationStreamsHardLimit, blocksReplWorkMultiplier and
PendingReconstructionBlocks#timeout should be volatile
Key: HDFS-16888
URL
Haiyang Hu created HDFS-16885:
-
Summary: Fix
TestHdfsConfigFields#testCompareConfigurationClassAgainstXml failed
Key: HDFS-16885
URL: https://issues.apache.org/jira/browse/HDFS-16885
Project: Hadoop HDFS
Haiyang Hu created HDFS-16884:
-
Summary: Fix TestFsDatasetImpl#testConcurrentWriteAndDeleteBlock
failed
Key: HDFS-16884
URL: https://issues.apache.org/jira/browse/HDFS-16884
Project: Hadoop HDFS
Haiyang Hu created HDFS-16879:
-
Summary: EC : Fsck -blockId shows number of redundant internal
block replicas for EC files
Key: HDFS-16879
URL: https://issues.apache.org/jira/browse/HDFS-16879
Project
Haiyang Hu created HDFS-16841:
-
Summary: Enhance the function of DebugAdmin#VerifyECCommand
Key: HDFS-16841
URL: https://issues.apache.org/jira/browse/HDFS-16841
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-16840:
-
Summary: Add sp and ec policy opiton description about oiv in
HDFSCommands.md
Key: HDFS-16840
URL: https://issues.apache.org/jira/browse/HDFS-16840
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-16810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haiyang Hu resolved HDFS-16810.
---
Resolution: Won't Do
> Support
[
https://issues.apache.org/jira/browse/HDFS-16810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haiyang Hu reopened HDFS-16810:
---
> Support to make
> dfs.namenode.decommission.backoff.monitor.pending.blocks.per.lock
> recon
[
https://issues.apache.org/jira/browse/HDFS-16810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haiyang Hu resolved HDFS-16810.
---
Resolution: Done
> Support to m
Haiyang Hu created HDFS-16819:
-
Summary: Remove the redundant write lock in
FsDatasetImpl#createTemporary
Key: HDFS-16819
URL: https://issues.apache.org/jira/browse/HDFS-16819
Project: Hadoop HDFS
Haiyang Hu created HDFS-16817:
-
Summary: Remove useless DataNode lock related configuration
Key: HDFS-16817
URL: https://issues.apache.org/jira/browse/HDFS-16817
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-16813:
-
Summary: Remove parameter validation logic such as
dfs.namenode.decommission.blocks.per.interval in DatanodeAdminManager#activate
Key: HDFS-16813
URL: https://issues.apache.org/jira
Haiyang Hu created HDFS-16812:
-
Summary: Support refresh the decommission manager at runtime
Key: HDFS-16812
URL: https://issues.apache.org/jira/browse/HDFS-16812
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-16811:
-
Summary: 5. Support to make
dfs.namenode.decommission.backoff.monitor.pending.limit reconfigurable
Key: HDFS-16811
URL: https://issues.apache.org/jira/browse/HDFS-16811
Haiyang Hu created HDFS-16810:
-
Summary: 4. Support to make
dfs.namenode.decommission.backoff.monitor.pending.blocks.per.lock
reconfigurable
Key: HDFS-16810
URL: https://issues.apache.org/jira/browse/HDFS-16810
Haiyang Hu created HDFS-16805:
-
Summary: Support set the number of RPC Readers according to
different RPC Servers in NameNode
Key: HDFS-16805
URL: https://issues.apache.org/jira/browse/HDFS-16805
Project
[
https://issues.apache.org/jira/browse/HDFS-16786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haiyang Hu resolved HDFS-16786.
---
Resolution: Duplicate
> RBF: Create -addNamespace method in dfsrouterad
Haiyang Hu created HDFS-16786:
-
Summary: Create addNamespace method in dfsrouteradmin
Key: HDFS-16786
URL: https://issues.apache.org/jira/browse/HDFS-16786
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-16775:
-
Summary: Improve BlockPlacementPolicyRackFaultTolerant's chooseOnce
Key: HDFS-16775
URL: https://issues.apache.org/jira/browse/HDFS-16775
Project: Hadoop
Haiyang Hu created HDFS-16774:
-
Summary: Improve async delete replica on datanode
Key: HDFS-16774
URL: https://issues.apache.org/jira/browse/HDFS-16774
Project: Hadoop HDFS
Issue Type
Haiyang Hu created HDFS-16314:
-
Summary: Support to
makedfs.namenode.block-placement-policy.exclude-slow-nodes.enabled
reconfigurable
Key: HDFS-16314
URL: https://issues.apache.org/jira/browse/HDFS-16314
Haiyang Hu created HDFS-16306:
-
Summary: Stale record should be remove when
DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson
Key: HDFS-16306
URL: https://issues.apache.org/jira/browse/HDFS-16306
Haiyang Hu created HDFS-16287:
-
Summary: Support to make dfs.namenode.avoid.read.slow.datanode and
dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable
Key: HDFS-16287
URL: https
Haiyang Hu created HDFS-16247:
-
Summary: RBF: Fix the ProcessingAvgTime and ProxyAvgTime code
comments and document metrics describe ms unit
Key: HDFS-16247
URL: https://issues.apache.org/jira/browse/HDFS-16247
Haiyang Hu created HDFS-16231:
-
Summary: Fix TestDataNodeMetrics#testReceivePacketSlowMetrics
Key: HDFS-16231
URL: https://issues.apache.org/jira/browse/HDFS-16231
Project: Hadoop HDFS
Issue
Haiyang Hu created HDFS-15998:
-
Summary: Fix NullPointException In listOpenFiles
Key: HDFS-15998
URL: https://issues.apache.org/jira/browse/HDFS-15998
Project: Hadoop HDFS
Issue Type: Bug
Haiyang Hu created HDFS-15889:
-
Summary: Erasure Coding: Limit the number of concurrent EC
Reconstruct blocks in NameNode
Key: HDFS-15889
URL: https://issues.apache.org/jira/browse/HDFS-15889
Project
Haiyang Hu created HDFS-15877:
-
Summary: BlockReconstructionWork should resetTargets() before
BlockManager#validateReconstructionWork return false
Key: HDFS-15877
URL: https://issues.apache.org/jira/browse/HDFS-15877
84 matches
Mail list logo
