Xiaobing Zhou created HDFS-9000:
---
Summary: Allow reconfiguration without restart for parameters
where applicable.
Key: HDFS-9000
URL: https://issues.apache.org/jira/browse/HDFS-9000
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou reopened HDFS-9000:
-
Reopen it as umbrella. There are much work to do.
> Allow reconfiguration without restart for paramete
Xiaobing Zhou created HDFS-9094:
---
Summary: Add command line option to ask NameNode reload
configuration.
Key: HDFS-9094
URL: https://issues.apache.org/jira/browse/HDFS-9094
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-9140:
---
Summary: Discover conf parameters that need NN/DN restart to make
changes effective
Key: HDFS-9140
URL: https://issues.apache.org/jira/browse/HDFS-9140
Project: Hadoop
Xiaobing Zhou created HDFS-9214:
---
Summary: Reconfigure DN concurrent move on the fly
Key: HDFS-9214
URL: https://issues.apache.org/jira/browse/HDFS-9214
Project: Hadoop HDFS
Issue Type: Sub-tas
Xiaobing Zhou created HDFS-9262:
---
Summary: Reconfigure lazy writer interval on the fly
Key: HDFS-9262
URL: https://issues.apache.org/jira/browse/HDFS-9262
Project: Hadoop HDFS
Issue Type: Sub-t
Xiaobing Zhou created HDFS-9330:
---
Summary: Reconfigure deleting duplicate replica on the fly
Key: HDFS-9330
URL: https://issues.apache.org/jira/browse/HDFS-9330
Project: Hadoop HDFS
Issue Type:
Xiaobing Zhou created HDFS-9349:
---
Summary: Reconfigure NN protected directories on the fly
Key: HDFS-9349
URL: https://issues.apache.org/jira/browse/HDFS-9349
Project: Hadoop HDFS
Issue Type: S
Xiaobing Zhou created HDFS-9414:
---
Summary: Moving reconfiguration protocol out of
ClientDatanodeProtocol for reusability
Key: HDFS-9414
URL: https://issues.apache.org/jira/browse/HDFS-9414
Project: Hado
Xiaobing Zhou created HDFS-9461:
---
Summary: DiskBalancer: Add Report Command
Key: HDFS-9461
URL: https://issues.apache.org/jira/browse/HDFS-9461
Project: Hadoop HDFS
Issue Type: Sub-task
Xiaobing Zhou created HDFS-9462:
---
Summary: DiskBalancer: Add Query Command
Key: HDFS-9462
URL: https://issues.apache.org/jira/browse/HDFS-9462
Project: Hadoop HDFS
Issue Type: Sub-task
Xiaobing Zhou created HDFS-9526:
---
Summary: DiskBalancer: change htrace...JsonIgnore to
codehaus...JsonIgnore
Key: HDFS-9526
URL: https://issues.apache.org/jira/browse/HDFS-9526
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-9550:
---
Summary: DiskBalancer: Add Run Command
Key: HDFS-9550
URL: https://issues.apache.org/jira/browse/HDFS-9550
Project: Hadoop HDFS
Issue Type: Sub-task
Xiaobing Zhou created HDFS-9564:
---
Summary: DiskBalancer: Refactor Execute Command
Key: HDFS-9564
URL: https://issues.apache.org/jira/browse/HDFS-9564
Project: Hadoop HDFS
Issue Type: Sub-task
Xiaobing Zhou created HDFS-9563:
---
Summary: DiskBalancer: Refactor Plan Command
Key: HDFS-9563
URL: https://issues.apache.org/jira/browse/HDFS-9563
Project: Hadoop HDFS
Issue Type: Sub-task
Xiaobing Zhou created HDFS-9759:
---
Summary: Fix the typo in
JvmPauseMonitor#getNumGcWarnThreadholdExceeded
Key: HDFS-9759
URL: https://issues.apache.org/jira/browse/HDFS-9759
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-9790:
---
Summary: HDFS Balancer should exit with a proper message if
upgrade is not finalized
Key: HDFS-9790
URL: https://issues.apache.org/jira/browse/HDFS-9790
Project: Hadoop
Xiaobing Zhou created HDFS-9824:
---
Summary: Unfriendly message while running rename command if target
exists
Key: HDFS-9824
URL: https://issues.apache.org/jira/browse/HDFS-9824
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-9824.
-
Resolution: Invalid
Release Note: I verified this doesn't exist in 3.0 any more. Closed it as
Xiaobing Zhou created HDFS-9892:
---
Summary: Add servlet support for NameNode reconfiguration
Key: HDFS-9892
URL: https://issues.apache.org/jira/browse/HDFS-9892
Project: Hadoop HDFS
Issue Type:
Xiaobing Zhou created HDFS-9893:
---
Summary: Add HTTP servlet support for DataNode reconfiguration
Key: HDFS-9893
URL: https://issues.apache.org/jira/browse/HDFS-9893
Project: Hadoop HDFS
Issue T
Xiaobing Zhou created HDFS-9894:
---
Summary: Add unsetStoragePolicy API to
FileContext/AbstractFileSystem and derivatives
Key: HDFS-9894
URL: https://issues.apache.org/jira/browse/HDFS-9894
Project: Hadoo
Xiaobing Zhou created HDFS-9895:
---
Summary: Remove all cached configuration from NN/DN
Key: HDFS-9895
URL: https://issues.apache.org/jira/browse/HDFS-9895
Project: Hadoop HDFS
Issue Type: Improv
Xiaobing Zhou created HDFS-9931:
---
Summary: Remove all cached configuration from NameNode
Key: HDFS-9931
URL: https://issues.apache.org/jira/browse/HDFS-9931
Project: Hadoop HDFS
Issue Type: Sub
Xiaobing Zhou created HDFS-10224:
Summary: Augment DistributedFileSystem to support asynchronous
HDFS access
Key: HDFS-10224
URL: https://issues.apache.org/jira/browse/HDFS-10224
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-10334:
Summary: TestHFlush#testHFlushInterrupted and
TestFsDatasetImpl#testCleanShutdownOfVolume failed on trunk
Key: HDFS-10334
URL: https://issues.apache.org/jira/browse/HDFS-10334
Xiaobing Zhou created HDFS-10345:
Summary: Implement an asynchronous DistributedFileSystem
Key: HDFS-10345
URL: https://issues.apache.org/jira/browse/HDFS-10345
Project: Hadoop HDFS
Issue Typ
Xiaobing Zhou created HDFS-10346:
Summary: Implement asynchronous setPermission for
DistributedFileSystem
Key: HDFS-10346
URL: https://issues.apache.org/jira/browse/HDFS-10346
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-8696:
---
Summary: Small reads are blocked by large long running reads
Key: HDFS-8696
URL: https://issues.apache.org/jira/browse/HDFS-8696
Project: Hadoop HDFS
Issue Typ
Xiaobing Zhou created HDFS-8861:
---
Summary: Remove unnecessary log from method
FSNamesystem.getCorruptFiles
Key: HDFS-8861
URL: https://issues.apache.org/jira/browse/HDFS-8861
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-8910:
---
Summary: Downgrade log "Operation category READ is not supported
in state..." to DEBUG level.
Key: HDFS-8910
URL: https://issues.apache.org/jira/browse/HDFS-8910
Projec
Xiaobing Zhou created HDFS-10350:
Summary: Implement asynchronous setOwner for DistributedFileSystem
Key: HDFS-10350
URL: https://issues.apache.org/jira/browse/HDFS-10350
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-10345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-10345.
--
Resolution: Duplicate
Closed this as a duplicate of HDFS-9924.
> [umbrella] Implement an asynch
[
https://issues.apache.org/jira/browse/HDFS-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-10350.
--
Resolution: Won't Fix
Resolved this one since it's been merged to HDFS-10346.
> Implement async
Xiaobing Zhou created HDFS-10390:
Summary: Implement asynchronous setAcl/getAclStatus for
DistributedFileSystem
Key: HDFS-10390
URL: https://issues.apache.org/jira/browse/HDFS-10390
Project: Hadoop HD
Xiaobing Zhou created HDFS-10392:
Summary: Test failures on trunk: TestEditLog and
TestReconstructStripedBlocks
Key: HDFS-10392
URL: https://issues.apache.org/jira/browse/HDFS-10392
Project: Hadoop HD
Xiaobing Zhou created HDFS-10405:
Summary: Test failure on trunk: TestEditLog
Key: HDFS-10405
URL: https://issues.apache.org/jira/browse/HDFS-10405
Project: Hadoop HDFS
Issue Type: Bug
Af
Xiaobing Zhou created HDFS-10406:
Summary: Test failure on trunk: TestReconstructStripedBlocks
Key: HDFS-10406
URL: https://issues.apache.org/jira/browse/HDFS-10406
Project: Hadoop HDFS
Issue
[
https://issues.apache.org/jira/browse/HDFS-10392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-10392.
--
Resolution: Duplicate
Resolved this since it's been split into two separate Jiras: HDFS-10405 an
Xiaobing Zhou created HDFS-10408:
Summary: Add tests for out-of-order asynchronous
rename/setPermission/setOwner
Key: HDFS-10408
URL: https://issues.apache.org/jira/browse/HDFS-10408
Project: Hadoop H
Xiaobing Zhou created HDFS-10413:
Summary: Implement asynchronous listStatus for
DistributedFileSystem
Key: HDFS-10413
URL: https://issues.apache.org/jira/browse/HDFS-10413
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-10430:
Summary: Refactor FileSystem#checkAccessPermissions for better
reuse from tests
Key: HDFS-10430
URL: https://issues.apache.org/jira/browse/HDFS-10430
Project: Hadoop
Xiaobing Zhou created HDFS-10431:
Summary: Refactor Async DFS related tests to reuse shared
AsyncDistributedFileSystem instance to speed up tests
Key: HDFS-10431
URL: https://issues.apache.org/jira/browse/HDFS-104
Xiaobing Zhou created HDFS-10433:
Summary: Make retry also works well for Async DFS
Key: HDFS-10433
URL: https://issues.apache.org/jira/browse/HDFS-10433
Project: Hadoop HDFS
Issue Type: Sub-
Xiaobing Zhou created HDFS-10444:
Summary: Refactor tests by moving irrevelant parts out of
TestAsyncDFSRename
Key: HDFS-10444
URL: https://issues.apache.org/jira/browse/HDFS-10444
Project: Hadoop HDF
Xiaobing Zhou created HDFS-10445:
Summary: Add timeout tests for asynchronous async DFS API
Key: HDFS-10445
URL: https://issues.apache.org/jira/browse/HDFS-10445
Project: Hadoop HDFS
Issue Ty
Xiaobing Zhou created HDFS-10446:
Summary: Add interleaving tests for asynchronous async DFS API
Key: HDFS-10446
URL: https://issues.apache.org/jira/browse/HDFS-10446
Project: Hadoop HDFS
Iss
[
https://issues.apache.org/jira/browse/HDFS-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-10444.
--
Resolution: Duplicate
Mark this as duplicate since it's been addressed in HDFS-10431.
> Refacto
Xiaobing Zhou created HDFS-10503:
Summary: DiskBalancer: simplify adding command options
Key: HDFS-10503
URL: https://issues.apache.org/jira/browse/HDFS-10503
Project: Hadoop HDFS
Issue Type
Xiaobing Zhou created HDFS-10514:
Summary: Augment QueryDiskBalancerPlan to return storage type of
source/dest volume
Key: HDFS-10514
URL: https://issues.apache.org/jira/browse/HDFS-10514
Project: Had
[
https://issues.apache.org/jira/browse/HDFS-9563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-9563.
-
Resolution: Invalid
I closed this, as the code base evolved much, the refactoring proposed in the
[
https://issues.apache.org/jira/browse/HDFS-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-9564.
-
Resolution: Invalid
I closed this, as the code base evolved much, the refactoring proposed in the
Xiaobing Zhou created HDFS-10538:
Summary: Remove AsyncDistributedFileSystem
Key: HDFS-10538
URL: https://issues.apache.org/jira/browse/HDFS-10538
Project: Hadoop HDFS
Issue Type: Sub-task
Xiaobing Zhou created HDFS-10550:
Summary: DiskBalancer: fix issue of order dependency in iteration
in ReportCommand test
Key: HDFS-10550
URL: https://issues.apache.org/jira/browse/HDFS-10550
Project:
Xiaobing Zhou created HDFS-10571:
Summary: TestDiskBalancerCommand#testPlanNode failed with
IllegalArgumentException
Key: HDFS-10571
URL: https://issues.apache.org/jira/browse/HDFS-10571
Project: Hado
Xiaobing Zhou created HDFS-10577:
Summary: Support building MiniDFSCluster from JSON
Key: HDFS-10577
URL: https://issues.apache.org/jira/browse/HDFS-10577
Project: Hadoop HDFS
Issue Type: Sub
Xiaobing Zhou created HDFS-10824:
Summary: MiniDFSCluster#storageCapacities has no effects on real
capacity
Key: HDFS-10824
URL: https://issues.apache.org/jira/browse/HDFS-10824
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-10913:
Summary: Refactor BlockReceiver by introducing faults injector to
enhance testability of detecting slow mirrors
Key: HDFS-10913
URL: https://issues.apache.org/jira/browse/HDFS-109
Xiaobing Zhou created HDFS-10915:
Summary: fix typo in
TestDatanodeRestart#testWaitForRegistrationOnRestart
Key: HDFS-10915
URL: https://issues.apache.org/jira/browse/HDFS-10915
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-10917:
Summary: Maintain various peer performance statistics on DataNode
Key: HDFS-10917
URL: https://issues.apache.org/jira/browse/HDFS-10917
Project: Hadoop HDFS
[
https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou reopened HDFS-10824:
--
> MiniDFSCluster#storageCapacities has no effects on real capacity
> ---
Xiaobing Zhou created HDFS-10949:
Summary: DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity
Key: HDFS-10949
URL: https://issues.apache.org/jira/browse/HDFS-10949
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-10950:
Summary: Add unit tests to verify ACLs in safemode
Key: HDFS-10950
URL: https://issues.apache.org/jira/browse/HDFS-10950
Project: Hadoop HDFS
Issue Type: Sub
[
https://issues.apache.org/jira/browse/HDFS-10950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-10950.
--
Resolution: Invalid
Essentially, test_resetacl calls setAcl, getacl_recursive calls get
getAclS
Xiaobing Zhou created HDFS-10965:
Summary: Add unit test for DFSAdmin#printTopology
Key: HDFS-10965
URL: https://issues.apache.org/jira/browse/HDFS-10965
Project: Hadoop HDFS
Issue Type: Sub-
Xiaobing Zhou created HDFS-10973:
Summary: Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'
Key: HDFS-10973
URL: https://issues.apache.org/jira/browse/HDFS-10973
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-10972:
Summary: Add unit test for HDFS command 'dfsadmin -getDatanodeInfo'
Key: HDFS-10972
URL: https://issues.apache.org/jira/browse/HDFS-10972
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-10981:
Summary: remove print stream maintained in DFSAdmin
Key: HDFS-10981
URL: https://issues.apache.org/jira/browse/HDFS-10981
Project: Hadoop HDFS
Issue Type: Bu
Xiaobing Zhou created HDFS-10998:
Summary: Add unit tests for some other dfsadmin commands
Key: HDFS-10998
URL: https://issues.apache.org/jira/browse/HDFS-10998
Project: Hadoop HDFS
Issue Typ
Xiaobing Zhou created HDFS-11011:
Summary: Add unit test for HDFS command 'dfsadmin
-set/clearSpaceQuota'
Key: HDFS-11011
URL: https://issues.apache.org/jira/browse/HDFS-11011
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-11016:
Summary: Add unit test for HDFS command 'dfsadmin -set/clearQuota'
Key: HDFS-11016
URL: https://issues.apache.org/jira/browse/HDFS-11016
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-11017:
Summary: dfsadmin set/clrSpaceQuota fail to recognize StorageType
option
Key: HDFS-11017
URL: https://issues.apache.org/jira/browse/HDFS-11017
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-11037:
Summary: DiskBalancer: redirect stdout/stderr stream for easy tests
Key: HDFS-11037
URL: https://issues.apache.org/jira/browse/HDFS-11037
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-11038:
Summary: DiskBalancer: support running multiple commands under one
setup of disk balancer
Key: HDFS-11038
URL: https://issues.apache.org/jira/browse/HDFS-11038
Projec
[
https://issues.apache.org/jira/browse/HDFS-11038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-11038.
--
Resolution: Implemented
As explained, it's already implemented in HDFS-9462 patch. Closed this t
[
https://issues.apache.org/jira/browse/HDFS-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou resolved HDFS-11017.
--
Resolution: Invalid
It seems there's a flaky error in my script. It's not an issue anymore, than
Xiaobing Zhou created HDFS-11047:
Summary: Remove deep copies of FinalizedReplica to alleviate heap
consumption on DataNode
Key: HDFS-11047
URL: https://issues.apache.org/jira/browse/HDFS-11047
Projec
Xiaobing Zhou created HDFS-11052:
Summary: TestPersistBlocks#TestRestartDfsWithFlush flaky failure
Key: HDFS-11052
URL: https://issues.apache.org/jira/browse/HDFS-11052
Project: Hadoop HDFS
I
[
https://issues.apache.org/jira/browse/HDFS-11038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaobing Zhou reopened HDFS-11038:
--
Reopened this ticket since HDFS-9462 will be deprecated in that some of work
overlaps with Query co
Xiaobing Zhou created HDFS-11065:
Summary: Add space quota tests for heterogenous storages
Key: HDFS-11065
URL: https://issues.apache.org/jira/browse/HDFS-11065
Project: Hadoop HDFS
Issue Typ
Xiaobing Zhou created HDFS-11079:
Summary: Accelerate TestQuotaByStorageType using shared
MiniDFSCluster
Key: HDFS-11079
URL: https://issues.apache.org/jira/browse/HDFS-11079
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-11089:
Summary: Accelerate TestDiskBalancerCommand using static shared
MiniDFSCluster
Key: HDFS-11089
URL: https://issues.apache.org/jira/browse/HDFS-11089
Project: Hadoop H
Xiaobing Zhou created HDFS-11107:
Summary: TestStartup#testStorageBlockContentsStaleAfterNNRestart
flaky failure
Key: HDFS-11107
URL: https://issues.apache.org/jira/browse/HDFS-11107
Project: Hadoop H
Xiaobing Zhou created HDFS-11194:
Summary: Maintain aggregated peer performance metrics on NameNode
Key: HDFS-11194
URL: https://issues.apache.org/jira/browse/HDFS-11194
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-11476:
Summary: Fix NPE in FsDatasetImpl#checkAndUpdate
Key: HDFS-11476
URL: https://issues.apache.org/jira/browse/HDFS-11476
Project: Hadoop HDFS
Issue Type: Bug
Xiaobing Zhou created HDFS-11488:
Summary: Fix failure of
TestDataNodeVolumeFailureReporting#testVolFailureStatsPreservedOnNNRestart
Key: HDFS-11488
URL: https://issues.apache.org/jira/browse/HDFS-11488
Xiaobing Zhou created HDFS-11534:
Summary: Add counters for number of blocks in pending IBR
Key: HDFS-11534
URL: https://issues.apache.org/jira/browse/HDFS-11534
Project: Hadoop HDFS
Issue Ty
Xiaobing Zhou created HDFS-11536:
Summary: Suppress logs in BlockReceiver when peer is slow
Key: HDFS-11536
URL: https://issues.apache.org/jira/browse/HDFS-11536
Project: Hadoop HDFS
Issue Ty
Xiaobing Zhou created HDFS-11547:
Summary: Restore logs for slow BlockReceiver while writing data to
disk
Key: HDFS-11547
URL: https://issues.apache.org/jira/browse/HDFS-11547
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-11608:
Summary: HDFS write crashed in the case of huge block size
Key: HDFS-11608
URL: https://issues.apache.org/jira/browse/HDFS-11608
Project: Hadoop HDFS
Issue T
Xiaobing Zhou created HDFS-11628:
Summary: Clarify behaviors of HDFS Mover in documentation
Key: HDFS-11628
URL: https://issues.apache.org/jira/browse/HDFS-11628
Project: Hadoop HDFS
Issue Ty
Xiaobing Zhou created HDFS-11800:
Summary: Document output of 'hdfs count -u' should contain PATHNAME
Key: HDFS-11800
URL: https://issues.apache.org/jira/browse/HDFS-11800
Project: Hadoop HDFS
Xiaobing Zhou created HDFS-11803:
Summary: Add -v option for du command to show header line
Key: HDFS-11803
URL: https://issues.apache.org/jira/browse/HDFS-11803
Project: Hadoop HDFS
Issue Ty
93 matches
Mail list logo