[jira] [Updated] (HDFS-8224) Schedule a block for scanning if its metadata file is corrupt

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8224: - Fix Version/s: (was: 2.9.0) > Schedule a block for scanning if its metadata file is corrupt >

[jira] [Updated] (HDFS-10869) Remove the unused method InodeId#checkId()

2017-01-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10869: -- Fix Version/s: (was: 2.9.0) > Remove the unused method InodeId#checkId() >

[jira] [Updated] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9478: - Fix Version/s: 2.8.0 > Reason for failing ipc.FairCallQueue contruction should be thrown >

[jira] [Updated] (HDFS-9772) TestBlockReplacement#testThrottler doesn't work as expected

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9772: - Fix Version/s: 2.8.0 > TestBlockReplacement#testThrottler doesn't work as expected >

[jira] [Updated] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9661: - Fix Version/s: 2.8.0 > Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw >

[jira] [Updated] (HDFS-9654) Code refactoring for HDFS-8578

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9654: - Fix Version/s: 2.8.0 > Code refactoring for HDFS-8578 > -- > >

[jira] [Updated] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9434: - Fix Version/s: 2.8.0 > Recommission a datanode with 500k blocks may pause NN for 30 seconds >

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6481: - Fix Version/s: 2.8.0 > DatanodeManager#getDatanodeStorageInfos() should check the length of > storageIDs

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8950: - Fix Version/s: 2.8.0 > NameNode refresh doesn't remove DataNodes that are no longer in the allowed > list

[jira] [Updated] (HDFS-8867) Enable optimized block reports

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8867: - Fix Version/s: 2.8.0 > Enable optimized block reports > -- > >

[jira] [Updated] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8879: - Fix Version/s: 2.8.0 > Quota by storage type usage incorrectly initialized upon namenode restart >

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9669: - Fix Version/s: 2.8.0 > TcpPeerServer should respect ipc.server.listen.queue.size >

[jira] [Updated] (HDFS-9305) Delayed heartbeat processing causes storm of subsequent heartbeats

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9305: - Fix Version/s: 2.8.0 > Delayed heartbeat processing causes storm of subsequent heartbeats >

[jira] [Updated] (HDFS-7164) Feature documentation for HDFS-6581

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7164: - Fix Version/s: 2.8.0 > Feature documentation for HDFS-6581 > --- > >

[jira] [Updated] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9221: - Fix Version/s: 2.8.0 > HdfsServerConstants#ReplicaState#getState should avoid calling values() since > it

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8522: - Fix Version/s: 2.8.0 > Change heavily recorded NN logs from INFO to DEBUG level >

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation "fsck -showprogress" from branch-2

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8523: - Fix Version/s: 2.8.0 > Remove usage information on unsupported operation "fsck -showprogress" from >

[jira] [Updated] (HDFS-8583) Document that NFS gateway does not work with rpcbind on SLES 11

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8583: - Fix Version/s: 2.8.0 > Document that NFS gateway does not work with rpcbind on SLES 11 >

[jira] [Updated] (HDFS-8566) HDFS documentation about debug commands wrongly identifies them as "hdfs dfs" commands

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8566: - Fix Version/s: 2.8.0 > HDFS documentation about debug commands wrongly identifies them as "hdfs dfs" >

[jira] [Updated] (HDFS-8576) Lease recovery should return true if the lease can be released and the file can be closed

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8576: - Fix Version/s: 2.8.0 > Lease recovery should return true if the lease can be released and the file > can

[jira] [Updated] (HDFS-8595) TestCommitBlockSynchronization fails in branch-2.7

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8595: - Fix Version/s: 2.8.0 > TestCommitBlockSynchronization fails in branch-2.7 >

[jira] [Updated] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9569: - Fix Version/s: 2.8.0 > Log the name of the fsimage being loaded for better supportability >

[jira] [Updated] (HDFS-9648) TestStartup.testImageChecksum is broken by HDFS-9569's message change

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9648: - Fix Version/s: 2.8.0 > TestStartup.testImageChecksum is broken by HDFS-9569's message change >

[jira] [Updated] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8521: - Fix Version/s: 2.8.0 > Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}} >

[jira] [Updated] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8581: - Fix Version/s: 2.8.0 > ContentSummary on / skips further counts on yielding lock >

[jira] [Updated] (HDFS-9043) Doc updation for commands in HDFS Federation

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9043: - Fix Version/s: 2.8.0 > Doc updation for commands in HDFS Federation >

[jira] [Updated] (HDFS-9042) Update document for the Storage policy name

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9042: - Fix Version/s: 2.8.0 > Update document for the Storage policy name >

[jira] [Updated] (HDFS-8633) Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8633: - Fix Version/s: 2.8.0 > Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match >

[jira] [Updated] (HDFS-8101) DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8101: - Fix Version/s: 2.8.0 > DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at > runtime

[jira] [Updated] (HDFS-8099) Change "DFSInputStream has been closed already" message to debug log level

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8099: - Fix Version/s: 2.8.0 > Change "DFSInputStream has been closed already" message to debug log level >

[jira] [Updated] (HDFS-10347) Namenode report bad block method doesn't log the bad block or datanode.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10347: -- Fix Version/s: 2.8.0 > Namenode report bad block method doesn't log the bad block or datanode. >

[jira] [Updated] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8384: - Fix Version/s: 2.8.0 > Allow NN to startup if there are files having a lease but are not under >

[jira] [Updated] (HDFS-8405) Fix a typo in NamenodeFsck

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8405: - Fix Version/s: 2.8.0 > Fix a typo in NamenodeFsck > -- > > Key:

[jira] [Updated] (HDFS-10186) DirectoryScanner: Improve logs by adding full path of both actual and expected block directories

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10186: -- Fix Version/s: 2.8.0 > DirectoryScanner: Improve logs by adding full path of both actual and >

[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10319: -- Fix Version/s: 2.8.0 > Balancer should not try to pair storages with different types >

[jira] [Updated] (HDFS-7546) Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7546: - Fix Version/s: 2.8.0 > Document, and set an accepting default for >

[jira] [Updated] (HDFS-8151) Always use snapshot path as source when invalid snapshot names are used for diff based distcp

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8151: - Fix Version/s: 2.8.0 > Always use snapshot path as source when invalid snapshot names are used for > diff

[jira] [Updated] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8204: - Fix Version/s: 2.8.0 > Mover/Balancer should not schedule two replicas to the same DN >

[jira] [Updated] (HDFS-7931) DistributedFIleSystem should not look for keyProvider in cache if Encryption is disabled

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7931: - Fix Version/s: 2.8.0 > DistributedFIleSystem should not look for keyProvider in cache if Encryption > is

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9574: - Fix Version/s: 2.8.0 > Reduce client failures during datanode restart >

[jira] [Updated] (HDFS-9033) dfsadmin -metasave prints "NaN" for cache used%

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9033: - Fix Version/s: 2.8.0 > dfsadmin -metasave prints "NaN" for cache used% >

[jira] [Updated] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9740: - Fix Version/s: 2.8.0 > Use a reasonable limit in DFSTestUtil.waitForMetric() >

[jira] [Updated] (HDFS-9730) Storage ID update does not happen when there is a layout change

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9730: - Fix Version/s: 2.8.0 > Storage ID update does not happen when there is a layout change >

[jira] [Updated] (HDFS-9690) ClientProtocol.addBlock is not idempotent after HDFS-8071

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9690: - Fix Version/s: 2.8.0 > ClientProtocol.addBlock is not idempotent after HDFS-8071 >

[jira] [Updated] (HDFS-9431) DistributedFileSystem#concat fails if the target path is relative.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9431: - Fix Version/s: 2.8.0 > DistributedFileSystem#concat fails if the target path is relative. >

[jira] [Updated] (HDFS-9365) Balancer does not work with the HDFS-6376 HA setup

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9365: - Fix Version/s: 2.8.0 > Balancer does not work with the HDFS-6376 HA setup >

[jira] [Updated] (HDFS-9383) TestByteArrayManager#testByteArrayManager fails

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9383: - Fix Version/s: 2.8.0 > TestByteArrayManager#testByteArrayManager fails >

[jira] [Updated] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9533: - Fix Version/s: 2.8.0 > seen_txid in the shared edits directory is modified during bootstrapping >

[jira] [Updated] (HDFS-9476) TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9476: - Fix Version/s: 2.8.0 > TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail >

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9516: - Fix Version/s: 2.8.0 > truncate file fails with data dirs on multiple disks >

[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9555: - Fix Version/s: 2.8.0 > LazyPersistFileScrubber should still sleep if there are errors in the clear >

[jira] [Updated] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9634: - Fix Version/s: 2.8.0 > webhdfs client side exceptions don't provide enough details >

[jira] [Updated] (HDFS-8597) Fix TestFSImage#testZeroBlockSize on Windows

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8597: - Fix Version/s: 2.8.0 > Fix TestFSImage#testZeroBlockSize on Windows >

[jira] [Updated] (HDFS-8615) Correct HTTP method in WebHDFS document

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8615: - Fix Version/s: 2.8.0 > Correct HTTP method in WebHDFS document > --- >

[jira] [Updated] (HDFS-8659) Block scanner INFO message is spamming logs

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8659: - Fix Version/s: 2.8.0 > Block scanner INFO message is spamming logs >

[jira] [Updated] (HDFS-8772) Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8772: - Fix Version/s: 2.8.0 > Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails >

[jira] [Updated] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7980: - Fix Version/s: 2.8.0 > Incremental BlockReport will dramatically slow down the startup of a namenode >

[jira] [Updated] (HDFS-8091) ACLStatus and XAttributes not properly presented to INodeAttributesProvider before returning to client

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8091: - Fix Version/s: 2.8.0 > ACLStatus and XAttributes not properly presented to INodeAttributesProvider >

[jira] [Updated] (HDFS-8046) Allow better control of getContentSummary

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8046: - Fix Version/s: 2.8.0 > Allow better control of getContentSummary >

[jira] [Updated] (HDFS-8147) Mover should not schedule two replicas to the same DN storage

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8147: - Fix Version/s: 2.8.0 > Mover should not schedule two replicas to the same DN storage >

[jira] [Updated] (HDFS-8404) Pending block replication can get stuck using older genstamp

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8404: - Fix Version/s: 2.8.0 > Pending block replication can get stuck using older genstamp >

[jira] [Updated] (HDFS-8081) Split getAdditionalBlock() into two methods.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8081: - Fix Version/s: 2.8.0 > Split getAdditionalBlock() into two methods. >

[jira] [Updated] (HDFS-8361) Choose SSD over DISK in block placement

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8361: - Fix Version/s: 2.8.0 > Choose SSD over DISK in block placement > --- >

[jira] [Updated] (HDFS-8153) Error Message points to wrong parent directory in case of path component name length error

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8153: - Fix Version/s: 2.8.0 > Error Message points to wrong parent directory in case of path component name >

[jira] [Updated] (HDFS-4937) ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4937: - Fix Version/s: 2.8.0 > ReplicationMonitor can infinite-loop in >

[jira] [Updated] (HDFS-8219) setStoragePolicy with folder behavior is different after cluster restart

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8219: - Fix Version/s: 2.8.0 > setStoragePolicy with folder behavior is different after cluster restart >

[jira] [Updated] (HDFS-8245) Standby namenode doesn't process DELETED_BLOCK if the add block request is in edit log.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8245: - Fix Version/s: 2.8.0 > Standby namenode doesn't process DELETED_BLOCK if the add block request is in >

[jira] [Updated] (HDFS-8270) create() always retried with hardcoded timeout when file already exists with open lease

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8270: - Fix Version/s: 2.8.0 > create() always retried with hardcoded timeout when file already exists with >

[jira] [Updated] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8305: - Fix Version/s: 2.8.0 > HDFS INotify: the destination field of RenameOp should always end with the > file

[jira] [Updated] (HDFS-7314) When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7314: - Fix Version/s: 2.8.0 > When the DFSClient lease cannot be renewed, abort open-for-write files rather >

[jira] [Updated] (HDFS-9880) TestDatanodeRegistration fails occasionally

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9880: - Fix Version/s: 2.8.0 > TestDatanodeRegistration fails occasionally >

[jira] [Updated] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9958: - Fix Version/s: 2.8.0 > BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed >

[jira] [Updated] (HDFS-10239) Fsshell mv fails if port usage doesn't match in src and destination paths

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10239: -- Fix Version/s: 2.8.0 > Fsshell mv fails if port usage doesn't match in src and destination paths >

[jira] [Updated] (HDFS-10372) Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10372: -- Fix Version/s: 2.8.0 > Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume >

[jira] [Updated] (HDFS-10261) TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10261: -- Fix Version/s: 2.8.0 > TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP ports >

[jira] [Updated] (HDFS-10275) TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10275: -- Fix Version/s: 2.8.0 > TestDataNodeMetrics failing intermittently due to TotalWriteTime counted >

[jira] [Updated] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10264: -- Fix Version/s: 2.8.0 > Logging improvements in FSImageFormatProtobuf.Saver >

[jira] [Updated] (HDFS-10182) Hedged read might overwrite user's buf

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10182: -- Fix Version/s: 2.8.0 > Hedged read might overwrite user's buf > --

[jira] [Updated] (HDFS-5215) dfs.datanode.du.reserved is not considered while computing available space

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5215: - Fix Version/s: 2.8.0 > dfs.datanode.du.reserved is not considered while computing available space >

[jira] [Updated] (HDFS-4946) Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-4946: - Fix Version/s: 2.8.0 > Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable >

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7163: - Fix Version/s: 2.8.0 > WebHdfsFileSystem should retry reads according to the configured retry policy. >

[jira] [Updated] (HDFS-8806) Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8806: - Fix Version/s: 2.8.0 > Inconsistent metrics: number of missing blocks with replication factor 1 not >

[jira] [Updated] (HDFS-8846) Add a unit test for INotify functionality across a layout version upgrade

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8846: - Fix Version/s: 2.8.0 > Add a unit test for INotify functionality across a layout version upgrade >

[jira] [Updated] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9917: - Fix Version/s: 2.8.0 > IBR accumulate more objects when SNN was down for sometime. >

[jira] [Updated] (HDFS-8863) The remaining space check in BlockPlacementPolicyDefault is flawed

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8863: - Fix Version/s: 2.8.0 > The remaining space check in BlockPlacementPolicyDefault is flawed >

[jira] [Updated] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8995: - Fix Version/s: 2.8.0 > Flaw in registration bookeeping can make DN die on reconnect >

[jira] [Updated] (HDFS-9724) Degraded performance in WebHDFS listing as it does not reuse ObjectMapper

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9724: - Fix Version/s: 2.8.0 > Degraded performance in WebHDFS listing as it does not reuse ObjectMapper >

[jira] [Updated] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9106: - Fix Version/s: 2.8.0 > Transfer failure during pipeline recovery causes permanent write failures >

[jira] [Updated] (HDFS-9273) ACLs on root directory may be lost after NN restart

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9273: - Fix Version/s: 2.8.0 > ACLs on root directory may be lost after NN restart >

[jira] [Updated] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9413: - Fix Version/s: 2.8.0 > getContentSummary() on standby should throw StandbyException >

[jira] [Updated] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9470: - Fix Version/s: 2.8.0 > Encryption zone on root not loaded from fsimage after NN restart >

[jira] [Updated] (HDFS-9178) Slow datanode I/O can cause a wrong node to be marked bad

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9178: - Fix Version/s: 2.8.0 > Slow datanode I/O can cause a wrong node to be marked bad >

[jira] [Updated] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6945: - Fix Version/s: 2.8.0 > BlockManager should remove a block from excessReplicateMap and decrement >

[jira] [Updated] (HDFS-6300) Prevent multiple balancers from running simultaneously

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6300: - Fix Version/s: 2.8.0 > Prevent multiple balancers from running simultaneously >

[jira] [Updated] (HDFS-9289) Make DataStreamer#block thread safe and verify genStamp in commitBlock

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9289: - Fix Version/s: 2.8.0 > Make DataStreamer#block thread safe and verify genStamp in commitBlock >

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8578: - Fix Version/s: 2.8.0 > On upgrade, Datanode should process all storage/data dirs in parallel >

[jira] [Updated] (HDFS-8656) Preserve compatibility of ClientProtocol#rollingUpgrade after finalization

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8656: - Fix Version/s: 2.8.0 > Preserve compatibility of ClientProtocol#rollingUpgrade after finalization >

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8676: - Fix Version/s: 2.8.0 > Delayed rolling upgrade finalization can cause heartbeat expiration and write >

[jira] [Updated] (HDFS-8722) Optimize datanode writes for small writes and flushes

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8722: - Fix Version/s: 2.8.0 > Optimize datanode writes for small writes and flushes >

[jira] [Updated] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8767: - Fix Version/s: 2.8.0 > RawLocalFileSystem.listStatus() returns null for UNIX pipefile >

<    1   2   3   4   5   6   7   8   9   10   >