[jira] [Commented] (HDFS-11296) Maintenance state expiry should be an epoch time and not jvm monotonic

2017-01-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803903#comment-15803903 ] Lei (Eddy) Xu commented on HDFS-11296: -- Hi, [~manojg] Thanks for working on this. I have a few

[jira] [Updated] (HDFS-11297) hadoop-7285-power

2017-01-05 Thread xlsong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xlsong updated HDFS-11297: -- Attachment: instruction.doc > hadoop-7285-power > - > > Key: HDFS-11297 >

[jira] [Updated] (HDFS-9478) Reason for failing ipc.FairCallQueue contruction should be thrown

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9478: - Fix Version/s: 2.8.0 > Reason for failing ipc.FairCallQueue contruction should be thrown >

[jira] [Updated] (HDFS-9772) TestBlockReplacement#testThrottler doesn't work as expected

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9772: - Fix Version/s: 2.8.0 > TestBlockReplacement#testThrottler doesn't work as expected >

[jira] [Updated] (HDFS-9661) Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9661: - Fix Version/s: 2.8.0 > Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw >

[jira] [Updated] (HDFS-9654) Code refactoring for HDFS-8578

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9654: - Fix Version/s: 2.8.0 > Code refactoring for HDFS-8578 > -- > >

[jira] [Updated] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9434: - Fix Version/s: 2.8.0 > Recommission a datanode with 500k blocks may pause NN for 30 seconds >

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-6481: - Fix Version/s: 2.8.0 > DatanodeManager#getDatanodeStorageInfos() should check the length of > storageIDs

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes that are no longer in the allowed list

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8950: - Fix Version/s: 2.8.0 > NameNode refresh doesn't remove DataNodes that are no longer in the allowed > list

[jira] [Updated] (HDFS-8867) Enable optimized block reports

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8867: - Fix Version/s: 2.8.0 > Enable optimized block reports > -- > >

[jira] [Updated] (HDFS-8879) Quota by storage type usage incorrectly initialized upon namenode restart

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8879: - Fix Version/s: 2.8.0 > Quota by storage type usage incorrectly initialized upon namenode restart >

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-01-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803859#comment-15803859 ] Xiao Chen commented on HDFS-10899: -- During the offline discussion, [~dilaver] also asked about the

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-01-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.04.patch > Add functionality to re-encrypt EDEKs. >

[jira] [Updated] (HDFS-9669) TcpPeerServer should respect ipc.server.listen.queue.size

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9669: - Fix Version/s: 2.8.0 > TcpPeerServer should respect ipc.server.listen.queue.size >

[jira] [Updated] (HDFS-9305) Delayed heartbeat processing causes storm of subsequent heartbeats

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9305: - Fix Version/s: 2.8.0 > Delayed heartbeat processing causes storm of subsequent heartbeats >

[jira] [Created] (HDFS-11297) hadoop-7285-power

2017-01-05 Thread xlsong (JIRA)
xlsong created HDFS-11297: - Summary: hadoop-7285-power Key: HDFS-11297 URL: https://issues.apache.org/jira/browse/HDFS-11297 Project: Hadoop HDFS Issue Type: Task Components:

[jira] [Updated] (HDFS-7164) Feature documentation for HDFS-6581

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7164: - Fix Version/s: 2.8.0 > Feature documentation for HDFS-6581 > --- > >

[jira] [Updated] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9221: - Fix Version/s: 2.8.0 > HdfsServerConstants#ReplicaState#getState should avoid calling values() since > it

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-01-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.03.patch > Add functionality to re-encrypt EDEKs. >

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-01-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803850#comment-15803850 ] Xiao Chen commented on HDFS-10899: -- [~dilaver] had a pretty good offline review of patch 2. Attaching #3

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8522: - Fix Version/s: 2.8.0 > Change heavily recorded NN logs from INFO to DEBUG level >

[jira] [Updated] (HDFS-8523) Remove usage information on unsupported operation "fsck -showprogress" from branch-2

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8523: - Fix Version/s: 2.8.0 > Remove usage information on unsupported operation "fsck -showprogress" from >

[jira] [Updated] (HDFS-8583) Document that NFS gateway does not work with rpcbind on SLES 11

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8583: - Fix Version/s: 2.8.0 > Document that NFS gateway does not work with rpcbind on SLES 11 >

[jira] [Updated] (HDFS-8566) HDFS documentation about debug commands wrongly identifies them as "hdfs dfs" commands

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8566: - Fix Version/s: 2.8.0 > HDFS documentation about debug commands wrongly identifies them as "hdfs dfs" >

[jira] [Updated] (HDFS-8576) Lease recovery should return true if the lease can be released and the file can be closed

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8576: - Fix Version/s: 2.8.0 > Lease recovery should return true if the lease can be released and the file > can

[jira] [Updated] (HDFS-8595) TestCommitBlockSynchronization fails in branch-2.7

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8595: - Fix Version/s: 2.8.0 > TestCommitBlockSynchronization fails in branch-2.7 >

[jira] [Updated] (HDFS-11259) Update fsck to display maintenance state info

2017-01-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-11259: Hadoop Flags: Incompatible change > Update fsck to display maintenance state info >

[jira] [Commented] (HDFS-11259) Update fsck to display maintenance state info

2017-01-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803767#comment-15803767 ] Lei (Eddy) Xu commented on HDFS-11259: -- Hi, [~manojg] Thanks for working on it. LGTM. +1. I will

[jira] [Commented] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803720#comment-15803720 ] Hadoop QA commented on HDFS-10860: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803671#comment-15803671 ] Weiwei Yang commented on HDFS-6874: --- The checkstyle warning was not introduced by this patch. Hi

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803659#comment-15803659 ] Hadoop QA commented on HDFS-6874: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-01-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-6874: -- Attachment: HDFS-6874.05.patch > Add GETFILEBLOCKLOCATIONS operation to HttpFS >

[jira] [Updated] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

2017-01-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Status: In Progress (was: Patch Available) To add unit tests for HttpFSServerWebServer > Switch

[jira] [Resolved] (HDFS-11202) httpfs.sh will not run when temp dir does not exist

2017-01-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-11202. --- Resolution: Duplicate Fix Version/s: 3.0.0-alpha2 HDFS-10860 does fix this issue. > httpfs.sh

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-05 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803589#comment-15803589 ] Ming Ma commented on HDFS-9391: --- Then for that specific case when

[jira] [Updated] (HDFS-11148) Update DataNode to use StorageLocationChecker at startup

2017-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11148: - Fix Version/s: 2.9.0 Cherry-picked to branch-2. > Update DataNode to use StorageLocationChecker

[jira] [Commented] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-05 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803569#comment-15803569 ] Yiqun Lin commented on HDFS-11282: -- Thanks [~arpitagarwal]. > Document the missing metrics of DataNode

[jira] [Updated] (HDFS-11119) Support for parallel checking of StorageLocations on DataNode startup

2017-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9: - Fix Version/s: 2.9.0 Cherry-picked to branch-2. > Support for parallel checking of

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-05 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803555#comment-15803555 ] Manoj Govindassamy commented on HDFS-9391: -- >> But NumberReplicas represents the state of all

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2017-01-05 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803543#comment-15803543 ] Surendra Singh Lilhore commented on HDFS-9483: -- Thanks [~cnauroth] for review and commit.

[jira] [Comment Edited] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-05 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803538#comment-15803538 ] Ming Ma edited comment on HDFS-9391 at 1/6/17 4:41 AM: --- A given replica is only in

[jira] [Commented] (HDFS-9391) Update webUI/JMX to display maintenance state info

2017-01-05 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803538#comment-15803538 ] Ming Ma commented on HDFS-9391: --- A given replica is only in one state, either decommission or maintenance.

[jira] [Commented] (HDFS-11291) Avoid unnecessary edit log for setStoragePolicy() and setReplication()

2017-01-05 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803531#comment-15803531 ] Yiqun Lin commented on HDFS-11291: -- Thanks [~surendrasingh] for updateing the patch. Now I see there are

[jira] [Commented] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803493#comment-15803493 ] Hudson commented on HDFS-11282: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11080 (See

[jira] [Updated] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11282: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

2017-01-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Attachment: HDFS-10860.004.patch Patch 004 - Update CommandsManual.md and SecureMode.md TESTING DONE -

[jira] [Updated] (HDFS-10860) Switch HttpFS from Tomcat to Jetty

2017-01-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10860: -- Status: Patch Available (was: In Progress) > Switch HttpFS from Tomcat to Jetty >

[jira] [Updated] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2017-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11253: - Target Version/s: (was: 3.0.0-alpha2) > FileInputStream leak on failure path in BlockSender >

[jira] [Updated] (HDFS-11253) FileInputStream leak on failure path in BlockSender

2017-01-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11253: - Affects Version/s: 3.0.0-alpha2 > FileInputStream leak on failure path in BlockSender >

[jira] [Commented] (HDFS-11194) Maintain aggregated peer performance metrics on NameNode

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803341#comment-15803341 ] Hadoop QA commented on HDFS-11194: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11243) [SPS]: Add a protocol command from NN to DN for dropping the SPS work and queues

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803302#comment-15803302 ] Hadoop QA commented on HDFS-11243: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11293) FsDatasetImpl throws ReplicaAlreadyExistsException in a wrong situation

2017-01-05 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803261#comment-15803261 ] Yuanbo Liu commented on HDFS-11293: --- [~umamaheswararao] Thanks for your response. I'll attach a test

[jira] [Commented] (HDFS-10675) Datanode support to read from external stores.

2017-01-05 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803257#comment-15803257 ] Virajith Jalaparti commented on HDFS-10675: --- Hi [~jiajia], v3 patch works on top of HDFS-9806 in

[jira] [Commented] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803251#comment-15803251 ] Hadoop QA commented on HDFS-11282: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9569: - Fix Version/s: 2.8.0 > Log the name of the fsimage being loaded for better supportability >

[jira] [Updated] (HDFS-9648) TestStartup.testImageChecksum is broken by HDFS-9569's message change

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9648: - Fix Version/s: 2.8.0 > TestStartup.testImageChecksum is broken by HDFS-9569's message change >

[jira] [Updated] (HDFS-8521) Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8521: - Fix Version/s: 2.8.0 > Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}} >

[jira] [Updated] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-05 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11282: - Attachment: HDFS-11282.004.patch > Document the missing metrics of DataNode Volume IO operations >

[jira] [Commented] (HDFS-11282) Document the missing metrics of DataNode Volume IO operations

2017-01-05 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803203#comment-15803203 ] Yiqun Lin commented on HDFS-11282: -- Thanks [~arpiagariu] for the review and comment. New patch attached

[jira] [Updated] (HDFS-8581) ContentSummary on / skips further counts on yielding lock

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8581: - Fix Version/s: 2.8.0 > ContentSummary on / skips further counts on yielding lock >

[jira] [Updated] (HDFS-9043) Doc updation for commands in HDFS Federation

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9043: - Fix Version/s: 2.8.0 > Doc updation for commands in HDFS Federation >

[jira] [Updated] (HDFS-9042) Update document for the Storage policy name

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9042: - Fix Version/s: 2.8.0 > Update document for the Storage policy name >

[jira] [Updated] (HDFS-8633) Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8633: - Fix Version/s: 2.8.0 > Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match >

[jira] [Commented] (HDFS-11221) Have StorageDirectory return Optional instead of File/null

2017-01-05 Thread Jiajia Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803201#comment-15803201 ] Jiajia Li commented on HDFS-11221: -- Hi, [~ehiggs], can I take this jira? > Have StorageDirectory return

[jira] [Updated] (HDFS-8101) DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8101: - Fix Version/s: 2.8.0 > DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at > runtime

[jira] [Updated] (HDFS-8099) Change "DFSInputStream has been closed already" message to debug log level

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8099: - Fix Version/s: 2.8.0 > Change "DFSInputStream has been closed already" message to debug log level >

[jira] [Updated] (HDFS-10347) Namenode report bad block method doesn't log the bad block or datanode.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10347: -- Fix Version/s: 2.8.0 > Namenode report bad block method doesn't log the bad block or datanode. >

[jira] [Updated] (HDFS-8384) Allow NN to startup if there are files having a lease but are not under construction

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8384: - Fix Version/s: 2.8.0 > Allow NN to startup if there are files having a lease but are not under >

[jira] [Updated] (HDFS-8405) Fix a typo in NamenodeFsck

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8405: - Fix Version/s: 2.8.0 > Fix a typo in NamenodeFsck > -- > > Key:

[jira] [Updated] (HDFS-10186) DirectoryScanner: Improve logs by adding full path of both actual and expected block directories

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10186: -- Fix Version/s: 2.8.0 > DirectoryScanner: Improve logs by adding full path of both actual and >

[jira] [Updated] (HDFS-10319) Balancer should not try to pair storages with different types

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-10319: -- Fix Version/s: 2.8.0 > Balancer should not try to pair storages with different types >

[jira] [Updated] (HDFS-7546) Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7546: - Fix Version/s: 2.8.0 > Document, and set an accepting default for >

[jira] [Updated] (HDFS-8151) Always use snapshot path as source when invalid snapshot names are used for diff based distcp

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8151: - Fix Version/s: 2.8.0 > Always use snapshot path as source when invalid snapshot names are used for > diff

[jira] [Updated] (HDFS-8204) Mover/Balancer should not schedule two replicas to the same DN

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8204: - Fix Version/s: 2.8.0 > Mover/Balancer should not schedule two replicas to the same DN >

[jira] [Updated] (HDFS-7931) DistributedFIleSystem should not look for keyProvider in cache if Encryption is disabled

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7931: - Fix Version/s: 2.8.0 > DistributedFIleSystem should not look for keyProvider in cache if Encryption > is

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9574: - Fix Version/s: 2.8.0 > Reduce client failures during datanode restart >

[jira] [Updated] (HDFS-9033) dfsadmin -metasave prints "NaN" for cache used%

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9033: - Fix Version/s: 2.8.0 > dfsadmin -metasave prints "NaN" for cache used% >

[jira] [Updated] (HDFS-9740) Use a reasonable limit in DFSTestUtil.waitForMetric()

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9740: - Fix Version/s: 2.8.0 > Use a reasonable limit in DFSTestUtil.waitForMetric() >

[jira] [Updated] (HDFS-9730) Storage ID update does not happen when there is a layout change

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9730: - Fix Version/s: 2.8.0 > Storage ID update does not happen when there is a layout change >

[jira] [Updated] (HDFS-9690) ClientProtocol.addBlock is not idempotent after HDFS-8071

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9690: - Fix Version/s: 2.8.0 > ClientProtocol.addBlock is not idempotent after HDFS-8071 >

[jira] [Updated] (HDFS-9431) DistributedFileSystem#concat fails if the target path is relative.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9431: - Fix Version/s: 2.8.0 > DistributedFileSystem#concat fails if the target path is relative. >

[jira] [Updated] (HDFS-9365) Balancer does not work with the HDFS-6376 HA setup

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9365: - Fix Version/s: 2.8.0 > Balancer does not work with the HDFS-6376 HA setup >

[jira] [Updated] (HDFS-9383) TestByteArrayManager#testByteArrayManager fails

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9383: - Fix Version/s: 2.8.0 > TestByteArrayManager#testByteArrayManager fails >

[jira] [Updated] (HDFS-9533) seen_txid in the shared edits directory is modified during bootstrapping

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9533: - Fix Version/s: 2.8.0 > seen_txid in the shared edits directory is modified during bootstrapping >

[jira] [Updated] (HDFS-9476) TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9476: - Fix Version/s: 2.8.0 > TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail >

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9516: - Fix Version/s: 2.8.0 > truncate file fails with data dirs on multiple disks >

[jira] [Updated] (HDFS-9555) LazyPersistFileScrubber should still sleep if there are errors in the clear progress

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9555: - Fix Version/s: 2.8.0 > LazyPersistFileScrubber should still sleep if there are errors in the clear >

[jira] [Updated] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9634: - Fix Version/s: 2.8.0 > webhdfs client side exceptions don't provide enough details >

[jira] [Updated] (HDFS-8597) Fix TestFSImage#testZeroBlockSize on Windows

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8597: - Fix Version/s: 2.8.0 > Fix TestFSImage#testZeroBlockSize on Windows >

[jira] [Updated] (HDFS-8615) Correct HTTP method in WebHDFS document

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8615: - Fix Version/s: 2.8.0 > Correct HTTP method in WebHDFS document > --- >

[jira] [Updated] (HDFS-8659) Block scanner INFO message is spamming logs

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8659: - Fix Version/s: 2.8.0 > Block scanner INFO message is spamming logs >

[jira] [Updated] (HDFS-8772) Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8772: - Fix Version/s: 2.8.0 > Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails >

[jira] [Updated] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-7980: - Fix Version/s: 2.8.0 > Incremental BlockReport will dramatically slow down the startup of a namenode >

[jira] [Updated] (HDFS-8091) ACLStatus and XAttributes not properly presented to INodeAttributesProvider before returning to client

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8091: - Fix Version/s: 2.8.0 > ACLStatus and XAttributes not properly presented to INodeAttributesProvider >

[jira] [Updated] (HDFS-8046) Allow better control of getContentSummary

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8046: - Fix Version/s: 2.8.0 > Allow better control of getContentSummary >

[jira] [Updated] (HDFS-8147) Mover should not schedule two replicas to the same DN storage

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8147: - Fix Version/s: 2.8.0 > Mover should not schedule two replicas to the same DN storage >

[jira] [Updated] (HDFS-8404) Pending block replication can get stuck using older genstamp

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8404: - Fix Version/s: 2.8.0 > Pending block replication can get stuck using older genstamp >

[jira] [Updated] (HDFS-8081) Split getAdditionalBlock() into two methods.

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8081: - Fix Version/s: 2.8.0 > Split getAdditionalBlock() into two methods. >

[jira] [Updated] (HDFS-8361) Choose SSD over DISK in block placement

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8361: - Fix Version/s: 2.8.0 > Choose SSD over DISK in block placement > --- >

[jira] [Updated] (HDFS-8153) Error Message points to wrong parent directory in case of path component name length error

2017-01-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8153: - Fix Version/s: 2.8.0 > Error Message points to wrong parent directory in case of path component name >

  1   2   3   >