[jira] [Updated] (HDFS-9650) Problem is logging of "Redundant addStoredBlock request received"

2016-01-14 Thread Daniel Takamori (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Takamori updated HDFS-9650: -- Summary: Problem is logging of "Redundant addStoredBlock request received" (was: Need to create

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098281#comment-15098281 ] Yongjun Zhang commented on HDFS-9569: - Hi [~szetszwo], Thanks for pointing out, the jenkins test was

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098509#comment-15098509 ] Yongjun Zhang commented on HDFS-9652: - {code} Error Message Expected to find 'Failed to load an

[jira] [Updated] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9652: Description: TestStartup.testImageChecksum is broken due to a message change introduced in

[jira] [Created] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-9652: --- Summary: TestStartup.testImageChecksum is broken by HDFS-9569 Key: HDFS-9652 URL: https://issues.apache.org/jira/browse/HDFS-9652 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2016-01-14 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9574: -- Fix Version/s: (was: 3.0.0) bq. This is an important improvement for rolling

[jira] [Updated] (HDFS-9374) Inform user when a file with corrupted data blocks are read

2016-01-14 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-9374: Attachment: HDFS-9374-001.patch Another way is to add the decode info to ReadStatistics. > Inform user when a file

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097797#comment-15097797 ] Hadoop QA commented on HDFS-9612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-14 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097894#comment-15097894 ] Vinayakumar B commented on HDFS-9648: - +1 for patch. TestStartup stil failed, but with port in use,

[jira] [Commented] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097887#comment-15097887 ] Hadoop QA commented on HDFS-9648: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2016-01-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097956#comment-15097956 ] Tsz Wo Nicholas Sze commented on HDFS-9569: --- It seems that this caused TestStartup failing for

[jira] [Updated] (HDFS-5328) MiniDFSCluster times out at startup

2016-01-14 Thread Rob Vesse (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Vesse updated HDFS-5328: Status: Patch Available (was: Open) Resubmitting patch to see if apparently unrelated transient errors will

[jira] [Updated] (HDFS-5328) MiniDFSCluster times out at startup

2016-01-14 Thread Rob Vesse (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Vesse updated HDFS-5328: Attachment: HDFS-5328.002.patch > MiniDFSCluster times out at startup > ---

[jira] [Updated] (HDFS-5328) MiniDFSCluster times out at startup

2016-01-14 Thread Rob Vesse (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rob Vesse updated HDFS-5328: Status: Open (was: Patch Available) > MiniDFSCluster times out at startup >

[jira] [Commented] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098050#comment-15098050 ] Hadoop QA commented on HDFS-9648: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9649) NNStorage does not synchronize iteration on a synchronized list

2016-01-14 Thread emopers (JIRA)
emopers created HDFS-9649: - Summary: NNStorage does not synchronize iteration on a synchronized list Key: HDFS-9649 URL: https://issues.apache.org/jira/browse/HDFS-9649 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8767) RawLocalFileSystem.listStatus() returns null for UNIX pipefile

2016-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098131#comment-15098131 ] Hudson commented on HDFS-8767: -- FAILURE: Integrated in Hadoop-trunk-Commit #9108 (See

[jira] [Commented] (HDFS-8326) Documentation about when checkpoints are run is out of date

2016-01-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098149#comment-15098149 ] Junping Du commented on HDFS-8326: -- Looks like we wrongly add this to the CHANGES.txt entry of 2.7.2 for

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098152#comment-15098152 ] Walter Su commented on HDFS-9646: - {code} + bufferSize, (int)(maxTargetLength -

[jira] [Commented] (HDFS-5328) MiniDFSCluster times out at startup

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098175#comment-15098175 ] Hadoop QA commented on HDFS-5328: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9649) NNStorage does not synchronize iteration on a synchronized list

2016-01-14 Thread emopers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] emopers updated HDFS-9649: -- Attachment: HDFS-9649.patch > NNStorage does not synchronize iteration on a synchronized list >

[jira] [Updated] (HDFS-9628) libhdfs++: Implement builder apis from C bindings

2016-01-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9628: -- Resolution: Fixed Status: Resolved (was: Patch Available) Comitted to HDFS-8707.

[jira] [Updated] (HDFS-9574) Reduce client failures during datanode restart

2016-01-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9574: - Fix Version/s: (was: 2.7.3) 2.7.2 > Reduce client failures during datanode restart

[jira] [Created] (HDFS-9651) All web UIs should include a robots.txt file

2016-01-14 Thread Lars Francke (JIRA)
Lars Francke created HDFS-9651: -- Summary: All web UIs should include a robots.txt file Key: HDFS-9651 URL: https://issues.apache.org/jira/browse/HDFS-9651 Project: Hadoop HDFS Issue Type:

[jira] [Moved] (HDFS-9650) Need to create issue in HDFS-jira

2016-01-14 Thread Daniel Takamori (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Takamori moved INFRA-11079 to HDFS-9650: --- INFRA-Members: (was: [infrastructure-team]) Component/s:

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2016-01-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098377#comment-15098377 ] Chris Nauroth commented on HDFS-9569: - I missed it too. This patch lingered for a few weeks, and I

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101038#comment-15101038 ] Kai Zheng commented on HDFS-9646: - bq. The bug can also be reproduced with the change in this comment , and

[jira] [Updated] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9415: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.4 2.7.3

[jira] [Updated] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9612: -- Attachment: HDFS-9612.008.patch Thanks [~yzhangal] for the missing change. Attached is my rev8

[jira] [Commented] (HDFS-9635) Add one more volume choosing policy with considering volume IO load

2016-01-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099197#comment-15099197 ] Kai Zheng commented on HDFS-9635: - Thanks [~andrew.wang] for the review and discussion! Would take some

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-14 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099272#comment-15099272 ] Kai Sasaki commented on HDFS-9646: -- {quote} For HDFS-9585, if we have some false targetStatus, the

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101065#comment-15101065 ] Kai Zheng commented on HDFS-9646: - Using {{random.nextInt}} to generate the datanode dead indexes is good

[jira] [Updated] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-14 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9624: Attachment: HDFS-9624.007.patch Modify the checkstyles warnings. I test the failed test in local and these

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099183#comment-15099183 ] Hadoop QA commented on HDFS-9646: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099264#comment-15099264 ] Hadoop QA commented on HDFS-9612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099261#comment-15099261 ] Jing Zhao commented on HDFS-9646: - The bug can also be reproduced with the change in this [comment |

[jira] [Commented] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

2016-01-14 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099064#comment-15099064 ] Benoy Antony commented on HDFS-9034: committed to branch-2.8. > "StorageTypeStats" Metric should not

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099131#comment-15099131 ] Hudson commented on HDFS-9415: -- FAILURE: Integrated in Hadoop-trunk-Commit #9115 (See

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099202#comment-15099202 ] Hadoop QA commented on HDFS-9608: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9597) BaseReplicationPolicyTest should update data node stats after adding a data node

2016-01-14 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099063#comment-15099063 ] Benoy Antony commented on HDFS-9597: committed to branch-2.8 also. > BaseReplicationPolicyTest should

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2016-01-14 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099130#comment-15099130 ] Tsz Wo Nicholas Sze commented on HDFS-9569: --- Thanks for the quick fix! > Log the name of the

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099133#comment-15099133 ] Yongjun Zhang commented on HDFS-9612: - Thanks Wei-Chiu, +1 on rev8 pending jenkins. > DistCp worker

[jira] [Updated] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9652: Attachment: HDFS-9652.001.patch > TestStartup.testImageChecksum is broken by HDFS-9569 >

[jira] [Updated] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9652: Status: Patch Available (was: Open) HI [~cnauroth] and [~szetszwo], Would you please take a look

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

2016-01-14 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098719#comment-15098719 ] Zhe Zhang commented on HDFS-9576: - Thanks for the review Colin. bq. Can we use "pos" instead? Good point.

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098717#comment-15098717 ] Wei-Chiu Chuang commented on HDFS-9652: --- [~yzhangal] I should have commented on HDFS-9569 earlier.

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098637#comment-15098637 ] Mingliang Liu commented on HDFS-9652: - +1 (non-binding) > TestStartup.testImageChecksum is broken by

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098646#comment-15098646 ] Wei-Chiu Chuang commented on HDFS-9652: --- But I am +1 this patch (non-binding) >

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098644#comment-15098644 ] Wei-Chiu Chuang commented on HDFS-9652: --- By the way this is a duplicate of HDFS-9648 :) >

[jira] [Updated] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9652: Resolution: Duplicate Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098705#comment-15098705 ] Yongjun Zhang commented on HDFS-9652: - Thanks [~liuml07] and [~jojochuang]. I marked it as duplicate

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098742#comment-15098742 ] Yongjun Zhang commented on HDFS-9652: - No problem [~jojochuang], thanks for being proactive and working

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098686#comment-15098686 ] Andrew Wang commented on HDFS-9624: --- Hi, looks like Jenkins flagged some checkstyle issues, could you

[jira] [Updated] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9608: -- Affects Version/s: 2.6.0 Target Version/s: 2.9.0 Status: Patch Available (was: Open)

[jira] [Commented] (HDFS-9608) Disk IO imbalance in HDFS with heterogeneous storages

2016-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098745#comment-15098745 ] Andrew Wang commented on HDFS-9608: --- Patch looks good to me, nice find! For any watchers, the issue IIUC

[jira] [Created] (HDFS-9653) Expose the number of blocks pending deletion through dfsadmin report command

2016-01-14 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-9653: - Summary: Expose the number of blocks pending deletion through dfsadmin report command Key: HDFS-9653 URL: https://issues.apache.org/jira/browse/HDFS-9653 Project: Hadoop

[jira] [Assigned] (HDFS-9653) Expose the number of blocks pending deletion through dfsadmin report command

2016-01-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-9653: - Assignee: Weiwei Yang > Expose the number of blocks pending deletion through dfsadmin report

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101242#comment-15101242 ] Hadoop QA commented on HDFS-9624: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2016-01-14 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-9525: --- Status: Open (was: Patch Available) > hadoop utilities need to support provided delegation tokens >

[jira] [Commented] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099234#comment-15099234 ] Kai Zheng commented on HDFS-9646: - Thanks Jing for the update. Do you think it's good to address my minor

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101394#comment-15101394 ] Hadoop QA commented on HDFS-9612: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9612: Attachment: HDFS-9612.009.patch Upload rev9 on behalf of Wei-Chiu to fix checkstyle issue. >

[jira] [Commented] (HDFS-9534) Add CLI command to clear storage policy from a path.

2016-01-14 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101365#comment-15101365 ] Walter Su commented on HDFS-9534: - Thanks [~xiaobingo]. 1. I think the original design doesn't mean to make

[jira] [Commented] (HDFS-9635) Add one more volume choosing policy with considering volume IO load

2016-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098748#comment-15098748 ] Andrew Wang commented on HDFS-9635: --- Thanks for pointing out that JIRA [~drankye], reviewed it. I like

[jira] [Updated] (HDFS-9646) ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

2016-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9646: Attachment: HDFS-9646.001.patch Thanks for the review, [~drankye], [~lewuathe], [~szetszwo], [~walter.k.su]!

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098784#comment-15098784 ] Arpit Agarwal commented on HDFS-9415: - +1 pending Jenkins. > Document dfs.cluster.administrators and

[jira] [Commented] (HDFS-9576) HTrace: collect position/length information on read operations

2016-01-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098791#comment-15098791 ] Colin Patrick McCabe commented on HDFS-9576: bq. So how about only reporting "returned length"

[jira] [Updated] (HDFS-9648) TestStartup.testImageChecksum is broken by HDFS-9569's message change

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9648: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098899#comment-15098899 ] Hadoop QA commented on HDFS-9094: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098903#comment-15098903 ] Yongjun Zhang commented on HDFS-9569: - Committed HDFS-9648 as the fix. Thanks [~szetszwo] and

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098927#comment-15098927 ] Chris Nauroth commented on HDFS-9652: - Thank you, [~jojochuang] and [~yzhangal]. >

[jira] [Commented] (HDFS-9648) TestStartup.testImageChecksum is broken by HDFS-9569's message change

2016-01-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098926#comment-15098926 ] Chris Nauroth commented on HDFS-9648: - Thank you, [~jojochuang] and [~yzhangal]. >

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098831#comment-15098831 ] Arpit Agarwal commented on HDFS-9094: - Thanks for the updated patch [~xiaobingo]. Looks like we need

[jira] [Updated] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9415: Attachment: HDFS-9415.004.patch > Document dfs.cluster.administrators and

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098601#comment-15098601 ] Xiaobing Zhou commented on HDFS-9415: - Thanks all for review. We should follow the principle of clarity

[jira] [Updated] (HDFS-9648) TestStartup.testImageChecksum is broken by HDFS-9569's message change

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9648: Summary: TestStartup.testImageChecksum is broken by HDFS-9569's message change (was: Test

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2016-01-14 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Attachment: HDFS-9094-HDFS-9000.005.patch V005 added minor changes by adding 'namenode' option to

[jira] [Commented] (HDFS-9624) DataNode start slowly due to the initial DU command operations

2016-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098694#comment-15098694 ] Andrew Wang commented on HDFS-9624: --- Also should say, otherwise looks good! +1 pending Jenkins. >

[jira] [Commented] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098712#comment-15098712 ] Yongjun Zhang commented on HDFS-9648: - +1 on the patch, thanks [~jojochuang]. Will commit soon. >

[jira] [Commented] (HDFS-9648) Test TestStartup.testImageChecksum keeps failing

2016-01-14 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098232#comment-15098232 ] Wei-Chiu Chuang commented on HDFS-9648: --- TestDecommissioningStatus.testDecommissionStatus is an

[jira] [Updated] (HDFS-9651) All web UIs should include a robots.txt file

2016-01-14 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Francke updated HDFS-9651: --- Attachment: HDFS-9651.1.patch > All web UIs should include a robots.txt file >

[jira] [Updated] (HDFS-9651) All web UIs should include a robots.txt file

2016-01-14 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Francke updated HDFS-9651: --- Status: Patch Available (was: Open) > All web UIs should include a robots.txt file >

[jira] [Commented] (HDFS-9651) All web UIs should include a robots.txt file

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098367#comment-15098367 ] Hadoop QA commented on HDFS-9651: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9652) TestStartup.testImageChecksum is broken by HDFS-9569

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098957#comment-15098957 ] Hadoop QA commented on HDFS-9652: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2016-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098968#comment-15098968 ] Hudson commented on HDFS-9569: -- FAILURE: Integrated in Hadoop-trunk-Commit #9114 (See

[jira] [Commented] (HDFS-9648) TestStartup.testImageChecksum is broken by HDFS-9569's message change

2016-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098969#comment-15098969 ] Hudson commented on HDFS-9648: -- FAILURE: Integrated in Hadoop-trunk-Commit #9114 (See

[jira] [Commented] (HDFS-9612) DistCp worker threads are not terminated after jobs are done.

2016-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098991#comment-15098991 ] Yongjun Zhang commented on HDFS-9612: - Hi [~jojochuang], The patch looks good to me, except a minor

[jira] [Commented] (HDFS-9415) Document dfs.cluster.administrators and dfs.permissions.superusergroup

2016-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099000#comment-15099000 ] Hadoop QA commented on HDFS-9415: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||