[jira] [Commented] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060839#comment-15060839 ] Arpit Agarwal commented on HDFS-9565: - +1 pending Jenkins. >

[jira] [Created] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky

2015-12-16 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9565: - Summary: TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky Key: HDFS-9565 URL: https://issues.apache.org/jira/browse/HDFS-9565 Project:

[jira] [Updated] (HDFS-9198) Coalesce IBR processing in the NN

2015-12-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9198: -- Attachment: HDFS-9198-trunk.patch No functional change, just updated to account for line number drift.

[jira] [Commented] (HDFS-9487) libhdfs++ Enable builds with no compiler optimizations

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060300#comment-15060300 ] Hadoop QA commented on HDFS-9487: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060341#comment-15060341 ] Allen Wittenauer edited comment on HDFS-402 at 12/16/15 5:21 PM: - With

[jira] [Reopened] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HDFS-402: --- With rolling upgrade, this is very important now. The fact that this wasn't completed as part of

[jira] [Updated] (HDFS-9325) Allow the location of hadoop source tree resources to be passed to CMake during a build.

2015-12-16 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9325: - Attachment: HDFS-9325.HDFS-8707.003.patch New patch: include connection in the lib output > Allow the

[jira] [Updated] (HDFS-8674) Improve performance of postponed block scans

2015-12-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-8674: -- Attachment: HDFS-8674.patch Updated patch since a data structure change prevented it from applying

[jira] [Commented] (HDFS-8477) describe dfs.ha.zkfc.port in hdfs-default.xml

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060698#comment-15060698 ] Hadoop QA commented on HDFS-8477: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2015-12-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060622#comment-15060622 ] Daryn Sharp commented on HDFS-9525: --- bq. If we want to distcp from non-kerberos cluster to kerberos

[jira] [Commented] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060889#comment-15060889 ] Arpit Agarwal commented on HDFS-9552: - Nice work [~cnauroth], thanks for documenting this. Should this

[jira] [Commented] (HDFS-9557) Reduce object allocation in PB conversion

2015-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060629#comment-15060629 ] Hudson commented on HDFS-9557: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8976 (See

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060590#comment-15060590 ] Zhe Zhang commented on HDFS-9173: - Agreed on #3 above. This is the 9 RBW => 9 RUR => 9 Finalized option as

[jira] [Updated] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky

2015-12-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9565: -- Attachment: HDFS-9565.001.patch rev01: use DFSTestUtil.waitForReplication() to avoid race

[jira] [Updated] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9565: -- Summary: TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race

[jira] [Updated] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9565: -- Status: Patch Available (was: Open) >

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

2015-12-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060295#comment-15060295 ] Ming Ma commented on HDFS-8674: --- Thanks [~daryn]. Your explanation makes sense. It is good to know the perf

[jira] [Resolved] (HDFS-3356) When dfs.block.size is configured to 0 the block which is created in rbw is never deleted

2015-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-3356. -- Resolution: Won't Fix This is not an issue since we now have minimum block size enforcement. > When

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2015-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060292#comment-15060292 ] Kihwal Lee commented on HDFS-5042: -- We can make it optional and put in after HDFS-8791. > Completed

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-16 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060356#comment-15060356 ] James Clampffer commented on HDFS-9523: --- Since the only difference between the last patch and the one

[jira] [Created] (HDFS-9563) DiskBalancer: Refactor Plan Command

2015-12-16 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9563: --- Summary: DiskBalancer: Refactor Plan Command Key: HDFS-9563 URL: https://issues.apache.org/jira/browse/HDFS-9563 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9563) DiskBalancer: Refactor Plan Command

2015-12-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9563: Description: This is used to track refactoring plan command. (was: It's quite helpful to do: 1)

[jira] [Updated] (HDFS-9564) DiskBalancer: Refactor Execute Command

2015-12-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9564: Description: This is used to track refactoring execute command. (was: This is used to track

[jira] [Created] (HDFS-9564) DiskBalancer: Refactor Execute Command

2015-12-16 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9564: --- Summary: DiskBalancer: Refactor Execute Command Key: HDFS-9564 URL: https://issues.apache.org/jira/browse/HDFS-9564 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

2015-12-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060444#comment-15060444 ] Zhe Zhang commented on HDFS-9373: - Thanks Bo. Could you address the checkstyle issue by adding a comma on

[jira] [Commented] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060446#comment-15060446 ] Kihwal Lee commented on HDFS-402: - I am not suggesting that it is the right way, but merely pointing out

[jira] [Commented] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060505#comment-15060505 ] Kihwal Lee commented on HDFS-402: - Sorry, I missed that. I couldn't find it by a quick search. I would

[jira] [Created] (HDFS-9562) libhdfs++ RpcConnectionImpl::Connect should acquire connection state lock

2015-12-16 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9562: - Summary: libhdfs++ RpcConnectionImpl::Connect should acquire connection state lock Key: HDFS-9562 URL: https://issues.apache.org/jira/browse/HDFS-9562 Project:

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-16 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060322#comment-15060322 ] James Clampffer commented on HDFS-9523: --- Thanks for the rebase. The patch looks good to me. CI

[jira] [Updated] (HDFS-9557) Reduce object allocation in PB conversion

2015-12-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9557: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Resolved] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-402. - Resolution: Won't Fix Please reopen if anyone thinks it is important and wants to work on it. > Display

[jira] [Commented] (HDFS-9559) Add haadmin command to get HA state of all the namenodes

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060335#comment-15060335 ] Hadoop QA commented on HDFS-9559: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9564) DiskBalancer: Refactor Execute Command

2015-12-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9564: Attachment: HDFS-9564-HDFS-1312.001.patch I posted patch v001, but can be committed only after

[jira] [Updated] (HDFS-9563) DiskBalancer: Refactor Plan Command

2015-12-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9563: Attachment: HDFS-9563-HDFS-1312.001.patch I posted patch v001, but can be committed only after

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060431#comment-15060431 ] Allen Wittenauer commented on HDFS-9525: javac issues are directly related to YETUS-187. > hadoop

[jira] [Commented] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060454#comment-15060454 ] Allen Wittenauer commented on HDFS-402: --- I don't consider rolling upgrade *stable* much less *feature

[jira] [Commented] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060318#comment-15060318 ] Hadoop QA commented on HDFS-9523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2015-12-16 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060397#comment-15060397 ] HeeSoo Kim commented on HDFS-9525: -- The test failures are unrelated to the change made for this jira.

[jira] [Commented] (HDFS-1595) DFSClient may incorrectly detect datanode failure

2015-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060275#comment-15060275 ] Kihwal Lee commented on HDFS-1595: -- It has been improved in HDFS-9178. This takes care of the most common

[jira] [Commented] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060371#comment-15060371 ] Allen Wittenauer commented on HDFS-402: --- bq. It is perhaps because there are already other ways to

[jira] [Commented] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060464#comment-15060464 ] Kihwal Lee commented on HDFS-402: - Please file jiras if you haven't already. Maybe we didn't see that since

[jira] [Commented] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060467#comment-15060467 ] Allen Wittenauer commented on HDFS-402: --- Already done. Last year. > Display the server version in

[jira] [Commented] (HDFS-402) Display the server version in dfsadmin -report

2015-12-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060357#comment-15060357 ] Kihwal Lee commented on HDFS-402: - bq. The fact that this wasn't completed as part of that JIRA It is

[jira] [Updated] (HDFS-9523) libhdfs++: failure to connect to ipv6 host causes CI unit tests to fail

2015-12-16 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9523: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: failure to

[jira] [Commented] (HDFS-9566) Remove expensive getStorages method

2015-12-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060928#comment-15060928 ] Mingliang Liu commented on HDFS-9566: - +1 (non-binding) pending on Jenkins. > Remove expensive

[jira] [Commented] (HDFS-9525) hadoop utilities need to support provided delegation tokens

2015-12-16 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061013#comment-15061013 ] HeeSoo Kim commented on HDFS-9525: -- {quote} I thought the issue at hand is how to access 2 kerberos

[jira] [Commented] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061054#comment-15061054 ] John Zhuge commented on HDFS-9568: -- Thx [~aw] for bringing the attention to HDFS-7499 which seems to focus

[jira] [Commented] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061108#comment-15061108 ] Arpit Agarwal commented on HDFS-9552: - Thanks, +1 for the v003 patch pending Jenkins. > Document types

[jira] [Commented] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061137#comment-15061137 ] Wei-Chiu Chuang commented on HDFS-9565: --- Test failures are all unrelated, because this patch only

[jira] [Commented] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061140#comment-15061140 ] Allen Wittenauer commented on HDFS-9568: It's not actually that new. To quote from RFC5403:

[jira] [Resolved] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-9568. -- Resolution: Duplicate > Support NFSv4 interface to HDFS > --- > >

[jira] [Assigned] (HDFS-7499) Add NFSv4 + Kerberos / client authentication support

2015-12-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-7499: Assignee: John Zhuge > Add NFSv4 + Kerberos / client authentication support >

[jira] [Updated] (HDFS-9566) Remove expensive getStorages method

2015-12-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9566: -- Attachment: HDFS-9566.patch HDFS-9566.branch-2.patch Just removes it. > Remove

[jira] [Updated] (HDFS-9566) Remove expensive getStorages method

2015-12-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-9566: -- Status: Patch Available (was: Open) > Remove expensive getStorages method >

[jira] [Commented] (HDFS-9325) Allow the location of hadoop source tree resources to be passed to CMake during a build.

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060921#comment-15060921 ] Hadoop QA commented on HDFS-9325: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-9567) LlapServiceDriver can fail if only the packaged logger config is present

2015-12-16 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HDFS-9567. Resolution: Invalid Wrong project > LlapServiceDriver can fail if only the packaged logger

[jira] [Created] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9568: Summary: Support NFSv4 interface to HDFS Key: HDFS-9568 URL: https://issues.apache.org/jira/browse/HDFS-9568 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061123#comment-15061123 ] Hadoop QA commented on HDFS-9565: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061164#comment-15061164 ] John Zhuge commented on HDFS-9568: -- :) You are right, I also recall no security mechanism was mandated by

[jira] [Commented] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061166#comment-15061166 ] Allen Wittenauer commented on HDFS-9568: Go for it. Thanks! > Support NFSv4 interface to HDFS >

[jira] [Updated] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9552: Attachment: HDFS-9552.003.patch bq. Nitpick you may consider fixing during commit, source should be

[jira] [Commented] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061103#comment-15061103 ] John Zhuge commented on HDFS-9568: -- [NFSv4|https://tools.ietf.org/html/rfc7530] added a new security

[jira] [Commented] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060923#comment-15060923 ] Wei-Chiu Chuang commented on HDFS-9565: --- Thanks for +1! [~arpitagarwal] >

[jira] [Commented] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition

2015-12-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060934#comment-15060934 ] Mingliang Liu commented on HDFS-9565: - +1 (non-binding) >

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2015-12-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060950#comment-15060950 ] Daryn Sharp commented on HDFS-7964: --- I'm trying to whittle down my backlog of internal features before I

[jira] [Commented] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061018#comment-15061018 ] Allen Wittenauer commented on HDFS-9568: This is basically going to end up a dupe of HDFS-7499. >

[jira] [Created] (HDFS-9566) Remove expensive getStorages method

2015-12-16 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-9566: - Summary: Remove expensive getStorages method Key: HDFS-9566 URL: https://issues.apache.org/jira/browse/HDFS-9566 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9515) NPE in TestDFSZKFailoverController due to binding exception in MiniDFSCluster.initMiniDFSCluster()

2015-12-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060951#comment-15060951 ] Arpit Agarwal commented on HDFS-9515: - +1 thanks for this improvement [~jojochuang]. When cluster/fs

[jira] [Updated] (HDFS-9498) Move code that tracks orphan blocks to BlockManagerSafeMode

2015-12-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9498: Attachment: HDFS-9498.002.patch The v2 patch rebases from {{trunk}} branch and resolves some trivial

[jira] [Commented] (HDFS-9198) Coalesce IBR processing in the NN

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061148#comment-15061148 ] Hadoop QA commented on HDFS-9198: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9566) Remove expensive getStorages method

2015-12-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060919#comment-15060919 ] Arpit Agarwal commented on HDFS-9566: - +1 > Remove expensive getStorages method >

[jira] [Commented] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061021#comment-15061021 ] Zhe Zhang commented on HDFS-9347: - Thanks Wei-Chiu for the work and Walter for the comment. LGTM overall. A

[jira] [Updated] (HDFS-9516) truncate file fails with data dirs on multiple disks

2015-12-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9516: -- Target Version/s: 2.8.0, 2.7.3 [~shv], unfortunately this came in too late for

[jira] [Commented] (HDFS-9561) PIpieline recovery near the end of a block may fail

2015-12-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061059#comment-15061059 ] Zhe Zhang commented on HDFS-9561: - Thanks for reporting this Kihwal. It seems

[jira] [Commented] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061060#comment-15061060 ] Chris Nauroth commented on HDFS-9552: - [~arpitagarwal], thank you for the review. I think the concat

[jira] [Created] (HDFS-9567) LlapServiceDriver can fail if only the packaged logger config is present

2015-12-16 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HDFS-9567: -- Summary: LlapServiceDriver can fail if only the packaged logger config is present Key: HDFS-9567 URL: https://issues.apache.org/jira/browse/HDFS-9567 Project:

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2015-12-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060976#comment-15060976 ] Jing Zhao commented on HDFS-7964: - Sorry for the late response, Daryn. The current patch looks good to me.

[jira] [Updated] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9173: Attachment: HDFS-9173.08.patch Upload a patch that simplifies the logic according to the above discussion.

[jira] [Commented] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061057#comment-15061057 ] Allen Wittenauer commented on HDFS-9568: I'm inclined to say no because you can't claim NFSv4

[jira] [Comment Edited] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061057#comment-15061057 ] Allen Wittenauer edited comment on HDFS-9568 at 12/16/15 10:50 PM: --- I'm

[jira] [Commented] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061068#comment-15061068 ] Arpit Agarwal commented on HDFS-9552: - Thanks. That makes sense. +1 pending Jenkins. Nitpick you may

[jira] [Commented] (HDFS-8674) Improve performance of postponed block scans

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061120#comment-15061120 ] Hadoop QA commented on HDFS-8674: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-9551) Random VolumeChoosingPolicy

2015-12-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-9551. --- Resolution: Won't Fix Based on discussion here, I don't want to add the maintenance burden of a new

[jira] [Updated] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9347: -- Attachment: HDFS-9347.003.patch Hi [~zhz] Thanks for the suggestion. Agreed the code was not

[jira] [Commented] (HDFS-9552) Document types of permission checks performed for HDFS operations.

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061210#comment-15061210 ] Hadoop QA commented on HDFS-9552: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2015-12-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061297#comment-15061297 ] Jing Zhao commented on HDFS-7964: - The patch looks good to me. One nit is that two places in FSEditLogAsync

[jira] [Updated] (HDFS-9051) webhdfs should support recursive list

2015-12-16 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9051: - Assignee: (was: Surendra Singh Lilhore) > webhdfs should support recursive

[jira] [Commented] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061592#comment-15061592 ] Hadoop QA commented on HDFS-9373: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9198) Coalesce IBR processing in the NN

2015-12-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9198: -- Attachment: HDFS-9198-Branch-2.8-withamend.diff

[jira] [Updated] (HDFS-8296) BlockManager.getUnderReplicatedBlocksCount() is not giving correct count if namenode in safe mode.

2015-12-16 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8296: - Resolution: Not A Problem Status: Resolved (was: Patch Available) >

[jira] [Updated] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

2015-12-16 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-9373: Attachment: HDFS-9373-003.patch Sorry for the checkstyle error.Update patch 003 to fix it. > Show friendly

[jira] [Updated] (HDFS-9198) Coalesce IBR processing in the NN

2015-12-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9198: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Commented] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

2015-12-16 Thread Max Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061626#comment-15061626 ] Max Schmidt commented on HDFS-6804: --- Hadoop version is 2.7.1 used on Ubuntu 14.04.3 LTS. > race

[jira] [Created] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-16 Thread Travis Campbell (JIRA)
Travis Campbell created HDFS-9570: - Summary: Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's Key: HDFS-9570 URL: https://issues.apache.org/jira/browse/HDFS-9570

[jira] [Commented] (HDFS-9393) After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy

2015-12-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061642#comment-15061642 ] Vinayakumar B commented on HDFS-9393: - Thanks [~andreina] for the patch. Changes looks good. Jenkins

[jira] [Updated] (HDFS-9114) NameNode and DataNode metric log file name should follow the other log file name format.

2015-12-16 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9114: - Resolution: Won't Fix Status: Resolved (was: Patch Available) > NameNode

[jira] [Commented] (HDFS-9347) Invariant assumption in TestQuorumJournalManager.shutdown() is wrong

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061490#comment-15061490 ] Hadoop QA commented on HDFS-9347: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9569) Log the name of the fsimage being loaded for better supportability

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061588#comment-15061588 ] Hadoop QA commented on HDFS-9569: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

2015-12-16 Thread Travis Campbell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Campbell updated HDFS-9570: -- Attachment: HDFS-9570-1.patch > Minor typos, grammar, and case sensitivity cleanup in >

[jira] [Commented] (HDFS-9515) NPE in TestDFSZKFailoverController due to binding exception in MiniDFSCluster.initMiniDFSCluster()

2015-12-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061250#comment-15061250 ] Wei-Chiu Chuang commented on HDFS-9515: --- Thanks [~arpitagarwal] for the suggestion. Do you intend to

  1   2   >