[jira] [Commented] (HDFS-6567) Clean up HdfsFileStatus

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095220#comment-14095220 ] Hadoop QA commented on HDFS-6567: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6846) NetworkTopology#sortByDistance should give nodes higher priority, which cache the block.

2014-08-12 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6846: Summary: NetworkTopology#sortByDistance should give nodes higher priority, which cache the block. Key: HDFS-6846 URL: https://issues.apache.org/jira/browse/HDFS-6846 Project: Hadoop

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095204#comment-14095204 ] Sanjay Radia commented on HDFS-6134: Larry I don't completely get the difference betwee

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

2014-08-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095165#comment-14095165 ] Yi Liu commented on HDFS-6840: -- Simplest way is to set {{dfs.namenode.randomize-block-location

[jira] [Commented] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

2014-08-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095162#comment-14095162 ] Yi Liu commented on HDFS-6803: -- {quote} It seems like we are all in agreement on Stack's point

[jira] [Comment Edited] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094613#comment-14094613 ] Sanjay Radia edited comment on HDFS-6134 at 8/13/14 4:58 AM: - A

[jira] [Commented] (HDFS-5887) Add suffix to generated protobuf class

2014-08-12 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095151#comment-14095151 ] Tassapol Athiapinya commented on HDFS-5887: --- [~wheat9] Is the jira still valid? I

[jira] [Updated] (HDFS-6321) Add a message on the old web UI that indicates the old UI is deprecated

2014-08-12 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tassapol Athiapinya updated HDFS-6321: -- Assignee: Tassapol Athiapinya Status: Patch Available (was: Open) > Add a message

[jira] [Updated] (HDFS-6321) Add a message on the old web UI that indicates the old UI is deprecated

2014-08-12 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tassapol Athiapinya updated HDFS-6321: -- Attachment: HDFS-6321.000.patch > Add a message on the old web UI that indicates the old

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095129#comment-14095129 ] Larry McCay commented on HDFS-6134: --- Hey [~tucu00] - I need a little more clarification h

[jira] [Updated] (HDFS-6567) Clean up HdfsFileStatus

2014-08-12 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tassapol Athiapinya updated HDFS-6567: -- Assignee: Tassapol Athiapinya Status: Patch Available (was: Open) > Clean up Hdfs

[jira] [Updated] (HDFS-6567) Clean up HdfsFileStatus

2014-08-12 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tassapol Athiapinya updated HDFS-6567: -- Attachment: HDFS-6567.000.patch > Clean up HdfsFileStatus > --- > >

[jira] [Updated] (HDFS-6827) Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status changing sometimes

2014-08-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6827: Summary: Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status chan

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14095065#comment-14095065 ] Hadoop QA commented on HDFS-6825: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6845) XSS and or content injection in hdfs

2014-08-12 Thread clouds (JIRA)
clouds created HDFS-6845: Summary: XSS and or content injection in hdfs Key: HDFS-6845 URL: https://issues.apache.org/jira/browse/HDFS-6845 Project: Hadoop HDFS Issue Type: Bug Affects Versions:

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

2014-08-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094977#comment-14094977 ] Andrew Wang commented on HDFS-6825: --- +1 from me as well, thanks for revving Yongjun. Let'

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

2014-08-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094966#comment-14094966 ] Aaron T. Myers commented on HDFS-6825: -- I think the latest patch looks good to me. [~

[jira] [Commented] (HDFS-6188) An ip whitelist based implementation of TrustedChannelResolver

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094923#comment-14094923 ] Arpit Agarwal commented on HDFS-6188: - Hi Benoy, I took a quick look at the patch. The

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094804#comment-14094804 ] Hadoop QA commented on HDFS-6836: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

2014-08-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094806#comment-14094806 ] Yongjun Zhang commented on HDFS-6825: - Uploaded 005 to address an important issue found

[jira] [Commented] (HDFS-6830) BlockInfo.addStorage fails when DN changes the storage for a block replica

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094785#comment-14094785 ] Hudson commented on HDFS-6830: -- FAILURE: Integrated in Hadoop-trunk-Commit #6053 (See [https:

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094787#comment-14094787 ] Hudson commented on HDFS-6836: -- FAILURE: Integrated in Hadoop-trunk-Commit #6053 (See [https:

[jira] [Updated] (HDFS-6825) Edit log corruption due to delayed block removal

2014-08-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6825: Attachment: HDFS-6825.005.patch > Edit log corruption due to delayed block removal > ---

[jira] [Updated] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6836: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target Version/s:

[jira] [Commented] (HDFS-6843) Create FileStatus.isEncrypted() method

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094754#comment-14094754 ] Charles Lamb commented on HDFS-6843: I'm going to "take back" this patch since we've de

[jira] [Work stopped] (HDFS-6843) Create FileStatus.isEncrypted() method

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6843 stopped by Charles Lamb. > Create FileStatus.isEncrypted() method > -- > > Key: HDFS-6843 >

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094756#comment-14094756 ] Arpit Agarwal commented on HDFS-6836: - I committed this just as you commented [~wheat9]

[jira] [Updated] (HDFS-6843) Create FileStatus.isEncrypted() method

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6843: --- Attachment: (was: HDFS-6843.001.patch) > Create FileStatus.isEncrypted() method >

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094748#comment-14094748 ] Haohui Mai commented on HDFS-6836: -- I'll commit it shortly. > HDFS INFO logging is verbos

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094744#comment-14094744 ] Hadoop QA commented on HDFS-6836: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6830) BlockInfo.addStorage fails when DN changes the storage for a block replica

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6830: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

2014-08-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094706#comment-14094706 ] Jason Lowe commented on HDFS-6840: -- Commenting out the setSeed call in NetworkTopology on

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094683#comment-14094683 ] Alejandro Abdelnur commented on HDFS-6134: -- httpfs accesses files using doAs() to

[jira] [Updated] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6836: Summary: HDFS INFO logging is verbose & uses file appenders (was: Reduce INFO logging) > HDFS INFO

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094677#comment-14094677 ] Arpit Agarwal commented on HDFS-6836: - +1 pending Jenkins. > HDFS INFO logging is verb

[jira] [Updated] (HDFS-6836) Reduce INFO logging

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6836: Summary: Reduce INFO logging (was: HDFS INFO logging is verbose & uses file appenders) > Reduce IN

[jira] [Commented] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

2014-08-12 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094667#comment-14094667 ] stack commented on HDFS-6803: - Let me write up a proposal for 2.1 and 2.2 with folding in good

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094621#comment-14094621 ] Larry McCay commented on HDFS-6134: --- [~sanjay.radia] that sounds right to me. In fact, t

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094613#comment-14094613 ] Sanjay Radia commented on HDFS-6134: Alejandro - for both webhdfs and httpfs to work yo

[jira] [Commented] (HDFS-6841) Use Time.monotonicNow() wherever applicable instead of Time.now()

2014-08-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094611#comment-14094611 ] Colin Patrick McCabe commented on HDFS-6841: Good idea! > Use Time.monotonicNo

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094587#comment-14094587 ] Alejandro Abdelnur commented on HDFS-6134: -- bq. Also I do not understand why httpf

[jira] [Resolved] (HDFS-6835) Archival Storage: Add a new API to set storage policy

2014-08-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6835. - Resolution: Fixed I've committed this. > Archival Storage: Add a new API to set storage policy >

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094527#comment-14094527 ] Sanjay Radia commented on HDFS-6134: bq. Regarding HAR, could you lay out the usecase .

[jira] [Updated] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6836: - Attachment: HDFS-6836.2.patch Updated based on the feedback. > HDFS INFO logging is verbose & uses file a

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-08-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094487#comment-14094487 ] Colin Patrick McCabe commented on HDFS-6757: bq. So far I plan to change the co

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094485#comment-14094485 ] Sanjay Radia commented on HDFS-6134: bq. Regarding webhdfs, it's not a recommended depl

[jira] [Updated] (HDFS-6844) Archival Storage: Extend HdfsFileStatus to get storage policy

2014-08-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6844: Attachment: HDFS-6844.000.patch Initial patch for review. The changes of the unit test depends on HDFS-6835.

[jira] [Comment Edited] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094475#comment-14094475 ] Haohui Mai edited comment on HDFS-6836 at 8/12/14 6:43 PM: --- {code

[jira] [Created] (HDFS-6844) Archival Storage: Extend HdfsFileStatus to get storage policy

2014-08-12 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6844: --- Summary: Archival Storage: Extend HdfsFileStatus to get storage policy Key: HDFS-6844 URL: https://issues.apache.org/jira/browse/HDFS-6844 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094475#comment-14094475 ] Haohui Mai commented on HDFS-6836: -- {code} - if (clientTraceFmt != null) { + if

[jira] [Updated] (HDFS-6835) Archival Storage: Add a new API to set storage policy

2014-08-12 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6835: -- Hadoop Flags: Reviewed +1 patch looks good. > Archival Storage: Add a new API to set st

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094466#comment-14094466 ] Xiaoyu Yao commented on HDFS-6836: -- Thanks! I've updated the patch with the feedback. > H

[jira] [Updated] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6836: - Attachment: HDFS-6836.1.patch Update to use debug log instead of default info log inside BlockSender.send

[jira] [Commented] (HDFS-6783) Fix HDFS CacheReplicationMonitor rescan logic

2014-08-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094443#comment-14094443 ] Colin Patrick McCabe commented on HDFS-6783: +1. > Fix HDFS CacheReplicationMo

[jira] [Commented] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

2014-08-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094410#comment-14094410 ] Colin Patrick McCabe commented on HDFS-6803: S3 might have a seek+read+seek imp

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose & uses file appenders

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094408#comment-14094408 ] Arpit Agarwal commented on HDFS-6836: - Hi [~xyao], thanks for picking this up and posti

[jira] [Updated] (HDFS-6843) Create FileStatus.isEncrypted() method

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6843: --- Attachment: HDFS-6843.001.patch I've attached a patch for this. > Create FileStatus.isEncrypted() met

[jira] [Work started] (HDFS-6843) Create FileStatus.isEncrypted() method

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6843 started by Charles Lamb. > Create FileStatus.isEncrypted() method > -- > > Key: HDFS-6843 >

[jira] [Updated] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6546: --- Status: Open (was: Patch Available) > Add non-superuser capability to get the encryption zone for a s

[jira] [Updated] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6546: --- Description: Need to add protocol, api, and CLI that allows a non super user to ask whether a path is

[jira] [Updated] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6546: --- Attachment: (was: HDFS-6546.001.patch) > Add non-superuser capability to get the encryption zone f

[jira] [Created] (HDFS-6843) Create FileStatus.isEncrypted() method

2014-08-12 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-6843: -- Summary: Create FileStatus.isEncrypted() method Key: HDFS-6843 URL: https://issues.apache.org/jira/browse/HDFS-6843 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-6835) Archival Storage: Add a new API to set storage policy

2014-08-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6835: Attachment: HDFS-6835.001.patch Thanks for the review, Nicholas and Vinay! Update the patch to address the

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

2014-08-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094340#comment-14094340 ] Andrew Wang commented on HDFS-6840: --- Alright, I'm sufficiently convinced :) Is the fix as

[jira] [Commented] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094331#comment-14094331 ] Hadoop QA commented on HDFS-6546: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6839) Fix TestCLI to expect new output

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6839: --- Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Status: R

[jira] [Commented] (HDFS-6839) Fix TestCLI to expect new output

2014-08-12 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094294#comment-14094294 ] Aaron T. Myers commented on HDFS-6839: -- +1. Thanks for taking care of this, Charles.

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094290#comment-14094290 ] Charles Lamb commented on HDFS-6826: Isn’t the authz check this Jira proposes analogous

[jira] [Commented] (HDFS-6839) Fix TestCLI to expect new output

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094284#comment-14094284 ] Hadoop QA commented on HDFS-6839: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Resolved] (HDFS-6842) TestHttpFSFWithWebhdfsFileSystem fails in trunk

2014-08-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-6842. -- Resolution: Duplicate Covered by HADOOP-10836 > TestHttpFSFWithWebhdfsFileSystem fails in trunk > -

[jira] [Updated] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6546: --- Attachment: HDFS-6546.001.patch Rebased. > Add non-superuser capability to get the encryption zone fo

[jira] [Updated] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6546: --- Attachment: (was: HDFS-6546.001.patch) > Add non-superuser capability to get the encryption zone f

[jira] [Commented] (HDFS-6842) TestHttpFSFWithWebhdfsFileSystem fails in trunk

2014-08-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094252#comment-14094252 ] Alejandro Abdelnur commented on HDFS-6842: -- Ted, this is happening because of HADO

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094239#comment-14094239 ] Alejandro Abdelnur commented on HDFS-6826: -- [~daryn], A proxy NN was one of the a

[jira] [Commented] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094233#comment-14094233 ] Hadoop QA commented on HDFS-6546: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6842) TestHttpFSFWithWebhdfsFileSystem fails in trunk

2014-08-12 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6842: Summary: TestHttpFSFWithWebhdfsFileSystem fails in trunk Key: HDFS-6842 URL: https://issues.apache.org/jira/browse/HDFS-6842 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-6838) Code cleanup for unnecessary INode replacement

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094218#comment-14094218 ] Hudson commented on HDFS-6838: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1835 (See [https://

[jira] [Commented] (HDFS-6582) Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler)

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094213#comment-14094213 ] Hudson commented on HDFS-6582: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1835 (See [https://

[jira] [Commented] (HDFS-6837) Code cleanup for Balancer and Dispatcher

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094217#comment-14094217 ] Hudson commented on HDFS-6837: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1835 (See [https://

[jira] [Commented] (HDFS-6838) Code cleanup for unnecessary INode replacement

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094202#comment-14094202 ] Hudson commented on HDFS-6838: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1861 (See [htt

[jira] [Commented] (HDFS-6837) Code cleanup for Balancer and Dispatcher

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094201#comment-14094201 ] Hudson commented on HDFS-6837: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1861 (See [htt

[jira] [Commented] (HDFS-6582) Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler)

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094197#comment-14094197 ] Hudson commented on HDFS-6582: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1861 (See [htt

[jira] [Work started] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6546 started by Charles Lamb. > Add non-superuser capability to get the encryption zone for a specific path >

[jira] [Updated] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6546: --- Target Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Affects Version/s: fs-encryption (HAD

[jira] [Updated] (HDFS-6546) Add non-superuser capability to get the encryption zone for a specific path

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6546: --- Attachment: HDFS-6546.001.patch Attached is a patch which adds an isEncrypted() method to FileStatus.

[jira] [Updated] (HDFS-6839) Fix TestCLI to expect new output

2014-08-12 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6839: --- Status: Patch Available (was: In Progress) Kick off a jenkins run. > Fix TestCLI to expect new outpu

[jira] [Updated] (HDFS-6841) Use Time.monotonicNow() wherever applicable instead of Time.now()

2014-08-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6841: Summary: Use Time.monotonicNow() wherever applicable instead of Time.now() (was: Use Time.monotonic

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-08-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094130#comment-14094130 ] Daryn Sharp commented on HDFS-6826: --- The critical question is whether a NN backend should

[jira] [Created] (HDFS-6841) Use Time.monotonicNow() whenever applicable instead of Time.now()

2014-08-12 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-6841: --- Summary: Use Time.monotonicNow() whenever applicable instead of Time.now() Key: HDFS-6841 URL: https://issues.apache.org/jira/browse/HDFS-6841 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6840) Clients are always sent to the same datanode when read is off rack

2014-08-12 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094111#comment-14094111 ] Daryn Sharp commented on HDFS-6840: --- bq. My impression of the old pseudo-sort was that i

[jira] [Commented] (HDFS-6247) Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094079#comment-14094079 ] Hadoop QA commented on HDFS-6247: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094054#comment-14094054 ] Alejandro Abdelnur commented on HDFS-6134: -- [~szetszwo], just a regular HttpFS set

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094050#comment-14094050 ] Hadoop QA commented on HDFS-6825: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6838) Code cleanup for unnecessary INode replacement

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094021#comment-14094021 ] Hudson commented on HDFS-6838: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #643 (See [https://b

[jira] [Commented] (HDFS-6837) Code cleanup for Balancer and Dispatcher

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094020#comment-14094020 ] Hudson commented on HDFS-6837: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #643 (See [https://b

[jira] [Commented] (HDFS-6582) Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler)

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094016#comment-14094016 ] Hudson commented on HDFS-6582: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #643 (See [https://b

[jira] [Commented] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093947#comment-14093947 ] Hadoop QA commented on HDFS-6833: - {color:green}+1 overall{color}. Here are the results of

[jira] [Assigned] (HDFS-3862) QJM: don't require a fencer to be configured if shared storage has built-in single-writer semantics

2014-08-12 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-3862: Assignee: Yi Liu > QJM: don't require a fencer to be configured if shared storage has built-in > single-wri

[jira] [Commented] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

2014-08-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093927#comment-14093927 ] Steve Loughran commented on HDFS-6803: -- +1 to not making non-positional reads concurre

[jira] [Updated] (HDFS-6247) Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer

2014-08-12 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-6247: Attachment: HDFS-6247.patch Removed the 20min *blind timeout* for the block movement. > Avoid timeo

  1   2   >