[jira] [Updated] (HDFS-6346) Optimize OP_SET_XATTRS by persisting single Xattr entry per setXattr/removeXattr api call

2014-05-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6346: - Attachment: HDFS-6346.1.patch Thanks Uma for the review. {quote} Do you think, we need warn/log to the user that

[jira] [Updated] (HDFS-6381) Fix a typo in INodeReference.java

2014-05-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6381: Resolution: Fixed Fix Version/s: 2.5.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-6283) Write end user documentation for xattrs.

2014-05-13 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997300#comment-13997300 ] Uma Maheswara Rao G commented on HDFS-6283: --- {quote} extended attributes are not

[jira] [Updated] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6293: - Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Release Note: Set "dfs.namenode

[jira] [Created] (HDFS-6394) HDFS encryption documentation

2014-05-13 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created HDFS-6394: Summary: HDFS encryption documentation Key: HDFS-6394 URL: https://issues.apache.org/jira/browse/HDFS-6394 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-05-13 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997264#comment-13997264 ] Uma Maheswara Rao G commented on HDFS-2006: --- Thanks Nicholas, we will update the

[jira] [Commented] (HDFS-6373) Remove support for extended attributes on symlinks

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996856#comment-13996856 ] Andrew Wang commented on HDFS-6373: --- That stacktrace is probably just from how symlink re

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996968#comment-13996968 ] Kihwal Lee commented on HDFS-6293: -- Thanks for the review, Suresh. I will commit this afte

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-05-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997288#comment-13997288 ] Yi Liu commented on HDFS-2006: -- Thanks Nicholas, I agree we have different limits for differen

[jira] [Commented] (HDFS-6366) FsImage loading failed with RemoveXattr op

2014-05-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994182#comment-13994182 ] Yi Liu commented on HDFS-6366: -- +1 for the patch. Thanks Uma. > FsImage loading failed with R

[jira] [Created] (HDFS-6367) Domain>#parse in EnumSetParam fails for parmater containing more than one enum.

2014-05-13 Thread Yi Liu (JIRA)
Yi Liu created HDFS-6367: Summary: Domain>#parse in EnumSetParam fails for parmater containing more than one enum. Key: HDFS-6367 URL: https://issues.apache.org/jira/browse/HDFS-6367 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

2014-05-13 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Fix Version/s: 2.4.1 > Distcp data between two HA clusters requires another configuration >

[jira] [Commented] (HDFS-6383) Upgrade S3n s3.fs.buffer.dir to suppoer multi directories

2014-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997184#comment-13997184 ] Hadoop QA commented on HDFS-6383: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Resolved] (HDFS-6283) Write end user documentation for xattrs.

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6283. --- Resolution: Fixed Fix Version/s: HDFS XAttrs (HDFS-2006) Committed to branch. > Write end user

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-05-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997202#comment-13997202 ] Tsz Wo Nicholas Sze commented on HDFS-2006: --- Thanks [~cnauroth] for showing me th

[jira] [Updated] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6293: - Attachment: HDFS-6293.trunk.patch The patch addresses review comments. I also added a simple check for OIV

[jira] [Commented] (HDFS-6383) Upgrade S3n s3.fs.buffer.dir to suppoer multi directories

2014-05-13 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997211#comment-13997211 ] David S. Wang commented on HDFS-6383: - Thanks Ted for the patch. We should probably us

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-05-13 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996507#comment-13996507 ] Tsz Wo Nicholas Sze commented on HDFS-2006: --- The latest design looks good. For a

[jira] [Created] (HDFS-6396) Remove support for ACL feature from INodeSymlink

2014-05-13 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6396: - Summary: Remove support for ACL feature from INodeSymlink Key: HDFS-6396 URL: https://issues.apache.org/jira/browse/HDFS-6396 Project: Hadoop HDFS Issue Type: Impr

[jira] [Commented] (HDFS-6375) Listing extended attributes with the search permission

2014-05-13 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997120#comment-13997120 ] Charles Lamb commented on HDFS-6375: Alternatively, we could just look at the permissio

[jira] [Updated] (HDFS-6376) Distcp data between two HA clusters requires another configuration

2014-05-13 Thread Dave Marion (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Marion updated HDFS-6376: -- Component/s: hdfs-client datanode > Distcp data between two HA clusters requires anothe

[jira] [Updated] (HDFS-6381) Fix a typo in INodeReference.java

2014-05-13 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-6381: -- Component/s: documentation > Fix a typo in INodeReference.java > - > >

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996873#comment-13996873 ] Kihwal Lee commented on HDFS-6293: -- I will fix all warnings except the two coming from FSI

[jira] [Created] (HDFS-6387) HDFS CLI admin tool for creating & deleting an encryption zone

2014-05-13 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created HDFS-6387: Summary: HDFS CLI admin tool for creating & deleting an encryption zone Key: HDFS-6387 URL: https://issues.apache.org/jira/browse/HDFS-6387 Project: Hadoop HD

[jira] [Commented] (HDFS-6377) Unify xattr name and value limits into a single limit

2014-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997065#comment-13997065 ] Chris Nauroth commented on HDFS-6377: - Ah, thanks for the explanation of the {{cacheMan

[jira] [Updated] (HDFS-6373) Remove support for extended attributes on symlinks

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6373: -- Resolution: Fixed Fix Version/s: HDFS XAttrs (HDFS-2006) Status: Resolved (was: Patch

[jira] [Commented] (HDFS-2576) Namenode should have a favored nodes hint to enable clients to have control over block placement.

2014-05-13 Thread samira elhami (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996841#comment-13996841 ] samira elhami commented on HDFS-2576: - This patch is really helpful. I know it is added

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997142#comment-13997142 ] Kihwal Lee commented on HDFS-6293: -- The failed test is unrelated to this JIRA. It will be

[jira] [Commented] (HDFS-6283) Write end user documentation for xattrs.

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997053#comment-13997053 ] Andrew Wang commented on HDFS-6283: --- New patch attached, thanks for the reviews all. I th

[jira] [Created] (HDFS-6395) Assorted improvements to xattr limit checking

2014-05-13 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6395: - Summary: Assorted improvements to xattr limit checking Key: HDFS-6395 URL: https://issues.apache.org/jira/browse/HDFS-6395 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Updated] (HDFS-6377) Unify xattr name and value limits into a single limit

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6377: -- Attachment: hdfs-6377-2.patch > Unify xattr name and value limits into a single limit >

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-13 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997056#comment-13997056 ] Aaron T. Myers commented on HDFS-6056: -- Why not add proper config deprecations of the

[jira] [Updated] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6293: - Status: Patch Available (was: In Progress) > Issues with OIV processing PB-based fsimages > -

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13997051#comment-13997051 ] Hadoop QA commented on HDFS-6293: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-6385) Show when block deletion will start after NameNode startup in WebUI

2014-05-13 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6385: --- Summary: Show when block deletion will start after NameNode startup in WebUI Key: HDFS-6385 URL: https://issues.apache.org/jira/browse/HDFS-6385 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996582#comment-13996582 ] Hadoop QA commented on HDFS-6293: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6283) Write end user documentation for xattrs.

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6283: -- Attachment: hdfs-6283-2.patch > Write end user documentation for xattrs. > -

[jira] [Updated] (HDFS-6334) Client failover proxy provider for IP failover based NN HA

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6334: - Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-6373) Remove support for extended attributes on symlinks

2014-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996975#comment-13996975 ] Chris Nauroth commented on HDFS-6373: - {quote} This makes sense to me, since symlink pe

[jira] [Commented] (HDFS-6313) WebHdfs may use the wrong NN when configured for multiple HA NNs

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13993042#comment-13993042 ] Kihwal Lee commented on HDFS-6313: -- MiniDFSCluster or NN does not alter the config after i

[jira] [Commented] (HDFS-6373) Remove support for extended attributes on symlinks

2014-05-13 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996912#comment-13996912 ] Charles Lamb commented on HDFS-6373: Yeah, good idea. I've uploaded a new patch. > Rem

[jira] [Updated] (HDFS-6370) Web UI fails to display in intranet under IE

2014-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6370: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Status: Resolved (

[jira] [Work started] (HDFS-6346) Optimize OP_SET_XATTRS by persisting single Xattr entry per setXattr/removeXattr api call

2014-05-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6346 started by Yi Liu. > Optimize OP_SET_XATTRS by persisting single Xattr entry per > setXattr/removeXattr api call > -

[jira] [Updated] (HDFS-6373) Remove support for extended attributes on symlinks

2014-05-13 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6373: --- Attachment: HDFS-6373.1.patch Andrew, attached is a patch which overrides the appropriate xattr method

[jira] [Comment Edited] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996922#comment-13996922 ] Suresh Srinivas edited comment on HDFS-6293 at 5/13/14 9:36 PM: -

[jira] [Commented] (HDFS-6395) Assorted improvements to xattr limit checking

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996989#comment-13996989 ] Andrew Wang commented on HDFS-6395: --- Let's also remove the extra import in FSNamesystem t

[jira] [Updated] (HDFS-6373) Remove support for extended attributes on symlinks

2014-05-13 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6373: --- Attachment: HDFS-6373.2.patch > Remove support for extended attributes on symlinks > -

[jira] [Commented] (HDFS-6370) Web UI fails to display in intranet under IE

2014-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996809#comment-13996809 ] Hadoop QA commented on HDFS-6370: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996922#comment-13996922 ] Suresh Srinivas commented on HDFS-6293: --- +1 for the patch. Thanks [~hmai] and [~kihwa

[jira] [Updated] (HDFS-6378) NFS: when portmap/rpcbind is not available, NFS registration should timeout instead of hanging

2014-05-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6378: - Description: NFS gateway should > NFS: when portmap/rpcbind is not available, NFS registration should ti

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-05-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995608#comment-13995608 ] Alejandro Abdelnur commented on HDFS-6134: -- Owen, I think the docs posted in HADOO

[jira] [Commented] (HDFS-6373) Remove support for extended attributes on symlinks

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996905#comment-13996905 ] Andrew Wang commented on HDFS-6373: --- This is basically what I had in mind, but how do you

[jira] [Commented] (HDFS-6345) DFS.listCacheDirectives() should allow filtering based on cache directive ID

2014-05-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996783#comment-13996783 ] Colin Patrick McCabe commented on HDFS-6345: {code} +// Querying for a sing

[jira] [Commented] (HDFS-6283) Write end user documentation for xattrs.

2014-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996767#comment-13996767 ] Chris Nauroth commented on HDFS-6283: - Hi, Andrew. The new content looks great. Here

[jira] [Updated] (HDFS-6056) Clean up NFS config settings

2014-05-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6056: - Attachment: HDFS-6056.004.patch > Clean up NFS config settings > > >

[jira] [Commented] (HDFS-6370) Web UI fails to display in intranet under IE

2014-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996834#comment-13996834 ] Chris Nauroth commented on HDFS-6370: - bq. -1 tests included. The patch doesn't appear

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996649#comment-13996649 ] Kihwal Lee commented on HDFS-6293: -- Ouch. The patch applies to trunk but it introduces a d

[jira] [Created] (HDFS-6384) Provide an alternative offline file system analysis tool

2014-05-13 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6384: Summary: Provide an alternative offline file system analysis tool Key: HDFS-6384 URL: https://issues.apache.org/jira/browse/HDFS-6384 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-6383) Upgrade S3n s3.fs.buffer.dir to suppoer multi directories

2014-05-13 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HDFS-6383: -- Attachment: HDFS-6383.patch This solves the problem. Thanks to: Joe Prosser, Dave Wang, Andrei Savu and

[jira] [Updated] (HDFS-6367) EnumSetParam$Domain#parse fails for parameter containing more than one enum.

2014-05-13 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-6367: -- Description: Fails because additional "," -

[jira] [Updated] (HDFS-6355) Fix divide-by-zero, improper use of wall-clock time in BlockPoolSliceScanner

2014-05-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6355: --- Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-6056) Clean up NFS config settings

2014-05-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6056: - Description: As discussed on HDFS-6050, there's a few opportunities to improve the config settings related

[jira] [Commented] (HDFS-6377) Unify xattr name and value limits into a single limit

2014-05-13 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995997#comment-13995997 ] Uma Maheswara Rao G commented on HDFS-6377: --- Thanks a lot, Andrew for filing thi

[jira] [Resolved] (HDFS-6380) TestBalancerWithNodeGroup is failing in trunk

2014-05-13 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G resolved HDFS-6380. --- Resolution: Duplicate > TestBalancerWithNodeGroup is failing in trunk > --

[jira] [Commented] (HDFS-6186) Pause deletion of blocks when the namenode starts up

2014-05-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996688#comment-13996688 ] Suresh Srinivas commented on HDFS-6186: --- +1 for the patch. We should create another

[jira] [Updated] (HDFS-6346) Optimize OP_SET_XATTRS by persisting single Xattr entry per setXattr/removeXattr api call

2014-05-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6346: - Attachment: HDFS-6346.2.patch Uma, thanks for review and collecting the improvement data. That's great. The new p

[jira] [Commented] (HDFS-6369) RemoteBlockReader#available() should call FSInputChecker.available()

2014-05-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995294#comment-13995294 ] Colin Patrick McCabe commented on HDFS-6369: The calling code in {{DFSInputStre

[jira] [Updated] (HDFS-6230) Expose upgrade status through NameNode web UI

2014-05-13 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated HDFS-6230: Attachment: HDFS-6230.patch Thanks for looking at the patch [~wheat9]. Posting the updated patch. > Expose

[jira] [Updated] (HDFS-6326) WebHdfs ACL compatibility is broken

2014-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6326: Attachment: HDFS-6326.5.patch Daryn, that looks like a good suggestion to me. Here is patch v5 inco

[jira] [Updated] (HDFS-6367) Domain>#parse in EnumSetParam fails for parmater containing more than one enum.

2014-05-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6367: - Attachment: HDFS-6367.patch The "," should not be contained. > Domain>#parse in EnumSetParam fails for parmater c

[jira] [Updated] (HDFS-6370) Web UI fails to display in intranet under IE

2014-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6370: Component/s: namenode journal-node datanode

[jira] [Commented] (HDFS-6056) Clean up NFS config settings

2014-05-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996698#comment-13996698 ] Brandon Li commented on HDFS-6056: -- [~jingzhao], thanks for the review. I've update the ji

[jira] [Updated] (HDFS-6361) TestIdUserGroup.testUserUpdateSetting failed due to out of range nfsnobody Id

2014-05-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6361: Attachment: HDFS-6361.003.patch > TestIdUserGroup.testUserUpdateSetting failed due to out of range n

[jira] [Commented] (HDFS-6340) DN can't finalize upgarde

2014-05-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992964#comment-13992964 ] Arpit Agarwal commented on HDFS-6340: - It looks like the previous build aborted. I kick

[jira] [Commented] (HDFS-6357) SetXattr should persist rpcIDs for handling retrycache with Namenode restart and HA

2014-05-13 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13994293#comment-13994293 ] Uma Maheswara Rao G commented on HDFS-6357: --- Thanks a lot, for the reviews Yi and

[jira] [Comment Edited] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996649#comment-13996649 ] Kihwal Lee edited comment on HDFS-6293 at 5/13/14 5:19 PM: --- Oops.

[jira] [Commented] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types

2014-05-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996072#comment-13996072 ] Zesheng Wu commented on HDFS-5682: -- Thanks [~ndimiduk], here are some details of our SLA r

[jira] [Commented] (HDFS-6250) TestBalancerWithNodeGroup.testBalancerWithRackLocality fails

2014-05-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996207#comment-13996207 ] Junping Du commented on HDFS-6250: -- Hi [~decster], patch LGTM. Would you run 50 iterations

[jira] [Commented] (HDFS-6326) WebHdfs ACL compatibility is broken

2014-05-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995821#comment-13995821 ] Chris Nauroth commented on HDFS-6326: - I've repeated my compatibility testing on patch

[jira] [Assigned] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-6293: Assignee: Kihwal Lee (was: Haohui Mai) > Issues with OIV processing PB-based fsimages > ---

[jira] [Commented] (HDFS-6371) In HA setup, the standby NN should redirect WebHDFS write requests to the active NN

2014-05-13 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996394#comment-13996394 ] Daryn Sharp commented on HDFS-6371: --- Agreed on client side retries. With IP-based failov

[jira] [Commented] (HDFS-6381) Fix a typo in INodeReference.java

2014-05-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996213#comment-13996213 ] Junping Du commented on HDFS-6381: -- Kick off Jenkins test manually. > Fix a typo in INode

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996442#comment-13996442 ] Kihwal Lee commented on HDFS-6293: -- Here is recap. * oiv_legacy for debugging and inspecti

[jira] [Updated] (HDFS-6383) Upgrade S3n s3.fs.buffer.dir to suppoer multi directories

2014-05-13 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Malaska updated HDFS-6383: -- Status: Patch Available (was: Open) Patch is ready > Upgrade S3n s3.fs.buffer.dir to suppoer multi dir

[jira] [Commented] (HDFS-6373) Remove support for extended attributes on symlinks

2014-05-13 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996425#comment-13996425 ] Charles Lamb commented on HDFS-6373: While investigating this, I noticed this in the Te

[jira] [Commented] (HDFS-6186) Pause deletion of blocks when the namenode starts up

2014-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996194#comment-13996194 ] Hadoop QA commented on HDFS-6186: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6345) DFS.listCacheDirectives() should allow filtering based on cache directive ID

2014-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996149#comment-13996149 ] Hadoop QA commented on HDFS-6345: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6377) Unify xattr name and value limits into a single limit

2014-05-13 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996396#comment-13996396 ] Charles Lamb commented on HDFS-6377: In general, LGTM. One nit (piling on Uma's comment

[jira] [Commented] (HDFS-6325) Append should fail if the last block has insufficient number of replicas

2014-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995837#comment-13995837 ] Hadoop QA commented on HDFS-6325: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6293) Issues with OIV processing PB-based fsimages

2014-05-13 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995444#comment-13995444 ] Kihwal Lee commented on HDFS-6293: -- bq. can you please mark the class that are brought

[jira] [Commented] (HDFS-6328) Clean up dead code in FSDirectory

2014-05-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995409#comment-13995409 ] Hudson commented on HDFS-6328: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5603 (See [https:

[jira] [Created] (HDFS-6382) HDFS File/Directory TTL

2014-05-13 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6382: Summary: HDFS File/Directory TTL Key: HDFS-6382 URL: https://issues.apache.org/jira/browse/HDFS-6382 Project: Hadoop HDFS Issue Type: Improvement Component

[jira] [Commented] (HDFS-6230) Expose upgrade status through NameNode web UI

2014-05-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995340#comment-13995340 ] Haohui Mai commented on HDFS-6230: -- +1. I'll commit it shortly. > Expose upgrade status t

[jira] [Commented] (HDFS-6305) WebHdfs response decoding may throw RuntimeExceptions

2014-05-13 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995737#comment-13995737 ] Jonathan Eagles commented on HDFS-6305: --- Kicked jenkins. there are 3 or 4 builds ahea

[jira] [Created] (HDFS-6379) HTTPFS - Implement ACLs support

2014-05-13 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created HDFS-6379: Summary: HTTPFS - Implement ACLs support Key: HDFS-6379 URL: https://issues.apache.org/jira/browse/HDFS-6379 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6345) DFS.listCacheDirectives() should allow filtering based on cache directive ID

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6345: -- Attachment: hdfs-6345-1.patch Patch attached. I did manual testing with a branch-2 NN and the new client

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996245#comment-13996245 ] Steve Loughran commented on HDFS-6134: -- Some side comments # The ASF don't want to be

[jira] [Commented] (HDFS-6374) setXAttr should require the user to be the owner of the file or directory

2014-05-13 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13995988#comment-13995988 ] Yi Liu commented on HDFS-6374: -- setXAttr/removeXAttr are only for owner, and getXAttr are *not

[jira] [Updated] (HDFS-6382) HDFS File/Directory TTL

2014-05-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6382: - Description: In production environment, we always have scenario like this, we want to backup files on hdf

[jira] [Assigned] (HDFS-6377) Unify xattr name and value limits into a single limit

2014-05-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-6377: - Assignee: Andrew Wang > Unify xattr name and value limits into a single limit > --

  1   2   >