[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-16 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873136#comment-13873136 ] Liang Xie commented on HDFS-5776: - mvn clean test -Dtest=TestPread passed locally:)

[jira] [Updated] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-16 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-5776: Description: This is a placeholder of hdfs related stuff backport from

[jira] [Commented] (HDFS-5292) clean up output of `dfs -du -s`

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873236#comment-13873236 ] Hadoop QA commented on HDFS-5292: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873239#comment-13873239 ] Hadoop QA commented on HDFS-5776: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873275#comment-13873275 ] Hudson commented on HDFS-5768: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #454 (See

[jira] [Commented] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873278#comment-13873278 ] Hudson commented on HDFS-5777: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #454 (See

[jira] [Commented] (HDFS-5762) BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873279#comment-13873279 ] Hudson commented on HDFS-5762: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #454 (See

[jira] [Commented] (HDFS-5766) In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873282#comment-13873282 ] Hudson commented on HDFS-5766: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #454 (See

[jira] [Assigned] (HDFS-5189) Rename the CorruptBlocks metric to CorruptReplicas

2014-01-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reassigned HDFS-5189: - Assignee: (was: Harsh J) Rename the CorruptBlocks metric to CorruptReplicas

[jira] [Commented] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873365#comment-13873365 ] Hudson commented on HDFS-5775: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1671 (See

[jira] [Commented] (HDFS-5762) BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873369#comment-13873369 ] Hudson commented on HDFS-5762: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1671 (See

[jira] [Commented] (HDFS-5766) In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873372#comment-13873372 ] Hudson commented on HDFS-5766: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1671 (See

[jira] [Commented] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873368#comment-13873368 ] Hudson commented on HDFS-5777: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1671 (See

[jira] [Commented] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873366#comment-13873366 ] Hudson commented on HDFS-5768: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1671 (See

[jira] [Commented] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873387#comment-13873387 ] Hudson commented on HDFS-5775: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1646 (See

[jira] [Commented] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873388#comment-13873388 ] Hudson commented on HDFS-5768: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1646 (See

[jira] [Commented] (HDFS-5766) In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873394#comment-13873394 ] Hudson commented on HDFS-5766: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1646 (See

[jira] [Commented] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873390#comment-13873390 ] Hudson commented on HDFS-5777: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1646 (See

[jira] [Commented] (HDFS-5762) BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873391#comment-13873391 ] Hudson commented on HDFS-5762: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1646 (See

[jira] [Created] (HDFS-5788) listLocatedStatus response can be very large

2014-01-16 Thread Nathan Roberts (JIRA)
Nathan Roberts created HDFS-5788: Summary: listLocatedStatus response can be very large Key: HDFS-5788 URL: https://issues.apache.org/jira/browse/HDFS-5788 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

2014-01-16 Thread Eric Sirianni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873518#comment-13873518 ] Eric Sirianni commented on HDFS-5318: - Hi Arpit - would appreciate any feedback you

[jira] [Updated] (HDFS-5153) Datanode should send block reports for each storage in a separate message

2014-01-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Attachment: HDFS-5153.03b.patch Datanode should send block reports for each storage in a separate

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

2014-01-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873566#comment-13873566 ] Arpit Agarwal commented on HDFS-5318: - Hi Eric, thanks for the new patch. I will try to

[jira] [Updated] (HDFS-5318) Support read-only and read-write paths to shared replicas

2014-01-16 Thread Eric Sirianni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318b-branch-2.patch Update patch. Add overload to {{BlocksMap.getStorages()}}

[jira] [Updated] (HDFS-4600) HDFS file append failing in multinode cluster

2014-01-16 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-4600: - Priority: Major (was: Minor) HDFS file append failing in multinode cluster

[jira] [Commented] (HDFS-4600) HDFS file append failing in multinode cluster

2014-01-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873691#comment-13873691 ] Suresh Srinivas commented on HDFS-4600: --- [~cos], looks like you changed the priority.

[jira] [Commented] (HDFS-4600) HDFS file append failing in multinode cluster

2014-01-16 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873695#comment-13873695 ] Konstantin Boudnik commented on HDFS-4600: -- Suresh, I didn't see its fixed, so yes

[jira] [Commented] (HDFS-4600) HDFS file append failing in multinode cluster

2014-01-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873712#comment-13873712 ] Suresh Srinivas commented on HDFS-4600: --- I am actually surprised. Many people have

[jira] [Commented] (HDFS-5761) DataNode fails to validate integrity for checksum type NULL when DataNode recovers

2014-01-16 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873719#comment-13873719 ] Kousuke Saruta commented on HDFS-5761: -- Thanks for your comment, Uma. At first, I

[jira] [Commented] (HDFS-5608) WebHDFS: implement GETACLSTATUS and SETACL.

2014-01-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873722#comment-13873722 ] Chris Nauroth commented on HDFS-5608: - Thanks, Sachin. I'll check out the new patch.

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

2014-01-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873720#comment-13873720 ] Suresh Srinivas commented on HDFS-5788: --- bq. a listLocatedStatus response is over 1MB

[jira] [Commented] (HDFS-4600) HDFS file append failing in multinode cluster

2014-01-16 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873728#comment-13873728 ] Konstantin Boudnik commented on HDFS-4600: -- Actually you're right. I've re-read

[jira] [Resolved] (HDFS-4600) HDFS file append failing in multinode cluster

2014-01-16 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik resolved HDFS-4600. -- Resolution: Invalid The issues seems to be caused by specific cluster configuration

[jira] [Updated] (HDFS-5754) Split LayoutVerion into NamenodeLayoutVersion and DatanodeLayoutVersion

2014-01-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5754: - Attachment: HDFS-5754.003.patch Split LayoutVerion into NamenodeLayoutVersion and DatanodeLayoutVersion

[jira] [Commented] (HDFS-5153) Datanode should send block reports for each storage in a separate message

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873748#comment-13873748 ] Hadoop QA commented on HDFS-5153: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5730) Inconsistent Audit logging for HDFS APIs

2014-01-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-5730: -- Status: Patch Available (was: Open) Inconsistent Audit logging for HDFS APIs

[jira] [Updated] (HDFS-5730) Inconsistent Audit logging for HDFS APIs

2014-01-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-5730: -- Attachment: HDFS-5730.patch I have attached initial version of patch here.

[jira] [Created] (HDFS-5789) Some of snapshot, Cache APIs missing checkOperation double check in fsn

2014-01-16 Thread Uma Maheswara Rao G (JIRA)
Uma Maheswara Rao G created HDFS-5789: - Summary: Some of snapshot, Cache APIs missing checkOperation double check in fsn Key: HDFS-5789 URL: https://issues.apache.org/jira/browse/HDFS-5789

[jira] [Commented] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873815#comment-13873815 ] Haohui Mai commented on HDFS-5758: -- It seems to me that you can enforce the permission by

[jira] [Commented] (HDFS-4564) Webhdfs returns incorrect http response codes for denied operations

2014-01-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873817#comment-13873817 ] Daryn Sharp commented on HDFS-4564: --- This bug will trigger the NPE described HADOOP-9363.

[jira] [Assigned] (HDFS-4564) Webhdfs returns incorrect http response codes for denied operations

2014-01-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-4564: - Assignee: Daryn Sharp Webhdfs returns incorrect http response codes for denied operations

[jira] [Updated] (HDFS-5784) reserve space in edit log header and fsimage header for feature flag section

2014-01-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5784: --- Attachment: HDFS-5784.002.patch reserve space in edit log header and fsimage header

[jira] [Commented] (HDFS-5784) reserve space in edit log header and fsimage header for feature flag section

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873832#comment-13873832 ] Hadoop QA commented on HDFS-5784: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

2014-01-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873839#comment-13873839 ] Jason Lowe commented on HDFS-5788: -- They are usually short-lived but a bit longer-lived

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873859#comment-13873859 ] Hadoop QA commented on HDFS-5318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873865#comment-13873865 ] Chris Nauroth commented on HDFS-5758: - bq. It seems to me that you can enforce the

[jira] [Created] (HDFS-5790) LeaseManager.findPath is very slow when many leases need recovery

2014-01-16 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-5790: - Summary: LeaseManager.findPath is very slow when many leases need recovery Key: HDFS-5790 URL: https://issues.apache.org/jira/browse/HDFS-5790 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5790) LeaseManager.findPath is very slow when many leases need recovery

2014-01-16 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873917#comment-13873917 ] Todd Lipcon commented on HDFS-5790: --- The handler threads were spending most of their time

[jira] [Commented] (HDFS-5790) LeaseManager.findPath is very slow when many leases need recovery

2014-01-16 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873921#comment-13873921 ] Todd Lipcon commented on HDFS-5790: --- Looking at the code, it's not obvious why we need to

[jira] [Updated] (HDFS-5784) reserve space in edit log header and fsimage header for feature flag section

2014-01-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5784: --- Attachment: HDFS-5784.003.patch rebase reserve space in edit log header and fsimage

[jira] [Commented] (HDFS-5754) Split LayoutVerion into NamenodeLayoutVersion and DatanodeLayoutVersion

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873943#comment-13873943 ] Hadoop QA commented on HDFS-5754: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873945#comment-13873945 ] Haohui Mai commented on HDFS-5758: -- I perfer not to baking in the concept of minimal /

[jira] [Created] (HDFS-5791) TestHttpsFileSystem should use a random port to avoid binding error during testing

2014-01-16 Thread Brandon Li (JIRA)
Brandon Li created HDFS-5791: Summary: TestHttpsFileSystem should use a random port to avoid binding error during testing Key: HDFS-5791 URL: https://issues.apache.org/jira/browse/HDFS-5791 Project:

[jira] [Commented] (HDFS-5754) Split LayoutVerion into NamenodeLayoutVersion and DatanodeLayoutVersion

2014-01-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873974#comment-13873974 ] Brandon Li commented on HDFS-5754: -- The unit test failure was not introduced by this

[jira] [Created] (HDFS-5792) DFSOutputStream.close() throws exceptions with unintuitive stacktraces

2014-01-16 Thread Eric Sirianni (JIRA)
Eric Sirianni created HDFS-5792: --- Summary: DFSOutputStream.close() throws exceptions with unintuitive stacktraces Key: HDFS-5792 URL: https://issues.apache.org/jira/browse/HDFS-5792 Project: Hadoop

[jira] [Updated] (HDFS-5434) Write resiliency for replica count 1

2014-01-16 Thread Buddy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Buddy updated HDFS-5434: Attachment: HDFS-5434-branch-2.patch It looks like the consensus for 2.4 is to implement this with block placement

[jira] [Commented] (HDFS-5730) Inconsistent Audit logging for HDFS APIs

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873994#comment-13873994 ] Hadoop QA commented on HDFS-5730: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

2014-01-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873998#comment-13873998 ] Arpit Agarwal commented on HDFS-5434: - Buddy - I think this will be handled by the

[jira] [Updated] (HDFS-5709) Improve upgrade with existing files and directories named .snapshot

2014-01-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5709: -- Attachment: hdfs-5709-2.patch Thanks for the review ATM, here's a new patch. I took all your comments

[jira] [Commented] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874024#comment-13874024 ] Chris Nauroth commented on HDFS-5758: - Is there a benefit to that change (other than

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

2014-01-16 Thread Eric Sirianni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874026#comment-13874026 ] Eric Sirianni commented on HDFS-5434: - Arpit - after some discussion, Buddy and I

[jira] [Commented] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874037#comment-13874037 ] Haohui Mai commented on HDFS-5758: -- bq. Is there a benefit to that change (other than

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named .snapshot

2014-01-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874046#comment-13874046 ] Aaron T. Myers commented on HDFS-5709: -- The latest patch looks pretty good to me. Docs

[jira] [Updated] (HDFS-5793) Optimize the serialization of PermissionStatus

2014-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5793: - Attachment: HDFS-5793.000.patch Optimize the serialization of PermissionStatus

[jira] [Created] (HDFS-5793) Optimize the serialization of PermissionStatus

2014-01-16 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5793: Summary: Optimize the serialization of PermissionStatus Key: HDFS-5793 URL: https://issues.apache.org/jira/browse/HDFS-5793 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5793) Optimize the serialization of PermissionStatus

2014-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874061#comment-13874061 ] Haohui Mai commented on HDFS-5793: -- I've tested the impact of this patch using a 512M

[jira] [Updated] (HDFS-5743) Use protobuf to serialize snapshot information

2014-01-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5743: Attachment: HDFS-5743.000.patch Initial patch. Still need to clean the code and fix unit tests. Use

[jira] [Commented] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874078#comment-13874078 ] Chris Nauroth commented on HDFS-5758: - bq. It's difficult for the client to

[jira] [Commented] (HDFS-5788) listLocatedStatus response can be very large

2014-01-16 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874107#comment-13874107 ] Nathan Roberts commented on HDFS-5788: -- A simple solution is: Restrict the size to

[jira] [Commented] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874113#comment-13874113 ] Haohui Mai commented on HDFS-5758: -- bq. This sounds like a scenario where one person is

[jira] [Updated] (HDFS-5791) TestHttpsFileSystem should use a random port to avoid binding error during testing

2014-01-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5791: - Affects Version/s: 3.0.0 TestHttpsFileSystem should use a random port to avoid binding error during

[jira] [Updated] (HDFS-5794) Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2

2014-01-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5794: Description: Currently in trunk, we have the layout version: {code} EDITLOG_ADD_BLOCK(-48, ...),

[jira] [Created] (HDFS-5794) Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2

2014-01-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-5794: --- Summary: Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2 Key: HDFS-5794 URL: https://issues.apache.org/jira/browse/HDFS-5794

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named .snapshot

2014-01-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874125#comment-13874125 ] Andrew Wang commented on HDFS-5709: --- Woops, I should have mentioned that one. The config

[jira] [Updated] (HDFS-5794) Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2

2014-01-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5794: Status: Patch Available (was: Open) Fix the inconsistency of layout version number of

[jira] [Updated] (HDFS-5794) Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2

2014-01-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5794: Attachment: HDFS-5794.000.patch One solution for this issue is to switch CACHING and

[jira] [Commented] (HDFS-5784) reserve space in edit log header and fsimage header for feature flag section

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874162#comment-13874162 ] Hadoop QA commented on HDFS-5784: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874185#comment-13874185 ] Chris Nauroth commented on HDFS-5758: - bq. I'm referring to distinguishing the ACLs

[jira] [Commented] (HDFS-5784) reserve space in edit log header and fsimage header for feature flag section

2014-01-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874184#comment-13874184 ] Colin Patrick McCabe commented on HDFS-5784: The failure in

[jira] [Commented] (HDFS-5784) reserve space in edit log header and fsimage header for feature flag section

2014-01-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874190#comment-13874190 ] Andrew Wang commented on HDFS-5784: --- LGTM, +1 reserve space in edit log header and

[jira] [Updated] (HDFS-5153) Datanode should send block reports for each storage in a separate message

2014-01-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Attachment: HDFS-5153.04.patch Updated patch with the following changes: # Introduces new conf key

[jira] [Updated] (HDFS-5153) Datanode should send block reports for each storage in a separate message

2014-01-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Attachment: (was: HDFS-5153.04.patch) Datanode should send block reports for each storage in a

[jira] [Updated] (HDFS-5153) Datanode should send block reports for each storage in a separate message

2014-01-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Attachment: HDFS-5153.04.patch Datanode should send block reports for each storage in a separate

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named .snapshot

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874210#comment-13874210 ] Hadoop QA commented on HDFS-5709: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5434) Write resiliency for replica count 1

2014-01-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874212#comment-13874212 ] Arpit Agarwal commented on HDFS-5434: - I think you are right, good catch. Write

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named .snapshot

2014-01-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874217#comment-13874217 ] Jing Zhao commented on HDFS-5709: - Thanks for the work Andrew! I'm now reviewing the patch

[jira] [Commented] (HDFS-5790) LeaseManager.findPath is very slow when many leases need recovery

2014-01-16 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874219#comment-13874219 ] Todd Lipcon commented on HDFS-5790: --- As a quick check of the above, I did the following

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named .snapshot

2014-01-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874247#comment-13874247 ] Jing Zhao commented on HDFS-5709: - The patch looks good to me. Some comments: # In

[jira] [Created] (HDFS-5795) RemoteBlockReader2#checkSuccess() shoud print error status

2014-01-16 Thread Brandon Li (JIRA)
Brandon Li created HDFS-5795: Summary: RemoteBlockReader2#checkSuccess() shoud print error status Key: HDFS-5795 URL: https://issues.apache.org/jira/browse/HDFS-5795 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-5784) reserve space in edit log header and fsimage header for feature flag section

2014-01-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874307#comment-13874307 ] Colin Patrick McCabe commented on HDFS-5784: backport to branch-2 is pending

[jira] [Assigned] (HDFS-5748) Too much information shown in the dfs health page.

2014-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reassigned HDFS-5748: Assignee: Haohui Mai Too much information shown in the dfs health page.

[jira] [Commented] (HDFS-5794) Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2

2014-01-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874306#comment-13874306 ] Colin Patrick McCabe commented on HDFS-5794: +1 for this approach of putting

[jira] [Updated] (HDFS-5784) reserve space in edit log header and fsimage header for feature flag section

2014-01-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5784: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-5794) Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874328#comment-13874328 ] Hadoop QA commented on HDFS-5794: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5784) reserve space in edit log header and fsimage header for feature flag section

2014-01-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874341#comment-13874341 ] Hudson commented on HDFS-5784: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5015 (See

[jira] [Updated] (HDFS-5794) Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2

2014-01-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5794: - Component/s: namenode Priority: Minor (was: Major) +1 patch looks good.

[jira] [Commented] (HDFS-5153) Datanode should send block reports for each storage in a separate message

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874362#comment-13874362 ] Hadoop QA commented on HDFS-5153: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5138) Support HDFS upgrade in HA

2014-01-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5138: - Attachment: HDFS-5138.patch Here's an updated patch which implements Suresh's suggestion of doing

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13874469#comment-13874469 ] Hadoop QA commented on HDFS-5138: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5748) Too much information shown in the dfs health page.

2014-01-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5748: - Attachment: hdfs-5748.png Convert information into tabs. Too much information shown in the dfs health

  1   2   >