[jira] [Updated] (HDFS-3163) TestHDFSCLI.testAll fails if the user name is not all lowercase

[ https://issues.apache.org/jira/browse/HDFS-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-3163: - Assignee: Brandon Li Status: Patch Available (was: Open) TestHDFSCLI.testAll fails if the

[jira] [Commented] (HDFS-3134) harden edit log loader against malformed or malicious input

[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272879#comment-13272879 ] Eli Collins commented on HDFS-3134: --- +1 looks good harden edit log

[jira] [Updated] (HDFS-3134) Harden edit log loader against malformed or malicious input

[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3134: -- Target Version/s: (was: 2.0.0) Fix Version/s: 2.0.0 Issue Type: Improvement (was:

[jira] [Updated] (HDFS-744) Support hsync in HDFS

[ https://issues.apache.org/jira/browse/HDFS-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl updated HDFS-744: --- Attachment: HDFS-744-trunk-v2.patch Patch that I tested against HBase. (I post the required HBase

[jira] [Commented] (HDFS-3134) Harden edit log loader against malformed or malicious input

[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272895#comment-13272895 ] Hudson commented on HDFS-3134: -- Integrated in Hadoop-Hdfs-trunk-Commit #2299 (See

[jira] [Commented] (HDFS-3388) GetJournalEditServlet should catch more exceptions, not just IOException

[ https://issues.apache.org/jira/browse/HDFS-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272896#comment-13272896 ] Tsz Wo (Nicholas), SZE commented on HDFS-3388: -- - Since

[jira] [Commented] (HDFS-3401) Cleanup DatanodeDescriptor creation in the tests

[ https://issues.apache.org/jira/browse/HDFS-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272909#comment-13272909 ] Hadoop QA commented on HDFS-3401: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3031) HA: Error (failed to close file) when uploading large file + kill active NN + manual failover

[ https://issues.apache.org/jira/browse/HDFS-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3031: -- Attachment: hdfs-3031.txt New rev fixes the issue with append(): the problem is that the client doesn't

[jira] [Commented] (HDFS-3404) Make putImage in GetImageServlet infer remote address to fetch from

[ https://issues.apache.org/jira/browse/HDFS-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272916#comment-13272916 ] Eli Collins commented on HDFS-3404: --- The approach - have the NN determine the hostname of

[jira] [Commented] (HDFS-3335) check for edit log corruption at the end of the log

[ https://issues.apache.org/jira/browse/HDFS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272919#comment-13272919 ] Hadoop QA commented on HDFS-3335: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3401) Cleanup DatanodeDescriptor creation in the tests

[ https://issues.apache.org/jira/browse/HDFS-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3401: -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: (was: 2.0.0) Hadoop

[jira] [Commented] (HDFS-3134) Harden edit log loader against malformed or malicious input

[ https://issues.apache.org/jira/browse/HDFS-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272924#comment-13272924 ] Hudson commented on HDFS-3134: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2242 (See

[jira] [Commented] (HDFS-3401) Cleanup DatanodeDescriptor creation in the tests

[ https://issues.apache.org/jira/browse/HDFS-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272927#comment-13272927 ] Hudson commented on HDFS-3401: -- Integrated in Hadoop-Hdfs-trunk-Commit #2300 (See

[jira] [Commented] (HDFS-3335) check for edit log corruption at the end of the log

[ https://issues.apache.org/jira/browse/HDFS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272929#comment-13272929 ] Todd Lipcon commented on HDFS-3335: --- In {{EditLogFileInputStream.nextOp}}, we should log

[jira] [Commented] (HDFS-3401) Cleanup DatanodeDescriptor creation in the tests

[ https://issues.apache.org/jira/browse/HDFS-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272931#comment-13272931 ] Hudson commented on HDFS-3401: -- Integrated in Hadoop-Common-trunk-Commit #2225 (See

[jira] [Commented] (HDFS-3163) TestHDFSCLI.testAll fails if the user name is not all lowercase

[ https://issues.apache.org/jira/browse/HDFS-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272932#comment-13272932 ] Brandon Li commented on HDFS-3163: -- I tested the patch by running TestHDFSCLI. It passed

[jira] [Commented] (HDFS-3031) HA: Error (failed to close file) when uploading large file + kill active NN + manual failover

[ https://issues.apache.org/jira/browse/HDFS-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272933#comment-13272933 ] Hadoop QA commented on HDFS-3031: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3385) ClassCastException when trying to append a file

[ https://issues.apache.org/jira/browse/HDFS-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272934#comment-13272934 ] Suresh Srinivas commented on HDFS-3385: --- +1 for the patch.

[jira] [Updated] (HDFS-3031) HA: Error (failed to close file) when uploading large file + kill active NN + manual failover

[ https://issues.apache.org/jira/browse/HDFS-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3031: -- Attachment: hdfs-3031.txt Woops, my previously uploaded patch was accidentally against the auto-HA

[jira] [Commented] (HDFS-3335) check for edit log corruption at the end of the log

[ https://issues.apache.org/jira/browse/HDFS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272945#comment-13272945 ] Colin Patrick McCabe commented on HDFS-3335: * Yeah, your understanding of

[jira] [Commented] (HDFS-3401) Cleanup DatanodeDescriptor creation in the tests

[ https://issues.apache.org/jira/browse/HDFS-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272957#comment-13272957 ] Hudson commented on HDFS-3401: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2243 (See

[jira] [Commented] (HDFS-3385) ClassCastException when trying to append a file

[ https://issues.apache.org/jira/browse/HDFS-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272963#comment-13272963 ] Hudson commented on HDFS-3385: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2244 (See

[jira] [Commented] (HDFS-3163) TestHDFSCLI.testAll fails if the user name is not all lowercase

[ https://issues.apache.org/jira/browse/HDFS-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272970#comment-13272970 ] Hadoop QA commented on HDFS-3163: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3394) Do not use generic in INodeFile.getLastBlock()

[ https://issues.apache.org/jira/browse/HDFS-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3394: - Status: Patch Available (was: Open) Do not use generic in

[jira] [Updated] (HDFS-3388) GetJournalEditServlet should close output stream only if the stream is used.

[ https://issues.apache.org/jira/browse/HDFS-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3388: - Summary: GetJournalEditServlet should close output stream only if the stream

[jira] [Commented] (HDFS-3031) HA: Error (failed to close file) when uploading large file + kill active NN + manual failover

[ https://issues.apache.org/jira/browse/HDFS-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272985#comment-13272985 ] Hadoop QA commented on HDFS-3031: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

[ https://issues.apache.org/jira/browse/HDFS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3368: -- Attachment: blockDeletePolicy-0.22.patch Missing blocks due to bad DataNodes

[jira] [Updated] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

[ https://issues.apache.org/jira/browse/HDFS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3368: -- Target Version/s: 0.22.1, 2.0.0, 3.0.0 (was: 3.0.0, 2.0.0, 0.22.1)

[jira] [Commented] (HDFS-3394) Do not use generic in INodeFile.getLastBlock()

[ https://issues.apache.org/jira/browse/HDFS-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272997#comment-13272997 ] Hadoop QA commented on HDFS-3394: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3400) DNs should be able start with jsvc even if security is disabled

[ https://issues.apache.org/jira/browse/HDFS-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3400: -- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: (was: 2.0.0) Hadoop

[jira] [Commented] (HDFS-3400) DNs should be able start with jsvc even if security is disabled

[ https://issues.apache.org/jira/browse/HDFS-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273006#comment-13273006 ] Hudson commented on HDFS-3400: -- Integrated in Hadoop-Hdfs-trunk-Commit #2302 (See

[jira] [Commented] (HDFS-3400) DNs should be able start with jsvc even if security is disabled

[ https://issues.apache.org/jira/browse/HDFS-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273007#comment-13273007 ] Hudson commented on HDFS-3400: -- Integrated in Hadoop-Common-trunk-Commit #2228 (See

[jira] [Commented] (HDFS-2391) Newly set BalancerBandwidth value is not displayed anywhere

[ https://issues.apache.org/jira/browse/HDFS-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273008#comment-13273008 ] Eli Collins commented on HDFS-2391: --- How about just one info log? {code} +

[jira] [Updated] (HDFS-3335) check for edit log corruption at the end of the log

[ https://issues.apache.org/jira/browse/HDFS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3335: --- Attachment: HDFS-3335.008.patch * EditLogFileInputStream: warn when skipping the last

[jira] [Updated] (HDFS-2391) Newly set BalancerBandwidth value is not displayed anywhere

[ https://issues.apache.org/jira/browse/HDFS-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2391: -- Attachment: HDFS-2391.patch Done. Newly set BalancerBandwidth value is not displayed anywhere

[jira] [Commented] (HDFS-3400) DNs should be able start with jsvc even if security is disabled

[ https://issues.apache.org/jira/browse/HDFS-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273025#comment-13273025 ] Hudson commented on HDFS-3400: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2245 (See

[jira] [Commented] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

[ https://issues.apache.org/jira/browse/HDFS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273032#comment-13273032 ] Hadoop QA commented on HDFS-3368: - +1 overall. Here are the results of testing the latest

[jira] [Created] (HDFS-3405) Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages

Aaron T. Myers created HDFS-3405: Summary: Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages Key: HDFS-3405 URL: https://issues.apache.org/jira/browse/HDFS-3405

[jira] [Commented] (HDFS-3391) TestPipelinesFailover#testLeaseRecoveryAfterFailover is failing

[ https://issues.apache.org/jira/browse/HDFS-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273034#comment-13273034 ] Todd Lipcon commented on HDFS-3391: --- I looped TestPipelinesFailover for quite some time

[jira] [Commented] (HDFS-3335) check for edit log corruption at the end of the log

[ https://issues.apache.org/jira/browse/HDFS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273041#comment-13273041 ] Hadoop QA commented on HDFS-3335: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3404) Make putImage in GetImageServlet infer remote address to fetch from

[ https://issues.apache.org/jira/browse/HDFS-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273044#comment-13273044 ] Aaron T. Myers commented on HDFS-3404: -- bq. This change needs to be made to the 2NN as

[jira] [Commented] (HDFS-2391) Newly set BalancerBandwidth value is not displayed anywhere

[ https://issues.apache.org/jira/browse/HDFS-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273048#comment-13273048 ] Hadoop QA commented on HDFS-2391: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3391) TestPipelinesFailover#testLeaseRecoveryAfterFailover is failing

[ https://issues.apache.org/jira/browse/HDFS-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13273052#comment-13273052 ] Todd Lipcon commented on HDFS-3391: --- I was able to reproduce this by reapplying HDFS-3157

[jira] [Updated] (HDFS-3404) Make putImage in GetImageServlet infer remote address to fetch from

[ https://issues.apache.org/jira/browse/HDFS-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3404: - Attachment: HDFS-3404.patch Here's an updated patch which addresses Eli's review feedback. I

[jira] [Updated] (HDFS-3404) Make putImage in GetImageServlet infer remote address to fetch from

[ https://issues.apache.org/jira/browse/HDFS-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3404: - Status: Patch Available (was: Open) Make putImage in GetImageServlet infer remote address

<    1   2