[jira] [Commented] (HDFS-3875) Issue handling checksum errors in write pipeline

2013-05-15 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659229#comment-13659229 ] Lohit Vijayarenu commented on HDFS-3875: Could this be targeted for 2.0.5 release?

[jira] [Commented] (HDFS-4826) TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk

2013-05-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659189#comment-13659189 ] Chris Nauroth commented on HDFS-4826: - Thank you, Colin and Nicholas!

[jira] [Commented] (HDFS-4826) TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk

2013-05-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659138#comment-13659138 ] Hudson commented on HDFS-4826: -- Integrated in Hadoop-trunk-Commit #3756 (See [https://builds.

[jira] [Updated] (HDFS-4826) TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk

2013-05-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4826: - Component/s: (was: namenode) Priority: Minor (was: Major)

[jira] [Updated] (HDFS-4826) TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk

2013-05-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4826: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Pa

[jira] [Commented] (HDFS-4827) Slight update to the implementation of API for handling favored nodes in DFSClient

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659071#comment-13659071 ] Hadoop QA commented on HDFS-4827: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-4815) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

2013-05-15 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659057#comment-13659057 ] Tian Hong Wang commented on HDFS-4815: -- Thanks Chris for your comment.

[jira] [Commented] (HDFS-4826) TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659055#comment-13659055 ] Hadoop QA commented on HDFS-4826: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4824) FileInputStreamCache.close leaves dangling reference to FileInputStreamCache.cacheCleaner

2013-05-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659047#comment-13659047 ] Todd Lipcon commented on HDFS-4824: --- Patch looks good. One more thought which might be un

[jira] [Commented] (HDFS-4826) TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk

2013-05-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659046#comment-13659046 ] Colin Patrick McCabe commented on HDFS-4826: This looks good to me. This is ex

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2013-05-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658986#comment-13658986 ] Todd Lipcon commented on HDFS-347: -- I ran the common and HDFS tests. Everything passed exce

[jira] [Commented] (HDFS-4825) webhdfs / httpfs tests broken because of min block size change

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658981#comment-13658981 ] Hadoop QA commented on HDFS-4825: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4815) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

2013-05-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4815: Summary: TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countR

[jira] [Commented] (HDFS-4815) Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

2013-05-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658975#comment-13658975 ] Chris Nauroth commented on HDFS-4815: - +1 for the patch. Nice catch, Tian. I ran the

[jira] [Updated] (HDFS-4815) Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

2013-05-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4815: Component/s: test datanode > Double call countReplicas() to fetch corruptReplic

[jira] [Updated] (HDFS-4825) webhdfs / httpfs tests broken because of min block size change

2013-05-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4825: - Target Version/s: 2.0.5-beta > webhdfs / httpfs tests broken because of min block size change

[jira] [Updated] (HDFS-4825) webhdfs / httpfs tests broken because of min block size change

2013-05-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4825: - Affects Version/s: 2.0.5-beta Status: Patch Available (was: Open) Marking PA for A

[jira] [Updated] (HDFS-4827) Slight update to the implementation of API for handling favored nodes in DFSClient

2013-05-15 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HDFS-4827: -- Status: Patch Available (was: Open) > Slight update to the implementation of API for handling favor

[jira] [Updated] (HDFS-4827) Slight update to the implementation of API for handling favored nodes in DFSClient

2013-05-15 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HDFS-4827: -- Attachment: hdfs-4827-1.txt Straightforward patch. In order for getting this to work, I had to change th

[jira] [Created] (HDFS-4827) Slight update to the implementation of API for handling favored nodes in DFSClient

2013-05-15 Thread Devaraj Das (JIRA)
Devaraj Das created HDFS-4827: - Summary: Slight update to the implementation of API for handling favored nodes in DFSClient Key: HDFS-4827 URL: https://issues.apache.org/jira/browse/HDFS-4827 Project: Had

[jira] [Updated] (HDFS-4826) TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk

2013-05-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4826: Attachment: HDFS-4826.1.patch This patch works around the problem by calling {{EditLogFileOutputStr

[jira] [Updated] (HDFS-4826) TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk

2013-05-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4826: Status: Patch Available (was: Open) > TestNestedSnapshots times out due to repeated slow edit l

[jira] [Created] (HDFS-4826) TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk

2013-05-15 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-4826: --- Summary: TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk Key: HDFS-4826 URL: https://issues.apache.org/jira/browse/HDFS-4826

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2013-05-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658864#comment-13658864 ] Chris Nauroth commented on HDFS-2802: - Nicholas, I have not been able to get a successf

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-05-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658863#comment-13658863 ] Andrew Wang commented on HDFS-4305: --- Thanks for the finding this, Suresh. I put a tiny pa

[jira] [Updated] (HDFS-4825) webhdfs / httpfs tests broken because of min block size change

2013-05-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4825: -- Attachment: hdfs-4825-1.patch Patch attached. It's the same change we've used for other projects. I ran

[jira] [Created] (HDFS-4825) webhdfs / httpfs tests broken because of min block size change

2013-05-15 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-4825: - Summary: webhdfs / httpfs tests broken because of min block size change Key: HDFS-4825 URL: https://issues.apache.org/jira/browse/HDFS-4825 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-4824) FileInputStreamCache.close leaves dangling reference to FileInputStreamCache.cacheCleaner

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658850#comment-13658850 ] Hadoop QA commented on HDFS-4824: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2013-05-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658819#comment-13658819 ] Todd Lipcon commented on HDFS-347: -- I cherry-picked the merge commit and two related follow

[jira] [Updated] (HDFS-4824) FileInputStreamCache.close leaves dangling reference to FileInputStreamCache.cacheCleaner

2013-05-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4824: --- Status: Patch Available (was: Open) > FileInputStreamCache.close leaves dangling

[jira] [Updated] (HDFS-4824) FileInputStreamCache.close leaves dangling reference to FileInputStreamCache.cacheCleaner

2013-05-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4824: --- Attachment: HDFS-4824.001.patch > FileInputStreamCache.close leaves dangling refer

[jira] [Commented] (HDFS-4824) FileInputStreamCache.close leaves dangling reference to FileInputStreamCache.cacheCleaner

2013-05-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658692#comment-13658692 ] Colin Patrick McCabe commented on HDFS-4824: OK, I figured out what is going on

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2013-05-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658665#comment-13658665 ] Tsz Wo (Nicholas), SZE commented on HDFS-2802: -- Thanks Chris for running the t

[jira] [Commented] (HDFS-3509) WebHdfsFilesystem does not work within a proxyuser doAs call in secure mode

2013-05-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658561#comment-13658561 ] Daryn Sharp commented on HDFS-3509: --- Is this still needed? I think this has been fixed b

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2013-05-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658521#comment-13658521 ] Chris Nauroth commented on HDFS-2802: - I just want to drop a quick note about Windows c

[jira] [Commented] (HDFS-4813) BlocksMap may throw NullPointerException during shutdown

2013-05-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658382#comment-13658382 ] Hudson commented on HDFS-4813: -- Integrated in Hadoop-Mapreduce-trunk #1426 (See [https://buil

[jira] [Commented] (HDFS-3180) Add socket timeouts to webhdfs

2013-05-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658381#comment-13658381 ] Hudson commented on HDFS-3180: -- Integrated in Hadoop-Mapreduce-trunk #1426 (See [https://buil

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2013-05-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658373#comment-13658373 ] Suresh Srinivas commented on HDFS-4305: --- See - https://builds.apache.org/job/Hadoop-H

[jira] [Commented] (HDFS-4813) BlocksMap may throw NullPointerException during shutdown

2013-05-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658346#comment-13658346 ] Hudson commented on HDFS-4813: -- Integrated in Hadoop-Hdfs-trunk #1399 (See [https://builds.ap

[jira] [Commented] (HDFS-3180) Add socket timeouts to webhdfs

2013-05-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658345#comment-13658345 ] Hudson commented on HDFS-3180: -- Integrated in Hadoop-Hdfs-trunk #1399 (See [https://builds.ap

[jira] [Commented] (HDFS-3180) Add socket timeouts to webhdfs

2013-05-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658236#comment-13658236 ] Hudson commented on HDFS-3180: -- Integrated in Hadoop-Yarn-trunk #210 (See [https://builds.apa

[jira] [Commented] (HDFS-4813) BlocksMap may throw NullPointerException during shutdown

2013-05-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13658237#comment-13658237 ] Hudson commented on HDFS-4813: -- Integrated in Hadoop-Yarn-trunk #210 (See [https://builds.apa