[jira] [Commented] (HDFS-3671) ByteRangeInputStream shouldn't require the content length header be present

2012-08-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436541#comment-13436541 ] Tsz Wo (Nicholas), SZE commented on HDFS-3671: -- After HDFS-3788, do we still n

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436536#comment-13436536 ] Hudson commented on HDFS-2421: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2623 (See [https

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436533#comment-13436533 ] Hadoop QA commented on HDFS-3788: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436529#comment-13436529 ] Hadoop QA commented on HDFS-3672: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436526#comment-13436526 ] Hudson commented on HDFS-3788: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2622 (See [https

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436521#comment-13436521 ] Uma Maheswara Rao G commented on HDFS-3194: --- Thanks Andy, for your verification.

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436517#comment-13436517 ] Hudson commented on HDFS-2421: -- Integrated in Hadoop-Hdfs-trunk-Commit #2657 (See [https://bu

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436518#comment-13436518 ] Hudson commented on HDFS-3788: -- Integrated in Hadoop-Hdfs-trunk-Commit #2657 (See [https://bu

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436513#comment-13436513 ] Hudson commented on HDFS-3788: -- Integrated in Hadoop-Common-trunk-Commit #2592 (See [https://

[jira] [Commented] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436512#comment-13436512 ] Hudson commented on HDFS-2421: -- Integrated in Hadoop-Common-trunk-Commit #2592 (See [https://

[jira] [Commented] (HDFS-3812) TestNameNodeMetrics.testCorruptBlock fails

2012-08-16 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436510#comment-13436510 ] Trevor Robinson commented on HDFS-3812: --- Yeah, I guess so. There must have been so ma

[jira] [Updated] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2421: - Resolution: Fixed Fix Version/s: (was: 0.24.0) 2.2.0-

[jira] [Updated] (HDFS-2421) Improve the concurrency of SerialNumberMap in NameNode

2012-08-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2421: - Hadoop Flags: Reviewed +1 patch looks good. > Improve the concurr

[jira] [Updated] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3788: - Resolution: Fixed Fix Version/s: 2.2.0-alpha Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3788: - Attachment: h3788_20120816.patch Fair enough. I added spaces in the comment so th

[jira] [Updated] (HDFS-3805) A small improvement of SerialNumberManager$SerialNumberMap.get

2012-08-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3805: Resolution: Invalid Status: Resolved (was: Patch Available) Already solved by HDFS-2421

[jira] [Created] (HDFS-3813) Secure NameNode startup has bad error message (Principal not defined in configuration) if WebHDFS is enabled but its principal is not configured

2012-08-16 Thread Stephen Chu (JIRA)
Stephen Chu created HDFS-3813: - Summary: Secure NameNode startup has bad error message (Principal not defined in configuration) if WebHDFS is enabled but its principal is not configured Key: HDFS-3813 URL: https://is

[jira] [Updated] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3672: -- Attachment: hdfs-3672-12.patch My bad, should have followed that hostname change a little more closely.

[jira] [Commented] (HDFS-2727) hdfs.c uses deprecated property dfs.block.size

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436488#comment-13436488 ] Hadoop QA commented on HDFS-2727: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436479#comment-13436479 ] Hudson commented on HDFS-3808: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2621 (See [https

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436453#comment-13436453 ] Hudson commented on HDFS-3808: -- Integrated in Hadoop-Hdfs-trunk-Commit #2656 (See [https://bu

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436447#comment-13436447 ] Hudson commented on HDFS-3808: -- Integrated in Hadoop-Common-trunk-Commit #2591 (See [https://

[jira] [Updated] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3808: - Resolution: Fixed Fix Version/s: 2.2.0-alpha Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436428#comment-13436428 ] Aaron T. Myers commented on HDFS-3808: -- +1, the latest patch looks good to me. I'm con

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436418#comment-13436418 ] Aaron T. Myers commented on HDFS-3672: -- The latest patch looks pretty good to me, and

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436417#comment-13436417 ] Hadoop QA commented on HDFS-3808: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436405#comment-13436405 ] Hadoop QA commented on HDFS-3808: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436398#comment-13436398 ] Andy Isaacson commented on HDFS-3194: - bq. Just re-opned this JIRA to check the above m

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436385#comment-13436385 ] Andrew Wang commented on HDFS-3672: --- Ran the three failed tests locally, and they passed.

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436377#comment-13436377 ] Hadoop QA commented on HDFS-3672: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-2727) hdfs.c uses deprecated property dfs.block.size

2012-08-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-2727: --- Attachment: HDFS-2727.001.patch This patch uses FileSystem.getDefaultBlockSize() to av

[jira] [Updated] (HDFS-2727) hdfs.c uses deprecated property dfs.block.size

2012-08-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-2727: --- Status: Patch Available (was: Open) > hdfs.c uses deprecated property dfs.block.s

[jira] [Commented] (HDFS-3177) Allow DFSClient to find out and use the CRC type being used for a file.

2012-08-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436371#comment-13436371 ] Kihwal Lee commented on HDFS-3177: -- The failed tests run fine on my machine. There are op

[jira] [Commented] (HDFS-3812) TestNameNodeMetrics.testCorruptBlock fails

2012-08-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436344#comment-13436344 ] Eli Collins commented on HDFS-3812: --- Dupe of HDFS-2434? > TestNameNodeMe

[jira] [Commented] (HDFS-3177) Allow DFSClient to find out and use the CRC type being used for a file.

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436338#comment-13436338 ] Hadoop QA commented on HDFS-3177: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436328#comment-13436328 ] Hudson commented on HDFS-2963: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2619 (See [https

[jira] [Updated] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3808: --- Attachment: HDFS-3808.003.patch %Z -> %z > fuse_dfs: postpone libhdfs

[jira] [Commented] (HDFS-3812) TestNameNodeMetrics.testCorruptBlock fails

2012-08-16 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436320#comment-13436320 ] Trevor Robinson commented on HDFS-3812: --- Also hit this in Jenkins when fixing an unre

[jira] [Commented] (HDFS-3804) TestHftpFileSystem fails intermittently with JDK7

2012-08-16 Thread Trevor Robinson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436318#comment-13436318 ] Trevor Robinson commented on HDFS-3804: --- Precommit test failures are unrelated issues

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436313#comment-13436313 ] Andy Isaacson commented on HDFS-3808: - {code} -DEBUG("dfs->rdbuffersize <= 0 = %ld"

[jira] [Created] (HDFS-3812) TestNameNodeMetrics.testCorruptBlock fails

2012-08-16 Thread Trevor Robinson (JIRA)
Trevor Robinson created HDFS-3812: - Summary: TestNameNodeMetrics.testCorruptBlock fails Key: HDFS-3812 URL: https://issues.apache.org/jira/browse/HDFS-3812 Project: Hadoop HDFS Issue Type: Bu

[jira] [Commented] (HDFS-2966) TestNameNodeMetrics tests can fail under load

2012-08-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436301#comment-13436301 ] Aaron T. Myers commented on HDFS-2966: -- Hey Trevor, please open a new issue for it. Th

[jira] [Updated] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3808: --- Attachment: HDFS-3808.002.patch > fuse_dfs: postpone libhdfs intialization until a

[jira] [Commented] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436297#comment-13436297 ] Hudson commented on HDFS-2963: -- Integrated in Hadoop-Hdfs-trunk-Commit #2654 (See [https://bu

[jira] [Commented] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436296#comment-13436296 ] Hudson commented on HDFS-2963: -- Integrated in Hadoop-Common-trunk-Commit #2589 (See [https://

[jira] [Updated] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3672: -- Attachment: hdfs-3672-11.patch Rebase try 2. A lesson about compile testing after a rebase has been lear

[jira] [Updated] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2963: -- Resolution: Fixed Fix Version/s: (was: 0.24.0) 2.2.0-alpha Tar

[jira] [Commented] (HDFS-2038) Update test to handle relative paths with globs

2012-08-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436292#comment-13436292 ] Eli Collins commented on HDFS-2038: --- Andrew Wang fixed this in HDFS-2963.

[jira] [Commented] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436289#comment-13436289 ] Eli Collins commented on HDFS-2963: --- +1 looks good > Console Output is c

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436285#comment-13436285 ] Eli Collins commented on HDFS-3194: --- I thought Andy's explanation in his above comment ("

[jira] [Updated] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3808: --- Attachment: (was: HDFS-3808.002.patch) > fuse_dfs: postpone libhdfs intializat

[jira] [Updated] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3808: --- Attachment: HDFS-3808.002.patch > fuse_dfs: postpone libhdfs intialization until a

[jira] [Assigned] (HDFS-2727) hdfs.c uses deprecated property dfs.block.size

2012-08-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reassigned HDFS-2727: -- Assignee: Colin Patrick McCabe > hdfs.c uses deprecated property dfs.block.s

[jira] [Commented] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436281#comment-13436281 ] Hadoop QA commented on HDFS-2963: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436279#comment-13436279 ] Hadoop QA commented on HDFS-3672: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3672) Expose disk-location information for blocks to enable better scheduling

2012-08-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3672: -- Attachment: hdfs-3672-10.patch Rebase patch on trunk. > Expose disk-location informatio

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436271#comment-13436271 ] Colin Patrick McCabe commented on HDFS-3808: Thanks for the review, Andy. I'm

[jira] [Updated] (HDFS-3177) Allow DFSClient to find out and use the CRC type being used for a file.

2012-08-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-3177: - Attachment: hdfs-3177-with-hadoop-8239-8240.patch.txt > Allow DFSClient to find out and use the CRC ty

[jira] [Commented] (HDFS-3177) Allow DFSClient to find out and use the CRC type being used for a file.

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436242#comment-13436242 ] Hadoop QA commented on HDFS-3177: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436213#comment-13436213 ] Uma Maheswara Rao G commented on HDFS-3194: --- oh, I did not see your comment Eli,

[jira] [Updated] (HDFS-2963) Console Output is confusing while executing metasave (dfsadmin command)

2012-08-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-2963: -- Attachment: hdfs-2963-2.patch New patch, updating the test based on the new output. I also took this op

[jira] [Reopened] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G reopened HDFS-3194: --- Just re-opned this JIRA to check the above mentioned scenario. If that scenario works fine

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436193#comment-13436193 ] Aaron T. Myers commented on HDFS-3808: -- Thanks a lot for reviewing the patch, Andy. C

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436189#comment-13436189 ] Andy Isaacson commented on HDFS-3808: - {code} + fprintf(stderr, "LD_LIBRARY_PATH=%s",l

[jira] [Commented] (HDFS-2745) unclear to users which command to use to access the filesystem

2012-08-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436184#comment-13436184 ] Andrew Wang commented on HDFS-2745: --- Regarding testing, I ran the hadoop and hdfs scripts

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436183#comment-13436183 ] Eli Collins commented on HDFS-3194: --- Hey Uma, Now that we're starting a new period every

[jira] [Created] (HDFS-3811) TestPersistBlocks#TestRestartDfsWithFlush appears to be flaky

2012-08-16 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-3811: - Summary: TestPersistBlocks#TestRestartDfsWithFlush appears to be flaky Key: HDFS-3811 URL: https://issues.apache.org/jira/browse/HDFS-3811 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436178#comment-13436178 ] Hudson commented on HDFS-3194: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2618 (See [https

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436166#comment-13436166 ] Uma Maheswara Rao G commented on HDFS-3194: --- Eli, Have seen my previous comment?

[jira] [Updated] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3808: Description: {{libhdfs}} may create threads or initialize internal JNI data structures when it is u

[jira] [Commented] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436158#comment-13436158 ] Andy Isaacson commented on HDFS-3808: - It's not accurate to say "we should not call for

[jira] [Commented] (HDFS-3788) distcp can't copy large files using webhdfs due to missing Content-Length header

2012-08-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436141#comment-13436141 ] Eli Collins commented on HDFS-3788: --- bq. I think we don't have a standard in our code for

[jira] [Updated] (HDFS-3808) fuse_dfs: postpone libhdfs intialization until after fork

2012-08-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3808: --- Priority: Critical (was: Major) > fuse_dfs: postpone libhdfs intialization until

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436133#comment-13436133 ] Hudson commented on HDFS-3194: -- Integrated in Hadoop-Common-trunk-Commit #2588 (See [https://

[jira] [Commented] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436132#comment-13436132 ] Hudson commented on HDFS-3194: -- Integrated in Hadoop-Hdfs-trunk-Commit #2653 (See [https://bu

[jira] [Commented] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436128#comment-13436128 ] Hadoop QA commented on HDFS-3809: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3177) Allow DFSClient to find out and use the CRC type being used for a file.

2012-08-16 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-3177: - Attachment: hdfs-3177-with-hadoop-8239-8240.patch.txt Corrected a bug due to a typo. Corrected a test case

[jira] [Updated] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3194: -- Resolution: Fixed Fix Version/s: 2.2.0-alpha Target Version/s: (was: 2.0.0-alpha)

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-08-16 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-3809: - Attachment: HDFS-3809.diff Fixed findbugs (exclude protobuf from check) > Make BKJM use p

[jira] [Commented] (HDFS-3507) DFS#isInSafeMode needs to execute only on Active NameNode

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436068#comment-13436068 ] Hadoop QA commented on HDFS-3507: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436065#comment-13436065 ] Hadoop QA commented on HDFS-3809: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3810) Implement format() for BKJM

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436058#comment-13436058 ] Hadoop QA commented on HDFS-3810: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3810) Implement format() for BKJM

2012-08-16 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-3810: - Status: Patch Available (was: Open) > Implement format() for BKJM > --- > >

[jira] [Updated] (HDFS-3810) Implement format() for BKJM

2012-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-3810: -- Target Version/s: 3.0.0 Affects Version/s: 3.0.0 Fix Version/s: (was: 3.

[jira] [Updated] (HDFS-3810) Implement format() for BKJM

2012-08-16 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-3810: - Attachment: HDFS-3810.diff Patch applies over patch for HDFS-3809. > Implement format() f

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-08-16 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-3809: - Attachment: HDFS-3809.diff Patch makes BKJM use NamespaceInfo also. > Make BKJM use proto

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-3809: -- Component/s: name-node > Make BKJM use protobufs for all serialization with ZK > ---

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-08-16 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-3809: - Status: Patch Available (was: Open) > Make BKJM use protobufs for all serialization with ZK > ---

[jira] [Updated] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-3809: -- Target Version/s: 3.0.0, 2.0.1-alpha Affects Version/s: 3.0.0

[jira] [Created] (HDFS-3810) Implement format() for BKJM

2012-08-16 Thread Ivan Kelly (JIRA)
Ivan Kelly created HDFS-3810: Summary: Implement format() for BKJM Key: HDFS-3810 URL: https://issues.apache.org/jira/browse/HDFS-3810 Project: Hadoop HDFS Issue Type: Sub-task Report

[jira] [Created] (HDFS-3809) Make BKJM use protobufs for all serialization with ZK

2012-08-16 Thread Ivan Kelly (JIRA)
Ivan Kelly created HDFS-3809: Summary: Make BKJM use protobufs for all serialization with ZK Key: HDFS-3809 URL: https://issues.apache.org/jira/browse/HDFS-3809 Project: Hadoop HDFS Issue Type: S

[jira] [Commented] (HDFS-3791) Backport HDFS-173 to Branch-1 : Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes

2012-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436038#comment-13436038 ] Uma Maheswara Rao G commented on HDFS-3791: --- Thanks a lot Suresh for the review!

[jira] [Updated] (HDFS-3791) Backport HDFS-173 to Branch-1 : Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes

2012-08-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-3791: -- Attachment: HDFS-3791.patch > Backport HDFS-173 to Branch-1 : Recursively deleting

[jira] [Updated] (HDFS-3507) DFS#isInSafeMode needs to execute only on Active NameNode

2012-08-16 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-3507: Attachment: HDFS-3507.patch Attaching the latest re-based patch > DFS#isInSafeMode needs to execute

[jira] [Commented] (HDFS-3791) Backport HDFS-173 to Branch-1 : Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes

2012-08-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13436000#comment-13436000 ] Suresh Srinivas commented on HDFS-3791: --- Uma, the ported patch looks good. One minor

[jira] [Commented] (HDFS-3177) Allow DFSClient to find out and use the CRC type being used for a file.

2012-08-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435995#comment-13435995 ] Hadoop QA commented on HDFS-3177: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435977#comment-13435977 ] Hudson commented on HDFS-3048: -- Integrated in Hadoop-Mapreduce-trunk #1168 (See [https://buil

[jira] [Commented] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435974#comment-13435974 ] Hudson commented on HDFS-3796: -- Integrated in Hadoop-Mapreduce-trunk #1168 (See [https://buil

[jira] [Commented] (HDFS-3048) Small race in BlockManager#close

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435946#comment-13435946 ] Hudson commented on HDFS-3048: -- Integrated in Hadoop-Hdfs-trunk #1136 (See [https://builds.ap

[jira] [Commented] (HDFS-3796) Speed up edit log tests by avoiding fsync()

2012-08-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13435943#comment-13435943 ] Hudson commented on HDFS-3796: -- Integrated in Hadoop-Hdfs-trunk #1136 (See [https://builds.ap

  1   2   >