[jira] Commented: (HDFS-562) Add a test for NameNode.getBlockLocations(..) to check read from un-closed file.

2009-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746401#action_12746401 ] Hadoop QA commented on HDFS-562: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-547) TestHDFSFileSystemContract#testOutputStreamClosedTwice sometimes fails with ClosedByInterruptException

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746382#action_12746382 ] Tsz Wo (Nicholas), SZE commented on HDFS-547: - +1 patch looks good. > TestHDFSFi

[jira] Commented: (HDFS-222) Support for concatenating of files into a single file

2009-08-21 Thread Robert Chansler (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746379#action_12746379 ] Robert Chansler commented on HDFS-222: -- The present preferred option is to do something

[jira] Updated: (HDFS-549) Allow non fault-inject specific tests execution with an explicit -Dtestcase=... setting

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-549: Component/s: build Affects Version/s: 0.21.0 Fix Version/s: 0.21.0

[jira] Updated: (HDFS-561) Fix write pipeline READ_TIMEOUT

2009-08-21 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated HDFS-561: --- Status: Patch Available (was: Open) > Fix write pipeline READ_TIMEOUT > --- > >

[jira] Commented: (HDFS-555) A few improvements to DataNodeCluster - HADOOP-5556

2009-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746364#action_12746364 ] Hadoop QA commented on HDFS-555: +1 overall. Here are the results of testing the latest atta

[jira] Updated: (HDFS-551) Create new functional test for a block report.

2009-08-21 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-551: Attachment: HDFS-551.patch 80 characters rule is applied > Create new functional test for a

[jira] Updated: (HDFS-551) Create new functional test for a block report.

2009-08-21 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-551: Attachment: HDFS-551.patch Two initial test cases. Not working as expected yet. > Create new

[jira] Updated: (HDFS-288) Redundant computation in hashCode() implemenation

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-288: Assignee: Tsz Wo (Nicholas), SZE Status: Patch Available (was: Open) > Redunda

[jira] Updated: (HDFS-563) Simplify the codes in FSNamesystem.getBlockLocations(..)

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-563: Status: Patch Available (was: Open) > Simplify the codes in FSNamesystem.getBlockLoc

[jira] Updated: (HDFS-563) Simplify the codes in FSNamesystem.getBlockLocations(..)

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-563: Attachment: h563_20090821.patch h563_20090821.patch: Simplify the codes in getBlockLo

[jira] Updated: (HDFS-563) Simplify the codes in FSNamesystem.getBlockLocations(..)

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-563: Component/s: name-node Priority: Minor (was: Major) Fix Version/s: 0.2

[jira] Resolved: (HDFS-538) DistributedFileSystem::listStatus incorrectly returns null for empty result sets

2009-08-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved HDFS-538. Resolution: Fixed Fix Version/s: 0.21.0 Hadoop Flags: [Incompatible change, Reviewed] +1

[jira] Created: (HDFS-563) Simplify the codes in FSNamesystem.getBlockLocations(..)

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
Simplify the codes in FSNamesystem.getBlockLocations(..) Key: HDFS-563 URL: https://issues.apache.org/jira/browse/HDFS-563 Project: Hadoop HDFS Issue Type: Improvement Repo

[jira] Commented: (HDFS-235) Add support for byte-ranges to hftp

2009-08-21 Thread Robert Chansler (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746323#action_12746323 ] Robert Chansler commented on HDFS-235: -- Venkatesh may have an additional perspective, bu

[jira] Commented: (HDFS-544) Add a "rbw" sub directory to DataNode data directory

2009-08-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746322#action_12746322 ] Konstantin Shvachko commented on HDFS-544: -- # In DataStorage.linkAllBlocks() you com

[jira] Updated: (HDFS-562) Add a test for NameNode.getBlockLocations(..) to check read from un-closed file.

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-562: Attachment: h562_20090821b.patch h562_20090821b.patch: same as h562_20090821.patch bu

[jira] Updated: (HDFS-562) Add a test for NameNode.getBlockLocations(..) to check read from un-closed file.

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-562: Component/s: (was: name-node) test Priority: Minor (was:

[jira] Commented: (HDFS-540) TestNameNodeMetrics fails intermittently

2009-08-21 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746297#action_12746297 ] Kan Zhang commented on HDFS-540: I think the test failed because it expects {{pendingReplicat

[jira] Updated: (HDFS-540) TestNameNodeMetrics fails intermittently

2009-08-21 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-540: - Attachment: HDFS-540.patch Updated patch deletes an unused import. > TestNameNodeMetrics fails int

[jira] Commented: (HDFS-538) DistributedFileSystem::listStatus incorrectly returns null for empty result sets

2009-08-21 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746267#action_12746267 ] Jakob Homan commented on HDFS-538: -- Also, unit tests were run locally and all pass, once an

[jira] Updated: (HDFS-453) XML-based metrics as JSP servlet for NameNode

2009-08-21 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated HDFS-453: --- Status: Open (was: Patch Available) > XML-based metrics as JSP servlet for NameNode > ---

[jira] Updated: (HDFS-453) XML-based metrics as JSP servlet for NameNode

2009-08-21 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated HDFS-453: --- Status: Patch Available (was: Open) > XML-based metrics as JSP servlet for NameNode > ---

[jira] Updated: (HDFS-453) XML-based metrics as JSP servlet for NameNode

2009-08-21 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated HDFS-453: --- Attachment: HDFS-453.4.patch The two new findbugs warnings are introduced by code generated by the JspC

[jira] Updated: (HDFS-453) XML-based metrics as JSP servlet for NameNode

2009-08-21 Thread Aaron Kimball (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Kimball updated HDFS-453: --- Attachment: HDFS-453.5.patch patch #4 was generated incorrectly and won't apply. Here we go. > XML-ba

[jira] Commented: (HDFS-538) DistributedFileSystem::listStatus incorrectly returns null for empty result sets

2009-08-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746252#action_12746252 ] Chris Douglas commented on HDFS-538: (after applying HADOOP-6201 ) {noformat} [exec]

[jira] Updated: (HDFS-562) Change NameNode.getBlockLocations(..) to support read from un-closed file.

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-562: Status: Patch Available (was: Open) > Change NameNode.getBlockLocations(..) to suppo

[jira] Updated: (HDFS-562) Change NameNode.getBlockLocations(..) to support read from un-closed file.

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-562: Attachment: h562_20090821.patch h562_20090821.patch: - simplified codes in FSNamesyst

[jira] Created: (HDFS-562) Change NameNode.getBlockLocations(..) to support read from un-closed file.

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
Change NameNode.getBlockLocations(..) to support read from un-closed file. -- Key: HDFS-562 URL: https://issues.apache.org/jira/browse/HDFS-562 Project: Hadoop HDFS Issu

[jira] Updated: (HDFS-562) Change NameNode.getBlockLocations(..) to support read from un-closed file.

2009-08-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-562: Description: NameNode.getBlockLocations(..) should return BlockInfoUnderConstruction,

[jira] Commented: (HDFS-235) Add support for byte-ranges to hftp

2009-08-21 Thread Bill Zeller (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746239#action_12746239 ] Bill Zeller commented on HDFS-235: -- Also, I believe it's unnecessary to support multiple byt

[jira] Commented: (HDFS-235) Add support for byte-ranges to hftp

2009-08-21 Thread Bill Zeller (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746235#action_12746235 ] Bill Zeller commented on HDFS-235: -- > Supporting seek() would be more generic. Perhaps the i

[jira] Updated: (HDFS-15) All replicas of a block end up on only 1 rack

2009-08-21 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-15: - Attachment: HDFS-15.patch.2 New patch with approach suggested by Raghu. > All replicas of a

[jira] Updated: (HDFS-540) TestNameNodeMetrics fails intermittently

2009-08-21 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-540: - Attachment: HDFS-540.patch Previous test expects {{pendingReplicationBlocks}} and {{scheduledRepli

[jira] Updated: (HDFS-538) DistributedFileSystem::listStatus incorrectly returns null for empty result sets

2009-08-21 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-538: - Attachment: HDFS-538.patch Attaching patch, but can't make it patch available because it depends on a new

[jira] Assigned: (HDFS-542) Support fault injection tests in Hudson

2009-08-21 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik reassigned HDFS-542: --- Assignee: Giridharan Kesavan Giri, could you please take a look into this? I've sent yo

[jira] Commented: (HDFS-561) Fix write pipeline READ_TIMEOUT

2009-08-21 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746124#action_12746124 ] Kan Zhang commented on HDFS-561: Attaching a patch, which 1. Fix datanode READ TIMEOUT setup

[jira] Commented: (HDFS-235) Add support for byte-ranges to hftp

2009-08-21 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746122#action_12746122 ] Doug Cutting commented on HDFS-235: --- > HftpFileSystem::open(Path f, int buffersize, long b

[jira] Updated: (HDFS-561) Fix write pipeline READ_TIMEOUT

2009-08-21 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated HDFS-561: --- Attachment: h561-01.patch > Fix write pipeline READ_TIMEOUT > --- > >

[jira] Updated: (HDFS-555) A few improvements to DataNodeCluster - HADOOP-5556

2009-08-21 Thread Ravi Phulari (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Phulari updated HDFS-555: -- Status: Patch Available (was: Open) > A few improvements to DataNodeCluster - HADOOP-5556 > ---

[jira] Created: (HDFS-561) Fix write pipeline READ_TIMEOUT

2009-08-21 Thread Kan Zhang (JIRA)
Fix write pipeline READ_TIMEOUT --- Key: HDFS-561 URL: https://issues.apache.org/jira/browse/HDFS-561 Project: Hadoop HDFS Issue Type: Sub-task Components: data-node, hdfs client, test Report

[jira] Commented: (HDFS-540) TestNameNodeMetrics fails intermittently

2009-08-21 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746099#action_12746099 ] Suresh Srinivas commented on HDFS-540: -- I will work on this next week > TestNameNodeMet

[jira] Commented: (HDFS-540) TestNameNodeMetrics fails intermittently

2009-08-21 Thread gary murry (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746098#action_12746098 ] gary murry commented on HDFS-540: - We are still seeing this: http://hudson.zones.apache.org/

[jira] Commented: (HDFS-235) Add support for byte-ranges to hftp

2009-08-21 Thread Bill Zeller (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746094#action_12746094 ] Bill Zeller commented on HDFS-235: -- I believe you're asking if seek() could be called on the

[jira] Commented: (HDFS-173) Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes

2009-08-21 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746083#action_12746083 ] Suresh Srinivas commented on HDFS-173: -- Additionally the approach Raghu is proposing wil

[jira] Commented: (HDFS-456) Problems with dfs.name.edits.dirs as URI

2009-08-21 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746078#action_12746078 ] Suresh Srinivas commented on HDFS-456: -- Comments: # {{FSImage.getDirectories()}} in this

[jira] Updated: (HDFS-560) Proposed enhancements/tuning to hadoop-hdfs/build.xml

2009-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-560: Priority: Minor (was: Major) rating as minor, though it does need to get fixed before putting up any

[jira] Commented: (HDFS-560) Proposed enhancements/tuning to hadoop-hdfs/build.xml

2009-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12746028#action_12746028 ] Steve Loughran commented on HDFS-560: - # make project name hadoop-hdfs (in lower case), s

[jira] Created: (HDFS-560) Proposed enhancements/tuning to hadoop-hdfs/build.xml

2009-08-21 Thread Steve Loughran (JIRA)
Proposed enhancements/tuning to hadoop-hdfs/build.xml -- Key: HDFS-560 URL: https://issues.apache.org/jira/browse/HDFS-560 Project: Hadoop HDFS Issue Type: Improvement Components

[jira] Commented: (HDFS-235) Add support for byte-ranges to hftp

2009-08-21 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12745949#action_12745949 ] Tom White commented on HDFS-235: Does this subsume HDFS-269? I think it could if the range en

[jira] Commented: (HDFS-559) Work out the memory consumption of NN artifacts on a compressed pointer JVM

2009-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12745890#action_12745890 ] Steve Loughran commented on HDFS-559: - There is a way to to do this in the java Instrumen

[jira] Updated: (HDFS-559) Work out the memory consumption of NN artifacts on a compressed pointer JVM

2009-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-559: Environment: 64-bit and 32 bit JVMs, Java6u14 and jdk7 betas, with -XX compressed oops enabled/disabl

[jira] Created: (HDFS-559) Work out the memory consumption of NN artifacts on a compressed pointer JVM

2009-08-21 Thread Steve Loughran (JIRA)
Work out the memory consumption of NN artifacts on a compressed pointer JVM --- Key: HDFS-559 URL: https://issues.apache.org/jira/browse/HDFS-559 Project: Hadoop HDFS Is

[jira] Commented: (HDFS-453) XML-based metrics as JSP servlet for NameNode

2009-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12745831#action_12745831 ] Hadoop QA commented on HDFS-453: -1 overall. Here are the results of testing the latest atta