[jira] [Commented] (HDFS-2726) "Exception in createBlockOutputStream" shouldn't delete exception stack trace

2011-12-29 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177057#comment-13177057 ] Hudson commented on HDFS-2726: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1497 (See [https

[jira] [Commented] (HDFS-2394) Add tests for Namenode active standby states

2011-12-29 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177063#comment-13177063 ] Suresh Srinivas commented on HDFS-2394: --- You are right. Existing tests cover this.

[jira] [Resolved] (HDFS-2394) Add tests for Namenode active standby states

2011-12-29 Thread Suresh Srinivas (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-2394. --- Resolution: Invalid > Add tests for Namenode active standby states > -

[jira] [Resolved] (HDFS-3) processIOError() may cause infinite loop.

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-3. Resolution: Not A Problem Looking at trunk {{NNStorage}}, this doesn't seem to be a problem anymore. Neither do we do

[jira] [Commented] (HDFS-4) DF should use used + available as the capacity of this volume

2011-12-29 Thread Harsh J (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177079#comment-13177079 ] Harsh J commented on HDFS-4: Are there any other disadvantages you can think of in going with use

[jira] [Resolved] (HDFS-21) unresponsive namenode because of not finding places to replicate

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-21. - Resolution: Won't Fix This is a clear effect of tweaking dfs.replication.min. You want your HDFS to guarantee X rep

[jira] [Resolved] (HDFS-10) DFS logging in NameSystem.pendingTransfer consumes all disk space

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-10. - Resolution: Won't Fix These things help ops determine HDFS activity. If you do not wish to see them ever, you may t

[jira] [Created] (HDFS-2727) hdfs.c uses deprecated property dfs.block.size

2011-12-29 Thread Sho Shimauchi (Created) (JIRA)
hdfs.c uses deprecated property dfs.block.size -- Key: HDFS-2727 URL: https://issues.apache.org/jira/browse/HDFS-2727 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions: 0.23.0

[jira] [Resolved] (HDFS-9) distcp job failed

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-9. Resolution: Incomplete This could've very well been a transient issue. Lets open a new JIRA if this is too frequent. T

[jira] [Commented] (HDFS-2727) hdfs.c uses deprecated property dfs.block.size

2011-12-29 Thread Harsh J (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177095#comment-13177095 ] Harsh J commented on HDFS-2727: --- It should not rely on properties for dfs.blocksize and dfs.r

[jira] [Updated] (HDFS-1314) dfs.block.size accepts only absolute value

2011-12-29 Thread Sho Shimauchi (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sho Shimauchi updated HDFS-1314: Attachment: hdfs-1314.txt attached * revert hdfs.c * add more info to hdfs-default.xml and cluster_

[jira] [Resolved] (HDFS-67) /tmp/hadoop-${user}/dfs/tmp/tmp/client-${long}.tmp is not cleanup correctly

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-67?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-67. - Resolution: Not A Problem Not a problem after Dhruba's HDFS-1707. > /tmp/hadoop-${user}/dfs/tmp/tmp

[jira] [Commented] (HDFS-67) /tmp/hadoop-${user}/dfs/tmp/tmp/client-${long}.tmp is not cleanup correctly

2011-12-29 Thread Harsh J (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-67?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177204#comment-13177204 ] Harsh J commented on HDFS-67: - Er, make that HADOOP-1707 sorry. > /tmp/hadoop-${

[jira] [Commented] (HDFS-2729) Update BlockManager's comments regarding the invalid block set

2011-12-29 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177315#comment-13177315 ] Hudson commented on HDFS-2729: -- Integrated in Hadoop-Hdfs-trunk-Commit #1552 (See [https://bu

[jira] [Resolved] (HDFS-5) Check that network topology is updated when new data-nodes are joining the cluster

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-5. Resolution: Cannot Reproduce The mapping is done pretty much properly as far as I've noticed. With caching enabled tho

[jira] [Resolved] (HDFS-58) DistributedFileSystem.listPaths with some paths causes directory to be cleared

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-58?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-58. - Resolution: Cannot Reproduce This has gone stale, and looking at listStatus impls, looks like it could not happen.

[jira] [Resolved] (HDFS-97) DFS should detect slow links(nodes) and avoid them

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-97?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-97. - Resolution: Not A Problem We do tend to avoid highly loaded DataNodes (via xceiver counts) which may almost do the

[jira] [Commented] (HDFS-1314) dfs.block.size accepts only absolute value

2011-12-29 Thread Harsh J (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177112#comment-13177112 ] Harsh J commented on HDFS-1314: --- Not sure why the patch failed. Perhaps its cause of the docs

[jira] [Commented] (HDFS-2729) Update BlockManager's comments regarding the invalid block set

2011-12-29 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177288#comment-13177288 ] Hudson commented on HDFS-2729: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1501 (See [https

[jira] [Commented] (HDFS-2726) "Exception in createBlockOutputStream" shouldn't delete exception stack trace

2011-12-29 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177174#comment-13177174 ] Hudson commented on HDFS-2726: -- Integrated in Hadoop-Mapreduce-trunk #942 (See [https://build

[jira] [Commented] (HDFS-2729) Update BlockManager's comments regarding the invalid block set

2011-12-29 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177317#comment-13177317 ] Hudson commented on HDFS-2729: -- Integrated in Hadoop-Common-trunk-Commit #1480 (See [https://

[jira] [Reopened] (HDFS-97) DFS should detect slow links(nodes) and avoid them

2011-12-29 Thread Harsh J (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-97?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened HDFS-97: - Oh well, didn't notice the 'read' issue too. We cover writes with that, not reads. Reopening. > DFS sh

[jira] [Resolved] (HDFS-36) Handling of deprecated dfs.info.bindAddress and dfs.info.port

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-36. - Resolution: Cannot Reproduce Can't reproduce on 1.0+. Setting dfs.http(s).address suffices. > Handl

[jira] [Updated] (HDFS-2580) NameNode#main(...) can make use of GenericOptionsParser.

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2580: -- Status: Open (was: Patch Available) > NameNode#main(...) can make use of GenericOptionsParser. > --

[jira] [Resolved] (HDFS-61) Datanode shutdown is called multiple times

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-61?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-61. - Resolution: Cannot Reproduce On trunk, looks like we only call it once now. This has gone stale, closing out.

[jira] [Commented] (HDFS-1910) when dfs.name.dir and dfs.name.edits.dir are same fsimage will be saved twice every time

2011-12-29 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177126#comment-13177126 ] Hudson commented on HDFS-1910: -- Integrated in Hadoop-Hdfs-22-branch #124 (See [https://builds

[jira] [Updated] (HDFS-2728) Remove dfsadmin -printTopology from branch-1 docs since it does not exist

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2728: -- Status: Patch Available (was: Open) > Remove dfsadmin -printTopology from branch-1 docs since it does not e

[jira] [Updated] (HDFS-2729) Update BlockManager's comments regarding the invalid block set

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2729: -- Resolution: Fixed Fix Version/s: 0.24.0 Status: Resolved (was: Patch Available) Committed rev

[jira] [Resolved] (HDFS-57) A Datanode's datadir could have lots of blocks in the top-level directory

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-57. - Resolution: Not A Problem Not a problem in the current {{FSDataset}} operations (neither on branch-1).

[jira] [Resolved] (HDFS-82) recentInvalidateSets in FSNamesystem is not required

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-82?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-82. - Resolution: Not A Problem This has been resolved on trunk. We only have one set. > recentInvalidate

[jira] [Updated] (HDFS-2728) Remove dfsadmin -printTopology from branch-1 docs since it does not exist

2011-12-29 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2728: -- Status: Open (was: Patch Available) > Remove dfsadmin -printTopology from branch-1 docs since it do

[jira] [Updated] (HDFS-2654) Make BlockReaderLocal not extend RemoteBlockReader2

2011-12-29 Thread Zhihong Yu (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhihong Yu updated HDFS-2654: - Description: The BlockReaderLocal code paths are easier to understand (especially true on branch-1 wh

[jira] [Commented] (HDFS-2698) BackupNode is downloading image from NameNode for every checkpoint

2011-12-29 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177125#comment-13177125 ] Hudson commented on HDFS-2698: -- Integrated in Hadoop-Hdfs-22-branch #124 (See [https://builds

[jira] [Created] (HDFS-2729) Update BlockManager's comments regarding the invalid block set

2011-12-29 Thread Harsh J (Created) (JIRA)
Update BlockManager's comments regarding the invalid block set -- Key: HDFS-2729 URL: https://issues.apache.org/jira/browse/HDFS-2729 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-19) Unhandled exceptions in DFSClient

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-19?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-19. - Resolution: Invalid This has gone stale. I do not find these methods in the current DFSOutputStream. Do open a new

[jira] [Commented] (HDFS-2726) "Exception in createBlockOutputStream" shouldn't delete exception stack trace

2011-12-29 Thread Hudson (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177141#comment-13177141 ] Hudson commented on HDFS-2726: -- Integrated in Hadoop-Hdfs-trunk #909 (See [https://builds.apa

[jira] [Resolved] (HDFS-22) Help information of refreshNodes does not show how to decomission nodes

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-22?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-22. - Resolution: Not A Problem The current docs: {code} Updates the set of hosts allowed to connect to namenode. Re-read

[jira] [Updated] (HDFS-2728) Remove dfsadmin -printTopology from branch-1 docs since it does not exist

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2728: -- Attachment: HDFS-2728.patch > Remove dfsadmin -printTopology from branch-1 docs since it does not exist > --

[jira] [Resolved] (HDFS-102) high cpu usage in ReplicationMonitor thread

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-102. -- Resolution: Cannot Reproduce This has gone stale. The current structure within BlockManager isn't a list anymore

[jira] [Resolved] (HDFS-20) fsck -delete doesn't report failures

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-20. - Resolution: Not A Problem Currently in NamenodeFsck, if any operation under check() throws an exception, I can veri

[jira] [Resolved] (HDFS-146) Regression: TestInjectionForSimulatedStorage fails with IllegalMonitorStateException

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-146. -- Resolution: Cannot Reproduce Hasn't had a failure report in two years now. Gone stale, closing out this and rela

[jira] [Resolved] (HDFS-92) if hadoop.tmp.dir is under your dfs.data.dir, HDFS will silently wipe out your "name" directory

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-92. - Resolution: Not A Problem This goes against all recommendations in configuring the directories. I don't see why one

[jira] [Commented] (HDFS-2728) Remove dfsadmin -printTopology from branch-1 docs since it does not exist

2011-12-29 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177164#comment-13177164 ] Hadoop QA commented on HDFS-2728: - -1 overall. Here are the results of testing the latest

[jira] [Resolved] (HDFS-64) delete on dfs hung

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-64?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-64. - Resolution: Not A Problem This has gone stale, and given that we haven't seen this recently at all, looks like it m

[jira] [Resolved] (HDFS-12) "hadoop dfs -put" does not return nonzero status on failure

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-12. - Resolution: Not A Problem Fix Version/s: 0.23.0 This has been fixed by the FsCommand revamp on 0.23+.

[jira] [Resolved] (HDFS-93) NameNode should not serve up a bad edits log

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-93?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-93. - Resolution: Cannot Reproduce This isn't a problem in the current version anymore. Errors in the dfs.namenode.name.d

[jira] [Commented] (HDFS-2729) Update BlockManager's comments regarding the invalid block set

2011-12-29 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177250#comment-13177250 ] Eli Collins commented on HDFS-2729: --- +1 findbugs and test failure are unrelated.

[jira] [Resolved] (HDFS-2728) Remove dfsadmin -printTopology from branch-1 docs since it does not exist

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-2728. --- Resolution: Fixed Fix Version/s: 1.1.0 Committed revision 1225589. Thanks Eli! > Remov

[jira] [Resolved] (HDFS-59) No recovery when trying to replicate on marginal datanode

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-59?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-59. - Resolution: Not A Problem This has gone stale. We haven't seen this lately. Lets file a new one if we see this agai

[jira] [Resolved] (HDFS-104) TestInjectionForSimulatedStorage fails once in a while

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-104. -- Resolution: Cannot Reproduce Hasn't had a failure report in two years now. Gone stale, closing out this and rela

[jira] [Updated] (HDFS-1314) dfs.block.size accepts only absolute value

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-1314: -- Target Version/s: 0.24.0 Status: Patch Available (was: Open) +1. Will commit once Hudson reports

[jira] [Updated] (HDFS-2728) Remove dfsadmin -printTopology from branch-1 docs since it does not exist

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2728: -- Target Version/s: 1.1.0 (was: 0.24.0) > Remove dfsadmin -printTopology from branch-1 docs since it does not

[jira] [Resolved] (HDFS-105) Streaming task stuck in MapTask$DirectMapOutputCollector.close

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-105. -- Resolution: Cannot Reproduce Hasn't had a similar failure report in two years now. Gone stale, so closing out as

[jira] [Resolved] (HDFS-55) Change all references of dfs to hdfs in configs

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-55?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-55. - Resolution: Won't Fix Its all dfs.* and its in Hadoop, and the settings go to hdfs-site.xml. I think that is suffic

[jira] [Updated] (HDFS-2729) Update BlockManager's comments regarding the invalid block set

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2729: -- Attachment: HDFS-2729.patch > Update BlockManager's comments regarding the invalid block set > -

[jira] [Resolved] (HDFS-103) handle return value of globStatus() to be uniform.

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-103. -- Resolution: Not A Problem Looking at the current impl. of globStatus, we always return an empty FileStatus[] out

[jira] [Resolved] (HDFS-44) Unit test failed: TestInjectionForSimulatedStorage

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-44?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-44. - Resolution: Cannot Reproduce Hasn't had a failure report in two years now. Gone stale, closing out this and related

[jira] [Created] (HDFS-2728) Remove dfsadmin -printTopology from branch-1 docs since it does not exist

2011-12-29 Thread Harsh J (Created) (JIRA)
Remove dfsadmin -printTopology from branch-1 docs since it does not exist - Key: HDFS-2728 URL: https://issues.apache.org/jira/browse/HDFS-2728 Project: Hadoop HDFS Issu

[jira] [Resolved] (HDFS-35) Confusing set replication message

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-35?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-35. - Resolution: Incomplete Unsure what seems to be the problem here. Those logs are in if-else clauses and represent th

[jira] [Commented] (HDFS-2729) Update BlockManager's comments regarding the invalid block set

2011-12-29 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177211#comment-13177211 ] Hadoop QA commented on HDFS-2729: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1314) dfs.block.size accepts only absolute value

2011-12-29 Thread Hadoop QA (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177110#comment-13177110 ] Hadoop QA commented on HDFS-1314: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2728) Remove dfsadmin -printTopology from branch-1 docs since it does not exist

2011-12-29 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177251#comment-13177251 ] Eli Collins commented on HDFS-2728: --- +1 Don't think test-patch results on branch-1 are

[jira] [Updated] (HDFS-2580) NameNode#main(...) can make use of GenericOptionsParser.

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2580: -- Status: Patch Available (was: Open) Resubmitting for tests. I don't see an elegant way to use Tool interface,

[jira] [Updated] (HDFS-2729) Update BlockManager's comments regarding the invalid block set

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-2729: -- Status: Patch Available (was: Open) Trivial patch that changes comments and log statements. No tests required.

[jira] [Resolved] (HDFS-47) dead datanodes because of OutOfMemoryError

2011-12-29 Thread Harsh J (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-47. - Resolution: Not A Problem This has gone stale. FWIW, haven't seen DNs go OOM on its own in recent years. Probably a

[jira] [Commented] (HDFS-2692) HA: Bugs related to failover from/into safe-mode

2011-12-29 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177367#comment-13177367 ] Todd Lipcon commented on HDFS-2692: --- bq. In FSEditLogLoader#loadFSEdits, should we really

[jira] [Updated] (HDFS-2692) HA: Bugs related to failover from/into safe-mode

2011-12-29 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2692: -- Attachment: hdfs-2692.txt > HA: Bugs related to failover from/into safe-mode > -

[jira] [Commented] (HDFS-2692) HA: Bugs related to failover from/into safe-mode

2011-12-29 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177368#comment-13177368 ] Aaron T. Myers commented on HDFS-2692: -- bq. I'd like to move a bunch of these methods

[jira] [Commented] (HDFS-2720) HA : TestStandbyIsHot is failing while copying in_use.lock file from NN1 nameSpaceDirs to NN2 nameSpaceDirs

2011-12-29 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177371#comment-13177371 ] Todd Lipcon commented on HDFS-2720: --- Small nits: {code} + // Now format 1st NN and

[jira] [Commented] (HDFS-2714) HA: Fix test cases which use standalone FSNamesystems

2011-12-29 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177374#comment-13177374 ] Aaron T. Myers commented on HDFS-2714: -- +1, the patch looks good to me.

[jira] [Commented] (HDFS-2720) HA : TestStandbyIsHot is failing while copying in_use.lock file from NN1 nameSpaceDirs to NN2 nameSpaceDirs

2011-12-29 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177389#comment-13177389 ] Eli Collins commented on HDFS-2720: --- ATM and I were discussing how to initialize the SBN

[jira] [Commented] (HDFS-2720) HA : TestStandbyIsHot is failing while copying in_use.lock file from NN1 nameSpaceDirs to NN2 nameSpaceDirs

2011-12-29 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177434#comment-13177434 ] Todd Lipcon commented on HDFS-2720: --- That would be a nice improvement... but I think it m

[jira] [Commented] (HDFS-1314) dfs.block.size accepts only absolute value

2011-12-29 Thread Sho Shimauchi (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177460#comment-13177460 ] Sho Shimauchi commented on HDFS-1314: - I guess HADOOP-7910 was not yet merged into the

[jira] [Resolved] (HDFS-2714) HA: Fix test cases which use standalone FSNamesystems

2011-12-29 Thread Todd Lipcon (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2714. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed > HA: Fi

[jira] [Created] (HDFS-2730) HA: Refactor shared HA-related test code into HATestUtils class

2011-12-29 Thread Todd Lipcon (Created) (JIRA)
HA: Refactor shared HA-related test code into HATestUtils class --- Key: HDFS-2730 URL: https://issues.apache.org/jira/browse/HDFS-2730 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-2720) HA : TestStandbyIsHot is failing while copying in_use.lock file from NN1 nameSpaceDirs to NN2 nameSpaceDirs

2011-12-29 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177468#comment-13177468 ] Eli Collins commented on HDFS-2720: --- Yup, I'll file a separate jira. Agree wrt the fix fo

[jira] [Resolved] (HDFS-2692) HA: Bugs related to failover from/into safe-mode

2011-12-29 Thread Todd Lipcon (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2692. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Committed to

[jira] [Created] (HDFS-2731) Autopopulate standby name dirs if they're empty

2011-12-29 Thread Eli Collins (Created) (JIRA)
Autopopulate standby name dirs if they're empty --- Key: HDFS-2731 URL: https://issues.apache.org/jira/browse/HDFS-2731 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Affect

[jira] [Updated] (HDFS-2731) Autopopulate standby name dirs if they're empty

2011-12-29 Thread Eli Collins (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2731: -- Description: To setup a SBN we currently format the primary then manually copy the name dirs to the SBN.

[jira] [Created] (HDFS-2732) Add support for the standby in the bin scripts

2011-12-29 Thread Eli Collins (Created) (JIRA)
Add support for the standby in the bin scripts -- Key: HDFS-2732 URL: https://issues.apache.org/jira/browse/HDFS-2732 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Affects

[jira] [Created] (HDFS-2733) Document HA configuration and CLI

2011-12-29 Thread Eli Collins (Created) (JIRA)
Document HA configuration and CLI - Key: HDFS-2733 URL: https://issues.apache.org/jira/browse/HDFS-2733 Project: Hadoop HDFS Issue Type: Sub-task Components: documentation, ha Affects Versions: H

[jira] [Commented] (HDFS-2732) Add support for the standby in the bin scripts

2011-12-29 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177479#comment-13177479 ] Todd Lipcon commented on HDFS-2732: --- For me, start-dfs.sh actually already works, since i

[jira] [Commented] (HDFS-2731) Autopopulate standby name dirs if they're empty

2011-12-29 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177478#comment-13177478 ] Todd Lipcon commented on HDFS-2731: --- bq. as an optimization it could copy the logs from t

[jira] [Updated] (HDFS-2709) HA: Appropriately handle error conditions in EditLogTailer

2011-12-29 Thread Aaron T. Myers (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-2709: - Attachment: HDFS-2709-HDFS-1623.patch > HA: Appropriately handle error conditions in EditLogTa

[jira] [Commented] (HDFS-2709) HA: Appropriately handle error conditions in EditLogTailer

2011-12-29 Thread Aaron T. Myers (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177483#comment-13177483 ] Aaron T. Myers commented on HDFS-2709: -- Thanks a lot for the thorough review, Eli. Com

[jira] [Commented] (HDFS-2731) Autopopulate standby name dirs if they're empty

2011-12-29 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177486#comment-13177486 ] Eli Collins commented on HDFS-2731: --- Wrt #1, if we get the image from the NN and the edit

[jira] [Commented] (HDFS-2731) Autopopulate standby name dirs if they're empty

2011-12-29 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177488#comment-13177488 ] Todd Lipcon commented on HDFS-2731: --- The primary shouldn't be removing any old images unl

[jira] [Commented] (HDFS-2386) with security enabled fsck calls lead to handshake_failure and hftp fails throwing the same exception in the logs

2011-12-29 Thread Rajesh Balamohan (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177534#comment-13177534 ] Rajesh Balamohan commented on HDFS-2386: >> we are actively hitting this issue with

[jira] [Updated] (HDFS-1314) dfs.block.size accepts only absolute value

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-1314: -- Status: Open (was: Patch Available) > dfs.block.size accepts only absolute value >

[jira] [Updated] (HDFS-1314) dfs.block.size accepts only absolute value

2011-12-29 Thread Harsh J (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-1314: -- Hadoop Flags: Reviewed Status: Patch Available (was: Open) > dfs.block.size accepts only absolute

[jira] [Updated] (HDFS-2716) HA: Configuration needs to allow different dfs.http.addresses for each HA NN

2011-12-29 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2716: -- Attachment: hdfs-2716.txt Attached patch fixes the generic conf code to handle NN IDs as well as Namese

[jira] [Updated] (HDFS-2291) HA: Checkpointing in an HA setup

2011-12-29 Thread Todd Lipcon (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2291: -- Attachment: hdfs-2291.txt Attached patch adds a thread to the SBN which takes checkpoints. It doesn't c

[jira] [Resolved] (HDFS-2732) Add support for the standby in the bin scripts

2011-12-29 Thread Eli Collins (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2732. --- Resolution: Won't Fix > Add support for the standby in the bin scripts > -

[jira] [Commented] (HDFS-2732) Add support for the standby in the bin scripts

2011-12-29 Thread Eli Collins (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177538#comment-13177538 ] Eli Collins commented on HDFS-2732: --- Good point, I missed that. It doesn't work for me si

[jira] [Commented] (HDFS-2709) HA: Appropriately handle error conditions in EditLogTailer

2011-12-29 Thread Todd Lipcon (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177540#comment-13177540 ] Todd Lipcon commented on HDFS-2709: --- A few thoughts on the overall approach: - Rather tha

[jira] [Created] (HDFS-2734) Even if we configure the property fs.checkpoint.size in both core-site.xml and hdfs-site.xml the values are not been considered

2011-12-29 Thread J.Andreina (Created) (JIRA)
Even if we configure the property fs.checkpoint.size in both core-site.xml and hdfs-site.xml the values are not been considered Key: HDFS-2734

[jira] [Commented] (HDFS-2734) Even if we configure the property fs.checkpoint.size in both core-site.xml and hdfs-site.xml the values are not been considered

2011-12-29 Thread Harsh J (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13177580#comment-13177580 ] Harsh J commented on HDFS-2734: --- Hi J.Andreina, That property is for upto 0.20/1.0 Secondary