[jira] [Resolved] (HDFS-4348) backup node document bug of 1.x

2012-12-28 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HDFS-4348. --- Resolution: Duplicate > backup node document bug of 1.x > --- > >

[jira] [Created] (HDFS-4348) backup node document bug of 1.x

2012-12-28 Thread andy zhou (JIRA)
andy zhou created HDFS-4348: --- Summary: backup node document bug of 1.x Key: HDFS-4348 URL: https://issues.apache.org/jira/browse/HDFS-4348 Project: Hadoop HDFS Issue Type: Bug Components:

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540772#comment-13540772 ] Hadoop QA commented on HDFS-347: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (HDFS-4347) TestBackupNode can go into infinite loop "Waiting checkpoint to complete."

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4347: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4308: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Av

[jira] [Commented] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540751#comment-13540751 ] Konstantin Shvachko commented on HDFS-4308: --- +1 > addBlock() sho

[jira] [Commented] (HDFS-4347) TestBackupNode can go into infinite loop "Waiting checkpoint to complete."

2012-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540733#comment-13540733 ] Hadoop QA commented on HDFS-4347: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-12-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-347: -- Status: Patch Available (was: Open) > DFS read performance suboptimal when client co

[jira] [Updated] (HDFS-4244) Support deleting snapshots

2012-12-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4244: Attachment: HDFS-4244.003.patch HDFS-4244.003.patch: update SnapshotManager#numSnapshots after deletion.

[jira] [Updated] (HDFS-4347) TestBackupNode can go into infinite loop "Waiting checkpoint to complete."

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4347: --- Status: Patch Available (was: Open) > TestBackupNode can go into infinite loop "Waiting c

[jira] [Updated] (HDFS-4230) Listing all the current snapshottable directories

2012-12-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4230: Attachment: HDFS-4230.002.patch > Listing all the current snapshottable directories > --

[jira] [Commented] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540679#comment-13540679 ] Plamen Jeliazkov commented on HDFS-4308: No new tests are needed because this fix i

[jira] [Commented] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540672#comment-13540672 ] Hadoop QA commented on HDFS-4308: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-4347) TestBackupNode can go into infinite loop "Waiting checkpoint to complete."

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540669#comment-13540669 ] Konstantin Shvachko commented on HDFS-4347: --- Yup. +1 from me. See what Jenkins sa

[jira] [Updated] (HDFS-4244) Support deleting snapshots

2012-12-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4244: Attachment: HDFS-4244.002.patch Add the implementation and tests. > Support deleting snapsh

[jira] [Updated] (HDFS-4347) TestBackupNode can go into infinite loop "Waiting checkpoint to complete."

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4347: --- Attachment: HDFS-4347.patch Are you looking for something like this? Seems like there was just

[jira] [Assigned] (HDFS-4347) TestBackupNode can go into infinite loop "Waiting checkpoint to complete."

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov reassigned HDFS-4347: -- Assignee: Plamen Jeliazkov > TestBackupNode can go into infinite loop "Waiting check

[jira] [Commented] (HDFS-4347) TestBackupNode can go into infinite loop "Waiting checkpoint to complete."

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540651#comment-13540651 ] Konstantin Shvachko commented on HDFS-4347: --- In the case {{waitCheckpointDone()}}

[jira] [Updated] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2012-12-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-347: -- Attachment: HDFS-347.035.patch bugfixes. > DFS read performance suboptim

[jira] [Created] (HDFS-4347) TestBackupNode can go into infinite loop "Waiting checkpoint to complete."

2012-12-28 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4347: - Summary: TestBackupNode can go into infinite loop "Waiting checkpoint to complete." Key: HDFS-4347 URL: https://issues.apache.org/jira/browse/HDFS-4347 Proj

[jira] [Updated] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4308: --- Attachment: HDFS-4308.2.patch Here is the new patch with Konstantin's suggestion. It compiles

[jira] [Updated] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4308: --- Status: Patch Available (was: Open) > addBlock() should persist file blocks once > --

[jira] [Updated] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4308: --- Status: Open (was: Patch Available) > addBlock() should persist file blocks once > --

[jira] [Commented] (HDFS-4334) Add a unique id to each INode

2012-12-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540620#comment-13540620 ] Tsz Wo (Nicholas), SZE commented on HDFS-4334: -- Hi Konstantin, the original HD

[jira] [Commented] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540619#comment-13540619 ] Konstantin Shvachko commented on HDFS-4308: --- Right, {{dir.removeBlock()}} is call

[jira] [Updated] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4308: --- Fix Version/s: 2.0.3-alpha Target Version/s: 2.0.3-alpha Status: Patch Ava

[jira] [Updated] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4308: --- Attachment: HDFS-4308.patch > addBlock() should persist file blocks once > ---

[jira] [Commented] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540611#comment-13540611 ] Plamen Jeliazkov commented on HDFS-4308: >From my inspection it seems that both get

[jira] [Updated] (HDFS-1558) Optimize FSNamesystem.startFileInternal

2012-12-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1558: -- Component/s: performance namenode > Optimize FSNamesystem.startFileInternal > -

[jira] [Commented] (HDFS-4301) 2NN image transfer timeout problematic

2012-12-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540561#comment-13540561 ] Todd Lipcon commented on HDFS-4301: --- I had a few thoughts: 1) Maybe we're just misusing

[jira] [Commented] (HDFS-4334) Add a unique id to each INode

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540555#comment-13540555 ] Konstantin Shvachko commented on HDFS-4334: --- > I feel the same way. Just have fil

[jira] [Commented] (HDFS-4338) TestNameNodeMetrics#testCorruptBlock is flaky

2012-12-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540528#comment-13540528 ] Andrew Wang commented on HDFS-4338: --- Test failure looks unrelated, it's flaking on other

[jira] [Updated] (HDFS-4346) Refactor INodeId and GenerationStamp

2012-12-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4346: - Description: The INodeId and GenerationStamp classes are very similar. It is bett

[jira] [Commented] (HDFS-4334) Add a unique id to each INode

2012-12-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540465#comment-13540465 ] Hudson commented on HDFS-4334: -- Integrated in Hadoop-Mapreduce-trunk #1298 (See [https://buil

[jira] [Commented] (HDFS-4330) Support snapshots up to the snapshot limit

2012-12-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540459#comment-13540459 ] Hudson commented on HDFS-4330: -- Integrated in Hadoop-Hdfs-Snapshots-Branch-build #53 (See [ht

[jira] [Commented] (HDFS-4334) Add a unique id to each INode

2012-12-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540455#comment-13540455 ] Hudson commented on HDFS-4334: -- Integrated in Hadoop-Hdfs-trunk #1268 (See [https://builds.ap

[jira] [Commented] (HDFS-4334) Add a unique id to each INode

2012-12-28 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540450#comment-13540450 ] Brandon Li commented on HDFS-4334: -- {quote}...~80MB is required for 1000 million inodes.{q

[jira] [Commented] (HDFS-4301) 2NN image transfer timeout problematic

2012-12-28 Thread liang xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540405#comment-13540405 ] liang xie commented on HDFS-4301: - [~tlipcon], IMHO the current implement seems OK, we can

[jira] [Resolved] (HDFS-4330) Support snapshots up to the snapshot limit

2012-12-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4330. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) Hadoop Flags: R

[jira] [Updated] (HDFS-4330) Support snapshots up to the snapshot limit

2012-12-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4330: - Attachment: h4330_20121228.patch h4330_20121228.patch: changes some messages in th

[jira] [Updated] (HDFS-4334) Add a unique id to each INode

2012-12-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4334: - Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4334) Add a unique id to each INode

2012-12-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540387#comment-13540387 ] Tsz Wo (Nicholas), SZE commented on HDFS-4334: -- +1 patch looks good. > ... Th

[jira] [Created] (HDFS-4346) Refactor INodeId and GenerationStamp

2012-12-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-4346: Summary: Refactor INodeId and GenerationStamp Key: HDFS-4346 URL: https://issues.apache.org/jira/browse/HDFS-4346 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-4341) TestBalancerWithNodeGroup fails on Windows

2012-12-28 Thread Ivan Mitic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13540385#comment-13540385 ] Ivan Mitic commented on HDFS-4341: -- Thanks Nicholas! > TestBalancerWithNo