[jira] [Commented] (HDFS-4880) Diagnostic logging while loading name/edits files

2013-06-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675639#comment-13675639 ] Arpit Agarwal commented on HDFS-4880: - edits file location is already logged on branch-

[jira] [Updated] (HDFS-4880) Diagnostic logging while loading name/edits files

2013-06-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4880: Attachment: HDFS-4880.branch-1.patch > Diagnostic logging while loading name/edits files > -

[jira] [Commented] (HDFS-4876) The javadoc of FileWithSnapshot is incorrect

2013-06-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675622#comment-13675622 ] Hudson commented on HDFS-4876: -- Integrated in Hadoop-trunk-Commit #3864 (See [https://builds.

[jira] [Updated] (HDFS-4876) The javadoc of FileWithSnapshot is incorrect

2013-06-04 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4876: - Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4871) Skip failing commons tests on Windows

2013-06-04 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675591#comment-13675591 ] Chuan Liu commented on HDFS-4871: - >My personal preference would be to file a single parent

[jira] [Created] (HDFS-4880) Diagnostic logging while loading name/edits files

2013-06-04 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-4880: --- Summary: Diagnostic logging while loading name/edits files Key: HDFS-4880 URL: https://issues.apache.org/jira/browse/HDFS-4880 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4873) callGetBlockLocations returns incorrect number of blocks for snapshotted files

2013-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675543#comment-13675543 ] Hadoop QA commented on HDFS-4873: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4877: Labels: snapshots (was: ) > Snapshot: fix the scenario where a directory is renamed under its prior >

[jira] [Updated] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4877: Component/s: snapshots > Snapshot: fix the scenario where a directory is renamed under its prior > desc

[jira] [Updated] (HDFS-4873) callGetBlockLocations returns incorrect number of blocks for snapshotted files

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4873: Attachment: HDFS-4873.001.patch Thanks a lot for the good catch, Hari! Upload the initial patch for review

[jira] [Updated] (HDFS-4873) callGetBlockLocations returns incorrect number of blocks for snapshotted files

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4873: Affects Version/s: 2.1.0-beta Status: Patch Available (was: Open) > callGetBlockLocation

[jira] [Commented] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.

2013-06-04 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675477#comment-13675477 ] Plamen Jeliazkov commented on HDFS-4867: The patch for trunk is applicable to branc

[jira] [Updated] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.

2013-06-04 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4867: --- Fix Version/s: 2.0.5-alpha > metaSave NPEs when there are invalid blocks in repl queue. >

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675458#comment-13675458 ] Aaron T. Myers commented on HDFS-4872: -- I think we should again seriously consider imp

[jira] [Commented] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.

2013-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675447#comment-13675447 ] Konstantin Shvachko commented on HDFS-4867: --- +1 for the patch. >

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675427#comment-13675427 ] Konstantin Shvachko commented on HDFS-4872: --- > A delete retry may delete an objec

[jira] [Commented] (HDFS-4879) Add "blocked ArrayList" collection to avoid CMS full GCs

2013-06-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675424#comment-13675424 ] Colin Patrick McCabe commented on HDFS-4879: This is a good improvement; it sho

[jira] [Commented] (HDFS-4878) On Remove Block, Block is not Removed from neededReplications queue

2013-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675414#comment-13675414 ] Hadoop QA commented on HDFS-4878: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4878) On Remove Block, Block is not Removed from neededReplications queue

2013-06-04 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo updated HDFS-4878: -- Status: Patch Available (was: Open) > On Remove Block, Block is not Removed from neededReplications queue >

[jira] [Commented] (HDFS-4815) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

2013-06-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675413#comment-13675413 ] Hudson commented on HDFS-4815: -- Integrated in Hadoop-trunk-Commit #3863 (See [https://builds.

[jira] [Updated] (HDFS-4878) On Remove Block, Block is not Removed from neededReplications queue

2013-06-04 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo updated HDFS-4878: -- Status: Open (was: Patch Available) > On Remove Block, Block is not Removed from neededReplications queue >

[jira] [Updated] (HDFS-4878) On Remove Block, Block is not Removed from neededReplications queue

2013-06-04 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4878: --- Fix Version/s: 3.0.0 > On Remove Block, Block is not Removed from neededReplications queue

[jira] [Updated] (HDFS-4815) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

2013-06-04 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4815: - Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed Status: R

[jira] [Commented] (HDFS-4874) create with OVERWRITE deletes existing file without checking the lease: feature or a bug.

2013-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675389#comment-13675389 ] Konstantin Shvachko commented on HDFS-4874: --- Also I have seen on 2.0 that the oth

[jira] [Commented] (HDFS-4815) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

2013-06-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675379#comment-13675379 ] Chris Nauroth commented on HDFS-4815: - Sorry, Aaron. I'll be away for at least a week,

[jira] [Commented] (HDFS-4874) create with OVERWRITE deletes existing file without checking the lease: feature or a bug.

2013-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675376#comment-13675376 ] Konstantin Shvachko commented on HDFS-4874: --- This sounds like an acceptable behav

[jira] [Commented] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.

2013-06-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675359#comment-13675359 ] Ravi Prakash commented on HDFS-4867: bq. Plamen, could you please open another JIRA for

[jira] [Commented] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.

2013-06-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675357#comment-13675357 ] Ravi Prakash commented on HDFS-4867: Patch looks good to me. Thanks Plamen! {quote} me

[jira] [Commented] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

2013-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675324#comment-13675324 ] Hadoop QA commented on HDFS-4877: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-4840) ReplicationMonitor gets NPE during shutdown

2013-06-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675314#comment-13675314 ] Hudson commented on HDFS-4840: -- Integrated in Hadoop-trunk-Commit #3860 (See [https://builds.

[jira] [Updated] (HDFS-4840) ReplicationMonitor gets NPE during shutdown

2013-06-04 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4840: - Resolution: Fixed Fix Version/s: 2.1.0-beta 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4874) create with OVERWRITE deletes existing file without checking the lease: feature or a bug.

2013-06-04 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675293#comment-13675293 ] Andrew Wang commented on HDFS-4874: --- Just throwing in my 2c, I've seen some some client a

[jira] [Reopened] (HDFS-4874) create with OVERWRITE deletes existing file without checking the lease: feature or a bug.

2013-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HDFS-4874: --- If you don't mind, Daryn, I'll reopen it while we are still discussing. >

[jira] [Commented] (HDFS-4815) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed

2013-06-04 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675278#comment-13675278 ] Aaron T. Myers commented on HDFS-4815: -- +1, patch looks good to me as well. Chris, mi

[jira] [Updated] (HDFS-4878) On Remove Block, Block is not Removed from neededReplications queue

2013-06-04 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo updated HDFS-4878: -- Status: Patch Available (was: Open) > On Remove Block, Block is not Removed from neededReplications queue >

[jira] [Updated] (HDFS-4878) On Remove Block, Block is not Removed from neededReplications queue

2013-06-04 Thread Tao Luo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Luo updated HDFS-4878: -- Attachment: HDFS-4878.patch Removing block from neededReplications queue when removeBlock() is called

[jira] [Updated] (HDFS-4879) Add "blocked ArrayList" collection to avoid CMS full GCs

2013-06-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4879: -- Attachment: hdfs-4879.txt New rev with slight improvements I noticed during further testing: - made def

[jira] [Comment Edited] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13673589#comment-13673589 ] Konstantin Shvachko edited comment on HDFS-4872 at 6/4/13 9:08 PM: --

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675234#comment-13675234 ] Konstantin Shvachko commented on HDFS-4872: --- I missed to include Suresh's proposa

[jira] [Updated] (HDFS-4879) Add "blocked ArrayList" collection to avoid CMS full GCs

2013-06-04 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4879: -- Attachment: hdfs-4879.txt Attached patch implements the simple data structure and integrates it in the

[jira] [Commented] (HDFS-4491) Parallel testing HDFS

2013-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675210#comment-13675210 ] Hadoop QA commented on HDFS-4491: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4877: Affects Version/s: 2.1.0-beta > Snapshot: fix the scenario where a directory is renamed under its prior

[jira] [Updated] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4877: Priority: Blocker (was: Critical) > Snapshot: fix the scenario where a directory is renamed under its p

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675183#comment-13675183 ] Arpit Agarwal commented on HDFS-4872: - I like the get INode+Delete approach for reasons

[jira] [Commented] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.

2013-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675172#comment-13675172 ] Hadoop QA commented on HDFS-4867: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-4879) Add "blocked ArrayList" collection to avoid CMS full GCs

2013-06-04 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-4879: - Summary: Add "blocked ArrayList" collection to avoid CMS full GCs Key: HDFS-4879 URL: https://issues.apache.org/jira/browse/HDFS-4879 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

2013-06-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13675139#comment-13675139 ] Ravi Prakash commented on HDFS-1172: I am able to consistently reproduce this issue wit

[jira] [Updated] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4877: Attachment: HDFS-4877.001.patch Initial patch for review. > Snapshot: fix the scenario whe

[jira] [Updated] (HDFS-4491) Parallel testing HDFS

2013-06-04 Thread Andrey Klochkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Klochkov updated HDFS-4491: -- Status: Patch Available (was: Open) > Parallel testing HDFS > - > >

[jira] [Updated] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4877: Status: Patch Available (was: Open) > Snapshot: fix the scenario where a directory is renamed under its

[jira] [Commented] (HDFS-1825) Remove thriftfs contrib

2013-06-04 Thread Chu Tong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674685#comment-13674685 ] Chu Tong commented on HDFS-1825: After removing hdfs thrift server, is there any alternativ

[jira] [Created] (HDFS-4878) On Remove Block, Block is not Removed from neededReplications queue

2013-06-04 Thread Tao Luo (JIRA)
Tao Luo created HDFS-4878: - Summary: On Remove Block, Block is not Removed from neededReplications queue Key: HDFS-4878 URL: https://issues.apache.org/jira/browse/HDFS-4878 Project: Hadoop HDFS Issu

[jira] [Commented] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674670#comment-13674670 ] Jing Zhao commented on HDFS-4877: - The main idea to fix is based on the observation that th

[jira] [Commented] (HDFS-4871) Skip failing commons tests on Windows

2013-06-04 Thread Ivan Mitic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674661#comment-13674661 ] Ivan Mitic commented on HDFS-4871: -- Thanks Arpit, +1 on the proposal. Getting CI working o

[jira] [Updated] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.

2013-06-04 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-4867: --- Attachment: HDFS-4867.trunk.patch > metaSave NPEs when there are invalid blocks in repl qu

[jira] [Commented] (HDFS-4867) metaSave NPEs when there are invalid blocks in repl queue.

2013-06-04 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674648#comment-13674648 ] Plamen Jeliazkov commented on HDFS-4867: New patch with Konstantin's comments taken

[jira] [Created] (HDFS-4877) Snapshot: fix the scenario where a directory is renamed under its prior descendant

2013-06-04 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4877: --- Summary: Snapshot: fix the scenario where a directory is renamed under its prior descendant Key: HDFS-4877 URL: https://issues.apache.org/jira/browse/HDFS-4877 Project: Hadoop

[jira] [Commented] (HDFS-4871) Skip failing commons tests on Windows

2013-06-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674642#comment-13674642 ] Arpit Agarwal commented on HDFS-4871: - Thanks Chuan. No we'd need to do this for HDFS,

[jira] [Commented] (HDFS-4871) Skip failing commons tests on Windows

2013-06-04 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674633#comment-13674633 ] Chuan Liu commented on HDFS-4871: - +1 on the approach to enable CI. [~arpitagarwal], do yo

[jira] [Commented] (HDFS-4876) The javadoc of FileWithSnapshot is incorrect

2013-06-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674563#comment-13674563 ] Jing Zhao commented on HDFS-4876: - +1 for the patch. > The javadoc of File

[jira] [Commented] (HDFS-4862) SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually

2013-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674562#comment-13674562 ] Hadoop QA commented on HDFS-4862: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674517#comment-13674517 ] Suresh Srinivas commented on HDFS-4872: --- bq. One cited drawback of rename/delete is t

[jira] [Updated] (HDFS-4869) FsShell get command does not support writing to stdout

2013-06-04 Thread Cristina L. Abad (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cristina L. Abad updated HDFS-4869: --- Attachment: 4869.branch-0.23.patch >From the jiras it wasn't clear that the change in the beha

[jira] [Updated] (HDFS-4862) SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually

2013-06-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-4862: --- Attachment: HDFS-4862.patch Reverted changes in getTurnOffTip(). That madness needs to be fixed in ano

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674448#comment-13674448 ] Daryn Sharp commented on HDFS-4872: --- I don't think there is a good approach that is porta

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-06-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674413#comment-13674413 ] Hudson commented on HDFS-3934: -- Integrated in Hadoop-Mapreduce-trunk #1446 (See [https://buil

[jira] [Resolved] (HDFS-4874) create with OVERWRITE deletes existing file without checking the lease: feature or a bug.

2013-06-04 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp resolved HDFS-4874. --- Resolution: Not A Problem Hadoop Flags: Incompatible change I fully agree with Suresh. An overw

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674371#comment-13674371 ] Suresh Srinivas commented on HDFS-4872: --- bq. that would imply the operation shouldn't

[jira] [Commented] (HDFS-4862) SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually

2013-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674356#comment-13674356 ] Hadoop QA commented on HDFS-4862: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-06-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674345#comment-13674345 ] Hudson commented on HDFS-3934: -- Integrated in Hadoop-Hdfs-trunk #1420 (See [https://builds.ap

[jira] [Commented] (HDFS-4876) The javadoc of FileWithSnapshot is incorrect

2013-06-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674305#comment-13674305 ] Hadoop QA commented on HDFS-4876: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-4862) SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually

2013-06-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-4862: --- Status: Patch Available (was: Open) > SafeModeInfo.isManual() returns true when resources are low

[jira] [Assigned] (HDFS-4862) SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually

2013-06-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reassigned HDFS-4862: -- Assignee: Ravi Prakash > SafeModeInfo.isManual() returns true when resources are low even if

[jira] [Commented] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2013-06-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674254#comment-13674254 ] Hudson commented on HDFS-3934: -- Integrated in Hadoop-Yarn-trunk #230 (See [https://builds.apa

[jira] [Updated] (HDFS-4876) The javadoc of FileWithSnapshot is incorrect

2013-06-04 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4876: - Status: Patch Available (was: Open) > The javadoc of FileWithSnapshot is inco

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674168#comment-13674168 ] Steve Loughran commented on HDFS-4872: -- BTW this isn't something that other filesystem

[jira] [Commented] (HDFS-4872) Idempotent delete operation.

2013-06-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13674150#comment-13674150 ] Steve Loughran commented on HDFS-4872: -- bq. Just mark delete idempotent. A delete retr

[jira] [Updated] (HDFS-4876) The javadoc of FileWithSnapshot is incorrect

2013-06-04 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4876: - Attachment: h4876_20130604.patch h4876_20130604.patch: fixes the javadoc and moves

[jira] [Updated] (HDFS-4875) Add a test for testing snapshot file length

2013-06-04 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4875: - Issue Type: Sub-task (was: Test) Parent: HDFS-2802 > Add a test for t

[jira] [Updated] (HDFS-4876) The javadoc of FileWithSnapshot is incorrect

2013-06-04 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4876: - Fix Version/s: (was: 2.1.0-beta) > The javadoc of FileWithSnapshot is inco

[jira] [Created] (HDFS-4876) The javadoc of FileWithSnapshot is incorrect

2013-06-04 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-4876: Summary: The javadoc of FileWithSnapshot is incorrect Key: HDFS-4876 URL: https://issues.apache.org/jira/browse/HDFS-4876 Project: Hadoop HDFS

[jira] [Created] (HDFS-4875) Add a test for testing snapshot file length

2013-06-04 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-4875: Summary: Add a test for testing snapshot file length Key: HDFS-4875 URL: https://issues.apache.org/jira/browse/HDFS-4875 Project: Hadoop HDFS