[jira] [Created] (HDFS-3541) Deadlock between recovery, xceiver and packet responder

2012-06-18 Thread suja s (JIRA)
suja s created HDFS-3541: Summary: Deadlock between recovery, xceiver and packet responder Key: HDFS-3541 URL: https://issues.apache.org/jira/browse/HDFS-3541 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-3541) Deadlock between recovery, xceiver and packet responder

2012-06-18 Thread suja s (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] suja s updated HDFS-3541: - Attachment: DN_dump.rar > Deadlock between recovery, xceiver and packet responder > --

[jira] [Assigned] (HDFS-3541) Deadlock between recovery, xceiver and packet responder

2012-06-18 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay reassigned HDFS-3541: --- Assignee: Vinay > Deadlock between recovery, xceiver and packet responder > --

[jira] [Commented] (HDFS-3530) TestFileAppend2.testComplexAppend occasionally fails

2012-06-18 Thread Sho Shimauchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13395853#comment-13395853 ] Sho Shimauchi commented on HDFS-3530: - The following log appears in the Jenkins log: {

[jira] [Commented] (HDFS-3541) Deadlock between recovery, xceiver and packet responder

2012-06-18 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13395862#comment-13395862 ] Vinay commented on HDFS-3541: - By seeing the ThreadDump attached, recoverBlock(..) call is wait

[jira] [Updated] (HDFS-3541) Deadlock between recovery, xceiver and packet responder

2012-06-18 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated HDFS-3541: -- Target Version/s: 0.23.3 Affects Version/s: 0.23.3 I really would like to see this

[jira] [Commented] (HDFS-3527) Distributed cache object changed Error

2012-06-18 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13395962#comment-13395962 ] Robert Joseph Evans commented on HDFS-3527: --- Just guessing here from the name of

[jira] [Commented] (HDFS-3530) TestFileAppend2.testComplexAppend occasionally fails

2012-06-18 Thread Sho Shimauchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13395963#comment-13395963 ] Sho Shimauchi commented on HDFS-3530: - nvm, my guess is probably wrong. It's probably

[jira] [Created] (HDFS-3542) chmod does not parse ugo+rwx,+t correctly

2012-06-18 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3542: --- Summary: chmod does not parse ugo+rwx,+t correctly Key: HDFS-3542 URL: https://issues.apache.org/jira/browse/HDFS-3542 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3510: --- Attachment: HDFS-3510.008.patch * remove unused constant from test * always add paddin

[jira] [Updated] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3510: --- Description: In the FSEditLog, we want to avoid running out of space in the middle of

[jira] [Updated] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3510: --- Description: In the FSEditLog, we want to avoid running out of space in the middle of

[jira] [Commented] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

2012-06-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396118#comment-13396118 ] Junping Du commented on HDFS-3498: -- It is interesting that Jenkins is not started after re

[jira] [Commented] (HDFS-3518) Provide API to check HDFS operational state

2012-06-18 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396151#comment-13396151 ] Aaron T. Myers commented on HDFS-3518: -- bq. This is not an admin method. Any user coul

[jira] [Commented] (HDFS-3538) TestBlocksWithNotEnoughRacks fails

2012-06-18 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396177#comment-13396177 ] Aaron T. Myers commented on HDFS-3538: -- Hey Brandon, this test just passed for me on m

[jira] [Commented] (HDFS-3533) NPE in DFSClient$DFSInputStream.openInfo

2012-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396191#comment-13396191 ] Todd Lipcon commented on HDFS-3533: --- I think this still persists in 1.x -- it looks like

[jira] [Commented] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396204#comment-13396204 ] Hadoop QA commented on HDFS-3510: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3498) Make ReplicaPlacementPolicyDefault extensible for reuse code in subclass

2012-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396216#comment-13396216 ] Hadoop QA commented on HDFS-3498: - +1 overall. Here are the results of testing the latest

[jira] [Assigned] (HDFS-3530) TestFileAppend2.testComplexAppend occasionally fails

2012-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-3530: - Assignee: Todd Lipcon > TestFileAppend2.testComplexAppend occasionally fails > ---

[jira] [Commented] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396248#comment-13396248 ] Suresh Srinivas commented on HDFS-3510: --- bq. Given the different intent of pre-alloca

[jira] [Commented] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396267#comment-13396267 ] Colin Patrick McCabe commented on HDFS-3510: Yep, this JIRA is still valid. Th

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-06-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396273#comment-13396273 ] Tsz Wo (Nicholas), SZE commented on HDFS-3157: -- See if I understand the patch

[jira] [Updated] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-06-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3157: - Attachment: h3157_20120618.patch > Error in deleting block is keep on coming f

[jira] [Commented] (HDFS-3538) TestBlocksWithNotEnoughRacks fails

2012-06-18 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396290#comment-13396290 ] Brandon Li commented on HDFS-3538: -- Hi Aarno, local test is fine. It was failing in jenkin

[jira] [Commented] (HDFS-3370) HDFS hardlink

2012-06-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396306#comment-13396306 ] Konstantin Shvachko commented on HDFS-3370: --- > the key question: What services sh

[jira] [Commented] (HDFS-3370) HDFS hardlink

2012-06-18 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396311#comment-13396311 ] Jesse Yates commented on HDFS-3370: --- bq. Hardlinks are of similar nature. They are hard t

[jira] [Updated] (HDFS-3535) audit logging should log denied accesses as well as permitted ones

2012-06-18 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3535: Attachment: hdfs-3535-1.txt Attaching updated diff including unit test. > audit log

[jira] [Updated] (HDFS-3425) Enable standby namenode to tail edits from journal service

2012-06-18 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-3425: - Attachment: HDFS-3425.HDFS-3092.patch.2 re-base the patch with HDFS-3092 head. > Enable s

[jira] [Commented] (HDFS-3535) audit logging should log denied accesses as well as permitted ones

2012-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396398#comment-13396398 ] Hadoop QA commented on HDFS-3535: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

2012-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396403#comment-13396403 ] Todd Lipcon commented on HDFS-3425: --- Hey Brandon, I'm just looking over this quickly, an

[jira] [Updated] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3510: --- Attachment: HDFS-3510.009.patch * when closing an edit log, remember to remove any pre

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

2012-06-18 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396426#comment-13396426 ] Brandon Li commented on HDFS-3425: -- Hi Todd, thanks for reviewing it. One implementation h

[jira] [Commented] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396428#comment-13396428 ] Colin Patrick McCabe commented on HDFS-3510: bq. Can you explain why this is im

[jira] [Commented] (HDFS-3535) audit logging should log denied accesses as well as permitted ones

2012-06-18 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396430#comment-13396430 ] Andy Isaacson commented on HDFS-3535: - The TestDatanodeBlockScanner failure appears to

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

2012-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396431#comment-13396431 ] Todd Lipcon commented on HDFS-3425: --- bq. I am not sure I got the idea about using selectI

[jira] [Created] (HDFS-3543) Refactor Raid so it can work better with new erasure codes

2012-06-18 Thread Scott Chen (JIRA)
Scott Chen created HDFS-3543: Summary: Refactor Raid so it can work better with new erasure codes Key: HDFS-3543 URL: https://issues.apache.org/jira/browse/HDFS-3543 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-3543) Refactor Raid so it can work better with new erasure codes

2012-06-18 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated HDFS-3543: - Component/s: contrib/raid > Refactor Raid so it can work better with new erasure codes > -

[jira] [Moved] (HDFS-3544) Ability to use SimpleRegeratingCode to fix missing blocks

2012-06-18 Thread Scott Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen moved MAPREDUCE-3361 to HDFS-3544: - Component/s: (was: contrib/raid) contrib/raid

[jira] [Commented] (HDFS-3425) Enable standby namenode to tail edits from journal service

2012-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396447#comment-13396447 ] Todd Lipcon commented on HDFS-3425: --- Hey Brandon, I just got my implementation "working"

[jira] [Commented] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396453#comment-13396453 ] Hadoop QA commented on HDFS-3510: - +1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3510) Fix FSEditLog pre-allocation

2012-06-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396463#comment-13396463 ] Colin Patrick McCabe commented on HDFS-3510: I guess I should also post a short

[jira] [Commented] (HDFS-3370) HDFS hardlink

2012-06-18 Thread M. C. Srivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396466#comment-13396466 ] M. C. Srivas commented on HDFS-3370: The fact that HBase wants to use hard-links for ba

[jira] [Updated] (HDFS-3530) TestFileAppend2.testComplexAppend occasionally fails

2012-06-18 Thread Tomohiko Kinebuchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomohiko Kinebuchi updated HDFS-3530: - Attachment: HDFS-3530-for-debug.txt > TestFileAppend2.testComplexAppend occasionally f

[jira] [Commented] (HDFS-3530) TestFileAppend2.testComplexAppend occasionally fails

2012-06-18 Thread Tomohiko Kinebuchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396476#comment-13396476 ] Tomohiko Kinebuchi commented on HDFS-3530: -- I created and attached a patch for deb

[jira] [Commented] (HDFS-3530) TestFileAppend2.testComplexAppend occasionally fails

2012-06-18 Thread Tomohiko Kinebuchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396477#comment-13396477 ] Tomohiko Kinebuchi commented on HDFS-3530: -- Could someone give me contributor perm

[jira] [Updated] (HDFS-3526) Standy NameNode is entering into Safemode even after HDFS-2914 due to resources low

2012-06-18 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-3526: Attachment: HDFS-3526.patch Attaching the patch with above mentioned changes > Standy NameNode is e

[jira] [Updated] (HDFS-3526) Standy NameNode is entering into Safemode even after HDFS-2914 due to resources low

2012-06-18 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay updated HDFS-3526: Affects Version/s: 3.0.0 Status: Patch Available (was: Open) > Standy NameNode is entering into

[jira] [Commented] (HDFS-1490) TransferFSImage should timeout

2012-06-18 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396494#comment-13396494 ] Vinay commented on HDFS-1490: - Hi Molkov, We also faced same problem in 2.0.1. Are you planni

[jira] [Commented] (HDFS-3443) Unable to catch up edits during standby to active switch due to NPE

2012-06-18 Thread amith (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396504#comment-13396504 ] amith commented on HDFS-3443: - Hi Todd can u review the patch :) > Unable to c

[jira] [Commented] (HDFS-2994) If lease is recovered successfully inline with create, create can fail

2012-06-18 Thread amith (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396505#comment-13396505 ] amith commented on HDFS-2994: - Hi Todd can u review the patch :) > If lease is

[jira] [Assigned] (HDFS-3530) TestFileAppend2.testComplexAppend occasionally fails

2012-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-3530: - Assignee: Tomohiko Kinebuchi (was: Todd Lipcon) > TestFileAppend2.testComplexAppend occasiona

[jira] [Commented] (HDFS-3526) Standy NameNode is entering into Safemode even after HDFS-2914 due to resources low

2012-06-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396525#comment-13396525 ] Hadoop QA commented on HDFS-3526: - -1 overall. Here are the results of testing the latest