[jira] Commented: (HDFS-1473) Refactor storage management into separate classes than fsimage file reading/writing

[ https://issues.apache.org/jira/browse/HDFS-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933489#action_12933489 ] Hairong Kuang commented on HDFS-1473: - Sounds good to me. Personally I feel that it is s

[jira] Updated: (HDFS-1476) listCorruptFileBlocks should be functional while the name node is still in safe mode

[ https://issues.apache.org/jira/browse/HDFS-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Kling updated HDFS-1476: Status: Patch Available (was: Open) > listCorruptFileBlocks should be functional while the name nod

[jira] Commented: (HDFS-1476) listCorruptFileBlocks should be functional while the name node is still in safe mode

[ https://issues.apache.org/jira/browse/HDFS-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933512#action_12933512 ] Hairong Kuang commented on HDFS-1476: - I really like this idea. It is simple, does not n

[jira] Commented: (HDFS-1476) listCorruptFileBlocks should be functional while the name node is still in safe mode

[ https://issues.apache.org/jira/browse/HDFS-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933513#action_12933513 ] Hairong Kuang commented on HDFS-1476: - > the safemode exiting threshold I meant the defa

[jira] Updated: (HDFS-1476) listCorruptFileBlocks should be functional while the name node is still in safe mode

[ https://issues.apache.org/jira/browse/HDFS-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Kling updated HDFS-1476: Attachment: HDFS-1476.3.patch Changed default value of replication queue threshold to safe mode thre

[jira] Commented: (HDFS-1476) listCorruptFileBlocks should be functional while the name node is still in safe mode

[ https://issues.apache.org/jira/browse/HDFS-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933526#action_12933526 ] Hairong Kuang commented on HDFS-1476: - +1. Looks good to me. Using the safemode exiting

[jira] Commented: (HDFS-1109) HFTP and URL Encoding

[ https://issues.apache.org/jira/browse/HDFS-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933539#action_12933539 ] Suresh Srinivas commented on HDFS-1109: --- Goto namenode web UI -> Browse the filesystem

[jira] Commented: (HDFS-528) Add ability for safemode to wait for a minimum number of live datanodes

[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933559#action_12933559 ] Eli Collins commented on HDFS-528: -- If no one objects to the latest patch I'm going to commi

[jira] Commented: (HDFS-528) Add ability for safemode to wait for a minimum number of live datanodes

[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933561#action_12933561 ] dhruba borthakur commented on HDFS-528: --- > If no one objects to the latest patch I'm go

[jira] Resolved: (HDFS-528) Add ability for safemode to wait for a minimum number of live datanodes

[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-528. -- Resolution: Fixed Fix Version/s: 0.22.0 Hadoop Flags: [Reviewed] Thanks Dhruba. I've committe

[jira] Commented: (HDFS-1109) HFTP and URL Encoding

[ https://issues.apache.org/jira/browse/HDFS-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933573#action_12933573 ] Dmytro Molkov commented on HDFS-1109: - Suresh, the reason for this patch was the way url

[jira] Updated: (HDFS-1377) Quota bug for partial blocks allows quotas to be violated

[ https://issues.apache.org/jira/browse/HDFS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1377: -- Attachment: hdfs-1377-b20-2.patch Right patch for branch 20 attached this time. > Quota bug for partial

[jira] Commented: (HDFS-1109) HFTP and URL Encoding

[ https://issues.apache.org/jira/browse/HDFS-1109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933579#action_12933579 ] Suresh Srinivas commented on HDFS-1109: --- I understood that. The problem is, filename i

[jira] Updated: (HDFS-1487) FSDirectory.removeBlock() should update diskspace count of the block owner node

[ https://issues.apache.org/jira/browse/HDFS-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1487: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Comm

[jira] Resolved: (HDFS-1507) TestAbandonBlock should abandon a block

[ https://issues.apache.org/jira/browse/HDFS-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-1507. --- Resolution: Fixed Fix Version/s: (was: 0.23.0) Hadoop Flags: [Reviewed] Committed to b

[jira] Updated: (HDFS-1473) Refactor storage management into separate classes than fsimage file reading/writing

[ https://issues.apache.org/jira/browse/HDFS-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1473: -- Attachment: hdfs-1473.txt Here's a patch that's been cleaned up and javadocced. I took Hairong's sugges

[jira] Created: (HDFS-1508) Ability to do savenamespace without being in safemode

Ability to do savenamespace without being in safemode - Key: HDFS-1508 URL: https://issues.apache.org/jira/browse/HDFS-1508 Project: Hadoop HDFS Issue Type: Improvement Reporter

[jira] Updated: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command

[ https://issues.apache.org/jira/browse/HDFS-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1509: --- Component/s: name-node > Resync discarded directories in fs.name.dir during saveNamespace comm

[jira] Created: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command

Resync discarded directories in fs.name.dir during saveNamespace command Key: HDFS-1509 URL: https://issues.apache.org/jira/browse/HDFS-1509 Project: Hadoop HDFS Issue

[jira] Updated: (HDFS-1508) Ability to do savenamespace without being in safemode

[ https://issues.apache.org/jira/browse/HDFS-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1508: --- Component/s: name-node > Ability to do savenamespace without being in safemode > -

[jira] Commented: (HDFS-1482) Add listCorruptFileBlocks to DistributedFileSystem (and ClientProtocol)

[ https://issues.apache.org/jira/browse/HDFS-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933617#action_12933617 ] Eli Collins commented on HDFS-1482: --- Per Suresh this API needs to be added to FileContext

[jira] Commented: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command

[ https://issues.apache.org/jira/browse/HDFS-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933621#action_12933621 ] Eli Collins commented on HDFS-1509: --- If a fs.name.dir is faulty (eg a failed local disk or

[jira] Commented: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command

[ https://issues.apache.org/jira/browse/HDFS-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933642#action_12933642 ] dhruba borthakur commented on HDFS-1509: > dir gets black-listed will get re-instate

[jira] Commented: (HDFS-1377) Quota bug for partial blocks allows quotas to be violated

[ https://issues.apache.org/jira/browse/HDFS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933651#action_12933651 ] Raghu Angadi commented on HDFS-1377: I am still refreshing my memory of this NN interna

[jira] Commented: (HDFS-1509) Resync discarded directories in fs.name.dir during saveNamespace command

[ https://issues.apache.org/jira/browse/HDFS-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933654#action_12933654 ] Eli Collins commented on HDFS-1509: --- Isn't there a motivation for the Namenode no longer w

[jira] Commented: (HDFS-1476) listCorruptFileBlocks should be functional while the name node is still in safe mode

[ https://issues.apache.org/jira/browse/HDFS-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933658#action_12933658 ] Hairong Kuang commented on HDFS-1476: - I thought more about this. ProcessMisReplicatedBl

[jira] Updated: (HDFS-1482) Add listCorruptFileBlocks to DistributedFileSystem (and ClientProtocol)

[ https://issues.apache.org/jira/browse/HDFS-1482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Kling updated HDFS-1482: Attachment: HDFS-1482.5.patch Added listCorruptFileBlocks to FileContext. > Add listCorruptFileBloc

[jira] Updated: (HDFS-1510) Add test-patch.properties required by test-patch.sh

[ https://issues.apache.org/jira/browse/HDFS-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HDFS-1510: -- Attachment: HDFS-1510.patch > Add test-patch.properties required by test-patch.sh >

[jira] Created: (HDFS-1510) Add test-patch.properties required by test-patch.sh

Add test-patch.properties required by test-patch.sh --- Key: HDFS-1510 URL: https://issues.apache.org/jira/browse/HDFS-1510 Project: Hadoop HDFS Issue Type: Improvement Reporter: Ni

[jira] Resolved: (HDFS-1510) Add test-patch.properties required by test-patch.sh

[ https://issues.apache.org/jira/browse/HDFS-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley resolved HDFS-1510. --- Resolution: Fixed Fix Version/s: 0.23.0 I just committed this to get HDFS patch testing back on

[jira] Commented: (HDFS-1510) Add test-patch.properties required by test-patch.sh

[ https://issues.apache.org/jira/browse/HDFS-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933676#action_12933676 ] Eli Collins commented on HDFS-1510: --- +1 > Add test-patch.properties required by test-pat

[jira] Updated: (HDFS-1001) DataXceiver and BlockReader disagree on when to send/recv CHECKSUM_OK

[ https://issues.apache.org/jira/browse/HDFS-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1001: -- Attachment: HDFS-1001-5.patch Patch attached rebased against trunk. > DataXceiver and BlockReader disag

[jira] Updated: (HDFS-1001) DataXceiver and BlockReader disagree on when to send/recv CHECKSUM_OK

[ https://issues.apache.org/jira/browse/HDFS-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1001: -- Hadoop Flags: [Reviewed] Status: Patch Available (was: Open) > DataXceiver and BlockReader di

[jira] Updated: (HDFS-1001) DataXceiver and BlockReader disagree on when to send/recv CHECKSUM_OK

[ https://issues.apache.org/jira/browse/HDFS-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1001: -- Fix Version/s: 0.23.0 Affects Version/s: (was: 0.22.0) Status: Open (was: Pat

[jira] Updated: (HDFS-1001) DataXceiver and BlockReader disagree on when to send/recv CHECKSUM_OK

[ https://issues.apache.org/jira/browse/HDFS-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-1001: -- Component/s: data-node Priority: Minor (was: Major) > DataXceiver and BlockReader disagree on wh

[jira] Created: (HDFS-1511) 98 Release Audit warnings on trunk and branch-0.22

98 Release Audit warnings on trunk and branch-0.22 -- Key: HDFS-1511 URL: https://issues.apache.org/jira/browse/HDFS-1511 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.22.0, 0.23

[jira] Updated: (HDFS-1511) 98 Release Audit warnings on trunk and branch-0.22

[ https://issues.apache.org/jira/browse/HDFS-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HDFS-1511: -- Attachment: releaseauditWarnings.txt > 98 Release Audit warnings on trunk and branch-0.22 >

[jira] Commented: (HDFS-1391) Exiting safemode takes a long time when there are lots of blocks in the HDFS

[ https://issues.apache.org/jira/browse/HDFS-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933697#action_12933697 ] Hadoop QA commented on HDFS-1391: - -1 overall. Here are the results of testing the latest a

[jira] Commented: (HDFS-1511) 98 Release Audit warnings on trunk and branch-0.22

[ https://issues.apache.org/jira/browse/HDFS-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933699#action_12933699 ] Owen O'Malley commented on HDFS-1511: - Is there already a suppression list for RAT? Clea

[jira] Commented: (HDFS-1467) Append pipeline never succeeds with more than one replica

[ https://issues.apache.org/jira/browse/HDFS-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933703#action_12933703 ] Todd Lipcon commented on HDFS-1467: --- It looks like this fix actually introduced some other

[jira] Reopened: (HDFS-1467) Append pipeline never succeeds with more than one replica

[ https://issues.apache.org/jira/browse/HDFS-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HDFS-1467: --- Reopening, I'm going to ask Eli to revert this patch until we figure out what's going on. > Append pipel

[jira] Commented: (HDFS-1511) 98 Release Audit warnings on trunk and branch-0.22

[ https://issues.apache.org/jira/browse/HDFS-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933705#action_12933705 ] Nigel Daley commented on HDFS-1511: --- Looks like the HDFS releaseaudit target doesn't filte

[jira] Commented: (HDFS-1467) Append pipeline never succeeds with more than one replica

[ https://issues.apache.org/jira/browse/HDFS-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12933707#action_12933707 ] Eli Collins commented on HDFS-1467: --- I've reverted this from trunk and branch 22. Thanks

[jira] Updated: (HDFS-1467) Append pipeline never succeeds with more than one replica

[ https://issues.apache.org/jira/browse/HDFS-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1467: -- Attachment: hdfs-1467-fixed.txt Take two! The issue was that we actually _depended_ on BlockReceiver to