[jira] Commented: (HDFS-1032) Extend DFSck with an option to list corrupt files using API from HDFS-729

[ https://issues.apache.org/jira/browse/HDFS-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849077#action_12849077 ] Hadoop QA commented on HDFS-1032: - -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1032) Extend DFSck with an option to list corrupt files using API from HDFS-729

[ https://issues.apache.org/jira/browse/HDFS-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849085#action_12849085 ] Rodrigo Schmidt commented on HDFS-1032: --- André, I had a quick chat with Dhruba offline

[jira] Commented: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849092#action_12849092 ] Bharath Mundlapudi commented on HDFS-1061: -- 10% saving from the current INodeFile.

[jira] Commented: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849244#action_12849244 ] Tsz Wo (Nicholas), SZE commented on HDFS-1061: -- We probably could safely assume

[jira] Commented: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849324#action_12849324 ] Bharath Mundlapudi commented on HDFS-1061: -- Storing exponents is a good suggestion

[jira] Commented: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849332#action_12849332 ] Bharath Mundlapudi commented on HDFS-1061: -- A small correction and additional note

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Attachment: HDFS-892.patch all the changes are compatible changes except renaming register(..) to

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Status: Patch Available (was: Open) optionally use Avro for namenode RPC

[jira] Created: (HDFS-1065) Secondary Namenode fails to fetch image and edits files

Secondary Namenode fails to fetch image and edits files --- Key: HDFS-1065 URL: https://issues.apache.org/jira/browse/HDFS-1065 Project: Hadoop HDFS Issue Type: Bug Affects Versions:

[jira] Updated: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Booth updated HDFS-918: --- Attachment: hdfs-200+826+918-branch20.patch I heard all the cool kids are running HDFS-200 and HDFS-826 on

[jira] Updated: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Booth updated HDFS-918: --- Attachment: (was: hdfs-918-0.20.2.patch) Use single Selector and small thread pool to replace many

[jira] Commented: (HDFS-854) Datanode should scan devices in parallel to generate block report

[ https://issues.apache.org/jira/browse/HDFS-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849388#action_12849388 ] Dmytro Molkov commented on HDFS-854: The test failure

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849391#action_12849391 ] Hadoop QA commented on HDFS-892: -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849399#action_12849399 ] dhruba borthakur commented on HDFS-1061: It appears that this proposal is: 48 bits

[jira] Updated: (HDFS-854) Datanode should scan devices in parallel to generate block report

[ https://issues.apache.org/jira/browse/HDFS-854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated HDFS-854: --- Status: Patch Available (was: Open) Going to submit it once again to see if the tests pass.

[jira] Updated: (HDFS-854) Datanode should scan devices in parallel to generate block report

[ https://issues.apache.org/jira/browse/HDFS-854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated HDFS-854: --- Status: Open (was: Patch Available) Datanode should scan devices in parallel to generate block

[jira] Commented: (HDFS-854) Datanode should scan devices in parallel to generate block report

[ https://issues.apache.org/jira/browse/HDFS-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849476#action_12849476 ] Jakob Homan commented on HDFS-854: -- The test failure is not related in all likelihood. The

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thanks,

[jira] Commented: (HDFS-1064) NN Availability - umbrella Jira

[ https://issues.apache.org/jira/browse/HDFS-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849490#action_12849490 ] Jeff Hammerbacher commented on HDFS-1064: - Hey, Could someone comment on how the

[jira] Commented: (HDFS-1064) NN Availability - umbrella Jira

[ https://issues.apache.org/jira/browse/HDFS-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849492#action_12849492 ] Jeff Hammerbacher commented on HDFS-1064: - It's also probably worth linking to some

[jira] Commented: (HDFS-1064) NN Availability - umbrella Jira

[ https://issues.apache.org/jira/browse/HDFS-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849495#action_12849495 ] Jeff Hammerbacher commented on HDFS-1064: - Sorry, can't edit the above, but wanted

[jira] Created: (HDFS-1066) Make HDFS tests pass using Avro RPC

Make HDFS tests pass using Avro RPC --- Key: HDFS-1066 URL: https://issues.apache.org/jira/browse/HDFS-1066 Project: Hadoop HDFS Issue Type: Bug Components: name-node Reporter: Doug

[jira] Commented: (HDFS-132) Namenode in Safemode reports to Simon non-zero number of deleted files during startup

[ https://issues.apache.org/jira/browse/HDFS-132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849504#action_12849504 ] Suresh Srinivas commented on HDFS-132: -- {{FSDirectory.directoryMetrics}} reports two

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849509#action_12849509 ] Hudson commented on HDFS-892: - Integrated in Hadoop-Hdfs-trunk-Commit #221 (See

[jira] Commented: (HDFS-854) Datanode should scan devices in parallel to generate block report

[ https://issues.apache.org/jira/browse/HDFS-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849510#action_12849510 ] Rodrigo Schmidt commented on HDFS-854: -- I agree with Jakob about the patch name. :-)

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849523#action_12849523 ] Hudson commented on HDFS-892: - Integrated in Hadoop-Hdfs-trunk-Commit #222 (See

[jira] Commented: (HDFS-1064) NN Availability - umbrella Jira

[ https://issues.apache.org/jira/browse/HDFS-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849530#action_12849530 ] dhruba borthakur commented on HDFS-1064: Could someone comment on how the

[jira] Commented: (HDFS-854) Datanode should scan devices in parallel to generate block report

[ https://issues.apache.org/jira/browse/HDFS-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849543#action_12849543 ] Hadoop QA commented on HDFS-854: -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-854) Datanode should scan devices in parallel to generate block report

[ https://issues.apache.org/jira/browse/HDFS-854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated HDFS-854: --- Attachment: HDFS-854-2.patch Addressing Jakob's comments: Moved dfs.datanode.directoryscan.threads to

[jira] Commented: (HDFS-854) Datanode should scan devices in parallel to generate block report

[ https://issues.apache.org/jira/browse/HDFS-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849553#action_12849553 ] Rodrigo Schmidt commented on HDFS-854: -- Patch looks good to me. +1. Datanode should

[jira] Commented: (HDFS-1032) Extend DFSck with an option to list corrupt files using API from HDFS-729

[ https://issues.apache.org/jira/browse/HDFS-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849575#action_12849575 ] André Oriani commented on HDFS-1032: I am concerned how to handle the exit code of fsck

[jira] Commented: (HDFS-1032) Extend DFSck with an option to list corrupt files using API from HDFS-729

[ https://issues.apache.org/jira/browse/HDFS-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849590#action_12849590 ] Rodrigo Schmidt commented on HDFS-1032: --- What about the following option: 2) In your