[jira] Commented: (HDFS-1032) Extend DFSck with an option to list corrupt files using API from HDFS-729

[ https://issues.apache.org/jira/browse/HDFS-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848046#action_12848046 ] Rodrigo Schmidt commented on HDFS-1032: --- +1 Patch looks good to me. André, Please

[jira] Updated: (HDFS-1010) HDFSProxy: Retrieve group information from UnixUserGroupInformation instead of LdapEntry

[ https://issues.apache.org/jira/browse/HDFS-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Sundarrajan updated HDFS-1010: --- Attachment: HDFS-1010-bp-y20s.patch Backport patch. Not for commit. Removed reference

[jira] Updated: (HDFS-1011) Improve Logging in HDFSProxy to include cluster name associated with the request

[ https://issues.apache.org/jira/browse/HDFS-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Sundarrajan updated HDFS-1011: --- Attachment: HDFS-1011-bp-y20s.patch HDFS-1011-bp-y20.patch

[jira] Assigned: (HDFS-1011) Improve Logging in HDFSProxy to include cluster name associated with the request

[ https://issues.apache.org/jira/browse/HDFS-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Sundarrajan reassigned HDFS-1011: -- Assignee: Srikanth Sundarrajan (was: Ramesh Sekaran) Improve Logging in

[jira] Updated: (HDFS-1011) Improve Logging in HDFSProxy to include cluster name associated with the request

[ https://issues.apache.org/jira/browse/HDFS-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Sundarrajan updated HDFS-1011: --- Fix Version/s: 0.22.0 Affects Version/s: (was: 0.20.2)

[jira] Updated: (HDFS-1011) Improve Logging in HDFSProxy to include cluster name associated with the request

[ https://issues.apache.org/jira/browse/HDFS-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Sundarrajan updated HDFS-1011: --- Attachment: (was: HDFS-1011.patch) Improve Logging in HDFSProxy to include

[jira] Updated: (HDFS-1011) Improve Logging in HDFSProxy to include cluster name associated with the request

[ https://issues.apache.org/jira/browse/HDFS-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Sundarrajan updated HDFS-1011: --- Attachment: HDFS-1011.patch Improve Logging in HDFSProxy to include cluster name

[jira] Assigned: (HDFS-1011) Improve Logging in HDFSProxy to include cluster name associated with the request

[ https://issues.apache.org/jira/browse/HDFS-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Sundarrajan reassigned HDFS-1011: -- Assignee: Ramesh Sekaran (was: Srikanth Sundarrajan) Improve Logging in

[jira] Commented: (HDFS-1011) Improve Logging in HDFSProxy to include cluster name associated with the request

[ https://issues.apache.org/jira/browse/HDFS-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848074#action_12848074 ] Hadoop QA commented on HDFS-1011: - -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1056) Multi-node RPC deadlocks during block recovery

[ https://issues.apache.org/jira/browse/HDFS-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848125#action_12848125 ] dhruba borthakur commented on HDFS-1056: I agree. if you setup fixed ports for DN,

[jira] Updated: (HDFS-1032) Extend DFSck with an option to list corrupt files using API from HDFS-729

[ https://issues.apache.org/jira/browse/HDFS-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André Oriani updated HDFS-1032: --- Status: Patch Available (was: In Progress) Extend DFSck with an option to list corrupt files using

[jira] Updated: (HDFS-1041) DFSClient does not retry in getFileChecksum(..)

[ https://issues.apache.org/jira/browse/HDFS-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1041: - Affects Version/s: 0.22.0 0.21.0

[jira] Commented: (HDFS-1051) Umbrella Jira for Scaling the HDFS Name Service

[ https://issues.apache.org/jira/browse/HDFS-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848235#action_12848235 ] Sanjay Radia commented on HDFS-1051: * Filing of this Jira does not exclude work on HA.

[jira] Updated: (HDFS-899) Delegation Token Implementation

[ https://issues.apache.org/jira/browse/HDFS-899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-899: -- Resolution: Fixed Status: Resolved (was: Patch Available) This is committed,

[jira] Assigned: (HDFS-1045) In secure clusters, re-login is necessary for https clients before opening connections

[ https://issues.apache.org/jira/browse/HDFS-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan reassigned HDFS-1045: - Assignee: Jakob Homan In secure clusters, re-login is necessary for https clients before opening

[jira] Commented: (HDFS-1051) Umbrella Jira for Scaling the HDFS Name Service

[ https://issues.apache.org/jira/browse/HDFS-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848334#action_12848334 ] Sanjay Radia commented on HDFS-1051: NN memory ... machines with 144 GB memory or more

[jira] Commented: (HDFS-1056) Multi-node RPC deadlocks during block recovery

[ https://issues.apache.org/jira/browse/HDFS-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848346#action_12848346 ] Tsz Wo (Nicholas), SZE commented on HDFS-1056: -- I think the solution may be to

[jira] Commented: (HDFS-1056) Multi-node RPC deadlocks during block recovery

[ https://issues.apache.org/jira/browse/HDFS-1056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848365#action_12848365 ] Tsz Wo (Nicholas), SZE commented on HDFS-1056: -- Not really, ... Ah, you are

[jira] Created: (HDFS-1061) Memory footprint optimization for INodeFile object.

Memory footprint optimization for INodeFile object. Key: HDFS-1061 URL: https://issues.apache.org/jira/browse/HDFS-1061 Project: Hadoop HDFS Issue Type: Improvement Components:

[jira] Commented: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848428#action_12848428 ] Bharath Mundlapudi commented on HDFS-1061: -- INodeFile objects are proportional to

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Attachment: HDFS-892.patch optionally use Avro for namenode RPC

[jira] Updated: (HDFS-892) optionally use Avro for namenode RPC

[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HDFS-892: -- Status: Patch Available (was: Open) Now that Avro 1.3.1 is available this should pass Hudson's tests.

[jira] Updated: (HDFS-520) Create new tests for block recovery

[ https://issues.apache.org/jira/browse/HDFS-520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-520: --- Attachment: blockRecoveryPositive2_0.21.patch Here is a patch for 0.21. Create new tests for block

[jira] Commented: (HDFS-985) HDFS should issue multiple RPCs for listing a large directory

[ https://issues.apache.org/jira/browse/HDFS-985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848463#action_12848463 ] Hairong Kuang commented on HDFS-985: There are some mapred changes in 20 version of the

[jira] Commented: (HDFS-985) HDFS should issue multiple RPCs for listing a large directory

[ https://issues.apache.org/jira/browse/HDFS-985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848465#action_12848465 ] Chris Douglas commented on HDFS-985: bq. It turns out there is no need to change mapred

[jira] Commented: (HDFS-265) Revisit append

[ https://issues.apache.org/jira/browse/HDFS-265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848466#action_12848466 ] Todd Lipcon commented on HDFS-265: -- Is the concurrent tailer use case part of this feature?

[jira] Commented: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848474#action_12848474 ] Hong Tang commented on HDFS-1061: - @bharath, what is the average size of an INodeFile object

[jira] Commented: (HDFS-892) optionally use Avro for namenode RPC

[ https://issues.apache.org/jira/browse/HDFS-892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848479#action_12848479 ] Hadoop QA commented on HDFS-892: -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848486#action_12848486 ] Bharath Mundlapudi commented on HDFS-1061: -- At present, The shallow size of

[jira] Updated: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Booth updated HDFS-918: --- Attachment: hdfs-918-0.20.2.patch 0.20.2 compatible patch! A couple people mentioned that it would be much

[jira] Updated: (HDFS-1032) Extend DFSck with an option to list corrupt files using API from HDFS-729

[ https://issues.apache.org/jira/browse/HDFS-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André Oriani updated HDFS-1032: --- Status: Patch Available (was: Open) Extend DFSck with an option to list corrupt files using API

[jira] Updated: (HDFS-1032) Extend DFSck with an option to list corrupt files using API from HDFS-729

[ https://issues.apache.org/jira/browse/HDFS-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André Oriani updated HDFS-1032: --- Status: Open (was: Patch Available) canceling patch in order to force it to be sent to hudson again

[jira] Updated: (HDFS-1031) Enhance the webUi to list a few of the corrupted files in HDFS

[ https://issues.apache.org/jira/browse/HDFS-1031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] André Oriani updated HDFS-1031: --- Attachment: hdfs-1031_aoriani.patch That's the prototype of my solution to this Jira in order to

[jira] Commented: (HDFS-985) HDFS should issue multiple RPCs for listing a large directory

[ https://issues.apache.org/jira/browse/HDFS-985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848547#action_12848547 ] Hairong Kuang commented on HDFS-985: Thanks Chris! HDFS should issue multiple RPCs for