[jira] [Updated] (HDFS-5304) Expose if a block replica is cached in getFileBlockLocations
[ https://issues.apache.org/jira/browse/HDFS-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5304: -- Attachment: hdfs-5304-3.patch Thanks for the review Colin. Updated patch which removes the additional cached locations from PB/PB translators and does a precondition check. It should be compatible to add it back in later. Expose if a block replica is cached in getFileBlockLocations Key: HDFS-5304 URL: https://issues.apache.org/jira/browse/HDFS-5304 Project: Hadoop HDFS Issue Type: Sub-task Components: namenode Affects Versions: HDFS-4949 Reporter: Andrew Wang Assignee: Andrew Wang Attachments: hdfs-5304-1.patch, hdfs-5304-2.patch, hdfs-5304-3.patch We need to expose which replicas of a block are cached so applications can place their tasks for memory-locality. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HDFS-5304) Expose if a block replica is cached in getFileBlockLocations
[ https://issues.apache.org/jira/browse/HDFS-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5304: -- Attachment: hdfs-5304-4.patch Thanks, new patch attached. Will commit shortly. Expose if a block replica is cached in getFileBlockLocations Key: HDFS-5304 URL: https://issues.apache.org/jira/browse/HDFS-5304 Project: Hadoop HDFS Issue Type: Sub-task Components: namenode Affects Versions: HDFS-4949 Reporter: Andrew Wang Assignee: Andrew Wang Attachments: hdfs-5304-1.patch, hdfs-5304-2.patch, hdfs-5304-3.patch, hdfs-5304-4.patch We need to expose which replicas of a block are cached so applications can place their tasks for memory-locality. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HDFS-5304) Expose if a block replica is cached in getFileBlockLocations
[ https://issues.apache.org/jira/browse/HDFS-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5304: -- Attachment: hdfs-5304-2.patch Here's a patch implementing my above proposal. The code, like I expected, is now mildly complex, but the user API is now nicer as per Colin's suggestion. Expose if a block replica is cached in getFileBlockLocations Key: HDFS-5304 URL: https://issues.apache.org/jira/browse/HDFS-5304 Project: Hadoop HDFS Issue Type: Sub-task Components: namenode Affects Versions: HDFS-4949 Reporter: Andrew Wang Assignee: Andrew Wang Attachments: hdfs-5304-1.patch, hdfs-5304-2.patch We need to expose which replicas of a block are cached so applications can place their tasks for memory-locality. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Updated] (HDFS-5304) Expose if a block replica is cached in getFileBlockLocations
[
https://issues.apache.org/jira/browse/HDFS-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Wang updated HDFS-5304:
--
Attachment: hdfs-5304-1.patch
Patch attached, wasn't that bad. Added a boolean array to {{LocatedBlock}}
which indicates if the location at the same index is cached. Added new checks
to an existing test to validate.
Expose if a block replica is cached in getFileBlockLocations
Key: HDFS-5304
URL: https://issues.apache.org/jira/browse/HDFS-5304
Project: Hadoop HDFS
Issue Type: Sub-task
Components: namenode
Affects Versions: HDFS-4949
Reporter: Andrew Wang
Assignee: Andrew Wang
Attachments: hdfs-5304-1.patch
We need to expose which replicas of a block are cached so applications can
place their tasks for memory-locality.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
