[
https://issues.apache.org/jira/browse/MAPREDUCE-207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated MAPREDUCE-207:
------------------------------------
Attachment: MAPREDUCE-207.patch
As foretold, here is a trivial, preliminary patch to move computation of
input-splits inside the cluster - something we've craved for a very long time,
as evinced by the interest in this jira and the number of times it comes up on
user lists.
This is huge, because it's a significant step towards various improvements such
as HTTP-based job submission etc.
Shameless plug for MRv2 - it took me 15 mins on a Sunday night to get this
done... glory to MRv2! *smile*
----
It needs a tad more work to get delegation tokens on the client side, but it's
nearly there.
> Computing Input Splits on the MR Cluster
> ----------------------------------------
>
> Key: MAPREDUCE-207
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-207
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: applicationmaster, mrv2
> Reporter: Philip Zeyliger
> Assignee: Arun C Murthy
> Attachments: MAPREDUCE-207.patch
>
>
> Instead of computing the input splits as part of job submission, Hadoop could
> have a separate "job task type" that computes the input splits, therefore
> allowing that computation to happen on the cluster.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
