[
https://issues.apache.org/jira/browse/MAPREDUCE-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13283209#comment-13283209
]
Nikhil S. Ketkar commented on MAPREDUCE-3315:
---------------------------------------------
Sharad, you mean the following, right?
{code}
public interface MWProtocol {
public static final long versionID = 1L;
HeartbeatResponse heartBeat(Writable HeartbeatRequest);
}
public class HeartbeatResponse implements Writable {
}
public class HeartbeatRequest implements Writable {
}
// User extends MasterRunner and WorkerRunner
public abstract class WorkerRunner {
Writable doWork(Writable workUnit); // Abstract, implemented by user
}
public abstract class MasterRunner {
public void addWorkers() {
// Implementation
}
public void killWorkers() {
// Implementation
}
public void assignWork(Writable workUnit) {
// Implementation
// uses heartBeat internally but HeartbeatResponse, HeartbeatRequest not
exposed
}
public Writable waitForResult() {
// Implementation
// uses heartBeat internally but HeartbeatResponse, HeartbeatRequest not
exposed
}
void manageWorkers(); // Abstract, implemented by user, can use addWorker(),
killWorker(), assignWork() and waitForResult()
}
{code}
> Master-Worker Application on YARN
> ---------------------------------
>
> Key: MAPREDUCE-3315
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3315
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Sharad Agarwal
> Assignee: Sharad Agarwal
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3315-1.patch, MAPREDUCE-3315-2.patch,
> MAPREDUCE-3315-3.patch, MAPREDUCE-3315.patch
>
>
> Currently master worker scenarios are forced fit into Map-Reduce. Now with
> YARN, these can be first class and would benefit real/near realtime workloads
> and be more effective in using the cluster resources.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira