[jira] Updated: (MAPREDUCE-1463) Reducer should start faster for smaller jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1463: -- Component/s: (was: contrib/fair-share) jobtracker > Reducer should start faster for smaller jobs > > > Key: MAPREDUCE-1463 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1463 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: jobtracker >Reporter: Scott Chen >Assignee: Scott Chen > Attachments: MAPREDUCE-1463-v1.patch, MAPREDUCE-1463-v2.patch, > MAPREDUCE-1463-v3.patch > > > Our users often complain about the slowness of smaller ad-hoc jobs. > The overhead to wait for the reducers to start in this case is significant. > It will be good if we can start the reducer sooner in this case. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1463) Reducer should start faster for smaller jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1463: -- Attachment: MAPREDUCE-1463-v3.patch > Reducer should start faster for smaller jobs > > > Key: MAPREDUCE-1463 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1463 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: contrib/fair-share >Reporter: Scott Chen >Assignee: Scott Chen > Attachments: MAPREDUCE-1463-v1.patch, MAPREDUCE-1463-v2.patch, > MAPREDUCE-1463-v3.patch > > > Our users often complain about the slowness of smaller ad-hoc jobs. > The overhead to wait for the reducers to start in this case is significant. > It will be good if we can start the reducer sooner in this case. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1463) Reducer should start faster for smaller jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1463: -- Attachment: MAPREDUCE-1463-v2.patch > Reducer should start faster for smaller jobs > > > Key: MAPREDUCE-1463 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1463 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: contrib/fair-share >Reporter: Scott Chen >Assignee: Scott Chen > Attachments: MAPREDUCE-1463-v1.patch, MAPREDUCE-1463-v2.patch > > > Our users often complain about the slowness of smaller ad-hoc jobs. > The overhead to wait for the reducers to start in this case is significant. > It will be good if we can start the reducer sooner in this case. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1463) Reducer should start faster for smaller jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1463: -- Attachment: MAPREDUCE-1463-v1.patch > Reducer should start faster for smaller jobs > > > Key: MAPREDUCE-1463 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1463 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: contrib/fair-share >Reporter: Scott Chen >Assignee: Scott Chen > Attachments: MAPREDUCE-1463-v1.patch > > > Our users often complain about the slowness of smaller ad-hoc jobs. > The overhead to wait for the reducers to start in this case is significant. > It will be good if we can start the reducer sooner in this case. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1463) Reducer should start faster for smaller jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1463: -- Attachment: (was: MAPREDUCE-1463-v1.patch) > Reducer should start faster for smaller jobs > > > Key: MAPREDUCE-1463 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1463 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: contrib/fair-share >Reporter: Scott Chen >Assignee: Scott Chen > > Our users often complain about the slowness of smaller ad-hoc jobs. > The overhead to wait for the reducers to start in this case is significant. > It will be good if we can start the reducer sooner in this case. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1463) Reducer should start faster for smaller jobs
[ https://issues.apache.org/jira/browse/MAPREDUCE-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Chen updated MAPREDUCE-1463: -- Attachment: MAPREDUCE-1463-v1.patch Our proposal is starting the reducers for job with few mappers or reducers. We make these two number configurable. I have uploaded the patch according to this proposal. Unit test will be included later. > Reducer should start faster for smaller jobs > > > Key: MAPREDUCE-1463 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1463 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: contrib/fair-share >Reporter: Scott Chen >Assignee: Scott Chen > Attachments: MAPREDUCE-1463-v1.patch > > > Our users often complain about the slowness of smaller ad-hoc jobs. > The overhead to wait for the reducers to start in this case is significant. > It will be good if we can start the reducer sooner in this case. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
