[jira] [Assigned] (HIVE-3952) merge map-job followed by map-reduce job
[ https://issues.apache.org/jira/browse/HIVE-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K reassigned HIVE-3952: Assignee: Vinod Kumar Vavilapalli (was: zgl) > merge map-job followed by map-reduce job > > > Key: HIVE-3952 > URL: https://issues.apache.org/jira/browse/HIVE-3952 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Namit Jain >Assignee: Vinod Kumar Vavilapalli >Priority: Major > Fix For: 0.11.0 > > Attachments: HIVE-3952-20130226.txt, HIVE-3952-20130227.1.txt, > HIVE-3952-20130301.txt, HIVE-3952-20130421.txt, HIVE-3952-20130424.txt, > HIVE-3952-20130428-branch-0.11-bugfix.txt, > HIVE-3952-20130428-branch-0.11-v2.txt, HIVE-3952-20130428-branch-0.11.txt, > hive.3952.1.patch > > > Consider the query like: > select count（*）FROM > ( select idOne, idTwo, value FROM > bigTable > JOIN > > smallTableOne on (bigTable.idOne = smallTableOne.idOne) > > ) firstjoin > > JOIN > > smallTableTwo on (firstjoin.idTwo = smallTableTwo.idTwo); > where smallTableOne and smallTableTwo are smaller than > hive.auto.convert.join.noconditionaltask.size and > hive.auto.convert.join.noconditionaltask is set to true. > The joins are collapsed into mapjoins, and it leads to a map-only job > (for the map-joins) followed by a map-reduce job (for the group by). > Ideally, the map-only job should be merged with the following map-reduce job. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-3952) merge map-job followed by map-reduce job
[ https://issues.apache.org/jira/browse/HIVE-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zgl reassigned HIVE-3952: - Assignee: zgl (was: Vinod Kumar Vavilapalli) > merge map-job followed by map-reduce job > > > Key: HIVE-3952 > URL: https://issues.apache.org/jira/browse/HIVE-3952 > Project: Hive > Issue Type: Improvement > Components: Query Processor >Reporter: Namit Jain >Assignee: zgl >Priority: Major > Fix For: 0.11.0 > > Attachments: HIVE-3952-20130226.txt, HIVE-3952-20130227.1.txt, > HIVE-3952-20130301.txt, HIVE-3952-20130421.txt, HIVE-3952-20130424.txt, > HIVE-3952-20130428-branch-0.11-bugfix.txt, > HIVE-3952-20130428-branch-0.11-v2.txt, HIVE-3952-20130428-branch-0.11.txt, > hive.3952.1.patch > > > Consider the query like: > select count（*）FROM > ( select idOne, idTwo, value FROM > bigTable > JOIN > > smallTableOne on (bigTable.idOne = smallTableOne.idOne) > > ) firstjoin > > JOIN > > smallTableTwo on (firstjoin.idTwo = smallTableTwo.idTwo); > where smallTableOne and smallTableTwo are smaller than > hive.auto.convert.join.noconditionaltask.size and > hive.auto.convert.join.noconditionaltask is set to true. > The joins are collapsed into mapjoins, and it leads to a map-only job > (for the map-joins) followed by a map-reduce job (for the group by). > Ideally, the map-only job should be merged with the following map-reduce job. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
