[jira] [Commented] (HIVE-11409) CBO: Calcite Operator To Hive Operator (Calcite Return Path): add SEL before UNION

2015-07-31 Thread Jesus Camacho Rodriguez (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649301#comment-14649301
 ] 

Jesus Camacho Rodriguez commented on HIVE-11409:


+1

 CBO: Calcite Operator To Hive Operator (Calcite Return Path): add SEL before 
 UNION
 --

 Key: HIVE-11409
 URL: https://issues.apache.org/jira/browse/HIVE-11409
 Project: Hive
  Issue Type: Sub-task
  Components: CBO
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-11409.01.patch, HIVE-11409.02.patch


 Two purpose: (1) to ensure that the data type of non-primary branch (the 1st 
 branch is the primary branch) of union can be casted to that of the primary 
 branch; (2) to make UnionProcessor optimizer work; (3) if the SEL is 
 redundant, it will be removed by IdentidyProjectRemover optimizer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11409) CBO: Calcite Operator To Hive Operator (Calcite Return Path): add SEL before UNION

2015-07-30 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648541#comment-14648541
 ] 

Hive QA commented on HIVE-11409:




{color:green}Overall{color}: +1 all checks pass

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12748059/HIVE-11409.02.patch

{color:green}SUCCESS:{color} +1 9276 tests passed

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4766/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4766/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4766/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12748059 - PreCommit-HIVE-TRUNK-Build

 CBO: Calcite Operator To Hive Operator (Calcite Return Path): add SEL before 
 UNION
 --

 Key: HIVE-11409
 URL: https://issues.apache.org/jira/browse/HIVE-11409
 Project: Hive
  Issue Type: Sub-task
  Components: CBO
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-11409.01.patch, HIVE-11409.02.patch


 Two purpose: (1) to ensure that the data type of non-primary branch (the 1st 
 branch is the primary branch) of union can be casted to that of the primary 
 branch; (2) to make UnionProcessor optimizer work; (3) if the SEL is 
 redundant, it will be removed by IdentidyProjectRemover optimizer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11409) CBO: Calcite Operator To Hive Operator (Calcite Return Path): add SEL before UNION

2015-07-30 Thread Pengcheng Xiong (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648123#comment-14648123
 ] 

Pengcheng Xiong commented on HIVE-11409:


a good example is union_remove_10.q
{code}
Group By Operator
  aggregations: count(VALUE._col0)
  keys: KEY._col0 (type: string)
  mode: mergepartial
  outputColumnNames: $f0, $f1
  Statistics: Num rows: 1 Data size: 30 Basic stats: COMPLETE Column 
stats: NONE
  Select Operator
expressions: $f0 (type: string), $f1 (type: bigint)
outputColumnNames: key, values
Statistics: Num rows: 1 Data size: 30 Basic stats: COMPLETE Column 
stats: NONE
File Output Operator
  compressed: false
  Statistics: Num rows: 1 Data size: 30 Basic stats: COMPLETE 
Column stats: NONE
  table:
  input format: org.apache.hadoop.hive.ql.io.RCFileInputFormat
  output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat
  serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe
  name: default.outputtbl1
{code}

 CBO: Calcite Operator To Hive Operator (Calcite Return Path): add SEL before 
 UNION
 --

 Key: HIVE-11409
 URL: https://issues.apache.org/jira/browse/HIVE-11409
 Project: Hive
  Issue Type: Sub-task
  Components: CBO
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-11409.01.patch


 Two purpose: (1) to ensure that the data type of non-primary branch (the 1st 
 branch is the primary branch) of union can be casted to that of the primary 
 branch; (2) to make UnionProcessor optimizer work; (3) if the SEL is 
 redundant, it will be removed by IdentidyProjectRemover optimizer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11409) CBO: Calcite Operator To Hive Operator (Calcite Return Path): add SEL before UNION

2015-07-29 Thread Pengcheng Xiong (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647231#comment-14647231
 ] 

Pengcheng Xiong commented on HIVE-11409:


[~jcamachorodriguez], could u review this small patch? Thanks.

 CBO: Calcite Operator To Hive Operator (Calcite Return Path): add SEL before 
 UNION
 --

 Key: HIVE-11409
 URL: https://issues.apache.org/jira/browse/HIVE-11409
 Project: Hive
  Issue Type: Sub-task
  Components: CBO
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-11409.01.patch


 Two purpose: (1) to ensure that the data type of non-primary branch (the 1st 
 branch is the primary branch) of union can be casted to that of the primary 
 branch; (2) to make UnionProcessor optimizer work; (3) if the SEL is 
 redundant, it will be removed by IdentidyProjectRemover optimizer.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)