[jira] [Commented] (HIVE-9217) UnionProcessor misses results for multi-insert when hive.optimize.union.remove=true

2015-01-08 Thread Laljo John Pullokkaran (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270161#comment-14270161
 ] 

Laljo John Pullokkaran commented on HIVE-9217:
--

Committed to trunk; thanks [~pxiong]

 UnionProcessor misses results for multi-insert when 
 hive.optimize.union.remove=true
 ---

 Key: HIVE-9217
 URL: https://issues.apache.org/jira/browse/HIVE-9217
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-9217.01.patch, HIVE-9217.02.patch, 
 HIVE-9217.03.patch


 To reproduce:
 In union_remove_6.q, just change 
 FROM (
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 to 
 FROM (
   select * from(
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
   )subq
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 select * from outputtbl2 will output nothing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-9217) UnionProcessor misses results for multi-insert when hive.optimize.union.remove=true

2015-01-07 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267487#comment-14267487
 ] 

Hive QA commented on HIVE-9217:
---



{color:green}Overall{color}: +1 all checks pass

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12690480/HIVE-9217.03.patch

{color:green}SUCCESS:{color} +1 6724 tests passed

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2278/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2278/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2278/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12690480 - PreCommit-HIVE-TRUNK-Build

 UnionProcessor misses results for multi-insert when 
 hive.optimize.union.remove=true
 ---

 Key: HIVE-9217
 URL: https://issues.apache.org/jira/browse/HIVE-9217
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-9217.01.patch, HIVE-9217.02.patch, 
 HIVE-9217.03.patch


 To reproduce:
 In union_remove_6.q, just change 
 FROM (
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 to 
 FROM (
   select * from(
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
   )subq
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 select * from outputtbl2 will output nothing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-9217) UnionProcessor misses results for multi-insert when hive.optimize.union.remove=true

2015-01-07 Thread Laljo John Pullokkaran (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267980#comment-14267980
 ] 

Laljo John Pullokkaran commented on HIVE-9217:
--

+1

 UnionProcessor misses results for multi-insert when 
 hive.optimize.union.remove=true
 ---

 Key: HIVE-9217
 URL: https://issues.apache.org/jira/browse/HIVE-9217
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-9217.01.patch, HIVE-9217.02.patch, 
 HIVE-9217.03.patch


 To reproduce:
 In union_remove_6.q, just change 
 FROM (
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 to 
 FROM (
   select * from(
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
   )subq
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 select * from outputtbl2 will output nothing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-9217) UnionProcessor misses results for multi-insert when hive.optimize.union.remove=true

2015-01-07 Thread Pengcheng Xiong (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267937#comment-14267937
 ] 

Pengcheng Xiong commented on HIVE-9217:
---

[~jpullokkaran], the patch is ready to go. Thanks.

 UnionProcessor misses results for multi-insert when 
 hive.optimize.union.remove=true
 ---

 Key: HIVE-9217
 URL: https://issues.apache.org/jira/browse/HIVE-9217
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-9217.01.patch, HIVE-9217.02.patch, 
 HIVE-9217.03.patch


 To reproduce:
 In union_remove_6.q, just change 
 FROM (
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 to 
 FROM (
   select * from(
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
   )subq
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 select * from outputtbl2 will output nothing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-9217) UnionProcessor misses results for multi-insert when hive.optimize.union.remove=true

2014-12-31 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262082#comment-14262082
 ] 

Hive QA commented on HIVE-9217:
---



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12689623/HIVE-9217.02.patch

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 6724 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2230/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2230/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2230/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12689623 - PreCommit-HIVE-TRUNK-Build

 UnionProcessor misses results for multi-insert when 
 hive.optimize.union.remove=true
 ---

 Key: HIVE-9217
 URL: https://issues.apache.org/jira/browse/HIVE-9217
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-9217.01.patch, HIVE-9217.02.patch


 To reproduce:
 In union_remove_6.q, just change 
 FROM (
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 to 
 FROM (
   select * from(
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
   )subq
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 select * from outputtbl2 will output nothing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-9217) UnionProcessor misses results for multi-insert when hive.optimize.union.remove=true

2014-12-26 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259236#comment-14259236
 ] 

Hive QA commented on HIVE-9217:
---



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12689196/HIVE-9217.01.patch

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 6723 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_list_bucket_dml_10
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2200/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2200/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2200/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12689196 - PreCommit-HIVE-TRUNK-Build

 UnionProcessor misses results for multi-insert when 
 hive.optimize.union.remove=true
 ---

 Key: HIVE-9217
 URL: https://issues.apache.org/jira/browse/HIVE-9217
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-9217.01.patch


 To reproduce:
 In union_remove_6.q, just change 
 FROM (
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 to 
 FROM (
   select * from(
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
   )subq
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 select * from outputtbl2 will output nothing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-9217) UnionProcessor misses results for multi-insert when hive.optimize.union.remove=true

2014-12-26 Thread Pengcheng Xiong (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259238#comment-14259238
 ] 

Pengcheng Xiong commented on HIVE-9217:
---

[~jpullokkaran] and [~hagleitn], the test failure is not related. Could you 
please take a look? Thanks. The main reason for the bug is that,  when we add 
subq outside union, we will have

UNION-SEL-SEL-FS
|-SEL-FS

However, the current version only checks if UNION operator has more than 1 
children.

The solution is simply to check every operator after UNION.


 UnionProcessor misses results for multi-insert when 
 hive.optimize.union.remove=true
 ---

 Key: HIVE-9217
 URL: https://issues.apache.org/jira/browse/HIVE-9217
 Project: Hive
  Issue Type: Bug
Reporter: Pengcheng Xiong
Assignee: Pengcheng Xiong
 Attachments: HIVE-9217.01.patch


 To reproduce:
 In union_remove_6.q, just change 
 FROM (
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 to 
 FROM (
   select * from(
   SELECT key, count(1) as values from inputTbl1 group by key
   UNION ALL
   SELECT key, count(1) as values from inputTbl1 group by key
   )subq
 ) a
 insert overwrite table outputTbl1 select *
 insert overwrite table outputTbl2 select *;
 select * from outputtbl2 will output nothing



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)