[
https://issues.apache.org/jira/browse/HIVE-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142424#comment-14142424
]
Hive QA commented on HIVE-8163:
-------------------------------
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12670280/HIVE-8163.1.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 6298 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vectorized_dynamic_partition_pruning
org.apache.hadoop.hive.ql.parse.TestParse.testParse_union
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/909/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/909/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-909/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12670280
> With dynamic partition pruning map operator that generates the partition
> filters is not vectorized
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-8163
> URL: https://issues.apache.org/jira/browse/HIVE-8163
> Project: Hive
> Issue Type: Bug
> Components: Tez
> Affects Versions: 0.14.0
> Reporter: Mostafa Mokhtar
> Assignee: Gunther Hagleitner
> Priority: Minor
> Labels: performance
> Attachments: HIVE-8163.1.patch
>
>
> Vertex used to generate the partition pruning filters is not vectorized.
> Sample from the plan :
> {code}
> Vertices:
> Map 1
> Map Operator Tree:
> TableScan
> alias: d3
> filterExpr: ((d_quarter_name) IN ('2000Q1', '2000Q2',
> '2000Q3') and d_date_sk is not null) (type: boolean)
> Statistics: Num rows: 73049 Data size: 81741831 Basic
> stats: COMPLETE Column stats: NONE
> Filter Operator
> predicate: ((d_quarter_name) IN ('2000Q1', '2000Q2',
> '2000Q3') and d_date_sk is not null) (type: boolean)
> Statistics: Num rows: 18262 Data size: 20435178 Basic
> stats: COMPLETE Column stats: NONE
> Select Operator
> expressions: d_date_sk (type: int)
> outputColumnNames: _col0
> Statistics: Num rows: 18262 Data size: 20435178 Basic
> stats: COMPLETE Column stats: NONE
> Reduce Output Operator
> key expressions: _col0 (type: int)
> sort order: +
> Map-reduce partition columns: _col0 (type: int)
> Statistics: Num rows: 18262 Data size: 20435178 Basic
> stats: COMPLETE Column stats: NONE
> Select Operator
> expressions: _col0 (type: int)
> outputColumnNames: _col0
> Statistics: Num rows: 18262 Data size: 20435178 Basic
> stats: COMPLETE Column stats: NONE
> Group By Operator
> keys: _col0 (type: int)
> mode: hash
> outputColumnNames: _col0
> Statistics: Num rows: 18262 Data size: 20435178
> Basic stats: COMPLETE Column stats: NONE
> Dynamic Partitioning Event Operator
> Target Input: catalog_sales
> Partition key expr: cs_sold_date_sk
> Statistics: Num rows: 18262 Data size: 20435178
> Basic stats: COMPLETE Column stats: NONE
> Target column: cs_sold_date_sk
> Target Vertex: Map 3
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
