Sailesh Mukil created IMPALA-6402:
-------------------------------------
Summary: PlannerTest.testFkPkJoinDetection failure due to
unexpected extra partition file
Key: IMPALA-6402
URL: https://issues.apache.org/jira/browse/IMPALA-6402
Project: IMPALA
Issue Type: Bug
Components: Infrastructure
Affects Versions: Impala 2.11.0
Environment: PlannerTest.testFkPkJoinDetection
Reporter: Sailesh Mukil
PlannerTest.testFkPkJoinDetection failed recent test run. From the output
below, it looks like the test expects 1823 partitions and files to be present,
however, there is one extra file erroneously present. This may be due to
filesystem flakiness (a file that was supposed to be deleted wasn't, etc.), but
we're not certain yet.
{code:java}
-------------------------------------------------------------------------------
Test set: org.apache.impala.planner.PlannerTest
-------------------------------------------------------------------------------
Tests run: 64, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 62.354 sec <<<
FAILURE! - in org.apache.impala.planner.PlannerTest
testFkPkJoinDetection(org.apache.impala.planner.PlannerTest) Time elapsed:
4.821 sec <<< FAILURE!
java.lang.AssertionError:
Section PLAN of query:
select /* +straight_join */ 1 from
tpcds_seq_snap.store_sales inner join tpcds.customer
on ss_customer_sk = c_customer_sk
Actual does not match expected result:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Host Resources: mem-estimate=177.94MB mem-reservation=1.94MB
PLAN-ROOT SINK
| mem-estimate=0B mem-reservation=0B
|
02:HASH JOIN [INNER JOIN]
| hash predicates: ss_customer_sk = c_customer_sk
| fk/pk conjuncts: assumed fk/pk
| runtime filters: RF000[bloom] <- c_customer_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB
| tuple-ids=0,1 row-size=8B cardinality=unavailable
|
|--01:SCAN HDFS [tpcds.customer]
| partitions=1/1 files=1 size=12.60MB
| stored statistics:
| table: rows=100000 size=12.60MB
| columns: all
| extrapolated-rows=disabled
| mem-estimate=48.00MB mem-reservation=0B
| tuple-ids=1 row-size=4B cardinality=100000
|
00:SCAN HDFS [tpcds_seq_snap.store_sales]
partitions=1823/1823 files=1823 size=207.90MB
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
runtime filters: RF000[bloom] -> ss_customer_sk
stored statistics:
table: rows=unavailable size=unavailable
partitions: 0/1823 rows=unavailable
columns: unavailable
extrapolated-rows=disabled
mem-estimate=128.00MB mem-reservation=0B
tuple-ids=0 row-size=4B cardinality=unavailable
Expected:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
| Per-Host Resources: mem-estimate=177.94MB mem-reservation=1.94MB
PLAN-ROOT SINK
| mem-estimate=0B mem-reservation=0B
|
02:HASH JOIN [INNER JOIN]
| hash predicates: ss_customer_sk = c_customer_sk
| fk/pk conjuncts: assumed fk/pk
| runtime filters: RF000[bloom] <- c_customer_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB
| tuple-ids=0,1 row-size=8B cardinality=unavailable
|
|--01:SCAN HDFS [tpcds.customer]
| partitions=1/1 files=1 size=12.60MB
| stored statistics:
| table: rows=100000 size=12.60MB
| columns: all
| extrapolated-rows=disabled
| mem-estimate=48.00MB mem-reservation=0B
| tuple-ids=1 row-size=4B cardinality=100000
|
00:SCAN HDFS [tpcds_seq_snap.store_sales]
partitions=1824/1824 files=1824 size=207.90MB
runtime filters: RF000[bloom] -> ss_customer_sk
stored statistics:
table: rows=unavailable size=unavailable
partitions: 0/1824 rows=unavailable
columns: unavailable
extrapolated-rows=disabled
mem-estimate=128.00MB mem-reservation=0B
tuple-ids=0 row-size=4B cardinality=unavailable
Verbose plan:
F00:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
Per-Host Resources: mem-estimate=177.94MB mem-reservation=1.94MB
PLAN-ROOT SINK
| mem-estimate=0B mem-reservation=0B
|
02:HASH JOIN [INNER JOIN]
| hash predicates: ss_customer_sk = c_customer_sk
| fk/pk conjuncts: assumed fk/pk
| runtime filters: RF000[bloom] <- c_customer_sk
| mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB
| tuple-ids=0,1 row-size=8B cardinality=unavailable
|
|--01:SCAN HDFS [tpcds.customer]
| partitions=1/1 files=1 size=12.60MB
| stored statistics:
| table: rows=100000 size=12.60MB
| columns: all
| extrapolated-rows=disabled
| mem-estimate=48.00MB mem-reservation=0B
| tuple-ids=1 row-size=4B cardinality=100000
|
00:SCAN HDFS [tpcds_seq_snap.store_sales]
partitions=1823/1823 files=1823 size=207.90MB
runtime filters: RF000[bloom] -> ss_customer_sk
stored statistics:
table: rows=unavailable size=unavailable
partitions: 0/1823 rows=unavailable
columns: unavailable
extrapolated-rows=disabled
mem-estimate=128.00MB mem-reservation=0B
tuple-ids=0 row-size=4B cardinality=unavailable
at org.junit.Assert.fail(Assert.java:88)
at
org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:770)
at
org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:729)
at
org.apache.impala.planner.PlannerTestBase.runPlannerTestFile(PlannerTestBase.java:724)
at
org.apache.impala.planner.PlannerTest.testFkPkJoinDetection(PlannerTest.java:150)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
