[
https://issues.apache.org/jira/browse/IGNITE-27915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aleksey Plekhanov updated IGNITE-27915:
---------------------------------------
Description:
Test AggregatePlannerTest.colocated[Algorithm = HASH] is flaky.
Eventually planner skips optimal join plan and produce plan like (exchange to
single):
{noformat}
IgniteProject(DEPTID=[$0], CNT=[$2]): rowcount = 37500.0, cumulative cost =
IgniteCost [rowCount=3037502.0, cpu=9475002.0, memory=5150002.0, io=2.0,
network=4000002.0], id = 48623
IgniteHashJoin(condition=[=($0, $1)], joinType=[inner], variablesSet=[[]]):
rowcount = 37500.0, cumulative cost = IgniteCost [rowCount=3000002.0,
cpu=9437502.0, memory=5150002.0, io=2.0, network=4000002.0], id = 48622
IgniteExchange(distribution=[single]): rowcount = 500000.0, cumulative cost
= IgniteCost [rowCount=1000001.0, cpu=875001.0, memory=1.0, io=1.0,
network=2000001.0], id = 48619
IgniteIndexScan(table=[[PUBLIC, DEPT]], index=[DEPTID],
requiredColumns=[{0}], inlineScan=[true], collation=[[0 ASC-nulls-first]]):
rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
cpu=375001.0, memory=1.0, io=1.0, network=1.0], id = 47383
IgniteExchange(distribution=[single]): rowcount = 250000.0, cumulative cost
= IgniteCost [rowCount=1250001.0, cpu=1062501.0, memory=2250001.0, io=1.0,
network=2000001.0], id = 48621
IgniteColocatedHashAggregate(group=[{0}], CNT=[COUNT()]): rowcount =
250000.0, cumulative cost = IgniteCost [rowCount=1000001.0, cpu=812501.0,
memory=2250001.0, io=1.0, network=1.0], id = 48620
IgniteIndexScan(table=[[PUBLIC, EMP]], index=[DEPTID],
requiredColumns=[{1}], inlineScan=[true], collation=[[1 ASC-nulls-first]]):
rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
cpu=312501.0, memory=1.0, io=1.0, network=1.0], id = 47348
{noformat}
Instead of:
{noformat}
IgniteProject(DEPTID=[$0], CNT=[$2]): rowcount = 37500.0, cumulative cost =
IgniteCost [rowCount=3037502.0, cpu=9475002.0, memory=5150002.0, io=2.0,
network=4000002.0], id = 1393
IgniteHashJoin(condition=[=($0, $1)], joinType=[inner], variablesSet=[[]]):
rowcount = 37500.0, cumulative cost = IgniteCost [rowCount=3000002.0,
cpu=9437502.0, memory=5150002.0, io=2.0, network=4000002.0], id = 1392
IgniteExchange(distribution=[single]): rowcount = 500000.0, cumulative cost
= IgniteCost [rowCount=1000001.0, cpu=875001.0, memory=1.0, io=1.0,
network=2000001.0], id = 1389
IgniteIndexScan(table=[[PUBLIC, DEPT]], index=[DEPTID],
requiredColumns=[{0}], inlineScan=[true], collation=[[0 ASC-nulls-first]]):
rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
cpu=375001.0, memory=1.0, io=1.0, network=1.0], id = 237
IgniteExchange(distribution=[single]): rowcount = 250000.0, cumulative cost
= IgniteCost [rowCount=1250001.0, cpu=1062501.0, memory=2250001.0, io=1.0,
network=2000001.0], id = 1391
IgniteColocatedHashAggregate(group=[{0}], CNT=[COUNT()]): rowcount =
250000.0, cumulative cost = IgniteCost [rowCount=1000001.0, cpu=812501.0,
memory=2250001.0, io=1.0, network=1.0], id = 1390
IgniteIndexScan(table=[[PUBLIC, EMP]], index=[DEPTID],
requiredColumns=[{1}], inlineScan=[true], collation=[[1 ASC-nulls-first]]):
rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
cpu=312501.0, memory=1.0, io=1.0, network=1.0], id = 202
{noformat}
It caused by https://issues.apache.org/jira/browse/IGNITE-16334 and root cause
can be fixed in Apache Calcite. Until this fix it's proposed to ignore this
test.
was:
Test AggregatePlannerTest.colocated[Algorithm = HASH] is flaky.
Eventually planner skips optimal join plan and produce plan like (exchange to
single):
{noformat}
IgniteProject(DEPTID=[$0], CNT=[$2]): rowcount = 37500.0, cumulative cost =
IgniteCost [rowCount=3037502.0, cpu=9475002.0, memory=5150002.0, io=2.0,
network=4000002.0], id = 48623
IgniteHashJoin(condition=[=($0, $1)], joinType=[inner], variablesSet=[[]]):
rowcount = 37500.0, cumulative cost = IgniteCost [rowCount=3000002.0,
cpu=9437502.0, memory=5150002.0, io=2.0, network=4000002.0], id = 48622
IgniteExchange(distribution=[single]): rowcount = 500000.0, cumulative cost
= IgniteCost [rowCount=1000001.0, cpu=875001.0, memory=1.0, io=1.0,
network=2000001.0], id = 48619
IgniteIndexScan(table=[[PUBLIC, DEPT]], index=[DEPTID],
requiredColumns=[{0}], inlineScan=[true], collation=[[0 ASC-nulls-first]]):
rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
cpu=375001.0, memory=1.0, io=1.0, network=1.0], id = 47383
IgniteExchange(distribution=[single]): rowcount = 250000.0, cumulative cost
= IgniteCost [rowCount=1250001.0, cpu=1062501.0, memory=2250001.0, io=1.0,
network=2000001.0], id = 48621
IgniteColocatedHashAggregate(group=[{0}], CNT=[COUNT()]): rowcount =
250000.0, cumulative cost = IgniteCost [rowCount=1000001.0, cpu=812501.0,
memory=2250001.0, io=1.0, network=1.0], id = 48620
IgniteIndexScan(table=[[PUBLIC, EMP]], index=[DEPTID],
requiredColumns=[{1}], inlineScan=[true], collation=[[1 ASC-nulls-first]]):
rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
cpu=312501.0, memory=1.0, io=1.0, network=1.0], id = 47348
{noformat}
It caused by https://issues.apache.org/jira/browse/IGNITE-16334 and root cause
can be fixed in Apache Calcite. Until this fix it's proposed to ignore this
test.
> Flaky AggregatePlannerTest.colocated[Algorithm = HASH]
> ------------------------------------------------------
>
> Key: IGNITE-27915
> URL: https://issues.apache.org/jira/browse/IGNITE-27915
> Project: Ignite
> Issue Type: Bug
> Reporter: Aleksey Plekhanov
> Assignee: Aleksey Plekhanov
> Priority: Major
> Labels: MakeTeamcityGreenAgain, calcite, ise
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Test AggregatePlannerTest.colocated[Algorithm = HASH] is flaky.
> Eventually planner skips optimal join plan and produce plan like (exchange to
> single):
> {noformat}
> IgniteProject(DEPTID=[$0], CNT=[$2]): rowcount = 37500.0, cumulative cost =
> IgniteCost [rowCount=3037502.0, cpu=9475002.0, memory=5150002.0, io=2.0,
> network=4000002.0], id = 48623
> IgniteHashJoin(condition=[=($0, $1)], joinType=[inner], variablesSet=[[]]):
> rowcount = 37500.0, cumulative cost = IgniteCost [rowCount=3000002.0,
> cpu=9437502.0, memory=5150002.0, io=2.0, network=4000002.0], id = 48622
> IgniteExchange(distribution=[single]): rowcount = 500000.0, cumulative
> cost = IgniteCost [rowCount=1000001.0, cpu=875001.0, memory=1.0, io=1.0,
> network=2000001.0], id = 48619
> IgniteIndexScan(table=[[PUBLIC, DEPT]], index=[DEPTID],
> requiredColumns=[{0}], inlineScan=[true], collation=[[0 ASC-nulls-first]]):
> rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
> cpu=375001.0, memory=1.0, io=1.0, network=1.0], id = 47383
> IgniteExchange(distribution=[single]): rowcount = 250000.0, cumulative
> cost = IgniteCost [rowCount=1250001.0, cpu=1062501.0, memory=2250001.0,
> io=1.0, network=2000001.0], id = 48621
> IgniteColocatedHashAggregate(group=[{0}], CNT=[COUNT()]): rowcount =
> 250000.0, cumulative cost = IgniteCost [rowCount=1000001.0, cpu=812501.0,
> memory=2250001.0, io=1.0, network=1.0], id = 48620
> IgniteIndexScan(table=[[PUBLIC, EMP]], index=[DEPTID],
> requiredColumns=[{1}], inlineScan=[true], collation=[[1 ASC-nulls-first]]):
> rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
> cpu=312501.0, memory=1.0, io=1.0, network=1.0], id = 47348
> {noformat}
> Instead of:
> {noformat}
> IgniteProject(DEPTID=[$0], CNT=[$2]): rowcount = 37500.0, cumulative cost =
> IgniteCost [rowCount=3037502.0, cpu=9475002.0, memory=5150002.0, io=2.0,
> network=4000002.0], id = 1393
> IgniteHashJoin(condition=[=($0, $1)], joinType=[inner], variablesSet=[[]]):
> rowcount = 37500.0, cumulative cost = IgniteCost [rowCount=3000002.0,
> cpu=9437502.0, memory=5150002.0, io=2.0, network=4000002.0], id = 1392
> IgniteExchange(distribution=[single]): rowcount = 500000.0, cumulative
> cost = IgniteCost [rowCount=1000001.0, cpu=875001.0, memory=1.0, io=1.0,
> network=2000001.0], id = 1389
> IgniteIndexScan(table=[[PUBLIC, DEPT]], index=[DEPTID],
> requiredColumns=[{0}], inlineScan=[true], collation=[[0 ASC-nulls-first]]):
> rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
> cpu=375001.0, memory=1.0, io=1.0, network=1.0], id = 237
> IgniteExchange(distribution=[single]): rowcount = 250000.0, cumulative
> cost = IgniteCost [rowCount=1250001.0, cpu=1062501.0, memory=2250001.0,
> io=1.0, network=2000001.0], id = 1391
> IgniteColocatedHashAggregate(group=[{0}], CNT=[COUNT()]): rowcount =
> 250000.0, cumulative cost = IgniteCost [rowCount=1000001.0, cpu=812501.0,
> memory=2250001.0, io=1.0, network=1.0], id = 1390
> IgniteIndexScan(table=[[PUBLIC, EMP]], index=[DEPTID],
> requiredColumns=[{1}], inlineScan=[true], collation=[[1 ASC-nulls-first]]):
> rowcount = 500000.0, cumulative cost = IgniteCost [rowCount=500001.0,
> cpu=312501.0, memory=1.0, io=1.0, network=1.0], id = 202
> {noformat}
> It caused by https://issues.apache.org/jira/browse/IGNITE-16334 and root
> cause can be fixed in Apache Calcite. Until this fix it's proposed to ignore
> this test.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)