[
https://issues.apache.org/jira/browse/IMPALA-14718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18059874#comment-18059874
]
Balazs Hevele commented on IMPALA-14718:
----------------------------------------
In the specific case linked, the test failure happened, because it was running
in parallel with test_iceberg.py::test_table_repair, which ran an INVALIDATE
METADATA exactly before a SELECT query of test_confirm_individual_refresh,
which was checking that data in its table is not reloaded. Due to the global
invalidate, the data was reloaded anyway.
The best solution to this phenomenon is most likely to not allow INVALIDATE
METADATA queries in parallelly running tests.
> test_confirm_individual_refresh is flaky
> ----------------------------------------
>
> Key: IMPALA-14718
> URL: https://issues.apache.org/jira/browse/IMPALA-14718
> Project: IMPALA
> Issue Type: Bug
> Reporter: Balazs Hevele
> Assignee: Balazs Hevele
> Priority: Major
> Labels: broken-build, flaky-test
>
> TestRefreshPartition::test_confirm_individual_refresh is flaky.
>
> It seems to fail very rarely with error:
> {noformat}
> metadata/test_refresh_partition.py:209: in test_confirm_individual_refresh
> assert result.data == [str(0)]
> E AssertionError: assert ['5000'] == ['0']
> E At index 0 diff: '5000' != '0'
> E Full diff:
> E - ['0']
> E + ['5000']
> E ? +++
> dst_path =
> '/test-warehouse/test_confirm_individual_refresh_5e857700/year=2010/month=%s/alltypes.parq'
> file_name = 'alltypes.parq'
> file_num_rows = 1000
> month = 5
> result = <tests.common.impala_connection.ImpylaHS2ResultSet
> object at 0x7f8ef9096d60>
> self =
> <tests.metadata.test_refresh_partition.TestRefreshPartition object at
> 0x7f8ef90f2490>
> src_file =
> '/test-warehouse/alltypesagg_parquet/year=2010/month=1/day=9/*.parq'
> table_location =
> '/test-warehouse/test_confirm_individual_refresh_5e857700'
> table_name =
> 'test_confirm_individual_refresh_5e857700.partition_test_table'
> unique_database = 'test_confirm_individual_refresh_5e857700'
> {noformat}
>
> An example is:
> https://jenkins.impala.io/job/ubuntu-20.04-dockerised-tests/4596/testReport/junit/metadata.test_refresh_partition/TestRefreshPartition/test_confirm_individual_refresh/
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
