[
https://issues.apache.org/jira/browse/IMPALA-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486722#comment-17486722
]
ASF subversion and git services commented on IMPALA-9057:
---------------------------------------------------------
Commit d59ec73990d89bfa4d4fa3d8fe598d53eb2918b7 in impala's branch
refs/heads/master from Yu-Wen Lai
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=d59ec73 ]
IMPALA-11093: Fine grained table refreshing doesn't refresh table file
metadata
If we insert data into an acid partitioned table from Hive, the
generated events will be like open_txn -> alter_partition
-> commit_txn.
Previously we assumed the partition object with the alter_partition
event has write id < current write id. However, that is not a valid
assumption, the partition object is actually the write id allocated
in this transaction. That means in commit_txn event, we will have
a partition with write id equals to the write id of cached partition.
So we need to modify the '<' condition to '<='.
Tests:
After IMPALA-10923, we now refresh file metadata while processing
commit events. Therefore, we can add back the test disabled in
IMPALA-9057.
Change-Id: Idabeb522525c45f000ca0992348660fa5a5d4d2d
Reviewed-on: http://gerrit.cloudera.org:8080/18175
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Reviewed-by: Sourabh Goyal <soura...@cloudera.com>
Reviewed-by: Joe McDonnell <joemcdonn...@cloudera.com>
> TestEventProcessing.test_insert_events_transactional is flaky
> -------------------------------------------------------------
>
> Key: IMPALA-9057
> URL: https://issues.apache.org/jira/browse/IMPALA-9057
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 3.4.0
> Reporter: Alice Fan
> Assignee: Vihang Karajgaonkar
> Priority: Blocker
> Labels: build-failure, flaky
>
> Assertion failure for
> custom_cluster.test_event_processing.TestEventProcessing.test_insert_events_transactional
>
> {code:java}
> Error Message
> assert ['101', 'x', ..., '3', '2019'] == ['101', 'z', '28', '3', '2019'] At
> index 1 diff: 'x' != 'z' Full diff: - ['101', 'x', '28', '3', '2019'] ?
> ^ + ['101', 'z', '28', '3', '2019'] ? ^
> Stacktrace
> custom_cluster/test_event_processing.py:49: in
> test_insert_events_transactional
> self.run_test_insert_events(is_transactional=True)
> custom_cluster/test_event_processing.py:131: in run_test_insert_events
> assert data.split('\t') == ['101', 'z', '28', '3', '2019']
> E assert ['101', 'x', ..., '3', '2019'] == ['101', 'z', '28', '3', '2019']
> E At index 1 diff: 'x' != 'z'
> E Full diff:
> E - ['101', 'x', '28', '3', '2019']
> E ? ^
> E + ['101', 'z', '28', '3', '2019']
> E ? ^
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
