[
https://issues.apache.org/jira/browse/IMPALA-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969983#comment-16969983
]
ASF subversion and git services commented on IMPALA-8648:
---------------------------------------------------------
Commit 7ccfc43d963e4c36d065f1d912b52cf983e0595d in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=7ccfc43 ]
IMPALA-8648: Add stress tests for ACID INSERTs/SELECTs
Added different stress tests for ACID operations. We already had one
stress test where an Impala client issued SELECTs while another process
inserted data through Hive. The test checked wether some invariants are
held.
I added the following tests:
* one Impala client inserts data, one Impala client reads and checks
invariants
* multiple Impala clients issue INSERTs and TRUNCATEs, multiple Impala
clients issue SELECTs and check invariants
* multiple Impala clients insert data, sometimes failures are injected
during inserts to create aborted transactions. In the meantime
multiple Impala clients read the data and check that if they see
data from aborted transactions
During the tests I found and fixed a temporal deadlock.
CatalogOpExecutor.truncateTable() locked catalog_.versionLock_ and the
HMS ACID lock in a different order than the INSERT statements, it could
lead to a deadlock for 30 seconds, after that TRUNCATE failed.
Also, in the Frontend I switched the order of write id allocation and
locking. From now on at first we lock the table then allocate a write
id.
Change-Id: I066652bfa7d924742af01aef8df4512e00620c7d
Reviewed-on: http://gerrit.cloudera.org:8080/14444
Reviewed-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
> Impala ACID read stress tests
> -----------------------------
>
> Key: IMPALA-8648
> URL: https://issues.apache.org/jira/browse/IMPALA-8648
> Project: IMPALA
> Issue Type: Test
> Reporter: Dinesh Garg
> Assignee: Zoltán Borók-Nagy
> Priority: Critical
> Labels: impala-acid
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
