[
https://issues.apache.org/jira/browse/KAFKA-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15471552#comment-15471552
]
ASF GitHub Bot commented on KAFKA-4140:
---------------------------------------
GitHub user granders opened a pull request:
https://github.com/apache/kafka/pull/1834
[WIP] KAFKA-4140: make system tests parallel friendly
Updates to take advantage of soon-to-be-released ducktape features.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/confluentinc/kafka systest-parallel-friendly
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/1834.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1834
----
commit 7f8d49d32d35e0980c84c895b6384d9d4f9e15e8
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-05T01:46:51Z
Added state check in stop() method in zookeeper.py
commit 4ac3aa410e9a1fd692e063d9bd4d238cf63299cb
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-05T01:47:24Z
Added wait_until for line_count check in console consumer sanity check test
commit 9f727d6afe6e5a77c6d272b2a1cc876c64b80101
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-08T06:10:02Z
Tweak system tests/services for running in parallel
commit c049cdaed50b31d28da4fc7bdc1d255657c8654d
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-08T17:55:52Z
Save keystore/truststore in local scratch to make parallel safe
commit a7b1530597b04508ebe78aeb7fcc89fea75ce597
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-08T23:08:16Z
More informative error message
commit 7471460ebf7359bd63e9ce90d63289163d6758bb
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-08T23:12:26Z
Use stdout instead of stderr
commit ff1221862f11fff8daf82cb88c5b7ff5ab6f9ae7
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-09T19:54:01Z
Some adjustments to expected cluster usage
commit 051825dfd47d92a0f6856faa53a80db8e3680a76
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-11T17:03:25Z
Cluster size adjustments and other fixes
commit 7f447ae50dd1518a0f6d48daa13688c22dde8cad
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-11T21:52:26Z
More fixes to tests
commit 150e8438ca4b1ec2ad2d198ba954c09a04fdc11b
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-30T17:58:16Z
Minor cleanup
commit 3eb185307f31d02034dcf3d4f8e684b8324baf0c
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-30T23:27:45Z
Use per-test local scratch directory in minikdc
commit b1cca95b78004275fe8bf0602b7c2566abd87105
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-08-31T23:20:23Z
Removed a few uses of scp_to in system tests
commit b29e1fa179be201cf201a11e92fc1a4c21fa18d1
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-09-04T07:46:18Z
Tabs to spaces, scp_to -> copy_to after rebase
commit 9ebb4c35b29796e1d3d0ab92b9ae4e8bad6bf2c3
Author: Geoff Anderson <ge...@confluent.io>
Date: 2016-09-06T06:07:13Z
Updated scratch_dir -> local_scratch_dir per changes in ducktape
----
> Update system tests to allow running tests in parallel
> ------------------------------------------------------
>
> Key: KAFKA-4140
> URL: https://issues.apache.org/jira/browse/KAFKA-4140
> Project: Kafka
> Issue Type: Improvement
> Reporter: Geoff Anderson
> Assignee: Geoff Anderson
>
> The framework used to run system tests will soon have the capability to run
> tests in parallel. In our validations, we've found significant speedup with
> modest increase in the size of the worker cluster, as well as much better
> usage of the cluster resources.
> A few updates to the kafka system test services and tests are needed to take
> full advantage of this:
> 1) cluster usage annotation - this provides a hint to the framework about
> what cluster resources to set aside for a given test, and lets the driver
> efficiently use the worker cluster.
> 2) eliminate a few canonical paths on the test driver. This is fine when
> tests are run serially, but in parallel, different tests end up colliding on
> these paths. The primary culprits here are security_config.py, and minikdc.py
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
