[ https://issues.apache.org/jira/browse/KAFKA-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14541121#comment-14541121 ]
Geoffrey Anderson commented on KAFKA-2003: ------------------------------------------ Just making sure you're aware of work we're doing at Confluent on system tests. I'll be posting a KIP for this soon, but here's some info: The original plan is sketched here: https://cwiki.apache.org/confluence/display/KAFKA/System+Test+Improvements This is the core library/test framework (WIP) which aids in writing and running the tests https://github.com/confluentinc/ducktape/ This has system tests we've written to date for the Confluent Platform https://github.com/confluentinc/muckrake > Add upgrade tests > ----------------- > > Key: KAFKA-2003 > URL: https://issues.apache.org/jira/browse/KAFKA-2003 > Project: Kafka > Issue Type: Improvement > Components: system tests > Reporter: Gwen Shapira > Assignee: Ashish K Singh > > To test protocol changes, compatibility and upgrade process, we need a good > way to test different versions of the product together and to test end-to-end > upgrade process. > For example, for 0.8.2 to 0.8.3 test we want to check: > * Can we start a cluster with a mix of 0.8.2 and 0.8.3 brokers? > * Can a cluster of 0.8.3 brokers bump the protocol level one broker at a time? > * Can 0.8.2 clients run against a cluster of 0.8.3 brokers? > There are probably more questions. But an automated framework that can test > those and report results will be a good start. -- This message was sent by Atlassian JIRA (v6.3.4#6332)