[ https://issues.apache.org/jira/browse/SPARK-6211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354584#comment-14354584 ]
Apache Spark commented on SPARK-6211: ------------------------------------- User 'jerryshao' has created a pull request for this issue: https://github.com/apache/spark/pull/4961 > Test Python Kafka API using Python unit tests > --------------------------------------------- > > Key: SPARK-6211 > URL: https://issues.apache.org/jira/browse/SPARK-6211 > Project: Spark > Issue Type: Test > Components: Streaming, Tests > Reporter: Tathagata Das > Assignee: Saisai Shao > Priority: Critical > > This is tricky in python because the KafkaStreamSuiteBase (which has the > functionality of creating embedded kafka clusters) is in the test package, > which is not in the python path. To fix that, we have to ways. > 1. Add test jar to classpath in python test. Thats kind of trickier. > 2. Bring that into the src package (maybe renamed as KafkaTestUtils), and > then wrap that in python to use it from python. > If (2) does not add any extra test dependencies to the main Kafka pom, then 2 > should be simpler to do. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org