Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19134 Yes, Python kafka.py itself is OK to leave without calling it, but the UT will involve Scala Kafka module to do the test. Currently I don't know how to address this issue. Ideally it would be better to put Python Kafka related codes to this python module, and only load in when specifically opt-in. But I'm not sure how to achieve this. Another option is to remove this python Kafka code. Previously we stopped supporting Python Spark Streaming work (https://github.com/apache/spark/pull/14340#issuecomment-235457517), so it might be OK to remove it.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org