Re: Spark Kafka adapter questions

2018-08-17 Thread Ted Yu
If you have picked up all the changes for SPARK-18057, the Kafka “broker” supporting v1.0+ should be compatible with Spark's Kafka adapter. Can you post more details about the “failed to send SSL close message” errors ? (The default Kafka version is 2.0.0 in Spark Kafka adapter after SPARK-18057

Spark Kafka adapter questions

2018-08-17 Thread Basil Hariri
Hi all, I work on Azure Event Hubs (Microsoft's PaaS offering similar to Apache Kafka) and am trying to get our new Kafka head to play nice with Spark's Kafka adapter. The goal is for our Kafka endp

Re: [DISCUSS] Handling correctness/data loss jiras

2018-08-17 Thread Tom Graves
Since we haven't heard any objections to this, the documentation has been updated (Thanks to Sean). All devs please make sure to re-read: http://spark.apache.org/contributing.html  . Note the set of labels used in Jira has been documented and correctness or data loss issues should be marked as b