Github user ijuma commented on the issue: https://github.com/apache/spark/pull/21488 Yeah, the Java client libraries have been evolved in a compatible manner for the most part since 0.10.0. The set of broker versions supported by 0.10.0 and 2.0.0 is exactly the same. The consumer/producer API has been enriched (transactions, idempotent producer, offsetsForTimes), but the existing methods have been kept. A small number of deprecated, but rarely used methods have been removed (not in KafkaProducer or KafkaConsumer though): https://github.com/apache/kafka/commit/a4c292173618e22b3f99ab8615c6b585c7688a40 In 0.10.1, a heartbeat thread was added to the Java consumer: https://cwiki.apache.org/confluence/display/KAFKA/KIP-62%3A+Allow+consumer+to+send+heartbeats+from+a+background+thread This is helpful to users who could not call `poll` often enough, but the default configs should be fine for most cases.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org