Re: Does structured streaming support Spark Kafka Direct?

2018-04-12 Thread Tathagata Das
have code based on Spark Kafka Direct in production and we want to port > this code to Structured Streaming. Does structured streaming support spark > kafka direct? What are the configs for parallelism and scalability in > structured streaming? In Spark Kafka Direct, the number of kafk

Does structured streaming support Spark Kafka Direct?

2018-04-11 Thread SRK
hi, We have code based on Spark Kafka Direct in production and we want to port this code to Structured Streaming. Does structured streaming support spark kafka direct? What are the configs for parallelism and scalability in structured streaming? In Spark Kafka Direct, the number of kafka