The parallelism is same for Structured Streaming. In fact, the Kafka Structured Streaming source is based on the same principle as DStream's Kafka Direct, hence it has very similar behavior.
On Tue, Apr 10, 2018 at 11:03 PM, SRK <swethakasire...@gmail.com> wrote: > hi, > > We have code based on Spark Kafka Direct in production and we want to port > this code to Structured Streaming. Does structured streaming support spark > kafka direct? What are the configs for parallelism and scalability in > structured streaming? In Spark Kafka Direct, the number of kafka partitions > take care of parallelism when doing the consumption. Is it the same case > with Structured Streaming? > > Thanks for the help in Advance! > > > > -- > Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
