Re: [Structured Streaming][Kafka] For a Kafka topic with 3 partitions, how does the parallelism work ?

Yes as long as there are 3 cores available on your local machine. On Fri, Apr 20, 2018 at 10:56 AM karthikjay wrote: > I have the following code to read data from Kafka topic using the > structured > streaming. The topic has 3 partitions: > > val spark = SparkSession >

Re: Spark with Scala 2.12

Even more to the point: http://apache-spark-developers-list.1001551.n3.nabble.com/Scala-2-12-support-td23833.html tldr; It's an item of discussion, but there is no imminent release of Spark that will use Scala 2.12. On Sat, Apr 21, 2018 at 2:44 AM, purijatin wrote: > I see

Re: Spark with Scala 2.12

I see a discussion post on the dev mailing list: http://apache-spark-developers-list.1001551.n3.nabble.com/time-for-Apache-Spark-3-0-td23755.html#a23830 Thanks -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/