Trying to port my Spark 2.4 based (Structured) streaming application to Spark 3.0. I compiled it using the dependency given below:
<dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-sql-kafka-0-10_${scala.binary.version}</artifactId> <version>3.1.0</version> </dependency> Every time I run it under Spark 3.0, I get this message: *Data source v2 streaming sinks does not support Update mode* I am using '*mapGroupsWithState*' so as per this link ( https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#output-modes), the only supported Output mode is "*Update*". My Sink is a Kafka topic so I am using this: .writeStream .format("kafka") What am I missing?