Which version do you use? Above app works with Spark 2.3.1, 200 partitions
are stored for State.
val queryStatusFile = conf.queryStatusFile()
val rateRowPerSecond = conf.rateRowPerSecond()
val rateRampUpTimeSecond = conf.rateRampUpTimeSecond()
val ss = SparkSession
.builder(
Hi,
Lately, I encountered a problem, when I was writing as structured streaming
job to write things into opentsdb.
The write-stream part looks something like
outputDs
.coalesce(14)
.writeStream
.outputMode("append")
.trigger(Trigger.Processin
