unsubscribe
Hi all,
I'm trying to group X rows in a single one without shuffling the date.
I was thinking doing something like that :
val myDF = Seq(1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11).toDF("myColumn")
myDF.withColumn("myColumn", expr("sliding(myColumn, 3)"))
expected result:
myColumn
[1,2,3]
[4,5,6]
Hi all,
I would like to ask how you perform a Spark Streaming application upgrade?
I didn't find any builtin solution.
I found some people writing a marker on file system and polling
periodically to stop running query.
Thanks,
Yoel
