you shutdown gracefully, eg.
invoke StreamingQuery#stop.
https://issues.apache.org/jira/browse/SPARK-21029 is probably of interest.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Structured-Streaming-truncated-Parquet-after-driver-crash-or-kill
iodically to deploy new versions of the code. We want to run the
application as a long lived process that is continually reading from the
Kafka queue and writing out to HDFS for archival purposes.
Thanks,
Dave Cameron
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.c
