Thank you your reply, I will open pull request for this doc issue. The
logic is clear.
пт, 14 апр. 2017, 23:34 Michael Armbrust :
> 1) could we update documentation for Structured Streaming and describe
>> that checkpointing could be specified by
>>
>
> 1) could we update documentation for Structured Streaming and describe
> that checkpointing could be specified by
> spark.sql.streaming.checkpointLocation
> on SparkSession level and thus automatically checkpoint dirs will be
> created per foreach query?
>
>
Sure, please open a pull request.
Hello, guys.
I have initiated the ticket
https://issues.apache.org/jira/browse/SPARK-20325 ,
My case was: I launch two streams from one source stream *streamToProcess *like
this
streamToProcess
.groupBy(metric)
.agg(count(metric))
.writeStream