Hi all
Now I am using Structured Streaming in Continuous Processing mode and I
faced a odd problem.
My code is so simple that it is similar to the sample code on the
documentation.
https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#continuous-processing
When I send the same text data ten times, for example 10 lines text, in
Batch mode the result has 100 lines.
But in Continuous Processing mode the result has only 10 lines.
It appears duplicated lines are removed.
The difference of these two codes is only with or without trigger method.
Why these two code behave differently ?
--
Regard,
Yuta
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
