Hi,
Check the thread on graceful shutdown. That might help
On Tue, 7 Feb 2023 at 12:47, Yoel Benharrous
wrote:
> Hi all,
>
> I would like to ask how you perform a Spark Streaming application upgrade?
> I didn't find any builtin solution.
> I found some people writing a marker on file system
Hi all,
I would like to ask how you perform a Spark Streaming application upgrade?
I didn't find any builtin solution.
I found some people writing a marker on file system and polling
periodically to stop running query.
Thanks,
Yoel
