Re: Graceful shutdown SPARK Structured Streaming

2021-05-06 Thread Mich Talebzadeh
That is a valid question and I am not aware of any new addition to Spark Structured Streaming (SSS) in newer releases for this graceful shutdown. Going back to my earlier explanation, there are occasions that you may want to stop the Spark program gracefully. Gracefully meaning that Spark

Re: Graceful shutdown SPARK Structured Streaming

2021-05-06 Thread ayan guha
What are some other "newer" methodologies? Really interested to understand what is possible here as this is a topic came up in this forum time and again. On Thu, 6 May 2021 at 5:13 pm, Gourav Sengupta < gourav.sengupta.develo...@gmail.com> wrote: > Hi Mich, > > thanks a ton for your kind

(无主题)

2021-05-06 Thread Tang Jinxin
unsubscribe xiaoxingstack 邮箱:xiaoxingst...@gmail.com 签名由 网易邮箱大师 定制

Re: Graceful shutdown SPARK Structured Streaming

2021-05-06 Thread Gourav Sengupta
Hi Mich, thanks a ton for your kind response, looks like we are still using the earlier methodologies for stopping a spark streaming program gracefully. Regards, Gourav Sengupta On Wed, May 5, 2021 at 6:04 PM Mich Talebzadeh wrote: > > Hi, > > > I believe I discussed this in this forum. I