Read this [SPARK-42485] SPIP: Shutting down spark structured streaming when the streaming process completed current process - ASF JIRA (apache.org) <https://issues.apache.org/jira/browse/SPARK-42485>
<https://issues.apache.org/jira/browse/SPARK-42485>HTH Mich Talebzadeh, Lead Solutions Architect/Engineering Lead Palantir Technologies Limited view my Linkedin profile <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Wed, 22 Mar 2023 at 00:38, Srinivas Rishindra <sririshin...@gmail.com> wrote: > Hi Team, > > Does anyone know about any ongoing work to gracefully stop spark streaming > applications externally using "yarn application -stop" or by using any > other method? > > My understanding is that in order to make use of "yarn application -stop", > spark needs to implement "org.apache.hadoop.yarn.client.api.AppAdminClient". > Does anyone have any thoughts or knowledge about this? > > Best Regards > Rishi > > > >
