Re: Adding pause() method to pyspark.sql.streaming.StreamingQuery

2023-03-15 Thread Mich Talebzadeh
9 > *To:* Martin Andersson > *Cc:* Spark dev list > *Subject:* Re: Adding pause() method to > pyspark.sql.streaming.StreamingQuery > > > EXTERNAL SENDER. Do not click links or open attachments unless you > recognize the sender and know the content is safe. DO NOT provide your &

Re: Adding pause() method to pyspark.sql.streaming.StreamingQuery

2023-03-15 Thread Martin Andersson
ch 9, 2023 17:12 To: Spark dev list mailto:dev@spark.apache.org>> Subject: Adding pause() method to pyspark.sql.streaming.StreamingQuery EXTERNAL SENDER. Do not click links or open attachments unless you recognize the sender and know the content is safe. DO NOT provide your username or pass

Re: Adding pause() method to pyspark.sql.streaming.StreamingQuery

2023-03-14 Thread Mich Talebzadeh
-cases where it > would be beneficial with a pause and how a pause would differ functionally > from a stop? > > Best regards, Martin > -- > *From:* Mich Talebzadeh > *Sent:* Thursday, March 9, 2023 17:12 > *To:* Spark dev list > *Subject

Re: Adding pause() method to pyspark.sql.streaming.StreamingQuery

2023-03-14 Thread Martin Andersson
dev list Subject: Adding pause() method to pyspark.sql.streaming.StreamingQuery EXTERNAL SENDER. Do not click links or open attachments unless you recognize the sender and know the content is safe. DO NOT provide your username or password. Hi, Currently for Spark Streaming we have

Adding pause() method to pyspark.sql.streaming.StreamingQuery

2023-03-09 Thread Mich Talebzadeh
Hi, Currently for Spark Streaming we have the following class: pyspark.sql.streaming.StreamingQuery There are a number of useful methods, for example stop() which stops the streaming process gracefully. Can we add another method pause() so w can pause the processing. This will come handy