Burak Yavuz created SPARK-30143:
-----------------------------------

             Summary: StreamingQuery.stop() should not block indefinitely
                 Key: SPARK-30143
                 URL: https://issues.apache.org/jira/browse/SPARK-30143
             Project: Spark
          Issue Type: Improvement
          Components: Structured Streaming
    Affects Versions: 2.4.4
            Reporter: Burak Yavuz


The stop() method on a Streaming Query awaits the termination of the stream 
execution thread. However, the stream execution thread may block forever 
depending on the streaming source implementation (like in Kafka, which runs 
UninterruptibleThreads).

This causes control flow applications to hang indefinitely as well. We'd like 
to introduce a timeout to stop the execution thread, so that the control flow 
thread can decide to do an action if a timeout is hit. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to