Jose Torres created SPARK-23441: ----------------------------------- Summary: Remove interrupts from ContinuousExecution Key: SPARK-23441 URL: https://issues.apache.org/jira/browse/SPARK-23441 Project: Spark Issue Type: Sub-task Components: Structured Streaming Affects Versions: 2.4.0 Reporter: Jose Torres
The reason StreamExecution interrupts the query execution thread is that, for the microbatch case, nontrivial work goes on in that thread to construct a batch. In ContinuousExecution, this doesn't apply. Once the state is flipped from ACTIVE and the underlying job is cancelled, the query execution thread will immediately go to cleanup. So we don't need to call queryExecutionThread.interrupt() at all there. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org