[ https://issues.apache.org/jira/browse/SPARK-19774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shixiong Zhu resolved SPARK-19774. ---------------------------------- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 > StreamExecution should call stop() on sources when a stream fails > ----------------------------------------------------------------- > > Key: SPARK-19774 > URL: https://issues.apache.org/jira/browse/SPARK-19774 > Project: Spark > Issue Type: Bug > Components: Structured Streaming > Affects Versions: 2.0.2, 2.1.0 > Reporter: Burak Yavuz > Assignee: Burak Yavuz > Fix For: 2.1.1, 2.2.0 > > > We call stop() on a Structured Streaming Source only when the stream is > shutdown when a user calls streamingQuery.stop(). We should actually stop all > sources when the stream fails as well, otherwise we may leak resources, e.g. > connections to Kafka. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org