[ https://issues.apache.org/jira/browse/SPARK-18908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shixiong Zhu updated SPARK-18908: --------------------------------- Description: If the logical plan fails to create, e.g., some Source options are invalid, the user cannot use the code to detect the failure. The only place receiving this error is Thread's UncaughtExceptionHandler. This bug is because logicalPlan is lazy, and when we try to create StreamingQueryException to wrap the exception thrown by creating logicalPlan, it calls logicalPlan agains. was: If the logical plan fails to create, e.g., some options are invalid, the user cannot use the code to detect the failure. The only place receiving this error is Thread's UncaughtExceptionHandler. This bug is because logicalPlan is lazy, and when we try to create StreamingQueryException to wrap the exception thrown by creating logicalPlan, it calls logicalPlan agains. > It's hard for the user to see the failure if StreamExecution fails to create > the logical plan > --------------------------------------------------------------------------------------------- > > Key: SPARK-18908 > URL: https://issues.apache.org/jira/browse/SPARK-18908 > Project: Spark > Issue Type: Bug > Components: Structured Streaming > Affects Versions: 2.1.0 > Reporter: Shixiong Zhu > Priority: Blocker > > If the logical plan fails to create, e.g., some Source options are invalid, > the user cannot use the code to detect the failure. The only place receiving > this error is Thread's UncaughtExceptionHandler. > This bug is because logicalPlan is lazy, and when we try to create > StreamingQueryException to wrap the exception thrown by creating logicalPlan, > it calls logicalPlan agains. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org