Tom White created SPARK-8625: -------------------------------- Summary: Propagate user exceptions in tasks back to driver Key: SPARK-8625 URL: https://issues.apache.org/jira/browse/SPARK-8625 Project: Spark Issue Type: Improvement Components: Spark Core Affects Versions: 1.4.0 Reporter: Tom White
Runtime exceptions that are thrown by user code in Spark are presented to the user as strings (message and stacktrace), rather than the exception object itself. If the exception stores information about the error in fields then these cannot be retrieved. Exceptions are Serializable, so it would be feasible to return the original object back to the driver as the cause field in SparkException. This would allow the client to retrieve information from the original exception. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org