Vitalii Li created SPARK-47977: ---------------------------------- Summary: DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception Key: SPARK-47977 URL: https://issues.apache.org/jira/browse/SPARK-47977 Project: Spark Issue Type: Bug Components: PySpark, SQL Affects Versions: 4.0.0 Reporter: Vitalii Li
https://github.com/apache/spark/pull/44263 converted `IllegalStateException` to `InternalError` when a unit for DateTimeUtils.timestampDiff and DateTimeUtils.timestampAdd is not from a sanctioned list. Originally incorrect unit should have been caught in parser before an expression is constructed. However, PySpark introduced PythonSQLUtils that creates expressions without validation. Since then the `INTERNAL_ERROR` is incorrect error class and should be converted to execution error with correct error class instead. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org