Vitalii Li created SPARK-47977:
----------------------------------
Summary: DateTimeUtils.timestampDiff and
DateTimeUtils.timestampAdd should not throw INTERNAL_ERROR exception
Key: SPARK-47977
URL: https://issues.apache.org/jira/browse/SPARK-47977
Project: Spark
Issue Type: Bug
Components: PySpark, SQL
Affects Versions: 4.0.0
Reporter: Vitalii Li
https://github.com/apache/spark/pull/44263 converted `IllegalStateException` to
`InternalError` when a unit for DateTimeUtils.timestampDiff and
DateTimeUtils.timestampAdd is not from a sanctioned list.
Originally incorrect unit should have been caught in parser before an
expression is constructed. However, PySpark introduced PythonSQLUtils that
creates expressions without validation. Since then the `INTERNAL_ERROR` is
incorrect error class and should be converted to execution error with correct
error class instead.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
