We are happy to announce the availability of Spark 2.3.3!
Apache Spark 2.3.3 is a maintenance release, based on the branch-2.3
maintenance branch of Spark. We strongly recommend all 2.3.x users to
upgrade to this stable release.
To download Spark 2.3.3, head over to the download page:
in the Spark SQL example, `year("1912")` means, first cast "1912" to date
type, and then call the "year" function.
in the Postgres example, `date_part('year',TIMESTAMP '2017')` means, get a
timestamp literal, and call the "date_part" function.
Can you try date literal in Postgres?
On Mon, Feb
It is hard to say this is a bug. In the existing Spark applications, the
current behavior might be already considered as a feature instead of a bug.
I am thinking if we should introduce a strict mode to throw an exception
for these type casting, like what Postgres behaves.
Darcy Shen
For PostgreSQL:
postgres=# SELECT date_part('year',TIMESTAMP '2017-01-01');
date_part
---
2017
(1 row)
postgres=# SELECT date_part('year',TIMESTAMP '2017');
ERROR: invalid input syntax for type timestamp: "2017"
LINE 1: SELECT date_part('year',TIMESTAMP '2017');
