Rajesh Balamohan created SPARK-14321:
----------------------------------------
Summary: Reduce DateFormat cost in datetimeExpressions
Key: SPARK-14321
URL: https://issues.apache.org/jira/browse/SPARK-14321
Project: Spark
Issue Type: Bug
Reporter: Rajesh Balamohan
Priority: Minor
Currently the code generated is
{noformat}
/* 066 */ UTF8String primitive5 = null;
/* 067 */ if (!isNull4) {
/* 068 */ try {
/* 069 */ primitive5 = UTF8String.fromString(new
java.text.SimpleDateFormat("yyyy-MM-dd HH:mm:ss").format(
/* 070 */ new java.util.Date(primitive7 * 1000L)));
/* 071 */ } catch (java.lang.Throwable e) {
/* 072 */ isNull4 = true;
/* 073 */ }
/* 074 */ }
{noformat}
Instantiation of SimpleDateFormat is fairly expensive. It can be created on
need basis.
I will share the patch soon.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
