Maxim Gekk created SPARK-27031:
----------------------------------
Summary: Avoid double formatting in timestampToString
Key: SPARK-27031
URL: https://issues.apache.org/jira/browse/SPARK-27031
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.4.0
Reporter: Maxim Gekk
The method DateTimeUtils.timestampToString performs converting of its input to
string twice:
- First time by converting microseconds to java.sql.Timestamp and toString:
https://github.com/apache/spark/blob/8e5f9995cad409799f3646b3d03761a771ea1664/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala#L103
- Second time by using provided formatter:
https://github.com/apache/spark/blob/8e5f9995cad409799f3646b3d03761a771ea1664/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala#L104
This could be avoided by using specialised TimestampFormatter.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
