[ https://issues.apache.org/jira/browse/SPARK-31814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-31814: --------------------------------- Description: Hi, We are trying to convert a column with string datatype to date type using below example. It seems to work for all timestamps except for the timestamp for 31st March 2019 02:**:** like 190331020000. Can you please look into it. Thanks. {code} scala> sql("select to_date('190331000000','yyMMddHHmmss')").show(false) +------------------------------------------------+ | to_date('190331000000', 'yyMMddHHmmss')| +------------------------------------------------+ |2019-03-31 | +------------------------------------------------+ {code} Interstingly below is not working for highlighted hours (02). {code} scala> sql("select to_date('190331020000','yyMMddHHmmss')").show(false) +------------------------------------------------+ | to_date('1903310000', 'yyMMddHHmmss')| +------------------------------------------------+ |null | +------------------------------------------------+ {code} was: Hi, We are trying to convert a column with string datatype to date type using below example. It seems to work for all timestamps except for the timestamp for 31st March 2019 02:**:** like 190331020000. Can you please look into it. Thanks. {code} scala> sql("select to_date('190331000000','yyMMddHHmmss')").show(false) +------------------------------------------------+ |to_date('190331000000', 'yyMMddHHmmss')| +------------------------------------------------+ |2019-03-31 | +------------------------------------------------+ {code} Interstingly below is not working for highlighted hours (02). {code} scala> sql("select to_date('190331020000','yyMMddHHmmss')").show(false) +------------------------------------------------+ |to_date('1903310000', 'yyMMddHHmmss')| +------------------------------------------------+ |null | +------------------------------------------------+ {code} > Null in Date conversion from yyMMddHHmmss for specific date and time > -------------------------------------------------------------------- > > Key: SPARK-31814 > URL: https://issues.apache.org/jira/browse/SPARK-31814 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.3.0 > Environment: Spark Version : 2.3.0.2.6.5.0-292 > Distribution : Hortonworks > Reporter: Sunny Jain > Priority: Minor > > Hi, > > We are trying to convert a column with string datatype to date type using > below example. It seems to work for all timestamps except for the timestamp > for 31st March 2019 02:**:** like 190331020000. Can you please look into it. > Thanks. > {code} > scala> sql("select to_date('190331000000','yyMMddHHmmss')").show(false) > +------------------------------------------------+ > | to_date('190331000000', 'yyMMddHHmmss')| > +------------------------------------------------+ > |2019-03-31 | > +------------------------------------------------+ > {code} > > > Interstingly below is not working for highlighted hours (02). > {code} > scala> sql("select to_date('190331020000','yyMMddHHmmss')").show(false) > +------------------------------------------------+ > | to_date('1903310000', 'yyMMddHHmmss')| > +------------------------------------------------+ > |null | > +------------------------------------------------+ > {code} > > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org