Jonathan Cui created SPARK-39469:
------------------------------------

             Summary: Infer date type for CSV schema inference
                 Key: SPARK-39469
                 URL: https://issues.apache.org/jira/browse/SPARK-39469
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.2.1
            Reporter: Jonathan Cui


1. If a column contains only dates, it should be of “date” type in the inferred 
schema
 * If the date format and the timestamp format are identical (e.g. both are 
yyyy/mm/dd), entries will default to being interpreted as Date

2. If a column contains dates and timestamps, it should be of “timestamp” type 
in the inferred schema



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to