SaurabhChawla100 opened a new pull request #32558:
URL: https://github.com/apache/spark/pull/32558


   ### What changes were proposed in this pull request?
   Till now there is no support in infer schema for the DateType format while 
reading the CSV/json. In this PR, code change is done to support the DateType 
when inferschema set true in the options
   
   ### Why are the changes needed?
   Many times there are multiple columns which are DateType but after inferred 
from schema they are added as StringType in the schema and than there is need 
to convert into to_date before we start the running any query. After this 
change DateType will be added in the schema instead of the StringType
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   
   ### How was this patch tested?
   Unit test added , also testing is done while running read command on spark 
shell.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to