[
https://issues.apache.org/jira/browse/SPARK-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-2674:
------------------------------------
Assignee: Davies Liu (was: Michael Armbrust)
> Add date and time types to inferSchema
> --------------------------------------
>
> Key: SPARK-2674
> URL: https://issues.apache.org/jira/browse/SPARK-2674
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 1.0.0
> Reporter: Hossein Falaki
> Assignee: Davies Liu
>
> When I try inferSchema in PySpark on an RDD of dictionary that contains a
> datatime.datetime object, I get the following exception:
> {code}
> Object of type
> java.util.GregorianCalendar[time=?,areFieldsSet=false,areAllFieldsSet=false,lenient=true,zone=sun.util.calendar.ZoneInfo[id="Etc/UTC",offset=0,dstSavings=0,useDaylight=false,transitions=0,lastRule=null],firstDayOfWeek=1,minimalDaysInFirstWeek=1,ERA=?,YEAR=2014,MONTH=3,WEEK_OF_YEAR=?,WEEK_OF_MONTH=?,DAY_OF_MONTH=22,DAY_OF_YEAR=?,DAY_OF_WEEK=?,DAY_OF_WEEK_IN_MONTH=?,AM_PM=0,HOUR=0,HOUR_OF_DAY=0,MINUTE=0,SECOND=0,MILLISECOND=4,ZONE_OFFSET=?,DST_OFFSET=?]
> cannot be used
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
