i tried setting both dateFormat and timestampFormat to impossible values (e.g. "~|.G~z~a|wW") and it still detected my data to be TimestampType
On Wed, Oct 26, 2016 at 1:15 PM, Koert Kuipers <ko...@tresata.com> wrote: > we had the inference of dates/timestamps when reading csv files disabled > in spark 2.0.0 by always setting dateFormat to something impossible (e.g. > dateFormat "~|.G~z~a|wW") > > i noticed in spark 2.0.1 that setting this impossible dateFormat does not > stop spark from inferring it is a date or timestamp type anyhow. is this > intentional? how do i disable inference of datetype/timestamp type now? > > thanks! koert > >
