Hi, Denis. It should be a String. Even if it looks like a number when you do hadoop fs -ls ..., it's a String representation of a date/time.
Phillip On Thu, Jan 10, 2019 at 2:00 PM ddebarbieux <ddebarbi...@norsys.fr> wrote: > cala> spark.read.schema(StructType(Seq(StructField("_1",StringType,false), > StructField("_2",StringType,true)))).parque ("hdfs://---/MY_DIRECTORY/ > *_1=201812030900*").show() > +----+--------------------+ > | _1| _2| > +----+--------------------+ > |null|ba1ca2dc033440125...| > |null|ba1ca2dc033440125...| > |null|ba1ca2dc033440125...| > > > Is the column '_1' a String or a Number? > > Denis > >