Hi Spark users and developers, I have a dataframe with the following schema (Spark 1.5.1):
StructType(StructField(type,StringType,true), StructField(timestamp,LongType,false)) After I save the dataframe in parquet and read it back, I get the following schema: StructType(StructField(timestamp,LongType,true), StructField(type,StringType,true)) As you can see the schema does not match. The nullable field is set to true for timestamp upon reading the dataframe back. Is there a way to preserve the schema so that what we write to will be what we read back? Best Regards, Jerry