Re: SparkSQL saveAsParquetFile does not preserve AVRO schema

2015-08-26 Thread storm
is data.schema.asNullable. What's the real reason for this? Why not simply use the existing schema nullable flags? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-saveAsParquetFile-does-not-preserve-AVRO-schema-tp2p24454.html Sent from

SparkSQL saveAsParquetFile does not preserve AVRO schema

2015-08-25 Thread storm
in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-saveAsParquetFile-does-not-preserve-AVRO-schema-tp2.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user

SparkSQL- saveAsParquetFile

2014-06-26 Thread anthonyjschu...@gmail.com
, but there is no content in these files... only directories. Is there an obvious mistake in my code which would cause this execution to fail? Thank you-- Tony -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkSQL-saveAsParquetFile-tp8375.html Sent from the Apache Spark User