Unsubscribe
Sent from my iPhone
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Sent from my iPhone
-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
Unsubscribe
Sent from my iPhone
I have similar case where I have RDD [List[Any], List[Long] ] and wants to
save it as Parquet file.
My understanding is that only RDD of case classes can be converted to
SchemaRDD. So is there any way I can save this RDD as Parquet file without
using Avro?
Thanks in advance
Anita
On 18 June
:
Unfortunately, I couldn’t figure it out without involving Avro.
Here is something that may be useful since it uses Avro generic records
(so no case classes needed) and transforms to Parquet.
http://blog.cloudera.com/blog/2014/05/how-to-convert-existing-data-into-parquet
/
HTH,
Mahesh
From: Anita