I guess you can do a .saveAsObjectFiles and read it back as sc.objectFile Thanks Best Regards
On Fri, Oct 23, 2015 at 7:57 AM, mark <manwoodv...@googlemail.com> wrote: > I have Avro records stored in Parquet files in HDFS. I want to read these > out as an RDD and save that RDD in Tachyon for any spark job that wants the > data. > > How do I save the RDD in Tachyon? What format do I use? Which RDD > 'saveAs...' method do I want? > > Thanks >
