Mapping SchemaRDD/Row to JSON

2014-11-10 Thread Akshat Aranya
Hi, Does there exist a way to serialize Row objects to JSON. In the absence of such a way, is the right way to go: * get hold of schema using SchemaRDD.schema * Iterate through each individual Row as a Seq and use the schema to convert values in the row to JSON types. Thanks, Akshat

Re: Mapping SchemaRDD/Row to JSON

2014-11-10 Thread Tobias Pfeiffer
Akshat On Tue, Nov 11, 2014 at 4:12 AM, Akshat Aranya aara...@gmail.com wrote: Does there exist a way to serialize Row objects to JSON. I can't think of any other way than the one you proposed. A Row is more or less an Array[Object], so you need to read JSON key and data type from the

Re: Mapping SchemaRDD/Row to JSON

2014-11-10 Thread Michael Armbrust
There is a JIRA for adding this: https://issues.apache.org/jira/browse/SPARK-4228 Your described approach sounds reasonable. On Mon, Nov 10, 2014 at 5:10 PM, Tobias Pfeiffer t...@preferred.jp wrote: Akshat On Tue, Nov 11, 2014 at 4:12 AM, Akshat Aranya aara...@gmail.com wrote: Does there