Re: Spark - HiveContext - Unstructured Json

2014-10-22 Thread Harivardan Jayaraman
can be inferred. > > You can also use SQLContext.applySchema to specify your own schema (which > is a StructType). > > On 10/22/14 5:56 AM, Harivardan Jayaraman wrote: > > Hi, > I have unstructured JSON as my input which may have extra columns row to > row. I want to store the

Spark - HiveContext - Unstructured Json

2014-10-21 Thread Harivardan Jayaraman
Hi, I have unstructured JSON as my input which may have extra columns row to row. I want to store these json rows using HiveContext so that it can be accessed from the JDBC Thrift Server. I notice there are primarily only two methods available on the SchemaRDD for data - saveAsTable and insertInto.