You can use get On Thu, 7 Dec 2017 at 10:39 am, satyajit vegesna <satyajit.apas...@gmail.com> wrote:
> Does spark support automatic detection of schema from a json string in a > dataframe. > > I am trying to parse a json string and do some transofrmations on to it > (would like append new columns to the dataframe) , from the data i stream > from kafka. > > But i am not very sure, how i can parse the json in structured streaming. > And i would not be interested in creating a schema, as the data form kafka > is going to maintain different schema objects in value column. > > Any advice or help would be appreciated. > > Regards, > Satyajit. > -- Best Regards, Ayan Guha