Re: Json Parsing.

Thank you for the info, is there a way to get all keys of JSON, so that i can create a dataframe with json keys, as below, fieldsDataframe.withColumn("data" , functions.get_json_object($"RecordString", "$.id")) this is for appending a single column in dataframe with id key. I would like to

Json Parsing.

Does spark support automatic detection of schema from a json string in a dataframe. I am trying to parse a json string and do some transofrmations on to it (would like append new columns to the dataframe) , from the data i stream from kafka. But i am not very sure, how i can parse the json in

Re: [RESULT][VOTE] Spark 2.2.1 (RC2)

I saw the svn move on Monday so I’m working on the website updates. I will look into maven today. I will ask if I couldn’t do it. On Wed, Dec 6, 2017 at 10:49 AM Sean Owen wrote: > Pardon, did this release finish? I don't see it in Maven. I know there was > some question

Re: [RESULT][VOTE] Spark 2.2.1 (RC2)

Pardon, did this release finish? I don't see it in Maven. I know there was some question about getting a hand in finishing the release process, including copying artifacts in svn. Was there anything else you're waiting on someone to do? On Fri, Dec 1, 2017 at 2:10 AM Felix Cheung