Re: Dataframe Transformation with Inner fields in Complex Datatypes.

Hi Ayan, Thanks for your update. All i am trying is to update an inner field in one of the dataframe's complex type column. withColumn method adds or replaces existing column. In my case column is a nested column. Please see the below example i mentioned in the mail. I dont have to add a new

Re: Dataframe Transformation with Inner fields in Complex Datatypes.

Hi withColumn adds the column. If you want different name, please use .alias() function. On Mon, Jul 18, 2016 at 2:16 AM, java bigdata wrote: > Hi Team, > > I am facing a major issue while transforming dataframe containing complex > datatype columns. I need to update the

Dataframe Transformation with Inner fields in Complex Datatypes.

Hi Team, I am facing a major issue while transforming dataframe containing complex datatype columns. I need to update the inner fields of complex datatype, for eg: converting one inner field to UPPERCASE letters, and return the same dataframe with new upper case values in it. Below is my issue