Hi All, I have mentioned the sample data below and the operation I need to perform over there,
I have delta tables with columns, in that columns I have the data in the string data type(contains the struct data), So, I need to update one key value in the struct field data in the string column of the delta table. Note: I can able to explode the string column into the struct field and into the individual field by using the following operation in the spark, [image: image.png] df_new = spark.read.json(df.rdd.map(lambda x: '{"data": x.data }') Could you suggest a possible way to perform the required action in an optimistic way? Note: Please feel free to ask, if you need further information. Thanks & regards, Karthick On Mon, Oct 2, 2023 at 10:53 PM Karthick Nk <kcekarth...@gmail.com> wrote: > Hi community members, > > In databricks adls2 delta tables, I need to perform the below operation, > could you help me with your thoughts > > I have the delta tables with one colum with data type string , which > contains the json data in string data type, I need to do the following > 1. I have to update one particular field value in the json and update it > back in the same column of the data. > > Example : > > In string column, inside json I have one field with value in hexadecimal. > Like { version : ''0xabcd1234"} > > I have to convert this field into corresponding integer value and update > back into same strong column json value. > Note: I have to perform this operation within this column. This column is > basically with data type string in delta table. > > Could you suggest some sample example. > > Thanks in advance. >