To: user@spark.apache.org
Subject: Create column in nested structure?
Has anyone used withColumn (or another method) to add a column to an existing
nested dataframe?
If I call:
df.withColumn(nested.newcolumn, df(oldcolumn))
then it just creates the new column with a . In it's name, not under
Has anyone used withColumn (or another method) to add a column to an existing
nested dataframe?
If I call:
df.withColumn(nested.newcolumn, df(oldcolumn))
then it just creates the new column with a . In it's name, not under the
nested structure.
Thanks,
Ewan