Re: Dataset - withColumn and withColumnRenamed that accept Column type

[sathich]

this may work
val df_post= listCustomCols
        .foldLeft(df_pre){(tempDF, listValue) =>
          tempDF.withColumn(
            listValue.name,
            new Column(listValue.name.toString + funcUDF(listValue.name))
            )

and outsource the renaming to an udf

or  you can rename the column of one of the datasets before join itself.



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org