Can you give a bit more detail ? Release of Spark symptom of renamed column being not recognized
Please take a look at "withColumnRenamed" test in: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala On Thu, Mar 17, 2016 at 2:02 AM, Divya Gehlot <divya.htco...@gmail.com> wrote: > Hi, > I am adding a new column and renaming it at same time but the renaming > doesnt have any effect. > > dffiltered = >> dffiltered.unionAll(dfresult.withColumn("Col1",lit("value1").withColumn("Col2",lit("value2")).cast("int")).withColumn("Col3",lit("values3")).withColumnRenamed("Col1","Col1Rename").drop("Col1") > > > Can anybody help me pointing out my mistake ? > > Thanks, > Divya >