I am trying to perform some insert column operations in dataframe.
Following is the code I used:
val df = sqlContext.read.json(examples/src/main/resources/people.json)
df.show() { works correctly }
df.withColumn(age, df.col(name) ) { works correctly }
df.withColumn(age, df.col(name) ).show()
This is an known issue:
https://issues.apache.org/jira/browse/SPARK-8461?filter=-1
Will be fixed soon by https://github.com/apache/spark/pull/6898
On Fri, Jun 19, 2015 at 5:50 AM, Animesh Baranawal
animeshbarana...@gmail.com wrote:
I am trying to perform some insert column operations in