From: Silvio Fiorito [mailto:silvio.fior...@granturing.com]
Sent: Wednesday, August 26, 2015 8:54 PM
To: Ellafi, Saif A.; user@spark.apache.org
Subject: Re: Help! Stuck using withColumn
Hi Saif,
In both cases you’re referencing columns that don’t exist in the current
DataFrame.
The first email
I can reproduce this even simpler with the following:
val gf = sc.parallelize(Array(3,6,4,7,3,4,5,5,31,4,5,2)).toDF(ASD)
val ff = sc.parallelize(Array(4,6,2,3,5,1,4,6,23,6,4,7)).toDF(GFD)
gf.withColumn(DSA, ff.col(GFD))
org.apache.spark.sql.AnalysisException: resolved attribute(s) GFD#421
...@wellsfargo.commailto:saif.a.ell...@wellsfargo.com
Date: Wednesday, August 26, 2015 at 6:06 PM
To: saif.a.ell...@wellsfargo.commailto:saif.a.ell...@wellsfargo.com,
user@spark.apache.orgmailto:user@spark.apache.org
Subject: RE: Help! Stuck using withColumn
I can reproduce this even simpler with the following
