From: Silvio Fiorito [mailto:silvio.fior...@granturing.com]
Sent: Wednesday, August 26, 2015 8:54 PM
To: Ellafi, Saif A.; user@spark.apache.org
Subject: Re: Help! Stuck using withColumn
Hi Saif,
In both cases you’re referencing columns that don’t exist in the current
DataFrame.
The first email
This simple comand call:
val final_df = data.select(month_balance).withColumn(month_date,
data.col(month_date_curr))
Is throwing:
org.apache.spark.sql.AnalysisException: resolved attribute(s)
month_date_curr#324 missing from month_balance#234 in operator !Project
[month_balance#234,
)
at org.apache.spark.sql.DataFrame.withColumn(DataFrame.scala:1039)
From: saif.a.ell...@wellsfargo.com [mailto:saif.a.ell...@wellsfargo.com]
Sent: Wednesday, August 26, 2015 6:47 PM
To: user@spark.apache.org
Subject: Help! Stuck using withColumn
This simple comand call:
val final_df = data.select(month_balance).withColumn(month_date
...@wellsfargo.commailto:saif.a.ell...@wellsfargo.com
Date: Wednesday, August 26, 2015 at 6:06 PM
To: saif.a.ell...@wellsfargo.commailto:saif.a.ell...@wellsfargo.com,
user@spark.apache.orgmailto:user@spark.apache.org
Subject: RE: Help! Stuck using withColumn
I can reproduce this even simpler with the following
