From: Silvio Fiorito [mailto:silvio.fior...@granturing.com]
Sent: Wednesday, August 26, 2015 8:54 PM
To: Ellafi, Saif A.; user@spark.apache.org
Subject: Re: Help! Stuck using withColumn
Hi Saif,
In both cases you’re referencing columns that don’t exist in the current
DataFrame.
The first email
saif.a.ell...@wellsfargo.com<mailto:saif.a.ell...@wellsfargo.com>"
Date: Wednesday, August 26, 2015 at 6:06 PM
To: "saif.a.ell...@wellsfargo.com<mailto:saif.a.ell...@wellsfargo.com>",
"user@spark.apache.org<mailto:user@spark.apache.org>"
Subject: RE: Help! Stuck usi
e.select(DataFrame.scala:595)
at org.apache.spark.sql.DataFrame.withColumn(DataFrame.scala:1039)
From: saif.a.ell...@wellsfargo.com [mailto:saif.a.ell...@wellsfargo.com]
Sent: Wednesday, August 26, 2015 6:47 PM
To: user@spark.apache.org
Subject: Help! Stuck using withColumn
This simple comand call:
val final_df =
This simple comand call:
val final_df = data.select("month_balance").withColumn("month_date",
data.col("month_date_curr"))
Is throwing:
org.apache.spark.sql.AnalysisException: resolved attribute(s)
month_date_curr#324 missing from month_balance#234 in operator !Project
[month_balance#234, mon
