--
Regards,
Sudhir K
Can we add a column to dataframe with a default value like sysdate .. I am
calling my udf but it is throwing error col expected .
On spark shell
df.withcolumn("date",curent_date) works I need similiar for scala program
which I can build in a jar
Thanks,
Sudhir
--
Sent from Gmail Mobile
Anastasios Zouzias <zouz...@gmail.com> wrote:
>>>
>>>> Just to note that in cluster mode the spark driver might run on any
>>>> node of the cluster, hence you need to make sure that the file exists on
>>>> *all* nodes. Push the file on all nodes or use cli
) and then
SparkFiles.get(first.sql) but still the same error.
Its working on the stand alone mode but not on cluster mode. Any help is
appreciated.. Using Spark 2.1.0 and Scala 2.11
Thanks.
Regards,
Sudhir K
--
Regards,
Sudhir K
