--
Regards,
Sudhir K
Can we add a column to dataframe with a default value like sysdate .. I am
calling my udf but it is throwing error col expected .
On spark shell
df.withcolumn("date",curent_date) works I need similiar for scala program
which I can build in a jar
Thanks,
Sudhir
--
Sent from Gmail Mobile
>> Just to note that in cluster mode the spark driver might run on any
>>>> node of the cluster, hence you need to make sure that the file exists on
>>>> *all* nodes. Push the file on all nodes or use client deploy-mode.
>>>>
>>>> Best,
>>>
SparkFiles.get(first.sql) but still the same error.
Its working on the stand alone mode but not on cluster mode. Any help is
appreciated.. Using Spark 2.1.0 and Scala 2.11
Thanks.
Regards,
Sudhir K
--
Regards,
Sudhir K