unsubscribe

2017-08-12 Thread sudhir k
-- Regards, Sudhir K

Withcolumn date with sysdate

2017-06-30 Thread sudhir k
Can we add a column to dataframe with a default value like sysdate .. I am calling my udf but it is throwing error col expected . On spark shell df.withcolumn("date",curent_date) works I need similiar for scala program which I can build in a jar Thanks, Sudhir -- Sent from Gmail Mobile

Re: Can we access files on Cluster mode

2017-06-25 Thread sudhir k
>> Just to note that in cluster mode the spark driver might run on any >>>> node of the cluster, hence you need to make sure that the file exists on >>>> *all* nodes. Push the file on all nodes or use client deploy-mode. >>>> >>>> Best, >>>

Fwd: Can we access files on Cluster mode

2017-06-24 Thread sudhir k
SparkFiles.get(first.sql) but still the same error. Its working on the stand alone mode but not on cluster mode. Any help is appreciated.. Using Spark 2.1.0 and Scala 2.11 Thanks. Regards, Sudhir K -- Regards, Sudhir K