Re: Spark DataFrameNaFunctions unrecognized

HI Ted, Please find the error below: [ERROR] C:\workspace\etl\src\main\scala\stg_mds_pmds_rec_df.scala:116: error: value na is not a member of org.apache.spark.sql.DataFrame [ERROR] var nw_cmpr_df=cmpr_df.na.fill("column1",) [ERROR] Please let me know if any further details

Re: Spark DataFrameNaFunctions unrecognized

bq. I am getting compile time error Do you mind pastebin'ning the error you got ? Cheers On Mon, Feb 15, 2016 at 11:08 PM, satish chandra j wrote: > HI Ted, > I understand it works fine if executed in Spark Shell > Sorry, I missed to mention that I am getting

Re: Spark DataFrameNaFunctions unrecognized

HI Ted, I understand it works fine if executed in Spark Shell Sorry, I missed to mention that I am getting compile time error( using Maven for build) I am executing my Spark Job in remote client by submitting the exe jar file Now do I need to import any specific packages make DataFrameNaFucntions

Re: Spark DataFrameNaFunctions unrecognized

fill() was introduced in 1.3.1 Can you show code snippet which reproduces the error ? I tried the following using spark-shell on master branch: scala> df.na.fill(0) res0: org.apache.spark.sql.DataFrame = [col: int] Cheers On Mon, Feb 15, 2016 at 3:36 AM, satish chandra j

Spark DataFrameNaFunctions unrecognized

Hi All, Currently I am using Spark 1.4.0 version, getting error when trying to use "fill" function which is one among DataFrameNaFunctions Snippet: df.na.fill(col: ) Error: value na is not a member of org.apache.spark.sql.DataFrame As I need null values in column "col" of DataFrame "df" to