I tried to create a Dataset by loading a file and pass that as argument to java method as below:
Dataset<Row> propertiesFile// Dataset created by loading a json property file Dataset<Row> streamingQuery // Dataset for streaming query streamingQuery.map( row -> myfunction( row, propertiesFile), Encoders.STRING()); This approach throws NulPointerException while reading from propertiesFile Dataset. Looks like I can not pass propertiesFile Dataset in this way in Spark, I have to join with streamingQuery Dataset. -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org