I tried to create a Dataset by loading a file and pass that as argument to
java method as below:
Dataset<Row> propertiesFile// Dataset created by loading a json property
file
Dataset<Row> streamingQuery // Dataset for streaming query
streamingQuery.map(
row -> myfunction( row, propertiesFile), Encoders.STRING());
This approach throws NulPointerException while reading from propertiesFile
Dataset.
Looks like I can not pass propertiesFile Dataset in this way in Spark, I
have to join with streamingQuery Dataset.
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: [email protected]
