brilliant thanks it is working
here is the code for anyone else that will find this useful.
val igniteContext = new IgniteContext(sc, () =>{
val tcpDiscoverySpi: TcpDiscoverySpi = new TcpDiscoverySpi
val ipFinder: TcpDiscoveryVmIpFinder = new
string (nullable = true)
> |-- COMPLIANCESUMMARYVALUE: string (nullable = true)
> |-- RECORDVALIDFROM: date (nullable = true)
> |-- RECORDVALIDTO: date (nullable = true)
>
>
> -----
>
> I can print the schema out but if i try query
--
I can print the schema out but if i try query it i get the following error
message:
org.apache.spark.SparkException: Job aborted due to stage failure: Task not
serializable: java.io.NotSerializableException:
org.apache.ignite.configuration.IgniteConfiguration
Serialization s
