Thanks Val for the info on indexes with DF. Do you know if adding index /
affinitykeys on the cache help with the join, when the IgniteRDD is joined with
a spark DF? The below from docs say that
“IgniteRDD also provides affinity information to Spark via
getPrefferredLocations method so that RD
Thank you and this is great news.
We currently use the Ignite cache as a Reference dataset RDD in Spark, convert
it into a spark DataFrame and then join this DF with the incoming-data DF. I
hope we can change this 3 step process to a single step with the Spark DF
integration. If so, would inde
