My Spark streaming application is failing after running for few hours. After it fails, when I check the storage tab, I see that MapWithStateRDD is less than 100%.
Is this is reason why it is failing? What does MapWithStateRDD 90% cached mean. Does this mean I lost 10% or the 10% is spilled to disk and will just be slower? I am attaching the screenshot of part of what I see in my storage tab. Please help. I am using Spark 2.0.2 .
--------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
