When I submit a Spark Streaming job, I see these INFO logs printing frequently:
14/11/21 18:53:17 INFO DAGScheduler: waiting: Set(Stage 216) 14/11/21 18:53:17 INFO DAGScheduler: failed: Set() 14/11/21 18:53:17 INFO DAGScheduler: Missing parents for Stage 216: List() 14/11/21 18:53:17 INFO DAGScheduler: Submitting Stage 216 (MappedRDD[1733] at map at MappedDStream.scala:35), which is now runnable I have a feeling this means there is some error with a Map I created as a broadcast variable, but I'm not sure. How can I figure out what this is referring to? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Missing-parents-for-stage-Spark-Streaming-tp19530.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
