Has anyone else seen this, at least in local mode? I haven't tried this in the cluster, but I'm getting myself frustrated that I cannot ID activity within the RDD's compute() method whether by stageId or rddId (available on ParallelCollectionPartition but not on ShuffledRDDPartition, and then only through reflection). Anyone else solving this problem?
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/TaskContext-stageId-0-tp9152.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
