AFAIK, Spark's EventLoggingListerner ignores BlockUpdate event, so it will not be written into event-log, I think that's why you cannot get such info in history server.
On Thu, Feb 23, 2017 at 9:51 AM, Parag Chaudhari <paragp...@gmail.com> wrote: > Hi, > > I am running spark shell in spark version 2.0.2. Here is my program, > > var myrdd = sc.parallelize(Array.range(1, 10)) > myrdd.setName("test") > myrdd.cache > myrdd.collect > > But I am not able to see any RDD info in "storage" tab in spark history > server. > > I looked at this > <https://forums.databricks.com/questions/117/why-is-my-rdd-not-showing-up-in-the-storage-tab-of.html> > but it is not helping as I have exact similar program mentioned there. Can > anyone help? > > > *Thanks,* > > *Parag* >