Cannot see RDDs in Spark UI
Hi, I create a bunch of RDDs, including schema RDDs. When I run the program and go to UI on xxx:4040, the storage tab does not shows any RDDs. Spark version is 1.1.1 (Hadoop 2.3) Any thoughts? Thanks,
Re: Cannot see RDDs in Spark UI
Hi Manoj, I've noticed that the storage tab only shows RDDs that have been cached. Did you call .cache() or .persist() on any of the RDDs? Andrew On Tue, Jan 6, 2015 at 6:48 PM, Manoj Samel wrote: > Hi, > > I create a bunch of RDDs, including schema RDDs. When I run the program > and go to UI on xxx:4040, the storage tab does not shows any RDDs. > > > Spark version is 1.1.1 (Hadoop 2.3) > > Any thoughts? > > Thanks, >