You get the list of all the persistet rdd using spark context... On Aug 21, 2015 12:06 AM, "Rishitesh Mishra" <rishi80.mis...@gmail.com> wrote:
> I am not sure if you can view all RDDs in a session. Tables are maintained > in a catalogue . Hence its easier. However you can see the DAG > representation , which lists all the RDDs in a job , with Spark UI. > On 20 Aug 2015 22:34, "Dhaval Patel" <dhaval1...@gmail.com> wrote: > >> Apologies!!!! >> >> I accidentally included Spark User DL on BCC. The actual email message is >> below. >> ============================================================= >> >> >> Hi: >> >> I have been working on few example using zeppelin. >> >> I have been trying to find a command that would list all >> *dataframes/RDDs* that has been created in current session. Anyone knows if >> there is any such commands available? >> >> Something similar to SparkSQL to list all temp tables : >> show tables; >> >> Thanks, >> Dhaval >> >> >> >> On Thu, Aug 20, 2015 at 12:49 PM, Dhaval Patel <dhaval1...@gmail.com> >> wrote: >> >>> Hi: >>> >>> I have been working on few example using zeppelin. >>> >>> I have been trying to find a command that would list all >>> *dataframes/RDDs* that has been created in current session. Anyone knows if >>> there is any such commands available? >>> >>> Something similar to SparkSQL to list all temp tables : >>> show tables; >>> >>> Thanks, >>> Dhaval >>> >> >>