Re: Doubt on data frame

2016-03-11 Thread Mich Talebzadeh
Temporary tables are created in temp file space within the session. Once the session is closed then the temporary table goes scala> rs.registerTempTable("mytemp") And this is the temporary file created with the above command drwx-- - hdusersupergroup 0 2016-03-11 17:09 /tmp/hi

Re: Doubt on data frame

2016-03-11 Thread ram kumar
No, I am not aware of it. Can you provide me with the details regarding this. Thanks On Fri, Mar 11, 2016 at 8:25 PM, Ted Yu wrote: > temporary tables are associated with SessionState which is used > by SQLContext. > > Did you keep the session ? > > Cheers > > On Fri, Mar 11, 2016 at 5:02 AM,

Re: Doubt on data frame

2016-03-11 Thread Ted Yu
temporary tables are associated with SessionState which is used by SQLContext. Did you keep the session ? Cheers On Fri, Mar 11, 2016 at 5:02 AM, ram kumar wrote: > Hi, > > I registered a dataframe as a table using registerTempTable > and I didn't close the Spark context. > > Will the table be

Doubt on data frame

2016-03-11 Thread ram kumar
Hi, I registered a dataframe as a table using registerTempTable and I didn't close the Spark context. Will the table be available for longer time? Thanks