Re: Spark SQL - Global Temporary View is not behaving as expected

2017-04-24 Thread vincent gromakowski
; > *From: *Gene Pang <gene.p...@gmail.com> > *Date: *Monday, 24 April 2017 at 16.41 > *To: *vincent gromakowski <vincent.gromakow...@gmail.com> > *Cc: *Hemanth Gudela <hemanth.gud...@qvantel.com>, "user@spark.apache.org" > <user@spark.apache.org>, Felix Che

Re: Spark SQL - Global Temporary View is not behaving as expected

2017-04-24 Thread Hemanth Gudela
elixcheun...@hotmail.com> Subject: Re: Spark SQL - Global Temporary View is not behaving as expected As Vincent mentioned, Alluxio helps with sharing data across different Spark contexts. This blog post about Spark dataframes and Alluxio discusses that use case<https://alluxio.com/blog/effect

Re: Spark SQL - Global Temporary View is not behaving as expected

2017-04-24 Thread Gene Pang
;> >> >> >> Cross session is this context is multiple spark sessions from the same >> spark context. Since you are running two shells, you are having different >> spark context. >> >> >> >> Do you have to you a temp view? Could you create a t

Re: Spark SQL - Global Temporary View is not behaving as expected

2017-04-22 Thread vincent gromakowski
global temporary view, now > it’s clear J > > > > -Hemanth > > > > *From: *Felix Cheung <felixcheun...@hotmail.com> > *Date: *Saturday, 22 April 2017 at 11.05 > *To: *Hemanth Gudela <hemanth.gud...@qvantel.com>, "user@spark.apache.org" > <user@

Re: Spark SQL - Global Temporary View is not behaving as expected

2017-04-22 Thread Hemanth Gudela
t; <user@spark.apache.org> Subject: Re: Spark SQL - Global Temporary View is not behaving as expected Cross session is this context is multiple spark sessions from the same spark context. Since you are running two shells, you are having different spark context. Do you have to you a tem

Re: Spark SQL - Global Temporary View is not behaving as expected

2017-04-22 Thread Felix Cheung
gud...@qvantel.com<mailto:hemanth.gud...@qvantel.com>> Sent: Saturday, April 22, 2017 12:57 AM Subject: Spark SQL - Global Temporary View is not behaving as expected To: <user@spark.apache.org<mailto:user@spark.apache.org>> Hi, According to documentation<http://spark.apache.org/

Spark SQL - Global Temporary View is not behaving as expected

2017-04-22 Thread Hemanth Gudela
Hi, According to documentation, global temporary views are cross-session accessible. But when I try to query a global temporary view from another spark shell like this --> Instance 1 of spark-shell