In Jerry's example, the first SparkContext, sc, has been stopped. So there would be only one SparkContext running at any given moment.
Cheers On Mon, Dec 21, 2015 at 8:23 AM, Chester @work <[email protected]> wrote: > Jerry > I thought you should not create more than one SparkContext within one > Jvm, ... > Chester > > Sent from my iPhone > > > On Dec 20, 2015, at 2:59 PM, Jerry Lam <[email protected]> wrote: > > > > Hi Spark developers, > > > > I found that SQLContext.getOrCreate(sc: SparkContext) does not behave > correctly when a different spark context is provided. > > > > ``` > > val sc = new SparkContext > > val sqlContext =SQLContext.getOrCreate(sc) > > sc.stop > > ... > > > > val sc2 = new SparkContext > > val sqlContext2 = SQLContext.getOrCreate(sc2) > > sc2.stop > > ``` > > > > The sqlContext2 will reference sc instead of sc2 and therefore, the > program will not work because sc has been stopped. > > > > Best Regards, > > > > Jerry > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
