Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

The way that we do this is to have a single context with a server in front that multiplexes jobs that use that shared context. Even if you aren't sharing data this is going to give you the best fine grained sharing of the resources that the context is managing. On Fri, Dec 11, 2015 at 10:55 AM,

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

Thanks for the insight! ___ *Mike Wright* Principal Architect, Software Engineering S Capital IQ and SNL 434-951-7816 *p* 434-244-4466 *f* 540-470-0119 *m* mwri...@snl.com On Fri, Dec 11, 2015 at 2:38 PM, Michael Armbrust wrote: > The way that we do

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

Somewhat related - What's the correct implementation when you have a single cluster to support multiple jobs that are unrelated and NOT sharing data? I was directed to figure out, via job server, to support "multiple contexts" and explained that multiple contexts per JVM is not really supported.

is Multiple Spark Contexts is supported in spark 1.5.0 ?

Hi I want to create multiple sparkContext in my application. i read so many articles they suggest " usage of multiple contexts is discouraged, since SPARK-2243 is still not resolved." i want to know that Is spark 1.5.0 supported to create multiple contexts without error ? and if

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

le sparkContext in my application. > i read so many articles they suggest " usage of multiple contexts is > discouraged, since SPARK-2243 is still not resolved." > i want to know that Is spark 1.5.0 supported to create multiple contexts > without error ? >

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

On Fri, Dec 4, 2015 at 11:24 AM, Anfernee Xu wrote: > If multiple users are looking at the same data set, then it's good choice > to share the SparkContext. > > But my usercases are different, users are looking at different data(I use > custom Hadoop InputFormat to load

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

i read so many articles they suggest " usage of multiple contexts is >> discouraged, since SPARK-2243 is still not resolved." >> i want to know that Is spark 1.5.0 supported to create multiple contexts >> without error ? >> and if supported then are we ne

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

t; >>> Cheers >>> >>> On Fri, Dec 4, 2015 at 9:46 AM, prateek arora < >>> prateek.arora...@gmail.com> wrote: >>> >>>> Hi >>>> >>>> I want to create multiple sparkContext in my application. >>&g

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

; Cheers >> >> On Fri, Dec 4, 2015 at 9:46 AM, prateek arora <prateek.arora...@gmail.com >> > wrote: >> >>> Hi >>> >>> I want to create multiple sparkContext in my application. >>> i read so many articles they suggest " usage of

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

; >>>> Cheers >>>> >>>> On Fri, Dec 4, 2015 at 9:46 AM, prateek arora < >>>> prateek.arora...@gmail.com> wrote: >>>> >>>>> Hi >>>>> >>>>> I want to create multiple sparkContext in my applica

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

gt;>>> >>>>> >>>>> http://search-hadoop.com/m/q3RTt1z1hUw4TiG1=Re+Question+about+yarn+cluster+mode+and+spark+driver+allowMultipleContexts >>>>> >>>>> Cheers >>>>> >>>>> On Fri, Dec 4, 2015 at 9:46

Re: is Multiple Spark Contexts is supported in spark 1.5.0 ?

/m/q3RTt1z1hUw4TiG1=Re+Question+about+yarn+cluster+mode+and+spark+driver+allowMultipleContexts >>>>> >>>>> Cheers >>>>> >>>>> On Fri, Dec 4, 2015 at 9:46 AM, prateek arora < >>>>> prateek.arora...@gmail.com> wrote: >>>