Re: How to create SparkSession using SparkConf?

2017-04-28 Thread madhu phatak
t;>> Could you try the following way? >>>> >>>> val spark = >>>> SparkSession.builder.appName("my-application").config("spark.jars", >>>> "a.jar, b.jar").getOrCreate() >>>> >>>> >>>>

Re: How to create SparkSession using SparkConf?

2017-04-28 Thread Yanbo Liang
"spark.jars", "a.jar, >>> b.jar").getOrCreate() >>> >>> >>> Thanks >>> >>> Yanbo >>> >>> >>> On Thu, Apr 27, 2017 at 9:21 AM, kant kodali <kanth...@gmail.com> wrote: >>> >>>>

Re: How to create SparkSession using SparkConf?

2017-04-27 Thread kant kodali
;> Thanks >> >> Yanbo >> >> >> On Thu, Apr 27, 2017 at 9:21 AM, kant kodali <kanth...@gmail.com> wrote: >> >>> I am using Spark 2.1 BTW. >>> >>> On Wed, Apr 26, 2017 at 3:22 PM, kant kodali <kanth...@gmail.com> wrote: >>&g

Re: How to create SparkSession using SparkConf?

2017-04-27 Thread kant kodali
t 3:22 PM, kant kodali <kanth...@gmail.com> wrote: >> >>> Hi All, >>> >>> I am wondering how to create SparkSession using SparkConf object? >>> Although I can see that most of the key value pairs we set in SparkConf we >>> can also set in Spark

Re: How to create SparkSession using SparkConf?

2017-04-27 Thread Yanbo Liang
1 BTW. > > On Wed, Apr 26, 2017 at 3:22 PM, kant kodali <kanth...@gmail.com> wrote: > >> Hi All, >> >> I am wondering how to create SparkSession using SparkConf object? >> Although I can see that most of the key value pairs we set in SparkConf w

Re: How to create SparkSession using SparkConf?

2017-04-26 Thread kant kodali
I am using Spark 2.1 BTW. On Wed, Apr 26, 2017 at 3:22 PM, kant kodali <kanth...@gmail.com> wrote: > Hi All, > > I am wondering how to create SparkSession using SparkConf object? Although > I can see that most of the key value pairs we set in SparkConf we can also >

How to create SparkSession using SparkConf?

2017-04-26 Thread kant kodali
Hi All, I am wondering how to create SparkSession using SparkConf object? Although I can see that most of the key value pairs we set in SparkConf we can also set in SparkSession or SparkSession.Builder however I don't see sparkConf.setJars which is required right? Because we want the driver jar