Re: HiveContext standalone => without a Hive metastore

2016-05-30 Thread Michael Segel
om the classpath, > but that shouldn’t be an issue since you said it’s standalone (not a Hadoop > distro right?). > > > > Thanks, > > Silvio > > > > From: Gerard Maas <gerard.m...@gmail.com <mailto:gerard.m...@gmail.com>> > Date:

Re: HiveContext standalone => without a Hive metastore

2016-05-30 Thread Gerard Maas
;> http://talebzadehmich.wordpress.com >>>> >>>> >>>> >>>> On 26 May 2016 at 13:01, Silvio Fiorito <silvio.fior...@granturing.com> >>>> wrote: >>>> >>>>> Hi Gerard, >>>>> >>&g

Re: HiveContext standalone => without a Hive metastore

2016-05-26 Thread Michael Armbrust
t;> >>>> >>>> I’ve never had an issue using the HiveContext without a hive-site.xml >>>> configured. However, one issue you may have is if multiple users are >>>> starting the HiveContext from the same path, they’ll all be trying to st

Re: HiveContext standalone => without a Hive metastore

2016-05-26 Thread Gerard Maas
t could be is Hive dependency collisions from the >> classpath, but that shouldn’t be an issue since you said it’s standalone >> (not a Hadoop distro right?). >> >> >> >> Thanks, >> >> Silvio >> >> >> >> *From: *Gerard Maas <

Re: HiveContext standalone => without a Hive metastore

2016-05-26 Thread Mich Talebzadeh
o right?). > > > > Thanks, > > Silvio > > > > *From: *Gerard Maas <gerard.m...@gmail.com> > *Date: *Thursday, May 26, 2016 at 5:28 AM > *To: *spark users <user@spark.apache.org> > *Subject: *HiveContext standalone => without a Hive meta

Re: HiveContext standalone => without a Hive metastore

2016-05-26 Thread Silvio Fiorito
From: Gerard Maas <gerard.m...@gmail.com> Date: Thursday, May 26, 2016 at 5:28 AM To: spark users <user@spark.apache.org> Subject: HiveContext standalone => without a Hive metastore Hi, I'm helping some folks setting up an analytics cluster with Spark. They want to use the HiveCo

Re: HiveContext standalone => without a Hive metastore

2016-05-26 Thread Mich Talebzadeh
Hi Gerald, I am not sure the so called independence is will. I gather you want to use HiveContext for your SQL queries and sqlContext only provides a subset of HiveContext. try this val sc = new SparkContext(conf) // Create sqlContext based on HiveContext val sqlContext = new

HiveContext standalone => without a Hive metastore

2016-05-26 Thread Gerard Maas
Hi, I'm helping some folks setting up an analytics cluster with Spark. They want to use the HiveContext to enable the Window functions on DataFrames(*) but they don't have any Hive installation, nor they need one at the moment (if not necessary for this feature) When we try to create a Hive