Unable to acces hive table (created through hive context) in hive console

Hi, I am new bee to Spark and using HDP 2.2 which comes with Spark 1.3.1 I tried following code example > import org.apache.spark.sql.SQLContext > val sqlContext = new org.apache.spark.sql.SQLContext(sc) > import sqlContext.implicits._ > > val personFile = "/user/hdfs/TestSpark/Person.csv" > val

RE: Create table from ORC or Parquet file?

Alex, It's no possible create ORC format table without columns. as well as Parquet hence parquet store visualization is like JSON. but it does not need to specify columns for creating a AVRO table, instead of specify a AVSC file to define table columns. Thanks, Link Qian From: apivova...@gmail

Fw: Managed to make Hive run on Spark engine

This is great news sir. It shows perseverance pays at last. Can you inform us when the write-up is ready so I can set it up as well please. I know a bit about the advantages of having Hive using Spark engine. However, the general question I have is when one should use Hive on spark as opposed to

Re: Quick Question

Thank you. From: Lefty Leverenz mailto:leftylever...@gmail.com>> Reply-To: "user@hive.apache.org" mailto:user@hive.apache.org>> Date: Friday, December 4, 2015 at 9:50 PM To: "user@hive.apache.org" mailto:user@hive.apache.org>> Subject: Re

Re: how to search the archive

On Mon, Dec 7, 2015 at 3:22 AM, Lefty Leverenz wrote: > I've been hoping someone else would answer the question about searching > the archives, but here's what I know: > >1. The Apache archives linked from Hive's mailing lists > page don't seem t

Beeline user default configuration

Hi, Does ~/.beeline/beeline.properties serve the same purpose as ~/.hiverc? I'd like to be able to apply a user specific configuration when the beeline CLI is started. Additionally, is it possible to provide a default connect string in either a configuration file or environment variable? Thanks -

Re: Hive | Beeline access with multiple host port

Thanks... On 7 Dec 2015 10:33 pm, "Takahiko Saito" wrote: > Hi, > > You may be able to take advantage of dynamic service discovery: > > http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_hadoop-ha/content/ha-hs2-service-discovery.html > > On Mon, Dec 7, 2015 at 3:04 AM, Shashi Vishwakarma

Re: Hive | Beeline access with multiple host port

Hi, You may be able to take advantage of dynamic service discovery: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_hadoop-ha/content/ha-hs2-service-discovery.html On Mon, Dec 7, 2015 at 3:04 AM, Shashi Vishwakarma wrote: > Hi > > down votefavorite >

Re: Storing the Hive Query Results into Variable

Thanks Dev. On 12/6/2015 8:17 PM, Devopam Mittra wrote: There are multiple ways of doing it. It will depend on your method of implementation as well. i.e. what is the platform you are using to fire the hive queries. Pig can do that for you (as already confirmed by another user) Shell scripts

Re: Managed to make Hive run on Spark engine

More and more people are beginning to use hive on spark. Congratulations! 2015-12-07 9:12 GMT+08:00 Link Qian : > congrats! > > Link Qian > > -- > Date: Sun, 6 Dec 2015 15:44:58 -0500 > Subject: Re: Managed to make Hive run on Spark engine > From: leftylever...@gmail.c

Hive | Beeline access with multiple host port

Hi down votefavorite Usually connecting HiveServer2 using beeline we pass hostnaime1 and port as connection property? Can we configure beeline in such a way that if my primary hostname is down then it shou