答复: 答复: Using Spark on Hive with Hive also using Spark as its execution engine

It is specific to HoS 发件人: Mich Talebzadeh [mailto:mich.talebza...@gmail.com] 发送时间: 2016年7月14日 11:55 收件人: user 主题: Re: 答复: Using Spark on Hive with Hive also using Spark as its execution engine Hi Wenli, You mentioned: Coming to HoS, I think the main problem now is many optimization should be

Re: Any way in hive to have functionality like SQL Server collation on Case sensitivity

You can use use any Java function in Hive without (!) the need to wrap it in an UDF via the reflect command. however not sure if this meets your use case. Sent from my iPhone > On 13 Jul 2016, at 19:50, Markovitz, Dudu wrote: > > Hi > > I’m personally not aware of other methods to achieve

msck repair table and hive v2.1.0

hey guys, i'm using hive version 2.1.0 and i can't seem to get msck repair table to work. no matter what i try i get the 'ol NPE. I've set the log level to 'DEBUG' but yet i still am not seeing any smoking gun. would anyone here have any pointers or suggestions to figure out what's going wrong?

Re: can't start up hive 2.1 hiveserver2/metastore services

Hi qiuzhuang hive is a bash file. try running it with sh -x $HIVE_HOME/bin/hive --service metastore To see where it is failing. In general I source the environment file before running the query. I am on Hive 2 and it works. Have not tried Hive 2.1 #!/bin/ksh ENVFILE=/home/hduser/dba/bin/envi

Re: 答复: Using Spark on Hive with Hive also using Spark as its execution engine

Hi Wenli, You mentioned: Coming to HoS, I think the main problem now is many optimization should be done , but seems no progress. Like conditional task , union sql cann’t convert to mapjoin(hive-9044) etc, so many optimize feature is pending, no one working on them. Is this issue specific t

Re: can't start up hive 2.1 hiveserver2/metastore services

Hi Mich, I have to use this command: bin/hive --service metastore then it works. While setting HIVE_HOME and add hive bin path, then issue command as follows, hive --service metastore it would breaks. I think shell under bin should be improved to address this? Regards, qiuzhuang On Thu,

答复: Using Spark on Hive with Hive also using Spark as its execution engine

Seems LLAP like tachyon, which purpose is also cache data between applications. Coming to HoS, I think the main problem now is many optimization should be done , but seems no progress. Like conditional task , union sql cann’t convert to mapjoin(hive-9044) etc, so many optimize feature is pen

RE: Any way in hive to have functionality like SQL Server collation on Case sensitivity

Hi I’m personally not aware of other methods to achieve case insensitivity comparison but to use lower() / upper() Dudu From: Mahender Sarangam [mailto:mahender.bigd...@outlook.com] Sent: Wednesday, July 13, 2016 12:56 AM To: user@hive.apache.org Subject: Re: Any way in hive to have functionali

Re: can't start up hive 2.1 hiveserver2/metastore services

Can hardly read the image :) Did you start the metastore before? $HIVE_HOME/bin/hive --service metastore & Assuming it is running on default port 9083 do you see the process netstat -alnp|egrep 'Local|9083' and then the same for Hive thrift server $HIVE_HOME/bin/hiveserver2 & By default th

Re: can't start up hive 2.1 hiveserver2/metastore services

Thanks, I can start hivesever2&metastore with hive 1.2.1 before. This error happened to 2.X. The error indicates that it throws ClassNotFound exception with service-rpc-*.jar. Thanks. Qiuzhuang On Thu, Jul 14, 2016 at 12:39 AM, Mich Talebzadeh wrote: > Can hardly read the image :) > > Did you s

Fwd: can't start up hive 2.1 hiveserver2/metastore services

We download hive 2.1 and run into errors when starting to metastore/hiveserver2 services, here is the errors, Any clues? Regards, Qiuzhuang [image: Inline image 1]

Hive authentication and authorisation in AWS.

Hello, I am attempting to setup a long running, shared Hive metastore in AWS. The intention is to have this serve as the core repository of metadata for shared datasets across multiple AWS accounts. Users will be able to spin up their own short-lived EMR clusters, Spark jobs, etc. and then locate

Re: Verifying Hive execution engine used within a session

Please send a brief message to Unsubscribe: user-unsubscr...@hive.apache.org in here HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Verifying Hive execution engine used within a session

Unsubscribe Sincerely, Robin Jain > On Jul 13, 2016, at 3:22 AM, Mich Talebzadeh > wrote: > > Nice one Shaw > > hive> set hive.execution.engine; > hive.execution.engine=mr > > Thanks > > Dr Mich Talebzadeh > > LinkedIn > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6

Re: Verifying Hive execution engine used within a session

Nice one Shaw hive> set hive.execution.engine; hive.execution.engine=mr Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzad

Re: Verifying Hive execution engine used within a session

Hi, try set hive.execution.engine; 2016-07-13 18:08 GMT+08:00 Mich Talebzadeh : > May be a naive question > > Is there any parameter to display the default execution engine used by > Hive say, MR, Spark or Tez in the current session. > > Of course one can find it out by running a job in a session

Verifying Hive execution engine used within a session

May be a naive question Is there any parameter to display the default execution engine used by Hive say, MR, Spark or Tez in the current session. Of course one can find it out by running a job in a session. However, is there such setting like show execution.engine This should be dynamic as one