Locking in HIVE : How to use locking/unlocking features using hive java API ?

Hi, I'm building / designing a back-up and restore tool for hive data for Disaster Recovery scenarios. I'm trying to understand the locking behavior of HIVE that is currently supporting ZooKeeper for locking. My thought process if like this ( early design.) 1. Backing up the meta-data of hive.

Re: Mapping existing HBase table with many columns to Hive.

Hello Swarnim, Thank you for your answer. I will try the options you pointed out. /David On Thu, Dec 6, 2012 at 9:10 PM, kulkarni.swar...@gmail.com < kulkarni.swar...@gmail.com> wrote: > map

Re: Mapping existing HBase table with many columns to Hive.

Hi David, First of all, you columns are not "long". They are binary as well. Currently as hive stands, there is no support for binary qualifiers. However, I recently submitted a patch for that[1]. Feel free to give it a shot and let me know if you see any issues. With that patch, you can directly

Re: Hive parallel execution deadlocks, need restart of yarn-nodemanager

You mentioned you only have one NodeManager. So, is hive generating 3 MapReduce jobs? And how many map and reduce tasks for each job? What is your yarn.nodemanager.resource.memory-mb? That determines the maximum number of containers you can run. You are running into an issue where all the job

Re: How is it that every hive release in maven depends on

These jars are pulled in by datanucleus which is a dependency of hive-metastore. The datanucleus project manages its own repositories for these jars: http://www.datanucleus.org/downloads/maven2 chris From: Edward Capriolo mailto:edlinuxg...@gmail.com>> Reply-To: "user@hive.apache.org

Mapping existing HBase table with many columns to Hive.

Hello, How can I map an HBase table with the following layout to Hive using the "CREATE EXTERNAL TABLE" command from shell (or another programmatic way): The HBase table's layout is as follows: Rowkey=16 bytes, a UUID that had the "-" removed, and the 32hex chars converted into two 8byte longs. C

Hive parallel execution deadlocks, need restart of yarn-nodemanager

Is there a known deadlock issue or bug when using Hive parallel execution with more parallel hive threads than there are computing nodemanagers ? On my test cluster, i have set Hive parallel excution to 2 or 3 threads, and have only 1 computing nodemanager with 5 cpu cores. When i run a hive re

RE: How to set an empty value to hive.querylog.location to disable the creation of hive history file

It’s not supported now. I think you a rise it in JIRA. Regards Ransom From: Bing Li [mailto:sarah.lib...@gmail.com] Sent: Thursday, December 06, 2012 5:06 PM To: user@hive.apache.org Subject: Re: How to set an empty value to hive.querylog.location to disable the creation of hive history file it

Re: handling null argument in custom udf

Right. Thanks for all the help. It turned out that it did help to check for null in the code. No mystery. I did try that earlier but the attempt got lost somehow. Thanks for the advise on using GenericUDF. cheers Søren On 05/12/2012 11:10, Vivek Mishra wrote: The way UDF works is, you need to

Re: How to set an empty value to hive.querylog.location to disable the creation of hive history file

it will exit with error like FAILED: Failed to open Query Log: /dev/null/hive_job_log_xxx.txt and pointed that the path is not a directory. 2012/12/6 Jithendranath Joijoide > How about setting it to /dev/null . Not sure if that would help in your > case. Just an hack. > > Regards. > > > On

Re: How to set an empty value to hive.querylog.location to disable the creation of hive history file

How about setting it to /dev/null . Not sure if that would help in your case. Just an hack. Regards. On Thu, Dec 6, 2012 at 2:14 PM, Bing Li wrote: > Hi, all > Refer to https://cwiki.apache.org/Hive/adminmanual-configuration.html, if > I set "hive.querylog.location" to an empty string, it won't

How to set an empty value to hive.querylog.location to disable the creation of hive history file

Hi, all Refer to https://cwiki.apache.org/Hive/adminmanual-configuration.html, if I set "hive.querylog.location" to an empty string, it won't create structured log. I filed hive-site.xml in HIVE_HOME/conf and add the following setting, hive.querylog.location BUT it didn't work, when launch