Now my hbase is working fine now, but i am still getting the same error
[127.0.0.1:1] hive> CREATE TABLE hbase_table_1(key int, value string)
> STORED BY 'org.apache.hadoop.hive.hbase.
HBaseStorageHandler'
> WITH SERDEPROPERTIES ("hbase.columns.mapp
Seems you are right, Sometime I got this error while running hbase shell
command.
ibrar@ibrar-virtual-machine:/usr/local/hbase/bin$ ./hbase shell
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/local/hbase/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/Sta
Ibrar,
This seems to be an issue with the cluster rather than the integration
itself. Can you make sure that HBase is happy and healthy and all RS are up
and running?
On Wed, May 13, 2015 at 1:58 PM, Ibrar Ahmed wrote:
> Hi,
>
> I am creating a table using hive and getting this error.
>
> [127.
Here is my hbase-site.xml
hbase.rootdir
file:///usr/local/hbase
hbase.zookeeper.property.dataDir
/usr/local/hbase/zookeeperdata
And hive-site.xml
hive.aux.jars.path
file:///usr/local/hive/lib/zookeeper-3.4.5.jar,file:/usr/local/hive/lib/hive-hbase-handler-0
Hey Mohan,
Could you detail your question a little bit more? Hopefully the wiki
here[1] solves your queries.
[1] https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration
On Thu, Jan 1, 2015 at 2:38 PM, Mohan Krishna
wrote:
> Any body know Hive-HBase Integration process?
>
>
>
> Thanks
This did work, though specifying the same list in the HIVE_AUX_JARS_PATH
environment variable
or in a ‘set hive.aux.jars.path’ command does not work.
Thanks, I can work with this.
Brian
On Jun 24, 2014, at 11:49 PM, D K wrote:
> If the MR job is failing can you try the following on Hive CLI
If the MR job is failing can you try the following on Hive CLI before
running the query?
add jar $HBASE_HOME/lib/hbase-client--hadoop2.jar;
add jar $HBASE_HOME/lib/hbase-protocol--hadoop2.jar;
add jar $HBASE_HOME/lib/hbase-server--hadoop2.jar;
add jar $HBASE_HOME/lib/htrace-core-2.01.jar
replace
Brian,
I'm successfully using Hive/Hbase integration on CDH5 (Hive 0.12.0 and
Hbase 0.96.1)
Can you explain your setup and configuration in details?
Cheers,
Andre'
On 24 June 2014 02:14, Brian Jeltema wrote:
> I’m running Hive 0.12 on Hadoop V2 (Ambari installation) and have been
> trying to
For the first question, it's hive-hbase-handler, for the second question,
you can refer to
https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration
On Fri, Apr 18, 2014 at 1:05 AM, Shushant Arora
wrote:
> what is hive storage handlers?
> What are the best practices for hive hbase integr
Hi Guys,
Eventually, i got success to solve that issue. As you know, issue was
related with map-reduce jobs. Error was clearing saying, there was some
jar(class) is missing. So, i have create a temporary folder and copied some
jars file there. Fortunately, it's work for me. Kindly fine below steps
Hi buddy,
have gone through with given link. But no luck..
Actually i am working on HDP. Might be, there is some issue with yarn and
MR.
On Thu, Dec 26, 2013 at 10:10 PM, kulkarni.swar...@gmail.com <
kulkarni.swar...@gmail.com> wrote:
> Seems like you are running hive on yarn instead of mr1. I
Seems like you are running hive on yarn instead of mr1. I have had some
issues in the past doing so. The post here[1] has some solutions on how to
configure hive ot work with yarn. Hope that helps.
[1]
https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/gHVq9C5H6RE
On Thu, Dec 26, 20
Update:
When I remove *client_list Array*in both tables, it works fine.
So, the problem is how to join a shark table and a hbase table with
Array, Struct or Map ?
Any workaround here ?
Thank you.
Hao
Le 07/08/2013 10:09, Hao Ren a écrit :
Hi,
I have integrated hbase with Hive.
When join
Hi,
Now the Job Tracker log's
java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error
while processing row {"foo":98,"bar":"abc"}
at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:161)
at org.apache.hadoop.mapred.MapRunner.run
From: "Garg, Rinku"
To: "user@hive.apache.org" ; Bejoy Ks
Sent: Thursday, March 1, 2012 11:19 AM
Subject: RE: Hive | HBase Integration
Hi Bejoy,
We want to insert data into Hbase cluster. We are having data in CSV files. We
want to insert large number of CSV’s file
Bejoy.K.S
From: "Garg, Rinku"
To: "user@hive.apache.org" ; "bejoy...@yahoo.com"
Sent: Wednesday, February 29, 2012 11:19 AM
Subject: RE: Hive | HBase Integration
Hi Bejoy,
Thanks for the quick reply.
Yes, we can create normal
p.
Thanks
Rinku Garg
From: bejoy...@yahoo.com [mailto:bejoy...@yahoo.com]
Sent: 29 February 2012 11:08
To: user@hive.apache.org
Subject: Re: Hive | HBase Integration
Hi Rinku
Were you able to create a normal table within your hive without any issues? By
Normal table I mean the one that has d
2012 05:29:12
To: user@hive.apache.org; Bejoy Ks
Reply-To: user@hive.apache.org
Subject: RE: Hive | HBase Integration
Hi ,
We tried the same also by issuing the below mentioned command but command does
not executes completely and a new command line is shown with an asterisk (*),
and table doe
'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES
("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES ("hbase.table.name" =
"hivehbasek");
Please suggest.
Thanks
Rinku Garg
From: Bejoy Ks [mailto:bejoy...@yahoo.com]
Sent: 29 February 201
Hi Keshav
Make your hive table EXTERNAL, it should get things rolling. If you are
mapping hive to a Hbase table, then as a mandatory requirement the hive table
has to be EXTERNAL.
Hope it helps.
Regards
Bejoy.K.S
From: "Savant, Keshav"
To: "user@hive
Hi Bejoy,
Thank you so much for your help again..Your way of explaining
things is really great..And the query provided by you is working
absolutely fine.
Regards,
Mohammad Tariq
On Sun, Dec 18, 2011 at 12:35 AM, Bejoy Ks wrote:
> Hi Tariq
> From the stack trace, I believe the issue
Hi Tariq
From the stack trace, I believe the issue could be due to the fact that you
are just providing Column Families but no Qualifiers in
thehbase.columns.mapping. If you don't specify the qualifier for a column
family then the hive column would be mapped to all the Qualifiers correspondi
Gotcha. Thanks John. If I getting running I will let you know.
Original Message
Subject: Re: Hive-Hbase integration require Hbase in Pseudo
distributed??
From: John Sichi
Date: Fri, December 02, 2011 4:51 pm
To: ""
As you can guess from the 0.89 depende
t; I'm trying to get Hive to build against HBase 0.90 but Ivy wants to pull
> the 0.90 out of snapshots so trying to grab the jar file throws 404s.
>
>
> As a side note: the --auxpath seems unnecessary. The jars are already in
> the lib directory so it seems like they ought
0.90 but Ivy wants to pull
the 0.90 out of snapshots so trying to grab the jar file throws 404s.
As a side note: the --auxpath seems unnecessary. The jars are already in
the lib directory so it seems like they ought to be on the classpath
already.
Original Message
Subject:
Anyone there, cud you please confirm if I can use hive-hbase in
standalone mode???
will it work? or should i go for Pseudo distributed mode ?
Regards,
Mohammad Tariq
On Fri, Dec 2, 2011 at 5:54 PM, Alok Kumar wrote:
> hi,
>
> yeah i've used
>
> $HIVE_HOME/bin/hive --auxpath
> $HIVE_HOME/li
hi,
yeah i've used
$HIVE_HOME/bin/hive --auxpath
$HIVE_HOME/lib/hive-hbase-handler-*.jar,$HIVE_HOME/lib/hbase-*.jar,$HIVE_HOME/lib/zookeeper-*.jar
-hiveconf hbase.master=localhost:6
Hadoop version : hadoop-0.20.203.0
Hbase version : hbase-0.90.
Hi,
have you used following command to start the hive shell.
$HIVE_HOME/bin/hive --auxpath
$HIVE_HOME/lib/hive-hbase-handler-*.jar,$HIVE_HOME/lib/hbase-*.jar,$HIVE_HOME/lib/zookeeper-*.jar
-hiveconf hbase.master=127.0.0.1:6
If no then used above command.
Regards,
Ankit
On Fri, Dec 2, 2011 a
Hi,
// Hadoop core-site.xml
fs.default.name
hdfs://localhost:9000
hadoop.tmp.dir
/home/alokkumar/hadoop/tmp
// hbase-site.xml
hbase.rootdir
file:///home/alokkumar/hbase/
with these conf Hbase/Hive are
HI,
Can you post the Hbase-site.xml and hadoop core-site.xml properties here.
Regards,
Ankit
On Fri, Dec 2, 2011 at 3:30 PM, Alok Kumar wrote:
> Hi Ankit,
>
> you were right, my Hbase shell/HMaster was not running though it was
> coming in jps :)
>
> nw i've run my HMaster n Hbase shell is up.
Hi Ankit,
you were right, my Hbase shell/HMaster was not running though it was coming
in jps :)
nw i've run my HMaster n Hbase shell is up.. n getting this error--
Do I need zookeeper configured in standalone mode?
hive> CREATE TABLE hbase_table_1(key int, value string)
> STORED BY 'org.apac
I am facing the same problem, the master is running though. I am able
to create tables directly through Hbase and Hive shell, but when I am
trying to do it using Hive and Hbase together I am facing this
problem. I am using Hbase-0.90.4 and Hive-0.7.0
Regards,
Mohammad Tariq
On Fri, Dec 2, 2
I think your hbase master is not running.
Open the hive shell and run command :
hbase> status
On Fri, Dec 2, 2011 at 2:00 PM, Alok Kumar wrote:
> Hi,
>
> Does Hive-Hbase integration require Hbase running in pseudo-distributed
> mode?
>
> I've build my Hadoop following this article
> http://www
Please go through this blog ..
http://ankitasblogger.blogspot.com/2011/01/installing-hbase-in-cluster-complete.html
On Tue, Nov 29, 2011 at 2:11 PM, shashwat shriparv <
dwivedishash...@gmail.com> wrote:
> Hey Ankit, Thanks. my host file i tried using 127.0.0.1 still same
> problem, can you please
Hey Ankit, Thanks. my host file i tried using 127.0.0.1 still same problem,
can you please tell me what should be there in the host file now my host
file contains following entries:
192.168.2.125 shashwat.pointcrossblr ubuntu
127.0.0.1 localhost
#127.0.0.1localhost
#192.168.2.125ubuntu.
Hi,
Please use 127.0.0.1 instead of ubuntu.ubuntu-domain .
or Open the Hbase shell and run command 'status'.
On Tue, Nov 29, 2011 at 1:34 PM, shashwat shriparv <
dwivedishash...@gmail.com> wrote:
> I have followed
> https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration my
> hbase is
yes !
I used the Cloudera CDH3 distribution whcih already includes HBase, Hive,
Pig, Hadoop tested & integrated !
Works like a charm !
It saved my day :)
https://ccp.cloudera.com/display/CDHDOC/CDH3+Installation+Guide
hope it will save your day too ;-)
shazz
On Wed, Sep 14, 2011 at 7:32 AM, Na
Hi Carl,
Thank you very much!
Cheers, Neerja
On Tue, Aug 2, 2011 at 11:31 PM, Carl Steinbach wrote:
> Hi Neerja,
>
> Ordinarily a POM for the hive-hbase-handler would be available
> from Cloudera's Maven repository, but it looks like we haven't
> generated one. We will get this resolved in CDH
Hi Neerja,
Ordinarily a POM for the hive-hbase-handler would be available
from Cloudera's Maven repository, but it looks like we haven't
generated one. We will get this resolved in CDH3u2. You can
track progress on this issue here:
https://issues.cloudera.org/browse/DISTRO-286
thrift-fb303-0.5.
Hi,
I am also trying the same but don't know the exact build steps. Someone please
tell the same.
-regards
Amit
From: Jean-Charles Thomas
To: Hive mailing list
Sent: Tue, 22 March, 2011 11:40:18 AM
Subject: Hive/hbase integration - Rebuild the Storage Handle
Look at this line in ivy/libraries.properties:
hbase.version=0.89.0-SNAPSHOT
The jars would be downloaded to:
./build/ivy/lib/default/hbase-0.89.0-SNAPSHOT-tests.jar
./build/ivy/lib/default/hbase-0.89.0-SNAPSHOT.jar
After changing hbase.version, I saw:
[ivy:resolve] :: problems summary ::
[ivy:r
Jean-Daniel Cryans wrote:
Can you confirm that the machine you're running hive from can "telnet
192.168.1.101 2181" and pals? Can it even ping? If not, then either
the problem is that the machine cannot reach your zookeeper servers or
they aren't running. There's not that many other options.
J-D
Can you confirm that the machine you're running hive from can "telnet
192.168.1.101 2181" and pals? Can it even ping? If not, then either
the problem is that the machine cannot reach your zookeeper servers or
they aren't running. There's not that many other options.
J-D
Jean-Daniel Cryans wrote:
Sorry it that wasn't obvious, but you need to run hive using this command:
I am extremely Sorry Sir.
As per your instructions I am sending you the output of the create table
command.
Please check the attachment.
Thanks & Warm Regards
Adarsh Sharma
bin/hive
Jean-Daniel Cryans wrote:
Sorry it that wasn't obvious, but you need to run hive using this command:
bin/hive -hiveconf hive.root.logger=INFO,console
AND in the same shell create the table in order to have more
information. What we're trying to get looks like this:
http://pastebin.com/gvTXDxtE
Sorry it that wasn't obvious, but you need to run hive using this command:
bin/hive -hiveconf hive.root.logger=INFO,console
AND in the same shell create the table in order to have more
information. What we're trying to get looks like this:
http://pastebin.com/gvTXDxtE
Specifically, this line is
Dear all,
Sorry I am replying my own question because I found the cause and want
to discuss if anyone have an idea about it.
From the wiki's page I found that :
http://wiki.apache.org/hadoop/Hive/HBaseIntegration
*
Jean-Daniel Cryans wrote:
You also need to create the table in order to see the relevant debug
information, it won't create it until it needs it.
Sir
Check the output :
hive> CREATE TABLE hive_hbasetable_k(key int, value string)
> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandl
You also need to create the table in order to see the relevant debug
information, it won't create it until it needs it.
J-D
On Jan 9, 2011 9:30 PM, "Adarsh Sharma" wrote:
> Jean-Daniel Cryans wrote:
>> Just figured that running the shell with this command will give all
>> the info you need:
>>
>>
Jean-Daniel Cryans wrote:
Just figured that running the shell with this command will give all
the info you need:
bin/hive -hiveconf hive.root.logger=INFO,console
Thanks JD, below is the output of this command :
had...@s2-ratw-1:~/project/hive-0.6.0/build/dist$ bin/hive -hiveconf
hive.roo
Viral Bajaria wrote:
Hi Adarsh,
Can you provide some more details as follows. I have had issues before
on communicating between my HMaster etc. but the initial issue was
ACL(s) and my zookeeper settings were a little messed up too (I can't
recollect what was wrong with zookeeper). I would su
Hi Adarsh,
Can you provide some more details as follows. I have had issues before on
communicating between my HMaster etc. but the initial issue was ACL(s) and
my zookeeper settings were a little messed up too (I can't recollect what
was wrong with zookeeper). I would suggest that you get things u
Just figured that running the shell with this command will give all
the info you need:
bin/hive -hiveconf hive.root.logger=INFO,console
J-D
On Fri, Jan 7, 2011 at 9:57 AM, Jean-Daniel Cryans wrote:
> While testing other things yesterday on my local machine, I
> encountered the same stack traces
While testing other things yesterday on my local machine, I
encountered the same stack traces. Like I said the other day, which
you seem to have discarded while debugging your issue, is that it's
not able to connect to Zookeeper.
Following the cue, I added these lines in HBaseStorageHandler.setCon
John Sichi wrote:
On Jan 6, 2011, at 9:53 PM, Adarsh Sharma wrote:
I want to know why it occurs in hive.log
2011-01-05 15:19:36,783 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle
"org.eclipse.jdt.core" requires "org.eclipse.core.resources" but it cannot be
resolved.
On Jan 6, 2011, at 9:53 PM, Adarsh Sharma wrote:
> I want to know why it occurs in hive.log
>
> 2011-01-05 15:19:36,783 ERROR DataNucleus.Plugin
> (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
> "org.eclipse.core.resources" but it cannot be resolved.
>
That is a bogus
John Sichi wrote:
Here is what you need to do:
1) Use svn to check out the source for Hive 0.6
I download Hive-0.6.0 source code with the command
svn co http://svn.apache.org/repos/asf/hive/branches/branch-0.6/ hive-0.6.0
2) In your checkout, replace the HBase 0.20.3 jars with the ones f
Here is what you need to do:
1) Use svn to check out the source for Hive 0.6
2) In your checkout, replace the HBase 0.20.3 jars with the ones from 0.20.6
3) Build Hive 0.6 from source
4) Use your new Hive build
JVS
On Jan 6, 2011, at 2:34 AM, Adarsh Sharma wrote:
> Dear all,
>
> I am sorry
Added 1 post at:
http://mevivs.wordpress.com/2010/11/24/hivehbase-integration/
Sharing it if is useful.
Vivek
-Original Message-
From: Vivek Mishra
Sent: Friday, November 19, 2010 10:36 AM
To:
Subject: RE: Hive/HBase integration issue.
Hi,
Just found that, It is related to HIVE-1264
Hi,
Just found that, It is related to HIVE-1264 JIRA. Thanks for all help.
Vivek
-Original Message-
From: John Sichi [mailto:jsi...@fb.com]
Sent: Friday, November 19, 2010 1:02 AM
To:
Subject: Re: Hive/HBase integration issue.
This is unrelated to Hive/HBase integration; it looks like
As noted here, when writing to HBase, existing rows are overwritten, but old
rows are not deleted.
http://wiki.apache.org/hadoop/Hive/HBaseIntegration#Overwrite
There is not yet any deletion support.
JVS
On Nov 18, 2010, at 1:00 AM, afancy wrote:
> Hi,
>
> Does the INSERT clause have to in
This is unrelated to Hive/HBase integration; it looks like a Hadoop version
issue.
JVS
On Nov 17, 2010, at 9:56 PM, Vivek Mishra wrote:
> Hi,
> Currently I am facing an issue with Hive/HBase integration.
>
> Exception in thread "main" java.lang.NoSuchMethodError:
> org.apache.hadoop.util.She
Hi,
Does the INSERT clause have to include the OVERWRITE, which means that the
new data will overwrite the previous data? How to implement the indeed
INSERT operation, instead of OVERWRITE?
BTW: How to implement the DELETE operator? thanks
afancy
--
63 matches
Mail list logo
