Hi Guys
When doing hive to hbase integration, we have observed that current Apache
Hive 2.x is not able to recognise 'NULL::character varying' (Variant data type
of NULL in prostgres) properly and throws the java.lang.ClassNotFoundException
exception.
Exception:
FAILED: RuntimeException
p{margin-top:0px;margin-bottom:0px;} Hi, Hive user mailing list memebers,
I am testing Hive-HBase integration on a Hadoop cluster.
The cluster uses CDH5.4.4 with Kerberos enabled.
Following the documentation of Cloudera and Apache HiveHBaseIntegration, I
installed
hive-hbase package
Now my hbase is working fine now, but i am still getting the same error
[127.0.0.1:1] hive CREATE TABLE hbase_table_1(key int, value string)
STORED BY 'org.apache.hadoop.hive.hbase.
HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping
Hi,
I am creating a table using hive and getting this error.
[127.0.0.1:1] hive CREATE TABLE hbase_table_1(key int, value string)
STORED BY
'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES (hbase.columns.mapping =
Seems you are right, Sometime I got this error while running hbase shell
command.
ibrar@ibrar-virtual-machine:/usr/local/hbase/bin$ ./hbase shell
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
Ibrar,
This seems to be an issue with the cluster rather than the integration
itself. Can you make sure that HBase is happy and healthy and all RS are up
and running?
On Wed, May 13, 2015 at 1:58 PM, Ibrar Ahmed ibrar.ah...@gmail.com wrote:
Hi,
I am creating a table using hive and getting
Here is my hbase-site.xml
configuration
property
namehbase.rootdir/name
valuefile:///usr/local/hbase/value
/property
property
namehbase.zookeeper.property.dataDir/name
value/usr/local/hbase/zookeeperdata/value
/property
/configuration
And hive-site.xml
configuration
access to the hive wiki in order to update the
hive/hbase integration docs (
https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration).
Specifically I'd like to:
1. Add documentation about compound key support
(the only statement on the wiki right now is there must be exactly
one
all,
Could I get edit access to the hive wiki in order to update the hive/hbase
integration docs (
https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration).
Specifically I'd like to:
1. Add documentation about compound key support
(the only statement on the wiki right now
Hi all,
Could I get edit access to the hive wiki in order to update the
hive/hbase integration docs
(https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration).
Specifically I'd like to:
1. Add documentation about compound key support
(the only statement on the wiki right now
-Howtogetpermissiontoedit).
-- Lefty
On Thu, Apr 30, 2015 at 7:07 PM, Andrew Mains
andrew.ma...@kontagent.com mailto:andrew.ma...@kontagent.com wrote:
Hi all,
Could I get edit access to the hive wiki in order to update the
hive/hbase integration docs
(https://cwiki.apache.org
Hey Mohan,
Could you detail your question a little bit more? Hopefully the wiki
here[1] solves your queries.
[1] https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration
On Thu, Jan 1, 2015 at 2:38 PM, Mohan Krishna mohan.25fe...@gmail.com
wrote:
Any body know Hive-HBase Integration
Any body know Hive-HBase Integration process?
Thanks
Mohan
The url for the hbase-hive integration:
https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration
has old versions: Hbase 0.92.0 and hadoop 0.20.x
Are there any significant changes to these docs that anyone might (a) have
pointers to or (b) be able/willing to mention here as important
This did work, though specifying the same list in the HIVE_AUX_JARS_PATH
environment variable
or in a ‘set hive.aux.jars.path’ command does not work.
Thanks, I can work with this.
Brian
On Jun 24, 2014, at 11:49 PM, D K deepe...@gmail.com wrote:
If the MR job is failing can you try the
Brian,
I'm successfully using Hive/Hbase integration on CDH5 (Hive 0.12.0 and
Hbase 0.96.1)
Can you explain your setup and configuration in details?
Cheers,
Andre'
On 24 June 2014 02:14, Brian Jeltema brian.jelt...@digitalenvoy.net wrote:
I’m running Hive 0.12 on Hadoop V2 (Ambari
If the MR job is failing can you try the following on Hive CLI before
running the query?
add jar $HBASE_HOME/lib/hbase-client-version-hadoop2.jar;
add jar $HBASE_HOME/lib/hbase-protocol-version-hadoop2.jar;
add jar $HBASE_HOME/lib/hbase-server-version-hadoop2.jar;
add jar
I’m running Hive 0.12 on Hadoop V2 (Ambari installation) and have been trying
to use HBase integration. Hive generated Map/Reduce jobs
are failing with:
Error: java.lang.ClassNotFoundException:
org.apache.hadoop.hbase.mapreduce.TableSplit
this is discussed in several discussion threads, but
what is hive storage handlers?
What are the best practices for hive hbase integration?
practices for hive hbase integration?
--
Regards
Shengjun
Hi Guys,
Eventually, i got success to solve that issue. As you know, issue was
related with map-reduce jobs. Error was clearing saying, there was some
jar(class) is missing. So, i have create a temporary folder and copied some
jars file there. Fortunately, it's work for me. Kindly fine below
Seems like you are running hive on yarn instead of mr1. I have had some
issues in the past doing so. The post here[1] has some solutions on how to
configure hive ot work with yarn. Hope that helps.
[1]
https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/gHVq9C5H6RE
On Thu, Dec 26,
Hi buddy,
have gone through with given link. But no luck..
Actually i am working on HDP. Might be, there is some issue with yarn and
MR.
On Thu, Dec 26, 2013 at 10:10 PM, kulkarni.swar...@gmail.com
kulkarni.swar...@gmail.com wrote:
Seems like you are running hive on yarn instead of mr1. I
Hi,
I have integrated hbase with Hive.
When joining a shark table with a hbase table.
It throws an exception:
java.lang.ClassCastException:
org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryArray cannot be cast
to [Ljava.lang.Object;
at
Update:
When I remove *client_list Arraystring*in both tables, it works fine.
So, the problem is how to join a shark table and a hbase table with
Array, Struct or Map ?
Any workaround here ?
Thank you.
Hao
Le 07/08/2013 10:09, Hao Ren a écrit :
Hi,
I have integrated hbase with Hive.
+szfnexgcat8caqtovf8j...@mail.gmail.com%3E
Mark
On Mon, Nov 5, 2012 at 6:53 AM, Cheng Su scarcer...@gmail.com wrote:
Hi, all. I have a hive+hbase integration cluster.
When I try to execute query through the java client of hive, sometimes
a ClassNotFoundException happens.
My java code
...@gmail.com wrote:
Hi, all.
I have a hive + hbase integration cluster. I met a performance issue.
I executed some complicated hql, but only the first one is actually running.
The rests are showed running on the job track web ui, but task
attempt failed with exceptions below:
java.io.IOException
Hi, all. I have a hive+hbase integration cluster.
When I try to execute query through the java client of hive, sometimes
a ClassNotFoundException happens.
My java code :
final Connection conn = DriverManager.getConnection(URL);
final ResultSet rs = conn.executeQuery(SELECT count(*) FROM
...@mail.gmail.com%3E
Mark
On Mon, Nov 5, 2012 at 6:53 AM, Cheng Su scarcer...@gmail.com wrote:
Hi, all. I have a hive+hbase integration cluster.
When I try to execute query through the java client of hive, sometimes
a ClassNotFoundException happens.
My java code :
final Connection conn
it in aux_lib. See
this thread for reference:
http://mail-archives.apache.org/mod_mbox/hive-user/201103.mbox/%3caanlktingqlgknqmizgoi+szfnexgcat8caqtovf8j...@mail.gmail.com%3E
Mark
On Mon, Nov 5, 2012 at 6:53 AM, Cheng Su scarcer...@gmail.com wrote:
Hi, all. I have a hive+hbase integration cluster
location.
Regards,
Bejoy KS
From: ashok.sa...@wipro.com ashok.sa...@wipro.com
To: user@hive.apache.org
Sent: Wednesday, September 12, 2012 8:55 AM
Subject: RE: Performance: hive+hbase integration query against the row_key
after loading the data into hive
Yes bejoy i did it today and it's working. But i was thinking by setting some
property we can achieve it.
Is there anything like that?
Thanks
Ashok
From: Bejoy KS [mailto:bejoy...@yahoo.com]
Sent: 13 September 2012 02:40
To: user@hive.apache.org
Subject: Re: Performance: hive+hbase integration
: Performance: hive+hbase integration query against the row_key
Yes bejoy i did it today and it’s working. But i was thinking by setting some
property we can achieve it.
Is there anything like that?
Thanks
Ashok
From:Bejoy KS [mailto:bejoy...@yahoo.com]
Sent: 13 September 2012 02:40
To: user
Hi,
I am trying to get hive working on top of my hbase table following the
guide below:
https://cwiki.apache.org/Hive/hbaseintegration.html
CREATE EXTERNAL TABLE hive_hbase_test (key string, a string, b string, c
string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH
Hey,
Hive does all kinds of parsing , metadata lookups, query tree building and
stuff before executing the query. Not sure if this all was included in
those 36 seconds !
Also what hive does is, it builds a scan object with ranges based on
predicates (and mappers too ) on key column and not a
On Sep 11, 2012, at 7:00 AM, bharath vissapragada wrote:
Hey,
Hive does all kinds of parsing , metadata lookups, query tree building and
stuff before executing the query. Not sure if this all was included in those
36 seconds !
Also what hive does is, it builds a scan object with
after loading the data into hive tables, the files gets automatically deleted
from HDFS...how to stop that?
Thanks
Ashok
-Original Message-
From: Alan Gates [mailto:ga...@hortonworks.com]
Sent: 12 September 2012 06:51
To: user@hive.apache.org
Subject: Re: Performance: hive+hbase
Hi,
I want to integrate Hive and Hbase Tables. I created a table in hive using
Stored By.
When i try to load data into that table using
INSERT OVERWRITE TABLE hbase_table_1 SELECT * FROM pokes;
I got the following exceptions,
FAILED: Execution Error, return code 2 from
Hi,
Now the Job Tracker log's
java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error
while processing row {foo:98,bar:abc}
at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:161)
at
: Garg, Rinku rinku.g...@fisglobal.com
To: user@hive.apache.org user@hive.apache.org; Bejoy Ks
bejoy...@yahoo.com
Sent: Thursday, March 1, 2012 11:19 AM
Subject: RE: Hive | HBase Integration
Hi Bejoy,
We want to insert data into Hbase cluster. We are having data in CSV files. We
want to insert
looking st some specific operation here?
· If we have to use hbase through hive then how can we proceed?
AFAIK, the hive Hbase integration is meant to query data from Hbase alone. For
inserts and updates in Hbase tables you need to use the Hbase APIs itself.
Regards
Bejoy.K.S
Hi All,
We did a successful setup of hadoop-0.20.203.0 and hive-0.7.1.
In our next step we are eyeing HBase integration with Hive. As far as we
understand from articles available on internet and apache site, we can use
HBase instead of derby as a metastore of Hive, this gives us more
Rinku Garg
From: bejoy...@yahoo.com [mailto:bejoy...@yahoo.com]
Sent: 29 February 2012 11:08
To: user@hive.apache.org
Subject: Re: Hive | HBase Integration
Hi Rinku
Were you able to create a normal table within your hive without any issues? By
Normal table I mean the one that has data dir
Hi
I have a problem in create a Hive table using existing HBase table (using
External Table concept) with multiple columns from column family (not using as
Map)
Case-1 :
I have created a table in HBase and able to map to Hive as an external table
just using only one column from the column
http://dl.dropbox.com/u/19454506/HadoopHIveHbaseReady.tar.gz
Download this its pre connfigured hive and hbase. you need to change some
settings accordingly specific to your linux settings...
On Fri, Jan 27, 2012 at 11:07 AM, Madhusudhana Rao Podila
madhusudhana_pod...@infosys.com wrote:
donta...@gmail.com
To: user user@hive.apache.org
Sent: Saturday, December 17, 2011 11:32 PM
Subject: Hive-Hbase integration
Hello list,
I have a small demo table in Hbase and I want to operate it
through Hive.Here is my table in Hbase -
hbase(main):021:0 scan 'employee'
ROW
@hive.apache.org
Sent: Saturday, December 17, 2011 11:32 PM
Subject: Hive-Hbase integration
Hello list,
I have a small demo table in Hbase and I want to operate it
through Hive.Here is my table in Hbase -
hbase(main):021:0 scan 'employee'
ROW COLUMN
I think your hbase master is not running.
Open the hive shell and run command :
hbase status
On Fri, Dec 2, 2011 at 2:00 PM, Alok Kumar alok...@gmail.com wrote:
Hi,
Does Hive-Hbase integration require Hbase running in pseudo-distributed
mode?
I've build my Hadoop following this article
, Ankit Jain ankitjainc...@gmail.comwrote:
I think your hbase master is not running.
Open the hive shell and run command :
hbase status
On Fri, Dec 2, 2011 at 2:00 PM, Alok Kumar alok...@gmail.com wrote:
Hi,
Does Hive-Hbase integration require Hbase running in pseudo-distributed
mode
,
Does Hive-Hbase integration require Hbase running in
pseudo-distributed mode?
I've build my Hadoop following this article
http://www.michael-noll.com/blog/2011/04/14/building-an-hadoop-0-20-x-version-for-hbase-0-90-2/
and have already replaced Hbase jar files accordingly..
I'm getting
, Ankit Jain ankitjainc...@gmail.comwrote:
I think your hbase master is not running.
Open the hive shell and run command :
hbase status
On Fri, Dec 2, 2011 at 2:00 PM, Alok Kumar alok...@gmail.com wrote:
Hi,
Does Hive-Hbase integration require Hbase running in
pseudo-distributed mode
contain 0.89-SNAPSHOT.
FYI: There's an official Hive/HBase integration page at the Confluence
wiki, but that doesn't work either:
https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration
It contains the instruction:
The handler requires Hadoop 0.20 or higher, and has only been tested
of HBase other than 0.89, but there are three 0.89
versions of HBase at archive.apache.org and the lib directories for Hive
contain 0.89-SNAPSHOT.
FYI: There's an official Hive/HBase integration page at the Confluence
wiki, but that doesn't work either:
https://cwiki.apache.org/confluence
Hello list,
Could anyone tell me the basic (and must) requirements for
integrating Hive and Hbase??? I have followed the Hive HBase
Integration link on cwiki but I am not able to do it. Need some
urgent help.Many thanks in advance.
Regards,
Mohammad Tariq
Hi,
Please use 127.0.0.1 instead of ubuntu.ubuntu-domain .
or Open the Hbase shell and run command 'status'.
On Tue, Nov 29, 2011 at 1:34 PM, shashwat shriparv
dwivedishash...@gmail.com wrote:
I have followed
https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration my
hbase is
Hey Ankit, Thanks. my host file i tried using 127.0.0.1 still same problem,
can you please tell me what should be there in the host file now my host
file contains following entries:
192.168.2.125 shashwat.pointcrossblr ubuntu
127.0.0.1 localhost
#127.0.0.1localhost
#192.168.2.125
Please go through this blog ..
http://ankitasblogger.blogspot.com/2011/01/installing-hbase-in-cluster-complete.html
On Tue, Nov 29, 2011 at 2:11 PM, shashwat shriparv
dwivedishash...@gmail.com wrote:
Hey Ankit, Thanks. my host file i tried using 127.0.0.1 still same
problem, can you please
Hi Carl,
Thank you very much!
Cheers, Neerja
On Tue, Aug 2, 2011 at 11:31 PM, Carl Steinbach c...@cloudera.com wrote:
Hi Neerja,
Ordinarily a POM for the hive-hbase-handler would be available
from Cloudera's Maven repository, but it looks like we haven't
generated one. We will get this
Hi,
I am using
hive-hbase-handler-0.7.0-cdh3u0.jar (under hive-0.7.0-cdh3u0/lib)
thrift-fb303-0.5.0.jar (under hive-0.7.0-cdh3u0/lib)
thrift-0.2.0.jar (under hbase-0.90.1-cdh3u0/lib)
in my project.
We use Maven; could anyone please tell me where I can get the pom
information for these jars?
environment?
Thanks
Michael Sun
From: Sun, Michael
Sent: Friday, May 06, 2011 5:16 PM
To: 'user@hive.apache.org'
Subject: hive/hbase integration with rebuilt handler
Hi, can any of you help to solve the error in the attachment when I
tried to integrate Hive and HBase?
Environment
/hbase integration - Rebuild the Storage Handler
Hi,
I am using hbase 0.90 and Hive 0.7 and would like to try the hive/hbase
integration. From the Wiki Doc I could see that I have to rebuild the the
handler:
“If you are not using hbase-0.89.0, you will need to rebuild the handler
Hi,
I am trying to connect the hive shell running on my laptop to a remote
hadoop / hbase cluster and test out the HBase/Hive integration. I manage to
connect and create the table in hbase from remote Hive shell. I am also
passing the auxpath parameter to the shell (specifying the Hive/HBase
. I am also
passing the auxpath parameter to the shell (specifying the Hive/HBase
integration related jars). In addition I have copied over these files to
HDFS as well (I am using the user name hadoop - so the jars are stored in
HDFS under /user/hadoop).
However when I fire a query on the HBase
the hive shell running on my laptop to a remote
hadoop / hbase cluster and test out the HBase/Hive integration. I manage
to
connect and create the table in hbase from remote Hive shell. I am also
passing the auxpath parameter to the shell (specifying the Hive/HBase
integration related jars
the auxpath parameter to the shell (specifying the Hive/HBase
integration related jars). In addition I have copied over these files to
HDFS as well (I am using the user name hadoop - so the jars are stored
in
HDFS under /user/hadoop).
However when I fire a query on the HBase table - select
Sorry it that wasn't obvious, but you need to run hive using this command:
bin/hive -hiveconf hive.root.logger=INFO,console
AND in the same shell create the table in order to have more
information. What we're trying to get looks like this:
http://pastebin.com/gvTXDxtE
Specifically, this line is
John Sichi wrote:
On Jan 6, 2011, at 9:53 PM, Adarsh Sharma wrote:
I want to know why it occurs in hive.log
2011-01-05 15:19:36,783 ERROR DataNucleus.Plugin (Log4JLogger.java:error(115)) - Bundle
org.eclipse.jdt.core requires org.eclipse.core.resources but it cannot be
resolved.
While testing other things yesterday on my local machine, I
encountered the same stack traces. Like I said the other day, which
you seem to have discarded while debugging your issue, is that it's
not able to connect to Zookeeper.
Following the cue, I added these lines in
Just figured that running the shell with this command will give all
the info you need:
bin/hive -hiveconf hive.root.logger=INFO,console
J-D
On Fri, Jan 7, 2011 at 9:57 AM, Jean-Daniel Cryans jdcry...@apache.org wrote:
While testing other things yesterday on my local machine, I
encountered the
On Jan 6, 2011, at 2:34 AM, Adarsh Sharma wrote:
Dear all,
I am sorry I am posting this message again but I can't able to locate the
root cause after googled a lot.
I am trying Hive/Hbase Integration from the past 2 days. I am facing the
below issue while creating external table in Hive
am posting this message again but I can't able to locate the
root cause after googled a lot.
I am trying Hive/Hbase Integration from the past 2 days. I am facing the
below issue while creating external table in Hive.
I am using hadoop-0.20.2, hbase-0.20.6, hive-0.6.0 ( Mysql as metstore
Added 1 post at:
http://mevivs.wordpress.com/2010/11/24/hivehbase-integration/
Sharing it if is useful.
Vivek
-Original Message-
From: Vivek Mishra
Sent: Friday, November 19, 2010 10:36 AM
To: user@hive.apache.org
Subject: RE: Hive/HBase integration issue.
Hi,
Just found
Hi,
Does the INSERT clause have to include the OVERWRITE, which means that the
new data will overwrite the previous data? How to implement the indeed
INSERT operation, instead of OVERWRITE?
BTW: How to implement the DELETE operator? thanks
afancy
As noted here, when writing to HBase, existing rows are overwritten, but old
rows are not deleted.
http://wiki.apache.org/hadoop/Hive/HBaseIntegration#Overwrite
There is not yet any deletion support.
JVS
On Nov 18, 2010, at 1:00 AM, afancy wrote:
Hi,
Does the INSERT clause have to
74 matches
Mail list logo
