Unfortunately the job's log also doesn't tell me anything very meaningful. Have
you or anyone might have seen this before?
java.lang.RuntimeException: Error in configuring object
at
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:387)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
Thanks.
Farah Omer
Sr. DB Engineer | MicroStrategy, Inc.
Tel 703.270.2230 | [email protected]
1850 Towers Crescent Plaza | Tysons Corner, VA 22182
www.microstrategy.com
From: [email protected] [mailto:[email protected]]
Sent: Tuesday, August 14, 2012 12:49 PM
To: [email protected]
Subject: Re: Issue with creating table in hbase
It seems like your Map reduce job is failing. Refer to the logs in the tracking
URL "http://hadoop001:50030/jobdetails.jsp?jobid=job_201207251201_0678"; to see
why exactly it is failing.
On Tue, Aug 14, 2012 at 11:35 AM, Omer, Farah
<[email protected]<mailto:[email protected]>> wrote:
Thanks. That helped.
Another related question:
I created this table on HIVE:
hive> CREATE TABLE hbase_mstr_1(key int, value string) STORED BY
'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES
("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES
("hbase.table.name<http://hbase.table.name>" = "hbase_mstr_1_xyz");
My intention is to load it and then access it via HIVE. But I am not able to
insert values into this table:
hive> insert overwrite table hbase_mstr_1 select * from eatwh1_ft1;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Starting Job = job_201207251201_0678, Tracking URL =
http://hadoop001:50030/jobdetails.jsp?jobid=job_201207251201_0678
Kill Command = /usr/lib/hadoop/bin/hadoop job
-Dmapred.job.tracker=hadoop001:6932 -kill job_201207251201_0678
2012-08-14 12:30:20,977 Stage-0 map = 0%, reduce = 0%
2012-08-14 12:30:47,110 Stage-0 map = 100%, reduce = 100%
Ended Job = job_201207251201_0678 with errors
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
The hive.log doesn't tell a lot of useful information.
2012-08-14 11:55:51,893 WARN hbase.HBaseConfiguration
(HBaseConfiguration.java:<init>(45)) - instantiating HBaseConfiguration() is
deprecated. Please use HBaseConfiguration#create() to construct a plain
Configuration
2012-08-14 11:55:52,302 WARN mapred.JobClient
(JobClient.java:copyAndConfigureFiles(649)) - Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
2012-08-14 11:56:21,132 ERROR exec.MapRedTask
(SessionState.java:printError(365)) - Ended Job = job_201207251201_0677 with
errors
2012-08-14 11:56:21,151 ERROR ql.Driver (SessionState.java:printError(365)) -
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
Any ideas?
Thank you.
Farah Omer
Sr. DB Engineer | MicroStrategy, Inc.
Tel 703.270.2230<tel:703.270.2230> |
[email protected]<http://[email protected]>
1850 Towers Crescent Plaza | Tysons Corner, VA 22182
www.microstrategy.com<http://www.microstrategy.com>
From: [email protected]<mailto:[email protected]>
[mailto:[email protected]<mailto:[email protected]>]
Sent: Tuesday, August 14, 2012 11:11 AM
To: [email protected]<mailto:[email protected]>
Subject: Re: Issue with creating table in hbase
> hbase(main):001:0> CREATE TABLE hbase_mstr_1.....
Are you running the CREATE TABLE from the hbase shell? You should run it from
the hive shell. You can start it from "$HIVE_HOME/bin/hive"
On Tue, Aug 14, 2012 at 10:05 AM, Omer, Farah
<[email protected]<mailto:[email protected]>> wrote:
Hi all,
I was testing hbase integrated with hive, and running into an issue. Would
anyone has an idea what it means?
hbase(main):001:0> CREATE TABLE hbase_mstr_1(key int, value string) STORED BY
'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES
("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES
("hbase.table.name<http://hbase.table.name>" = "xyz")
SyntaxError: (hbase):1: syntax error, unexpected tIDENTIFIER
CREATE TABLE hbase_mstr_1(key int, value string) STORED BY
'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES
("hbase.columns.mapping" = ":key,cf1:val") TBLPROPERTIES
("hbase.table.name<http://hbase.table.name>" = "xyz")
^
hbase(main):002:0>
Hive version is 0.7, hbase version is 0.90
Thanks.
Farah Omer
Sr. DB Engineer | MicroStrategy, Inc.
Tel 703.270.2230<tel:703.270.2230> |
[email protected]<http://[email protected]>
1850 Towers Crescent Plaza | Tysons Corner, VA 22182
www.microstrategy.com<http://www.microstrategy.com>
--
Swarnim
--
Swarnim
