Hi all,
I try inserting data into hive table storing by hbase storage handler but fail
with the following exception end of mapreduce stage info.
however, we didn't have problem accessing HbaseStorageHandler if force
accessing YARN rather than mapreduce. (hive: 0.9.0, hbase: 0.92.1).
could expert shed some light how we tweak the settings if would like to
initiate the mapper tasks to insert data leveraging HBaseStorageHandler. Thanks.
hereafter simple hive script tried before:
CREATE TABLE dest(num string, name string)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,cf1:name")
TBLPROPERTIES ("hbase.table.name" = "dest");
and the exception:
...
2013-03-28 03:49:41,107 Stage-0 map = 0%, reduce = 0%, Cumulative CPU 0.67 sec
2013-03-28 03:49:42,125 Stage-0 map = 0%, reduce = 0%, Cumulative CPU 0.67 sec
2013-03-28 03:49:43,143 Stage-0 map = 0%, reduce = 0%, Cumulative CPU 0.67 sec
2013-03-28 03:49:44,153 Stage-0 map = 0%, reduce = 0%
2013-03-28 03:49:47,184 Stage-0 map = 100%, reduce = 100%
MapReduce Total cumulative CPU time: 670 msec
Ended Job = job_201303251402_0005 with errors
Error during job, obtaining debugging information...
Examining task ID: task_201303251402_0005_m_000002 (and more) from job
job_201303251402_0005
Exception in thread "Thread-35" java.lang.NullPointerException
at
org.apache.hadoop.hive.shims.Hadoop23Shims.getTaskAttemptLogUrl(Hadoop23Shims.java:44)
at
org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:186)
at
org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:142)
at java.lang.Thread.run(Thread.java:662)
No encryption was performed by peer.
FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.MapRedTask
MapReduce Jobs Launched:
Job 0: Map: 1 Cumulative CPU: 0.67 sec HDFS Read: 0 HDFS Write: 0 FAIL
Cheers,
Jason
