Hello,all:
【My environment versions are ：Hadoop 2.6.0 、hive 1.2.1、tez 0.7.0】
Now I executed a HQL “select count(*) from h_im;”(h_im is an external
table, hbase table) in hive CLI, it throw exceptions:
(I am sorry， I can not copy the error information here, because we use
inner network,so some information will be omitted)
INFO [Dispatcher thread: Central] history.HistoryEventHandler: .... .....
at
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor.run(TezProcessor.java:172)
at
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:137)
at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:337)
...... .......
Caused by: java.lang.RuntimeException:
org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
processing writable org.apache.hadoop.hive.hbase....
at
org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:92)
at
org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
at
org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:367)
at
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor.run(TezProcessor.java:149)
.... 14 more
Caused by : java.lang.NullPointerException
at
com.fiberhome.nebula.datacenter.hbasehandler.NBHBaseSerde.deserialize(NBHBaseSerde.java:210)
at
org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:145)
at
org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$2(MapOperator.java:143)
at
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:512)
..... 18 more
I found this
"org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor.run(TezProcessor.java:149)",
In my hive source code:
----------------------------------------------------------------------------------------------
line 147: MRTaskReporter mrReporter = new MRTaskReporter(getContext));
line 148: rpoc.init(mrReporter, input, outputs);
line 149: rpoc.run();
--------------------------------------------------------------------------------------------------
I added a LOG message before line 149:
"LOG.info("-----TezProcessor.run(), rpoc is " + rpoc.getClass());"
it wasn't printed in container log. why?(hive.compute.splits.in.am=true) I can
not understand，should I change yarn log configurations?
Any reply will be appreciated.
Thankyou & Best Regards.
---LLBian
