On 1/9/15, 11:53 AM, Alexander Pivovarov wrote:
I noticed that if amount of data which should be sent to reducers is small
then tez might throw NPE.
I noticed that you sent it to the tez lists as well. This is a hive
specific issue.
https://issues.apache.org/jira/browse/HIVE-8361
to be precise (from the following backtrace)
Caused by: java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.exec.PTFOperator$PTFInvocation.finishPartition(PTFOperator.java:341)
at
org.apache.hadoop.hive.ql.exec.PTFOperator.processOp(PTFOperator.java:115)
at
org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
at
org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(ExtractOperator.java:45)
at
org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.processKeyValues(ReduceRecordProcessor.java:325)
... 8 more
HTH.
Cheers,
Gopal
