Fengdong Yu created HIVE-7020: --------------------------------- Summary: NPE when there is no plan file. Key: HIVE-7020 URL: https://issues.apache.org/jira/browse/HIVE-7020 Project: Hive Issue Type: Bug Components: File Formats Affects Versions: 0.13.0 Reporter: Fengdong Yu
Hive throws NPE when there is no plan file. Exception message: {code} 2014-05-06 18:03:17,749 INFO [main] org.apache.hadoop.hive.ql.exec.Utilities: No plan file found: file:/tmp/test/hive_2014-05-06_18-02-58_539_232619201891510265-1/-mr-10001/8cf1c965-b173-4482-a016-4a51a74b9324/map.xml 2014-05-06 18:03:17,750 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.NullPointerException at org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:255) at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:437) at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:430) at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:587) at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:168) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:409) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) {code} I looked through the code, ql/exec/Utilities.java: {code} private static BaseWork getBaseWork(Configuration conf, String name) { ............ } catch (FileNotFoundException fnf) { // happens. e.g.: no reduce work. LOG.info("No plan file found: "+path); return null; } {code} this code was called by HiveInputFormat.java: {code} protected void init(JobConf job) { mrwork = Utilities.getMapWork(job); pathToPartitionInfo = mrwork.getPathToPartitionInfo(); } {code} mrwork is null, then NPE here. -- This message was sent by Atlassian JIRA (v6.2#6252)