I am struggling with a "no such file or directory exception " when running a simple query in hive. It is unfortunate that the actual path were not included with the stacktrace: the following is all that is provided.
I have a query that fails with the following error when done as hive -e "select * from <table>'". But it works properly when done within the hive shell. But at the same time, doing hive> select * from <table2>;" fails with the same error message. I am also seeing this error both for hdfs files and for s3 files. Without any path information it is very difficult and time consuming to track this down. Any pointers appreciated. Automatically selecting local only mode for query Total MapReduce jobs = 1 Launching Job 1 out of 1 Number of reduce tasks determined at compile time: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=<number> In order to limit the maximum number of reducers: set hive.exec.reducers.max=<number> In order to set a constant number of reducers: set mapred.reduce.tasks=<number> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files. Execution log at: /tmp/impala/impala_20130302095252_79ce9404-6af7-405b-8b06-849fe6c5328d.log ENOENT: No such file or directory at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:568) at org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:411) at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:501) at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:733) at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:692) at org.apache.hadoop.mapred.JobClient.access$400(JobClient.java:172) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:910) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:895) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:416) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:895) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:869) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:435) at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:677) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.hadoop.util.RunJar.main(RunJar.java:208) Job Submission failed with exception 'org.apache.hadoop.io.nativeio.NativeIOException(No such file or directory)' Execution failed with exit status: 1 Obtaining error information
