Yu, I am not able to reproduce this issue with hadoop 2.4.0 and tez 0.4 . I tried it with both file system cache enabled and disabled. What are the non default configurations you have on your machine ?
Thanks, Thejas On Wed, Jun 4, 2014 at 10:56 PM, Yu Azuryy <azur...@outlook.com> wrote: > Hive-0.13.0 works well in my test cluster. > > > > > > -1 > > Verified with hadoop-2.4.0 and tez-0.5-snapshot, > Hive cannot start? > > And I also built hive branch-0.13, the same error. > > [test@vm-10-154-** tmp]$ hive > 14/06/05 13:53:45 INFO Configuration.deprecation: mapred.input.dir.recursive > is deprecated. Instead, use > mapreduce.input.fileinputformat.input.dir.recursive > 14/06/05 13:53:45 INFO Configuration.deprecation: mapred.max.split.size is > deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize > 14/06/05 13:53:45 INFO Configuration.deprecation: mapred.min.split.size is > deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize > 14/06/05 13:53:45 INFO Configuration.deprecation: > mapred.min.split.size.per.node is deprecated. Instead, use > mapreduce.input.fileinputformat.split.minsize.per.node > 14/06/05 13:53:45 INFO Configuration.deprecation: > mapred.min.split.size.per.rack is deprecated. Instead, use > mapreduce.input.fileinputformat.split.minsize.per.rack > 14/06/05 13:53:45 INFO Configuration.deprecation: mapred.reduce.tasks is > deprecated. Instead, use mapreduce.job.reduces > 14/06/05 13:53:45 INFO Configuration.deprecation: > mapred.reduce.tasks.speculative.execution is deprecated. Instead, use > mapreduce.reduce.speculative > 14/06/05 13:53:45 INFO Configuration.deprecation: > mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use > mapreduce.job.committer.setup.cleanup.needed > 14/06/05 13:53:45 WARN conf.HiveConf: DEPRECATED: hive.metastore.ds.retry.* > no longer has any effect. Use hive.hmshandler.retry.* instead > Logging initialized using configuration in > jar:file:/letv/hive-0.13.0/lib/hive-common-0.13.1.jar!/hive-log4j.properties > Exception in thread "main" java.lang.RuntimeException: java.io.IOException: > Filesystem closed > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:357) > at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) > at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > Caused by: java.io.IOException: Filesystem closed > at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:727) > at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1780) > at > org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1066) > at > org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1062) > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > at > org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1062) > at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1398) > at org.apache.hadoop.fs.FileSystem.deleteOnExit(FileSystem.java:1353) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.createTezDir(TezSessionState.java:297) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:144) > at > org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:123) > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:355) > ... 7 more > >> Subject: Re: [VOTE] Apache Hive 0.13.1 Release Candidate 3 >> From: hbut...@hortonworks.com >> Date: Wed, 4 Jun 2014 22:42:32 -0700 >> To: dev@hive.apache.org >> >> +1 >> >> - Verified signature and checksum >> - Checked release notes >> - built source >> - ran a few unit tests >> - ran a few queries in local mode >> >> On Jun 2, 2014, at 7:20 PM, Thejas Nair <the...@hortonworks.com> wrote: >> >> > +1 >> > >> > - Verified signatures and checksum of both packages >> > - Checked release notes >> > - Build source package >> > - Ran simple hive queries on newly built package in local mode >> > - Ran simple queries on package on single node cluster with both tez >> > and mr as execution engines >> > - Ran unit tests >> > >> > >> > On Mon, Jun 2, 2014 at 1:02 PM, Sushanth Sowmyan <khorg...@apache.org> >> > wrote: >> >> Apache Hive 0.13.1 Release Candidate 3 is available here: >> >> >> >> http://people.apache.org/~khorgath/releases/0.13.1_RC3/artifacts/ >> >> >> >> Maven artifacts are available here: >> >> >> >> https://repository.apache.org/content/repositories/orgapachehive-1015 >> >> >> >> Source tag for RC3 is at: >> >> >> >> http://svn.apache.org/viewvc/hive/tags/release-0.13.1-rc3/ >> >> >> >> Voting will remain open for 72 hours. >> >> >> >> Hive PMC Members: Please test and vote. >> >> >> >> Thanks, >> >> -Sushanth >> > >> > -- >> > CONFIDENTIALITY NOTICE >> > NOTICE: This message is intended for the use of the individual or entity to >> > which it is addressed and may contain information that is confidential, >> > privileged and exempt from disclosure under applicable law. If the reader >> > of this message is not the intended recipient, you are hereby notified that >> > any printing, copying, dissemination, distribution, disclosure or >> > forwarding of this communication is strictly prohibited. If you have >> > received this communication in error, please contact the sender immediately >> > and delete it from your system. Thank You. >> >> >> -- >> CONFIDENTIALITY NOTICE >> NOTICE: This message is intended for the use of the individual or entity to >> which it is addressed and may contain information that is confidential, >> privileged and exempt from disclosure under applicable law. If the reader >> of this message is not the intended recipient, you are hereby notified that >> any printing, copying, dissemination, distribution, disclosure or >> forwarding of this communication is strictly prohibited. If you have >> received this communication in error, please contact the sender immediately >> and delete it from your system. Thank You. > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
